@lunora/cli 1.0.0-alpha.34 → 1.0.0-alpha.341

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (130) hide show
  1. package/LICENSE.md +33 -0
  2. package/README.md +1 -1
  3. package/dist/bin.mjs +2 -10
  4. package/dist/index.d.mts +1007 -372
  5. package/dist/index.d.ts +1007 -372
  6. package/dist/index.mjs +1 -19
  7. package/dist/packem_chunks/dispatch.mjs +1 -0
  8. package/dist/packem_chunks/handler.mjs +1 -160
  9. package/dist/packem_chunks/handler10.mjs +2 -16
  10. package/dist/packem_chunks/handler11.mjs +1 -22
  11. package/dist/packem_chunks/handler12.mjs +1 -192
  12. package/dist/packem_chunks/handler13.mjs +1 -131
  13. package/dist/packem_chunks/handler14.mjs +1 -65
  14. package/dist/packem_chunks/handler15.mjs +3 -58
  15. package/dist/packem_chunks/handler16.mjs +1 -80
  16. package/dist/packem_chunks/handler17.mjs +1 -43
  17. package/dist/packem_chunks/handler18.mjs +1 -105
  18. package/dist/packem_chunks/handler19.mjs +7 -170
  19. package/dist/packem_chunks/handler2.mjs +1 -114
  20. package/dist/packem_chunks/handler20.mjs +1 -94
  21. package/dist/packem_chunks/handler21.mjs +1 -94
  22. package/dist/packem_chunks/handler22.mjs +3 -0
  23. package/dist/packem_chunks/handler23.mjs +3 -0
  24. package/dist/packem_chunks/handler24.mjs +1 -0
  25. package/dist/packem_chunks/handler25.mjs +2 -0
  26. package/dist/packem_chunks/handler26.mjs +1 -0
  27. package/dist/packem_chunks/handler27.mjs +99 -0
  28. package/dist/packem_chunks/handler28.mjs +10 -0
  29. package/dist/packem_chunks/handler3.mjs +1 -204
  30. package/dist/packem_chunks/handler4.mjs +1 -33
  31. package/dist/packem_chunks/handler5.mjs +1 -49
  32. package/dist/packem_chunks/handler6.mjs +3 -91
  33. package/dist/packem_chunks/handler7.mjs +1 -42
  34. package/dist/packem_chunks/handler8.mjs +1 -174
  35. package/dist/packem_chunks/handler9.mjs +1 -315
  36. package/dist/packem_chunks/runCodegenCommand.mjs +4 -52
  37. package/dist/packem_chunks/runDeployCommand.mjs +7 -594
  38. package/dist/packem_chunks/runDevCommand.mjs +2 -0
  39. package/dist/packem_chunks/runInitCommand.mjs +164 -1432
  40. package/dist/packem_chunks/runResetCommand.mjs +1 -41
  41. package/dist/packem_chunks/runRpcCommand.mjs +1 -68
  42. package/dist/packem_shared/COMMANDS-DRMcVnnw.mjs +1 -0
  43. package/dist/packem_shared/DEFAULT_IMPORT_BATCH_SIZE-CyIsI3S1.mjs +1 -0
  44. package/dist/packem_shared/EXIT_CODE-D_XCixv8.mjs +1 -0
  45. package/dist/packem_shared/admin-token-VdUnvnKW.mjs +1 -0
  46. package/dist/packem_shared/admin-url-DJB8P6Jh.mjs +1 -0
  47. package/dist/packem_shared/binding-manifest-file-CQ1eQYy1.mjs +2 -0
  48. package/dist/packem_shared/buildRegistryIndex-Dc8D8AR6.mjs +1 -0
  49. package/dist/packem_shared/catalog-CahzmDLV.mjs +1 -0
  50. package/dist/packem_shared/cli-CG_JgNKu.mjs +2 -0
  51. package/dist/packem_shared/codegen-error-AmH54ofi.mjs +3 -0
  52. package/dist/packem_shared/command-CAXl2A1S.mjs +1 -0
  53. package/dist/packem_shared/commands-Cg06JNO2.mjs +13 -0
  54. package/dist/packem_shared/createLogger-Cl18I8AX.mjs +2 -0
  55. package/dist/packem_shared/createRecordingSpawner-CYhdPBD5.mjs +1 -0
  56. package/dist/packem_shared/deploy-target-DCWwiuAe.mjs +1 -0
  57. package/dist/packem_shared/diffSnapshots-WWwx-KvZ.mjs +5 -0
  58. package/dist/packem_shared/docker-DpVxvYpL.mjs +1 -0
  59. package/dist/packem_shared/health-probe-Bw9JFfIy.mjs +1 -0
  60. package/dist/packem_shared/import-BRM1hs7j.mjs +12 -0
  61. package/dist/packem_shared/index-oHZBGBwB.mjs +1 -0
  62. package/dist/packem_shared/insertSchemaExtension-DuiV6cba.mjs +8 -0
  63. package/dist/packem_shared/lint-ignore-report-DKZagpqk.mjs +2 -0
  64. package/dist/packem_shared/open-url-EnKy--w-.mjs +1 -0
  65. package/dist/packem_shared/output-format-B4eQHi5y.mjs +2 -0
  66. package/dist/packem_shared/parseManifest-CwPTKdtS.mjs +1 -0
  67. package/dist/packem_shared/path-containment-CgxYZggb.mjs +1 -0
  68. package/dist/packem_shared/plan-Cqn2uvTo.mjs +5 -0
  69. package/dist/packem_shared/planDevCommand-KxbFGmBZ.mjs +1 -0
  70. package/dist/packem_shared/platform-diagnostics-Cn2g6Jh-.mjs +4 -0
  71. package/dist/packem_shared/prompt-cancelled-BvsNxg_Q.mjs +1 -0
  72. package/dist/packem_shared/render-lunora-error-C3OJY5wk.mjs +2 -0
  73. package/dist/packem_shared/resolve-DUCSc7jQ.mjs +5 -0
  74. package/dist/packem_shared/resolve-target-C_ZloTvd.mjs +1 -0
  75. package/dist/packem_shared/runAddCommand-BsOrlyfD.mjs +1 -0
  76. package/dist/packem_shared/runExportCommand-slAq5BCF.mjs +5 -0
  77. package/dist/packem_shared/runMigrateGenerateCommand-Ii_WMZEA.mjs +11 -0
  78. package/dist/packem_shared/schemaIrToSnapshot-BjK-0IRo.mjs +1 -0
  79. package/dist/packem_shared/secret-key-DsMeUoEg.mjs +1 -0
  80. package/dist/packem_shared/shared-D-zCOmgY.mjs +1 -0
  81. package/dist/packem_shared/storage-ChJtQ9E4.mjs +1 -0
  82. package/dist/packem_shared/tui-prompts-B3YwUhGw.mjs +4 -0
  83. package/dist/packem_shared/variables-acxcvVQa.mjs +1 -0
  84. package/dist/packem_shared/wrangler-name-Dsk5K1f-.mjs +1 -0
  85. package/dist/packem_shared/wrangler-secrets-Bqi6kLuq.mjs +1 -0
  86. package/package.json +39 -19
  87. package/skills/README.md +35 -17
  88. package/skills/lunora/SKILL.md +123 -9
  89. package/skills/lunora-create-package/SKILL.md +4 -3
  90. package/skills/lunora-deploy/SKILL.md +42 -11
  91. package/skills/lunora-functions/SKILL.md +213 -15
  92. package/skills/lunora-migration-helper/SKILL.md +74 -21
  93. package/skills/lunora-performance-audit/SKILL.md +78 -9
  94. package/skills/lunora-quickstart/SKILL.md +95 -27
  95. package/skills/lunora-realtime/SKILL.md +73 -39
  96. package/skills/lunora-setup-auth/SKILL.md +33 -6
  97. package/skills/lunora-setup-hyperdrive/SKILL.md +33 -13
  98. package/skills/lunora-setup-hyperdrive-global/SKILL.md +5 -0
  99. package/skills/lunora-setup-mail/SKILL.md +34 -28
  100. package/skills/lunora-setup-scheduler/SKILL.md +18 -14
  101. package/skills/lunora-setup-storage/SKILL.md +187 -27
  102. package/dist/packem_chunks/planDevCommand.mjs +0 -541
  103. package/dist/packem_chunks/runMigrateGenerateCommand.mjs +0 -397
  104. package/dist/packem_shared/COMMANDS-B0ftFD_3.mjs +0 -948
  105. package/dist/packem_shared/DEFAULT_IMPORT_BATCH_SIZE-Ck-2bU08.mjs +0 -244
  106. package/dist/packem_shared/admin-url-4UzT-CI4.mjs +0 -19
  107. package/dist/packem_shared/api-spec-CtA6ilu4.mjs +0 -13
  108. package/dist/packem_shared/buildRegistryIndex-BcYe607_.mjs +0 -38
  109. package/dist/packem_shared/codegen-error-DJG-ghs_.mjs +0 -31
  110. package/dist/packem_shared/command-D3lB_4Az.mjs +0 -19
  111. package/dist/packem_shared/commands-B-gR09Z_.mjs +0 -845
  112. package/dist/packem_shared/createLogger-B40gPzQo.mjs +0 -78
  113. package/dist/packem_shared/createRecordingSpawner-DxI3mebw.mjs +0 -43
  114. package/dist/packem_shared/detect-package-manager-DYp7n3mJ.mjs +0 -61
  115. package/dist/packem_shared/diffSnapshots-BeDvvNiF.mjs +0 -161
  116. package/dist/packem_shared/docker-hMQ97KSQ.mjs +0 -21
  117. package/dist/packem_shared/insertSchemaExtension-DAqbfr9Z.mjs +0 -64
  118. package/dist/packem_shared/open-url-Dfq6fAyT.mjs +0 -41
  119. package/dist/packem_shared/output-format-wUvAN6AL.mjs +0 -17
  120. package/dist/packem_shared/parseArgs-YXFuKdEk.mjs +0 -56
  121. package/dist/packem_shared/parseManifest--vZf2FY1.mjs +0 -94
  122. package/dist/packem_shared/prompt-cancelled-APzX1Im-.mjs +0 -9
  123. package/dist/packem_shared/resolve-target-qbsJ_5sF.mjs +0 -16
  124. package/dist/packem_shared/runAddCommand-bnY6-HKb.mjs +0 -4
  125. package/dist/packem_shared/schema-drift-gate-BtBt0as0.mjs +0 -79
  126. package/dist/packem_shared/schemaIrToSnapshot-DdsljJT-.mjs +0 -43
  127. package/dist/packem_shared/storage-BIsph-Vk.mjs +0 -84
  128. package/dist/packem_shared/tui-prompts-BjEN8XgP.mjs +0 -658
  129. package/dist/packem_shared/wrangler-name-cy4yhm9j.mjs +0 -12
  130. package/dist/packem_shared/wrangler-secrets-P2_ZUR-k.mjs +0 -47
@@ -2,7 +2,8 @@
2
2
  name: lunora-migration-helper
3
3
  description: Plans Lunora schema and data migrations with widen-migrate-narrow. Use for
4
4
  breaking schema changes, backfills, table reshaping, online data migrations
5
- (`defineMigration` + `lunora migrate up`), the `.global()` D1 SQL flow, and the
5
+ (`defineMigration` + `lunora migrate up`), the `.global()` D1 / Hyperdrive
6
+ structural flows, and the
6
7
  pre-deploy schema-drift gate.
7
8
  ---
8
9
 
@@ -15,7 +16,7 @@ Safely change a Lunora schema and migrate data when making breaking changes.
15
16
  - Adding required fields to existing tables.
16
17
  - Changing field types or structure.
17
18
  - Splitting/merging tables, renaming/removing fields.
18
- - Reshaping `.global()` (D1-backed) tables.
19
+ - Reshaping `.global()` tables (D1- or Hyperdrive-backed).
19
20
 
20
21
  ## When Not to Use
21
22
 
@@ -23,21 +24,35 @@ Safely change a Lunora schema and migrate data when making breaking changes.
23
24
  - Adding **optional** fields that need no backfill.
24
25
  - Adding new tables or indexes with no correctness concern.
25
26
 
26
- ## Two Storage Layers — Know Which You Are Migrating
27
+ ## Storage Layers — Know Which You Are Migrating
27
28
 
28
- Lunora tables live in one of two backends, and they migrate differently:
29
+ Lunora tables live in one of three backends, and they migrate differently:
29
30
 
30
31
  - **ShardDO SQLite (default `root`, and `.shardBy(key)` tables).** State lives in
31
32
  the per-app / per-shard Durable Object. Data is reshaped with **online data
32
33
  migrations** — `defineMigration` declarations run by `lunora migrate up`,
33
34
  resumable per shard.
34
- - **`.global()` tables (D1).** Replicated to D1 for cross-region reads. Their
35
- structural DDL gets versioned **SQL migrations** via `lunora migrate generate`,
36
- applied by `@lunora/d1`'s runner at deploy time.
37
-
38
- A breaking change to a `.global()` table needs a generated SQL migration; a data
39
- backfill (either layer) is an online `defineMigration`. Both follow the same
40
- **widen → migrate → narrow** discipline.
35
+ - **`.global()` on D1 (the default global backend).** Replicated to D1 for
36
+ cross-region reads. Structural DDL gets versioned **SQL migrations** via
37
+ `lunora migrate generate`, applied by `@lunora/d1`'s runner at deploy time.
38
+ - **`.global({ backend: "hyperdrive" })` on Postgres/MySQL.** The same reactive
39
+ `.global()` contract served over Cloudflare Hyperdrive. Structural DDL works
40
+ differently here: tables **auto-provision on first use** — the runtime applies
41
+ the DDL through the dialect — so there is no `lunora migrate generate` step
42
+ and no versioned SQL file to commit. See `lunora-setup-hyperdrive-global`.
43
+
44
+ So: a breaking structural change to a **D1-backed** `.global()` table needs a
45
+ generated SQL migration; the Hyperdrive-backed equivalent provisions itself. A
46
+ data backfill (any layer) is always an online `defineMigration`. All three
47
+ follow the same **widen → migrate → narrow** discipline — check the table's
48
+ backend before assuming which structural path applies.
49
+
50
+ > **Moving an existing dataset between global backends.** To move a `.global()`
51
+ > dataset from D1 onto Hyperdrive, use
52
+ > `lunora migrate d1-to-hyperdrive --from-url <d1-worker> --to-url <hd-worker>`
53
+ > (`--tables` scopes it; `--out` keeps the intermediate NDJSON dump). This is a
54
+ > backend move, not a schema change — the widen → migrate → narrow discipline
55
+ > below still governs any reshaping you do on either side of it.
41
56
 
42
57
  ## Key Principle: Widen, Migrate, Narrow
43
58
 
@@ -115,6 +130,40 @@ export default defineMigration({
115
130
  The transform must preserve row identity — the runner always keeps the original
116
131
  `_id` / `_creationTime`, so do not change them.
117
132
 
133
+ ### Reading another table
134
+
135
+ The transform's second argument is a **shard-scoped reader** (`ctx.db` with
136
+ `get` / `findFirst` / `findMany` / `count`), so the common backfill — read the
137
+ parent, copy a field down onto its children — is expressible. It may be `async`.
138
+
139
+ ```ts
140
+ up: async (doc, ctx) => {
141
+ const thread = await ctx.db.get(String(doc.threadId), "threads");
142
+
143
+ return thread ? { ...doc, userId: thread.userId } : undefined;
144
+ },
145
+ ```
146
+
147
+ It is a reader, not a writer: the runner accounts for exactly one rewrite per
148
+ row read, and a transform writing directly would make that count describe
149
+ something other than what happened. To touch a second table, run a second
150
+ migration over that table.
151
+
152
+ ### A shard key cannot be backfilled by a migration
153
+
154
+ If the field you are backfilling **is** the table's `.shardBy()` key, this is the
155
+ wrong tool, and no amount of reader access fixes it:
156
+
157
+ - a row whose shard key is unset does not belong to any shard, so a shard-scoped
158
+ query will never enumerate it; and
159
+ - writing the key would have to **move the row to a different Durable Object**,
160
+ which a per-shard runner has no way to do.
161
+
162
+ Re-keying is an export → transform → import (`lunora export`, rewrite the NDJSON,
163
+ `lunora import` — ids are preserved, so foreign keys survive), not a migration.
164
+ So the rule elsewhere in this skill that a data backfill is always an online
165
+ `defineMigration` has this one exception.
166
+
118
167
  ### Run it
119
168
 
120
169
  ```bash
@@ -129,7 +178,10 @@ lunora migrate down backfill-display-name # revert (if `down` defined)
129
178
  Useful flags: `--batch-size <n>`, `--steps <n>` (cap batches this run), and
130
179
  `--prod --url <worker> --yes` to target production (with `LUNORA_ADMIN_TOKEN`).
131
180
 
132
- ## `.global()` (D1) Structural Migration Flow
181
+ ## `.global()` on D1 — Structural Migration Flow
182
+
183
+ This flow is **D1-specific**. Hyperdrive-backed globals auto-provision their DDL
184
+ at runtime and skip it entirely.
133
185
 
134
186
  ```bash
135
187
  # 1. Edit lunora/schema.ts (widen: add the optional new field to the .global() table).
@@ -146,8 +198,8 @@ lunora deploy
146
198
  ```
147
199
 
148
200
  `lunora migrate generate` only considers `.global()` tables (root/sharded tables
149
- are not D1-backed). Run it after each schema edit in the widen and narrow steps;
150
- backfill data with an online migration between them.
201
+ live in ShardDO SQLite, not D1). Run it after each schema edit in the widen and
202
+ narrow steps; backfill data with an online migration between them.
151
203
 
152
204
  ## The Schema-Drift Gate
153
205
 
@@ -176,9 +228,10 @@ add the migration — not to bypass it.
176
228
  transform before it touches real rows.
177
229
  5. **Deleting a field prematurely.** Deprecate with `v.optional` + a comment;
178
230
  delete only once nothing references it.
179
- 6. **Migrating the wrong layer.** A `.global()` structural change needs `lunora
180
- migrate generate` (SQL); a data backfill needs a `defineMigration`. Check the
181
- table's `.global()` / `.shardBy()` modifier first.
231
+ 6. **Migrating the wrong layer.** A D1-backed `.global()` structural change needs
232
+ `lunora migrate generate` (SQL); a Hyperdrive-backed one auto-provisions; a
233
+ data backfill needs a `defineMigration`. Check the table's `.global()` /
234
+ `.shardBy()` modifier — and, for `.global()`, its `backend` — first.
182
235
 
183
236
  ## Checklist
184
237
 
@@ -186,9 +239,9 @@ migrate generate` (SQL); a data backfill needs a `defineMigration`. Check the
186
239
  - [ ] Widened the schema to accept both shapes; `lunora codegen` clean.
187
240
  - [ ] Updated reads to handle both shapes; started writing the new shape.
188
241
  - [ ] Deployed the widened schema.
189
- - [ ] Authored a `defineMigration`; previewed with `lunora migrate up --dry-run`.
190
- - [ ] Ran `lunora migrate up`; `lunora migrate generate` + deploy for `.global()`
191
- structural changes.
192
- - [ ] Verified completion with `lunora migrate status`.
242
+ - [ ] Authored a `defineMigration`; previewed with `lunora migrate up <id> --dry-run`.
243
+ - [ ] Ran `lunora migrate up <id>`; `lunora migrate generate` + deploy for
244
+ `.global()` structural changes.
245
+ - [ ] Verified completion with `lunora migrate status <id>`.
193
246
  - [ ] Narrowed the schema (required / drop old field); removed both-shapes code.
194
247
  - [ ] Deployed the final schema; schema-drift gate passed.
@@ -2,8 +2,8 @@
2
2
  name: lunora-performance-audit
3
3
  description: Diagnoses and fixes Lunora performance problems — full-table scans, missing
4
4
  indexes, OCC write conflicts, oversized subscriptions, and sharding/`.global()`
5
- scaling. Use when queries are slow, mutations conflict, or `@lunora/advisor`
6
- flags a table.
5
+ scaling. Use when queries are slow, mutations conflict, `lunora insights`
6
+ reports a hot-spot, or `@lunora/advisor` flags a table.
7
7
  ---
8
8
 
9
9
  # Lunora Performance Audit
@@ -14,7 +14,7 @@ apply it across sibling functions consistently.
14
14
  ## When to Use
15
15
 
16
16
  - Queries feel slow or read far more rows than they return.
17
- - Mutations retry or conflict under load (OCC).
17
+ - Mutations conflict (409 `CONFLICT`) under load (OCC).
18
18
  - Subscriptions fan out updates too broadly or re-run too often.
19
19
  - The Lunora Studio **Advisors** tab or `@lunora/advisor` flags a table.
20
20
 
@@ -34,12 +34,35 @@ apply it across sibling functions consistently.
34
34
 
35
35
  ## Signal Gathering
36
36
 
37
- Start with the static advisors — they need no traffic:
37
+ ### Runtime signal: `lunora insights`
38
+
39
+ When the worker is running and has served traffic, start here — it reports the
40
+ measured problem, not a suspected one:
41
+
42
+ ```bash
43
+ lunora insights # against the local dev worker
44
+ lunora insights --shard channel:demo # scope to one shard
45
+ lunora insights --limit 25 --format json # machine-readable, more rows
46
+ lunora insights --prod --url https://app.example.com --token $LUNORA_ADMIN_TOKEN
47
+ ```
48
+
49
+ It ranks per-function **write-conflict hot-spots** (OCC contention — the
50
+ sharding signal), **error rates**, and **latency outliers**. A function at the
51
+ top of the write-conflict list is the direct input to the OCC section below; a
52
+ latency outlier usually resolves to the read-amplification section.
53
+
54
+ The Studio **Issues** panel and `lunora logs` cover the error side in more
55
+ detail once `insights` tells you where to look.
56
+
57
+ ### Static signal: the advisors
58
+
59
+ These need no traffic, so they also work on a cold codebase:
38
60
 
39
61
  - **Lunora Studio → Advisors tab** surfaces `@lunora/advisor` findings live in
40
62
  dev.
41
- - `@lunora/advisor` runs static lints over `defineSchema` + discovered query
42
- reads / insert writes. Relevant performance/schema rules:
63
+ - `@lunora/advisor` runs ~90 static lints over `defineSchema` + discovered query
64
+ reads / insert writes (plus a few runtime lints). The performance/schema rules
65
+ most relevant here:
43
66
  - `filter-without-index` — a query filters a table with no covering index.
44
67
  - `unindexed-foreign-key` — a relation/FK column has no index.
45
68
  - `duplicate-index` / `empty-index` — wasted or malformed indexes.
@@ -73,11 +96,49 @@ const mine = await ctx.db
73
96
  Index columns are ordered: put equality columns first, then the range/sort
74
97
  column. Fix every sibling query on the table the same way.
75
98
 
99
+ ## Problem Class: Relation Traversal Cost
100
+
101
+ **Symptom:** a query calling `ctx.db.related` is slow, or one page of it reads
102
+ far more rows than it returns.
103
+
104
+ A traversal is not one read. It is one batched `findMany` **per edge, per hop**,
105
+ and the frontier grows multiplicatively — which is why every option is bounded,
106
+ and why the bounds **refuse rather than clamp**:
107
+
108
+ | Option | Default | Cap | What the cap is protecting |
109
+ | ------------- | ------- | -------- | ---------------------------------------------------------------------------- |
110
+ | `depth` | `1` | `4` | Past 4 hops a real schema is bounded by request time, not by `limit`. |
111
+ | `limit` | `50` | `200` | Nodes returned in one page. |
112
+ | cursor offset | `0` | `10 000` | The offset is re-walk work, not a skip: each hop reads `N + limit + 1` rows. |
113
+
114
+ A caller asking for `depth: 9` gets a `BAD_REQUEST`, not a silent depth 4 — so a
115
+ traversal that throws is a mis-sized request, not a bug to route around.
116
+
117
+ **Fixes, in order of preference:**
118
+
119
+ 1. **Narrow with `edges`.** Name only the `"<table>.<column>"` edges the feature
120
+ needs. Following every declared foreign key is the usual reason a walk is
121
+ wide — one unrelated `v.id(...)` column can double the frontier per hop.
122
+ 2. **Narrow with `direction`.** `"in"` or `"out"` instead of the default
123
+ `"both"` halves the edges expanded at each hop.
124
+ 3. **Drop `depth` before raising `limit`.** Each hop multiplies; a page is
125
+ linear.
126
+ 4. **Index the foreign keys.** Every inward hop is a `WHERE fk IN (…)` read, so
127
+ an unindexed FK makes each hop a scan. `@lunora/advisor` flags it as
128
+ `unindexed-foreign-key`.
129
+ 5. **Stop deep-paging.** An offset past 10 000 is refused outright. That is the
130
+ signal the traversal is the wrong tool for the job — narrow the walk instead
131
+ of paging through it.
132
+
76
133
  ## Problem Class: Write Conflicts (OCC)
77
134
 
78
- **Symptom:** mutations on hot rows retry or fail under concurrency. ShardDO uses
79
- optimistic concurrency control — concurrent writes to the same DO that touch
80
- overlapping state conflict and retry.
135
+ **Symptom:** mutations on hot rows fail under concurrency, or the function tops
136
+ the write-conflict section of `lunora insights`. ShardDO uses optimistic
137
+ concurrency control — concurrent writes to the same DO that touch overlapping
138
+ state conflict. There is **no server-side retry loop**: the loser throws
139
+ `ConflictError` (code `CONFLICT`, HTTP 409) and the caller decides, so a client
140
+ that never handles it (`isConflictError` from `@lunora/client`) just surfaces
141
+ 409s to the user.
81
142
 
82
143
  **Fixes, in order of preference:**
83
144
 
@@ -115,6 +176,11 @@ cross-region reads (with read-your-writes via the Sessions API). Reserve it for
115
176
  read-mostly tables — `.global()` adds the D1 migration flow (see the
116
177
  `lunora-migration-helper` skill) and write-path cost.
117
178
 
179
+ If the dataset outgrows D1, `.global({ backend: "hyperdrive" })` serves the same
180
+ reactive `.global()` contract from Postgres/MySQL over Cloudflare Hyperdrive —
181
+ see the `lunora-setup-hyperdrive-global` skill (and `lunora migrate
182
+ d1-to-hyperdrive` to move an existing dataset).
183
+
118
184
  ### `.shardBy(key)` vs `.global()` — choose one per table
119
185
 
120
186
  - `.shardBy(key)`: partitions a table across Durable Objects by key — scales
@@ -135,8 +201,11 @@ read-mostly tables — `.global()` adds the D1 migration flow (see the
135
201
  ## Checklist
136
202
 
137
203
  - [ ] Scoped one concrete flow; traced every `ctx.db` read/write.
204
+ - [ ] Ran `lunora insights` (if the worker has traffic) for the measured signal.
138
205
  - [ ] Checked the Studio Advisors tab / `@lunora/advisor` findings.
139
206
  - [ ] Read amplification: replaced `.filter()` with an indexed `.withIndex()`.
207
+ - [ ] Relation traversals: narrowed with `edges` / `direction` before `depth`;
208
+ foreign keys indexed.
140
209
  - [ ] Write conflicts: narrowed writes and/or partitioned with `.shardBy(key)`.
141
210
  - [ ] Subscription cost: scoped query args so live queries depend on few rows.
142
211
  - [ ] Cross-region: applied `.global()` only to read-mostly tables.
@@ -31,9 +31,12 @@ Set up a working Lunora project as fast as possible.
31
31
  Lunora into the current project.
32
32
  4. Run `lunora codegen` to generate `lunora/_generated/` and typecheck the
33
33
  schema + functions. This is the agent's feedback loop.
34
- 5. Start the dev loop with `lunora dev` (ask the user to run it locally, or
35
- start it in the background for cloud/headless agents — it is long-running and
36
- does not exit).
34
+ 5. Start the dev loop. As an agent, run `lunora dev --background` — it starts
35
+ the server as a managed detached process, blocks until it accepts requests,
36
+ prints the URL + PID, and returns (under a detected AI agent, plain
37
+ `lunora dev` does this automatically, with JSON logs). Never leave a bare
38
+ `lunora dev` running in your own shell — it is long-running and does not
39
+ exit.
37
40
  6. Verify a query/mutation round-trip works end to end.
38
41
 
39
42
  ## Path 1: New Project (Recommended)
@@ -42,27 +45,71 @@ Set up a working Lunora project as fast as possible.
42
45
  plugin + `lunora/` already wired together).
43
46
 
44
47
  ```bash
45
- lunora init my-app --template vite
48
+ lunora init my-app --vite react
46
49
  cd my-app
47
50
  pnpm install
48
51
  ```
49
52
 
50
- ### Pick a template
53
+ ### Pick a stack: `--vite` (SPA) or `-t` (bespoke template)
54
+
55
+ There are **two scaffold paths**, and they take different flags:
56
+
57
+ **`--vite <framework>` — the create-vite overlay.** Fetches the official
58
+ create-vite base and applies the Lunora layer on top. Use it for a plain SPA:
59
+
60
+ | `--vite` value | Stack |
61
+ | -------------- | ----------------------------------------------- |
62
+ | `react` | React SPA (**the default**) |
63
+ | `vue` | Vue SPA |
64
+ | `solid` | Solid SPA |
65
+ | `svelte` | Svelte SPA |
66
+ | `vanilla` | No framework (overlay-only — not in the picker) |
67
+
68
+ **`-t` / `--template <type>` — a bespoke Lunora template.** Whole-project
69
+ templates fetched remotely (via `giget`) from
70
+ `gh:anolilab/lunora/templates/<type>`:
71
+
72
+ | `-t` value | Stack |
73
+ | ----------------------------- | ---------------------------------------------------------- |
74
+ | `next` | Next.js (App Router, OpenNext on Cloudflare) |
75
+ | `tanstack-start-react` | TanStack Start (React) — SSR with live-loader routes |
76
+ | `tanstack-start-solid` | TanStack Start (Solid) |
77
+ | `tanstack-start-react-rspack` | TanStack Start (React) on Rsbuild, single worker |
78
+ | `solid-v2` | Solid 2.0 SPA (`@solidjs/web`, `vite-plugin-solid` 3) |
79
+ | `rspack-react` | React SPA on Rsbuild (`@lunora/rspack`) |
80
+ | `react-router` | React Router v7 (framework mode), SSR in the Lunora worker |
81
+ | `astro` | Astro + a standalone Lunora worker |
82
+ | `analog` | AnalogJS (Angular) — single worker, Lunora in Nitro |
83
+ | `nuxt` | Nuxt (Vue) — single worker, Lunora in Nitro |
84
+ | `sveltekit` | SvelteKit + a standalone Lunora worker |
85
+ | `expo` | React Native (Expo) — iOS/Android/web + a Lunora worker |
86
+ | `standalone` | Worker-only Lunora backend, no frontend |
87
+
88
+ > There is **no `--template vite`.** SPAs go through `--vite <framework>`; `-t`
89
+ > is only for the bespoke templates above. The one exception is `solid-v2`:
90
+ > create-vite's Solid base is still 1.x, and Solid 2.0 needs its own renderer
91
+ > package, `jsxImportSource`, and Vite plugin major — so it ships as a template
92
+ > rather than an overlay. `--vite solid` stays on Solid 1.x.
93
+
94
+ With neither flag, an interactive run shows the framework picker (defaulting to
95
+ the React overlay) and a **non-interactive run errors out** — so as an agent,
96
+ always pass `--vite` or `-t` explicitly. If the user stated no preference,
97
+ use `--vite react`.
98
+
99
+ ### Useful `init` flags
51
100
 
52
- | Template | Stack |
53
- | ---------------------- | ---------------------------------------------- |
54
- | `vite` | React + Vite (the simplest full-stack starter) |
55
- | `standalone` | Worker-only Lunora backend, no frontend |
56
- | `astro` | Astro integration |
57
- | `nuxt` | Nuxt (Vue) |
58
- | `sveltekit` | SvelteKit |
59
- | `tanstack-start-react` | TanStack Start (React) |
60
- | `tanstack-start-solid` | TanStack Start (Solid) |
101
+ ```bash
102
+ lunora init my-app --vite react --ci github # + a GitHub Actions deploy pipeline (or --ci gitlab)
103
+ lunora init my-app -t next --add auth,email # scaffold capabilities non-interactively
104
+ lunora init my-app --vite react --yes # skip the interactive auth/email offer
105
+ lunora init my-app --vite react --dry-run # walk every step, write nothing
106
+ ```
61
107
 
62
- If the user has not specified a preference, default to `vite`. Pass `--template`
63
- explicitly to avoid the interactive prompt. Templates are fetched remotely (via
64
- `giget`) from `gh:anolilab/lunora/templates/<type>`; pass `--from <dir>` to use a
65
- local template directory offline.
108
+ `--add` accepts a comma-separated list of `ai | auth | backup | browser |
109
+ cloudflare-access | crons | email | flags | hyperdrive | payment | presence |
110
+ queue | storage | workflow`. `--ref <branch|tag|commit>` pins the template
111
+ source (e.g. `--ref alpha`); `--from <dir>` copies from a local templates root
112
+ offline (expects `<type>/` subdirs).
66
113
 
67
114
  ### Generate types and push the first run
68
115
 
@@ -87,7 +134,23 @@ not exit, so:
87
134
 
88
135
  - **Local development (user at the keyboard):** ask the user to run `lunora dev`
89
136
  in a terminal.
90
- - **Cloud or headless agents:** start `lunora dev` in the background.
137
+ - **Agents:** run `lunora dev --background`. It detaches the server, waits until
138
+ it answers HTTP, prints `Dev server running at <url> (pid <n>)`, and exits —
139
+ no orphaned shell, no PID bookkeeping. When Lunora detects an AI agent
140
+ (Claude Code, Cursor, Codex, …), plain `lunora dev` flips into this mode
141
+ automatically with JSON logs; `LUNORA_AGENT_MODE=0` opts out.
142
+
143
+ Manage the running server afterwards:
144
+
145
+ ```bash
146
+ lunora dev status --json # machine-readable: url, pid, uptime, logFile
147
+ lunora dev logs --lines 50 # tail the captured output (.lunora/dev.log)
148
+ lunora dev stop # idempotent — succeeds even if nothing runs
149
+ ```
150
+
151
+ A second `lunora dev` never double-starts: it reports the existing instance
152
+ (`.lunora/dev.json` is the lockfile). Probe readiness or liveness at
153
+ `GET /_lunora/status` (`{"ok":true}`).
91
154
 
92
155
  Vite serves on `http://localhost:5173` by default; the Worker is served on the
93
156
  same origin via `@cloudflare/vite-plugin`.
@@ -132,9 +195,12 @@ createRoot(document.querySelector("#root")!).render(
132
195
  );
133
196
  ```
134
197
 
135
- Vue, Solid, and Svelte have matching providers in `@lunora/vue`, `@lunora/solid`,
136
- and `@lunora/svelte`. `VITE_LUNORA_URL` is optional — it defaults to
137
- `location.origin`, which is correct for the single-origin dev setup.
198
+ Every client adapter has a matching provider: `@lunora/vue`, `@lunora/solid`,
199
+ `@lunora/svelte`, `@lunora/angular` (`provideLunora` / `injectLunoraClient`),
200
+ and `@lunora/react-native` (`createLunoraClient`, re-exporting `@lunora/react`).
201
+ For meta-frameworks, `@lunora/astro` and `@lunora/nuxt` mount Lunora on the
202
+ server side. `VITE_LUNORA_URL` is optional — it defaults to `location.origin`,
203
+ which is correct for the single-origin dev setup.
138
204
 
139
205
  ## Writing Your First Function
140
206
 
@@ -143,7 +209,7 @@ Create a schema and a query/mutation to verify the full loop.
143
209
  `lunora/schema.ts`:
144
210
 
145
211
  ```ts
146
- import { defineSchema, defineTable, v } from "@lunora/server";
212
+ import { defineSchema, defineTable, v } from "lunorash/server";
147
213
 
148
214
  export default defineSchema({
149
215
  todos: defineTable({
@@ -157,8 +223,8 @@ export default defineSchema({
157
223
  `lunora/todos.ts`:
158
224
 
159
225
  ```ts
160
- import type { Id } from "@lunora/server";
161
- import { mutation, query, v } from "@lunora/server";
226
+ import type { Id } from "#lunora/_generated/server.js";
227
+ import { mutation, query, v } from "#lunora/_generated/server.js";
162
228
 
163
229
  export const list = query.query(async ({ ctx }) => ctx.db.query("todos").withIndex("by_creation").collect());
164
230
 
@@ -233,8 +299,10 @@ ids, `.dev.vars` secrets, and container exports.
233
299
  ## Checklist
234
300
 
235
301
  - [ ] Determined starting point: new project or existing app.
236
- - [ ] New project: scaffolded with `lunora init --template <t>`.
302
+ - [ ] New project: scaffolded with `lunora init --vite <framework>` (SPA) or
303
+ `lunora init -t <template>` (bespoke) — never `--template vite`.
237
304
  - [ ] Existing app: ran `lunora init --here` and wired `LunoraProvider`.
238
305
  - [ ] Ran `lunora codegen`: `lunora/_generated/` exists and typecheck is clean.
239
- - [ ] `lunora dev` is running — user terminal, or background for cloud agents.
306
+ - [ ] Dev server is running — user terminal, or `lunora dev --background`
307
+ (check with `lunora dev status`).
240
308
  - [ ] Verified a query/mutation round-trip re-renders the client live.
@@ -2,8 +2,8 @@
2
2
  name: lunora-realtime
3
3
  description: Wires Lunora's live data into a client. Use for `LunoraClient`/`LunoraProvider`,
4
4
  reactive `useQuery`/`useSubscription`, `useMutation` with optimistic updates,
5
- pagination, connection status, the React/Vue/Solid/Svelte adapters, and the
6
- `@lunora/db` TanStack binding.
5
+ pagination, connection status, the React/Vue/Solid/Svelte/Angular/React Native
6
+ adapters, and the `@lunora/db` TanStack binding.
7
7
  ---
8
8
 
9
9
  # Lunora Realtime
@@ -15,7 +15,8 @@ automatic rollback.
15
15
 
16
16
  ## When to Use
17
17
 
18
- - Wiring a frontend to a Lunora backend (React, Vue, Solid, Svelte).
18
+ - Wiring a frontend to a Lunora backend (React, Vue, Solid, Svelte, Angular,
19
+ React Native/Expo, or an Astro/Nuxt meta-framework).
19
20
  - Adding optimistic updates, pagination, or presence to the UI.
20
21
  - Choosing between live hooks and the `@lunora/db` collection layer.
21
22
 
@@ -42,6 +43,19 @@ const client = new LunoraClient({ url });
42
43
  Vue / Solid / Svelte have matching providers in `@lunora/vue`, `@lunora/solid`,
43
44
  `@lunora/svelte`; the hook names and semantics below mirror across them.
44
45
 
46
+ Two adapters differ in shape:
47
+
48
+ - **`@lunora/angular`** is signal-based rather than hook-based: register with
49
+ `provideLunora(...)`, read the client via `injectLunoraClient()`, and use
50
+ `liveQuery(...)` / `mutate(...)` / `connectionStatus(...)` in place of the
51
+ hooks below.
52
+ - **`@lunora/react-native`** re-exports all of `@lunora/react` and adds
53
+ `createLunoraClient` (plus `@lunora/react-native/auth` for the better-auth
54
+ Expo bridge) — build the client with that instead of `new LunoraClient`.
55
+
56
+ For SSR meta-frameworks, `@lunora/astro` and `@lunora/nuxt` compose Lunora into
57
+ the server (Nitro for Nuxt) and ship reactive-loader server helpers.
58
+
45
59
  ## Live Queries
46
60
 
47
61
  `useQuery(reference, args)` opens a subscription and returns the value, or
@@ -67,39 +81,38 @@ const todos = useQuery(api.todos.list, {}) as Doc<"todos">[] | undefined;
67
81
 
68
82
  ## Authorization & Live Queries
69
83
 
70
- Subscriptions re-run the query handler **server-side under anonymous
71
- identity**. The one-shot `fetch` RPC behind the initial load carries the
72
- caller's identity, but the live WebSocket channel (the subscription seed and
73
- every write-driven refresh) does not — it evaluates as anonymous.
74
-
75
- This matters for any query that authorizes or filters on the authenticated
76
- user:
77
-
78
- - A query guarded by `.use(rls(...))` or one that reads `ctx.auth.userId`
79
- directly returns the user's rows on the **initial** HTTP fetch, but its
80
- **live** updates evaluate anonymously and may resolve to an empty/denied
81
- set.
82
- - This **fails closed** — the live channel shows _less_ data, never another
83
- user's data, so there is no leak. But it is a correctness caveat: the
84
- initial render and the live updates can disagree.
85
-
86
- The supported pattern today is to scope per-user data **outside** of
87
- `ctx.auth` inside a subscribed query:
88
-
89
- - Partition the data by shard with `.shardBy(userId)` (or tenant/room), so the
90
- subscription is already scoped to the right state, or
91
- - Pass the identifier as an **explicit query arg**
92
- (`useQuery(api.todos.list, { userId })`) and filter on the arg rather than on
93
- `ctx.auth`.
94
-
95
- Reserve `rls()` / `ctx.auth`-based filtering for non-subscribed reads (one-shot
96
- actions/queries) where identity is always present.
84
+ **Live queries are identity-aware.** At the WebSocket upgrade the runtime
85
+ stamps the caller's verified identity onto the socket (from the server-minted
86
+ `x-lunora-userid` / `x-lunora-identity` headers, which a client cannot forge).
87
+ Every subscription re-run, shape resolution, and poke-driven refresh executes
88
+ under that socket's own identity, passed by value so a concurrent RPC can't
89
+ clobber it.
90
+
91
+ Practically, this means:
92
+
93
+ - `.use(rls(...))` and `ctx.auth.userId` work the same in a subscribed query as
94
+ in a one-shot read. Shape subscriptions AND-merge the shape predicate with
95
+ the table's RLS read base-where, so the membership query the poke protocol
96
+ runs is RLS-correct by construction — never the client's word for it.
97
+ - An **anonymous** socket carries no identity, so an RLS/`ctx.auth` query fails
98
+ closed (empty/denied) rather than leaking another user's rows.
99
+ - **Token expiry is enforced on the socket.** When the resolved credential
100
+ carries an expiry, the DO sends a `TOKEN_EXPIRED` error frame and closes with
101
+ code `4001` at the next send at or after that instant. `LunoraClient`
102
+ reconnects automatically and re-resolves a fresh identity — but surface it in
103
+ the UI if a re-login is required.
104
+
105
+ You can still scope data structurally when it fits the domain — `.shardBy(userId)`
106
+ (or tenant/room) partitions state so a subscription is narrow by construction,
107
+ and explicit query args keep subscriptions cheap (see the args-scoping note
108
+ above). Prefer those for _performance_; use `rls()` / `ctx.auth` for
109
+ _authorization_. They compose.
97
110
 
98
111
  ## Mutations + Optimistic Updates
99
112
 
100
- `useMutation(reference)` returns `{ mutate, pending }`. Pass an `optimistic`
101
- callback to paint the next state immediately; if the server rejects the call the
102
- runtime rolls the cache back automatically.
113
+ `useMutation(reference)` returns `{ mutate, pending }`. Pass an
114
+ `optimisticUpdate` callback to paint the next state immediately; if the server
115
+ rejects the call the runtime rolls the cache back automatically.
103
116
 
104
117
  ```tsx
105
118
  import { useMutation } from "@lunora/react";
@@ -111,8 +124,8 @@ const { mutate: add, pending } = useMutation(api.todos.add);
111
124
  await add(
112
125
  { text },
113
126
  {
114
- optimistic: (current) => {
115
- const list = (current as Doc<"todos">[] | undefined) ?? [];
127
+ optimisticUpdate: (store) => {
128
+ const list = store.getQuery(api.todos.list, {}) ?? [];
116
129
  const provisional: Doc<"todos"> = {
117
130
  _id: `optimistic_${Date.now()}` as Id<"todos">,
118
131
  _creationTime: Date.now(),
@@ -120,15 +133,21 @@ await add(
120
133
  done: false,
121
134
  createdAt: Date.now(),
122
135
  };
123
- return [provisional, ...list];
136
+ store.setQuery(api.todos.list, {}, [provisional, ...list]);
124
137
  },
125
138
  },
126
139
  );
127
140
  ```
128
141
 
129
- - The `optimistic` callback receives the current cached value and returns the
130
- provisional one. When the server delta arrives it replaces the optimistic
131
- entry; on failure the cache reverts.
142
+ - `optimisticUpdate` names the query it patches, because `todos.add` and
143
+ `todos.list` are different functions and nothing can infer the link. When the
144
+ server delta arrives it replaces the optimistic entry; on failure the cache
145
+ reverts. `store.getAllQueries(fn)` patches every subscribed variant of a query
146
+ at once.
147
+ - The per-call `optimistic: (current) => next` shortcut exists too, but it only
148
+ patches a subscription registered under the **mutation's own** reference and
149
+ args — a counter or a document by id. It is a silent no-op for the
150
+ `add`-updates-`list` shape above.
132
151
  - `pending` is `true` while the call is in flight — disable the submit button
133
152
  with it.
134
153
  - **Offline queue:** mutations made while disconnected are queued by
@@ -154,6 +173,13 @@ schema + functions into live TanStack DB collections). Reach for it when the app
154
173
  needs client-side indexes/joins or a persistent optimistic outbox; raw `useQuery`
155
174
  /`useMutation` are enough for straightforward live lists.
156
175
 
176
+ Call `defineCollections` **once** at module scope and treat the returned
177
+ collections as the single source of truth for each table. Don't mirror rows into
178
+ a parallel store, and never build derived indexes (trees, search, undo captures)
179
+ from a copy — optimistic writes and sync deltas land only on the Lunora
180
+ collection, so code reading a copy silently reads stale rows while `useLiveQuery`
181
+ renders fresh data.
182
+
157
183
  ## Common Pitfalls
158
184
 
159
185
  1. **Creating `LunoraClient` inside a component.** It re-opens the socket every
@@ -165,6 +191,12 @@ needs client-side indexes/joins or a persistent optimistic outbox; raw `useQuery
165
191
  4. **Optimistic shape drift.** The provisional value must match the query's
166
192
  element shape (including `_id`/`_creationTime`) or the UI flickers when the
167
193
  real delta lands.
194
+ 5. **Two sources of truth for the same rows.** `defineCollections` more than once
195
+ per table (or a parallel store of your own) mints copies that drift. Reads
196
+ through `useLiveQuery` look fine, but derived indexes built from the copy can
197
+ **miss rows** — rows written to the collection after the copy was taken never
198
+ appear in the index — or **hold stale rows** — rows updated or deleted in the
199
+ collection still show their old value. One instance, one collection per table.
168
200
 
169
201
  ## Checklist
170
202
 
@@ -175,3 +207,5 @@ needs client-side indexes/joins or a persistent optimistic outbox; raw `useQuery
175
207
  - [ ] Query `args` scoped narrowly to avoid over-broad re-renders.
176
208
  - [ ] Pagination via `usePaginatedQuery`/`useInfiniteQuery` over `.paginate`.
177
209
  - [ ] Considered `@lunora/db` if the app needs local indexes/joins or an outbox.
210
+ - [ ] `@lunora/db`: one `defineCollections` instance; no parallel copy of rows;
211
+ derived indexes built from the same collection the UI renders.