textus 0.42.0 → 0.43.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG.md +18 -0
- data/README.md +2 -2
- data/SPEC.md +17 -23
- data/docs/reference/conventions.md +3 -2
- data/lib/textus/doctor/check/illegal_keys.rb +2 -20
- data/lib/textus/manifest/entry/base.rb +0 -1
- data/lib/textus/manifest/entry/nested.rb +3 -5
- data/lib/textus/manifest/entry/parser.rb +4 -1
- data/lib/textus/manifest/entry/publish/mode.rb +6 -0
- data/lib/textus/manifest/entry/publish/to_paths.rb +2 -2
- data/lib/textus/manifest/entry/publish/tree.rb +5 -9
- data/lib/textus/manifest/entry/publish.rb +16 -14
- data/lib/textus/manifest/entry/validators/publish.rb +4 -2
- data/lib/textus/manifest/entry/validators.rb +0 -1
- data/lib/textus/manifest/resolver.rb +9 -25
- data/lib/textus/manifest/schema.rb +50 -10
- data/lib/textus/version.rb +1 -1
- metadata +1 -2
- data/lib/textus/manifest/entry/validators/index_filename.rb +0 -47
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 8c2c92f27b720b90f0dfa268174cf9d9ea775b37f92bb38ed90cd9719d7b2626
|
|
4
|
+
data.tar.gz: f5018ecfd8d72666d48236d42395e44819766659088bc98b1c69ad4fccf2fce8
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 758b3a9da98edb000100e9b6d1665829d94333f53e38f3a68104d33a4aefd831947e235ecb3048e16b388e0256239dfe6f66708d1253b7bfcbb56360a74350bc
|
|
7
|
+
data.tar.gz: d72be31709261f1aff37f00a9b213e03d8121758f61e781bfdd1626eb16122d994d64491f4c37be4c851031e8bd122d9df8d8abd682228e2693162d3861c865d
|
data/CHANGELOG.md
CHANGED
|
@@ -9,6 +9,24 @@ The **gem version** (`0.x.y`) is distinct from the **protocol version**
|
|
|
9
9
|
bump is a breaking change that requires a store migration; the gem version
|
|
10
10
|
tracks both additive improvements and breaking protocol bumps independently.
|
|
11
11
|
|
|
12
|
+
## 0.43.0 — 2026-06-02 — Typed `publish:` block + remove `index_filename` ([ADR 0052](docs/architecture/decisions/0052-typed-publish-block.md), [0053](docs/architecture/decisions/0053-remove-index-filename.md))
|
|
13
|
+
|
|
14
|
+
No `textus/3` wire-format change. Two breaking (pre-1.0) changes on the publish/enumeration surface: the two top-level publish keys become one typed `publish:` block, and the unused `index_filename:` enumeration feature is removed. Both fail at load with a migration-pointing message.
|
|
15
|
+
|
|
16
|
+
### Changed
|
|
17
|
+
|
|
18
|
+
- **BREAKING (pre-1.0): `publish_to:`/`publish_tree:` folded into one typed `publish:` block ([ADR 0052](docs/architecture/decisions/0052-typed-publish-block.md)).** Publishing is now configured by `publish: { to: [...] }` (file fan-out) **xor** `publish: { tree: "dir" }` (subtree mirror), mirroring the ADR 0049 internal sum type at the manifest layer and giving a future third mode a namespace instead of a third top-level key. Surface-only — the `Publish::*` modes, `:file_published` event, and build envelope are unchanged. A manifest using the flat `publish_to:`/`publish_tree:` keys **fails at load** with the replacement (`use publish: { to: [...] }` / `{ tree: "..." }`). This is grouping/extensibility, not a new invariant: a block with both `to:` and `tree:` is still caught by the one exclusivity guard in `Publish.resolve`.
|
|
19
|
+
|
|
20
|
+
### Removed
|
|
21
|
+
|
|
22
|
+
- **BREAKING (pre-1.0): the `index_filename:` enumeration feature is removed ([ADR 0053](docs/architecture/decisions/0053-remove-index-filename.md)).** `index_filename:` let a nested entry enumerate *directories* as addressable keys via a fixed index file (e.g. `SKILL.md`). It had zero real usage, its only motivating consumer (`EachDir` per-leaf publish) was removed in 0.42.0, and it could not compose with `publish_tree` (mutually exclusive). A nested entry now always enumerates each file under its tree as a key (key segments derived from the path, extension stripped). A manifest declaring `index_filename:` **fails at load** with a migration message; to mirror a directory of files to a consumer path without enumerating them as keys, use `publish: { tree: "..." }`. Native skill authoring (ADR 0050) is unaffected — it rides `publish_tree`, which never enumerated an index. The shallowest-index-wins claiming logic (ADR 0046 D5) and the `index_filename ⊥ publish_tree` guard go with it.
|
|
23
|
+
|
|
24
|
+
No `textus/3` wire-format change — repo-local publish behaviour only.
|
|
25
|
+
|
|
26
|
+
### Fixed
|
|
27
|
+
|
|
28
|
+
- **`publish_tree` files are now opaque in *every* path, not just the Publisher ([ADR 0047](docs/architecture/decisions/0047-publish-tree-keyless-subtree-mirror.md)).** A keyless subtree mirror carrying non-key-legal filenames (uppercase `SKILL.md`, `README`) tripped `doctor`'s `key.illegal` and red-gated commits, even though publish itself mirrored the files correctly — `doctor`'s `IllegalKeys` and `Resolver#enumerate_nested` still key-walked them, contradicting ADR 0047's "no keys" contract. The resolved publish mode now answers `Publish::Mode#keyless?` (true only for `Tree`); both paths consult it and skip enumerating a keyless mirror's files. A `publish_tree` subtree with uppercase filenames stays `doctor`-green and still mirrors; a non-publish nested entry still flags illegal segments as before.
|
|
29
|
+
|
|
12
30
|
## 0.42.0 — 2026-06-02 — Remove `publish_each`: collapse publish to two modes ([ADR 0051](docs/architecture/decisions/0051-remove-publish-each.md))
|
|
13
31
|
|
|
14
32
|
No `textus/3` wire-format change. **Breaking (pre-1.0):** the `publish_each:` manifest key is removed; a manifest declaring it now fails at load. The publish surface collapses to two modes — `publish_to:` (fixed paths) and `publish_tree:` (whole-subtree mirror) — plus `None`.
|
data/README.md
CHANGED
|
@@ -182,7 +182,7 @@ For a worked store — knowledge entries, a staged proposal, schemas, a template
|
|
|
182
182
|
|
|
183
183
|
## What's shipped
|
|
184
184
|
|
|
185
|
-
- **Per-entry formats & publish.** `format: markdown|json|yaml|text` per entry; `
|
|
185
|
+
- **Per-entry formats & publish.** `format: markdown|json|yaml|text` per entry; a typed `publish:` block (`to:` for file fan-out, `tree:` for a whole-subtree mirror) byte-copies derived files to their consumer paths. ([SPEC §5.2–5.3](SPEC.md))
|
|
186
186
|
- **Stable identity.** Auto-minted `uid:` survives writes and `textus key mv`; reorganising never breaks references.
|
|
187
187
|
- **Capability × zone-kind gate.** Writes carry `--as=<role>`; a role may write a zone iff it holds the capability the zone's `kind:` requires (`canon`→`author`, `workspace`→`keep`, `quarantine`→`fetch`, `queue`→`propose`, `derived`→`build`). The wrong role gets `write_forbidden` naming the capability needed and the roles that hold it. ([SPEC §5](SPEC.md))
|
|
188
188
|
- **Agent loop.** `textus boot` orients a fresh session; `textus pulse --since=N` is the per-turn heartbeat (changed entries, stale keys, pending proposals). ([docs/how-to/agents-mcp.md](docs/how-to/agents-mcp.md))
|
|
@@ -203,7 +203,7 @@ Derived entries declare `compute: { kind: projection, select: ..., pluck: ..., s
|
|
|
203
203
|
|
|
204
204
|
For externally-generated entries, declare `compute: { kind: external, sources: [...] }` — textus tracks the declared sources for staleness; the build automation produces the file.
|
|
205
205
|
|
|
206
|
-
`
|
|
206
|
+
Publishing is one typed `publish:` block (ADR 0052). `publish: { to: [path, ...] }` byte-copies a single derived file to one or more targets. `publish: { tree: "dir" }` on a nested entry mirrors its whole stored subtree to one target directory, preserving layout (path-driven — no keys or template variables). Sentinels for every published file live under `.textus/sentinels/`. See SPEC §5.2, §5.3, §5.12.
|
|
207
207
|
|
|
208
208
|
## Extension points
|
|
209
209
|
|
data/SPEC.md
CHANGED
|
@@ -24,7 +24,7 @@
|
|
|
24
24
|
- [5.2 Compute layer (derived entries)](#52-compute-layer-derived-entries)
|
|
25
25
|
- [5.2.1 Projection compute](#521-projection-compute-kind-projection)
|
|
26
26
|
- [5.2.2 External compute](#522-external-compute-kind-external)
|
|
27
|
-
- [5.3 Publish layer](#53-publish-layer-
|
|
27
|
+
- [5.3 Publish layer](#53-publish-layer-publish)
|
|
28
28
|
- [5.4 Intake](#54-intake-declared-fetched-via-registered-intake-handler)
|
|
29
29
|
- [5.5 Pending / accept workflow](#55-pending--accept-workflow)
|
|
30
30
|
- [5.6 Audit log](#56-audit-log)
|
|
@@ -100,7 +100,7 @@ textus is organized as five composable layers. Each layer has a single responsib
|
|
|
100
100
|
| L1 | **Store** | Plain-file backend: `.textus/zones/<zone>/...` with YAML frontmatter + Markdown body, addressed by dotted keys, schema-validated, etag-versioned. |
|
|
101
101
|
| L2 | **Sources** | Declared external inputs (the `feeds` zone in the default scaffold; any `quarantine` zone, writable by a role with `fetch`): URLs, files, feeds with declared parsers and TTLs. textus *describes* sources; external automation fetches and pipes results through `textus put`. |
|
|
102
102
|
| L3 | **Compute** | Pure transforms from store entries to derived entries. Projections (select/pluck/sort/limit/format) plus a vendored Mustache template subset. No shell execution. |
|
|
103
|
-
| L4 | **Publish** | Byte-for-byte file copy from derived entries to repo-relative paths declared via `
|
|
103
|
+
| L4 | **Publish** | Byte-for-byte file copy from derived entries to repo-relative paths declared via `publish: { to: [...] }`. The in-store artifact is the consumer-shaped output; the published file is an identical copy. A sentinel under `.textus/sentinels/<target-rel-path>.textus-managed.json` records the source, sha256, and `mode: "copy"`. |
|
|
104
104
|
| L5 | **Consumers** | Anything that reads the published files or calls the CLI — editors, LLM tools, MCP servers, CI jobs, dashboards. textus is agnostic about who consumes; the envelope is the contract. |
|
|
105
105
|
|
|
106
106
|
## 2. Goals and non-goals
|
|
@@ -228,21 +228,11 @@ Zone names are conventional — write authority comes from each zone's declared
|
|
|
228
228
|
| `yaml` | `.yaml` or `.yml` required | optional (escape hatch) | optional (top-level keys) |
|
|
229
229
|
| `text` | `.txt` or no extension | required for derived | MUST be null |
|
|
230
230
|
|
|
231
|
-
For `nested: true`, the recursive glob matches the format's extension (markdown→`**/*.md`, json→`**/*.json`, yaml→`**/*.{yaml,yml}`, text→`**/*.txt`). All files under one nested entry share one format and one schema.
|
|
231
|
+
For `nested: true`, the recursive glob matches the format's extension (markdown→`**/*.md`, json→`**/*.json`, yaml→`**/*.{yaml,yml}`, text→`**/*.txt`). All files under one nested entry share one format and one schema. Each matching file is enumerated as its own key, with the key segments derived from the path relative to the entry (extension stripped). A nested entry that instead mirrors a whole directory of files to a consumer path — without enumerating any of them as keys — uses `publish: { tree: }` (below); its files are opaque payload. (The former `index_filename:` directory-keyed enumeration was removed in 0.43.0 — ADR 0053.)
|
|
232
232
|
|
|
233
|
-
**
|
|
233
|
+
**The `publish:` block (ADR 0052).** Publishing is configured by one typed `publish:` block with exactly one of two sub-keys — `publish: { to: [...] }` (file fan-out, §5.3) **xor** `publish: { tree: "dir" }` (subtree mirror, below). Setting both is an error. The legacy top-level `publish_to:` / `publish_tree:` keys are rejected at load with a migration message.
|
|
234
234
|
|
|
235
|
-
|
|
236
|
-
- key: skills
|
|
237
|
-
path: skills
|
|
238
|
-
zone: skills
|
|
239
|
-
nested: true
|
|
240
|
-
index_filename: SKILL.md
|
|
241
|
-
```
|
|
242
|
-
|
|
243
|
-
A file at `.textus/zones/skills/ask/SKILL.md` enumerates as `skills.ask`; `.textus/zones/skills/ask/references/algorithm.md` is not enumerated. Resolving `skills.ask` returns the `SKILL.md` path. `index_filename:` requires `nested: true`; the value must be a bare basename (no slashes). `index_filename:` is a pure *enumeration* feature — it selects which file is the addressable row per directory and is independent of publishing (ADR 0051).
|
|
244
|
-
|
|
245
|
-
**Subtree mirror (`publish_tree:`).** A nested manifest entry MAY declare `publish_tree:` to mirror its entire stored subtree (`zones/<path>/**`) to a single target directory, preserving relative layout (case and extension preserved). It is **path-driven, not key-driven**: no keys are enumerated, no template variables are interpreted, and the mirrored files are opaque payload (never addressable). The entry's `ignore:` globs (§4, ADR 0042) filter the walk; each mirrored file gets its own sentinel; and on every build the whole target directory is pruned of textus-managed files the current source no longer produces (unmanaged files are never touched). `publish_tree:` is mutually exclusive with `publish_to:`, and incompatible with `index_filename:`. When a `publish_tree:` target directory overlaps a `derived` entry's `publish_to:` (e.g. a derived `SKILL.md` written into the mirrored dir), the `publish_tree:` entry **must** `ignore:` that filename or prune will delete it — `doctor` flags this as `publish.tree_index_overlap`. See ADR 0047.
|
|
235
|
+
**Subtree mirror (`publish: { tree: }`).** A nested manifest entry MAY declare `publish: { tree: "dir" }` to mirror its entire stored subtree (`zones/<path>/**`) to a single target directory, preserving relative layout (case and extension preserved). It is **path-driven, not key-driven**: no keys are enumerated, no template variables are interpreted, and the mirrored files are opaque payload (never addressable). The entry's `ignore:` globs (§4, ADR 0042) filter the walk; each mirrored file gets its own sentinel; and on every build the whole target directory is pruned of textus-managed files the current source no longer produces (unmanaged files are never touched). When a `publish.tree` target directory overlaps a `derived` entry's `publish.to` (e.g. a derived `SKILL.md` written into the mirrored dir), the mirroring entry **must** `ignore:` that filename or prune will delete it — `doctor` flags this as `publish.tree_index_overlap`. See ADR 0047.
|
|
246
236
|
|
|
247
237
|
```yaml
|
|
248
238
|
- key: working.skills
|
|
@@ -250,7 +240,8 @@ A file at `.textus/zones/skills/ask/SKILL.md` enumerates as `skills.ask`; `.text
|
|
|
250
240
|
zone: working
|
|
251
241
|
schema: skill
|
|
252
242
|
nested: true
|
|
253
|
-
|
|
243
|
+
publish:
|
|
244
|
+
tree: "skills"
|
|
254
245
|
ignore: ["*.tmp", ".DS_Store"]
|
|
255
246
|
```
|
|
256
247
|
|
|
@@ -444,21 +435,24 @@ generated:
|
|
|
444
435
|
|
|
445
436
|
`kind: external` and `kind: projection` are alternatives — exactly one per entry. Templates are not required for `kind: external`: the external automation produces the bytes directly.
|
|
446
437
|
|
|
447
|
-
### 5.3 Publish layer (`
|
|
438
|
+
### 5.3 Publish layer (`publish:`)
|
|
439
|
+
|
|
440
|
+
Publishing is configured by one typed `publish:` block with exactly one sub-key (ADR 0052): `to:` (file fan-out) **xor** `tree:` (subtree mirror). Setting both is an error; the legacy top-level `publish_to:` / `publish_tree:` keys are rejected at load with a migration message.
|
|
448
441
|
|
|
449
|
-
A derived entry MAY declare `
|
|
442
|
+
A derived entry MAY declare `publish: { to: [...] }`, listing one or more destination paths relative to the project root:
|
|
450
443
|
|
|
451
444
|
```yaml
|
|
452
|
-
|
|
453
|
-
|
|
454
|
-
|
|
445
|
+
publish:
|
|
446
|
+
to:
|
|
447
|
+
- CLAUDE.md
|
|
448
|
+
- .ai/instructions.md
|
|
455
449
|
```
|
|
456
450
|
|
|
457
451
|
When the entry is recomputed, textus copies the in-store file byte-for-byte to each destination. The in-store artifact under `.textus/zones/<output-zone>/…` is already the consumer-shaped output (per the format strategy — see §5.x), so publish is a verbatim file copy with no parsing or stripping.
|
|
458
452
|
|
|
459
453
|
A sentinel is written for each published file at `<store_root>/sentinels/<target-relative-to-repo>.textus-managed.json`, recording `source`, `target`, the target's sha256, and `mode: "copy"`. Sentinels live under the store rather than beside the consumer file so target directories stay clean. The sentinel exists so out-of-band edits can be detected on the next publish — textus refuses to clobber a destination that is not either missing, marked as managed, or **byte-identical to the source being published**. An identical destination is *adopted*: its sentinel is written and management proceeds (the copy is a content no-op), so an artifact tree already on disk onboards without a manual delete. An unmanaged destination whose content **differs**, or any unmanaged symlink, is still refused (ADR 0050). Legacy sibling sentinels (`<target>.textus-managed.json`) are still recognised as managed and are migrated to the new location on the next publish.
|
|
460
454
|
|
|
461
|
-
**Subtree mirror.** A nested entry MAY declare `
|
|
455
|
+
**Subtree mirror.** A nested entry MAY declare `publish: { tree: "dir" }` instead of `to:` (see §4). On every build, textus walks the entry's full stored subtree (`zones/<path>/**`), applies the entry's `ignore:` filter, and byte-copies each file to the target directory, preserving relative layout — one sentinel per file under `<store_root>/sentinels/`. The mirror is path-driven: no keys are enumerated, no template variables are interpreted, and mirrored files are opaque payload (never addressable). On rebuild, the entire target directory is pruned of textus-managed files the current source no longer produces; unmanaged files are never touched. The build envelope grows a `published_leaves` array — one row per mirrored file, with `key`, `source`, and `target` — alongside the existing `built` array, plus a `pruned` array listing any orphaned managed files removed on this build. Targets that would resolve outside the repo root are refused. When a `publish.tree` target overlaps a `derived` entry's `publish.to` (e.g. a derived `SKILL.md` written into the mirrored dir), the mirroring entry must `ignore:` that filename or prune will delete it — `doctor` flags this as `publish.tree_index_overlap` (ADR 0047).
|
|
462
456
|
|
|
463
457
|
### 5.4 Intake (declared, fetched via registered intake handler)
|
|
464
458
|
|
|
@@ -1018,7 +1012,7 @@ Given a manifest entry `derived.catalogs.skills` whose `compute: { kind: project
|
|
|
1018
1012
|
Given a derived entry with a `template` clause referencing a `.mustache` file and inputs drawn from other keys, `textus build` produces a body whose contents match the expected rendered output byte-for-byte (after trailing-newline normalization).
|
|
1019
1013
|
|
|
1020
1014
|
**Fixture G — Copy publish:**
|
|
1021
|
-
Given a manifest entry with `
|
|
1015
|
+
Given a manifest entry with `publish: { to: [<path>] }`, a successful `textus build` for that entry leaves a plain file at `<path>` whose contents are byte-identical to the in-store artifact at `.textus/zones/<...>`, accompanied by a sentinel at `.textus/sentinels/<path>.textus-managed.json` recording `source`, `target`, `sha256`, and `mode: "copy"`. Re-running `build` is idempotent.
|
|
1022
1016
|
|
|
1023
1017
|
**Fixture H — Audit log format:**
|
|
1024
1018
|
Every successful write verb (`put`, `delete`, `build`, `accept`, `schema migrate`) appends exactly one line per affected key to the audit log, in the canonical format defined in §audit (timestamp, actor role, verb, key, etag-before, etag-after). No write produces zero or multiple lines per key.
|
|
@@ -65,7 +65,8 @@ A derived entry declares a `compute:` block with a `kind:` discriminator. Two ki
|
|
|
65
65
|
pluck: [name, relationship, org]
|
|
66
66
|
sort_by: name
|
|
67
67
|
template: people.mustache # under .textus/templates/
|
|
68
|
-
|
|
68
|
+
publish:
|
|
69
|
+
to: [docs/people.md] # optional repo-relative byte-copy targets
|
|
69
70
|
```
|
|
70
71
|
|
|
71
72
|
**`compute: { kind: external }`** — an external build tool (rake, just, a shell script) produces the file. textus never executes the `command:`; it only tracks `sources:` so `textus freshness` can compare source mtimes against the file's `_meta.generated.at`. The role running the build must hold `build` (default: `automation`).
|
|
@@ -83,7 +84,7 @@ A derived entry declares a `compute:` block with a `kind:` discriminator. Two ki
|
|
|
83
84
|
|
|
84
85
|
The build automation is responsible for writing the `generated:` frontmatter block (`by`, `at`, `from`) when it produces the file. `generated.from` SHOULD match `compute.sources` — same list, recorded twice so a diff proves what was consumed.
|
|
85
86
|
|
|
86
|
-
Full contract for both shapes is in [`../../SPEC.md` §5.2.1 and §5.2.2](../../SPEC.md). Transforms (`compute.transform:`) and subtree publishing (`
|
|
87
|
+
Full contract for both shapes is in [`../../SPEC.md` §5.2.1 and §5.2.2](../../SPEC.md). Transforms (`compute.transform:`) and subtree publishing (`publish: { tree: }`) are also covered there.
|
|
87
88
|
|
|
88
89
|
## Intake and freshness
|
|
89
90
|
|
|
@@ -6,12 +6,12 @@ module Textus
|
|
|
6
6
|
out = []
|
|
7
7
|
manifest.data.entries.each do |entry|
|
|
8
8
|
next unless entry.nested?
|
|
9
|
+
next if entry.publish_mode.keyless? # publish_tree files are opaque payload, never keys (ADR 0047)
|
|
9
10
|
|
|
10
11
|
base = File.join(root, "zones", entry.path)
|
|
11
12
|
next unless File.directory?(base)
|
|
12
13
|
|
|
13
|
-
|
|
14
|
-
index_fn ? check_index_paths(entry, index_fn, base, out) : check_all_paths(entry, base, out)
|
|
14
|
+
check_all_paths(entry, base, out)
|
|
15
15
|
end
|
|
16
16
|
out
|
|
17
17
|
end
|
|
@@ -31,24 +31,6 @@ module Textus
|
|
|
31
31
|
end
|
|
32
32
|
end
|
|
33
33
|
|
|
34
|
-
# When the entry uses `index_filename:`, only the parent-directory
|
|
35
|
-
# segments leading to each index file participate in keys. Sibling
|
|
36
|
-
# files and unrelated subtrees are not enumerated and must not be
|
|
37
|
-
# flagged. Each illegal segment is reported once per path. Paths under
|
|
38
|
-
# an ignored subtree (ADR 0042) are excluded before any segment check.
|
|
39
|
-
def check_index_paths(entry, index_fn, base, out)
|
|
40
|
-
Dir.glob(File.join(base, "**", index_fn)).each do |fp|
|
|
41
|
-
rel = fp.sub(%r{\A#{Regexp.escape(base)}/?}, "")
|
|
42
|
-
next if entry.ignored?(rel)
|
|
43
|
-
|
|
44
|
-
File.dirname(rel).split("/").reject { |s| s.empty? || s == "." }.each do |seg|
|
|
45
|
-
next if seg.match?(Key::Grammar::SEGMENT)
|
|
46
|
-
|
|
47
|
-
out << issue(fp, seg)
|
|
48
|
-
end
|
|
49
|
-
end
|
|
50
|
-
end
|
|
51
|
-
|
|
52
34
|
def issue(abs_path, stem)
|
|
53
35
|
{
|
|
54
36
|
"code" => "key.illegal",
|
|
@@ -6,11 +6,10 @@ module Textus
|
|
|
6
6
|
# Entry::Publish::* — Nested is just the value (attributes + ignore
|
|
7
7
|
# predicate) those modes read.
|
|
8
8
|
class Nested < Base
|
|
9
|
-
attr_reader :
|
|
9
|
+
attr_reader :publish_tree, :ignore
|
|
10
10
|
|
|
11
|
-
def initialize(
|
|
11
|
+
def initialize(publish_tree: nil, ignore: nil, **rest)
|
|
12
12
|
super(**rest)
|
|
13
|
-
@index_filename = index_filename
|
|
14
13
|
@publish_tree = publish_tree
|
|
15
14
|
@ignore = Array(ignore)
|
|
16
15
|
end
|
|
@@ -26,8 +25,7 @@ module Textus
|
|
|
26
25
|
|
|
27
26
|
def self.from_raw(common, raw)
|
|
28
27
|
new(
|
|
29
|
-
|
|
30
|
-
publish_tree: raw["publish_tree"],
|
|
28
|
+
publish_tree: raw.dig("publish", "tree"), # ADR 0052: typed publish block
|
|
31
29
|
ignore: raw["ignore"],
|
|
32
30
|
**common,
|
|
33
31
|
)
|
|
@@ -18,7 +18,10 @@ module Textus
|
|
|
18
18
|
key: key, path: path, zone: zone,
|
|
19
19
|
schema: raw["schema"], owner: raw["owner"],
|
|
20
20
|
format: format,
|
|
21
|
-
|
|
21
|
+
# ADR 0052: publish config is one typed block; the internal
|
|
22
|
+
# publish_to/publish_tree readers (the ADR 0049 modes) are sourced
|
|
23
|
+
# from it (publish_to <- publish.to, publish_tree <- publish.tree).
|
|
24
|
+
publish_to: raw.dig("publish", "to")
|
|
22
25
|
}
|
|
23
26
|
|
|
24
27
|
klass = Entry::REGISTRY[kind] or
|
|
@@ -17,6 +17,12 @@ module Textus
|
|
|
17
17
|
# No shape rules by default — ToPaths/None publish without templating.
|
|
18
18
|
def validate!; end
|
|
19
19
|
|
|
20
|
+
# Whether this entry's subtree files are opaque payload that must
|
|
21
|
+
# never be enumerated as keys. Only Tree (publish_tree, ADR 0047)
|
|
22
|
+
# overrides to true; doctor's IllegalKeys and the resolver consult
|
|
23
|
+
# this so they stop key-walking a keyless mirror's files.
|
|
24
|
+
def keyless? = false
|
|
25
|
+
|
|
20
26
|
private
|
|
21
27
|
|
|
22
28
|
# Expand `rel` under repo_root and confirm it stays inside it.
|
|
@@ -2,8 +2,8 @@ module Textus
|
|
|
2
2
|
class Manifest
|
|
3
3
|
class Entry
|
|
4
4
|
module Publish
|
|
5
|
-
#
|
|
6
|
-
# The
|
|
5
|
+
# publish.to: copy the entry's one stored file to each fixed repo path.
|
|
6
|
+
# The behaviour of any entry that declares `publish: { to: [...] }`.
|
|
7
7
|
class ToPaths < Mode
|
|
8
8
|
def publish(pctx, prefix: nil) # rubocop:disable Lint/UnusedMethodArgument
|
|
9
9
|
targets = Array(entry.publish_to)
|
|
@@ -8,6 +8,9 @@ module Textus
|
|
|
8
8
|
# (e.g. a SKILL.md written by a separate entry into the same dir)
|
|
9
9
|
# survives the whole-target prune (ADR 0047 D4).
|
|
10
10
|
class Tree < Mode
|
|
11
|
+
# Mirrored files are opaque payload, never addressable keys (ADR 0047).
|
|
12
|
+
def keyless? = true
|
|
13
|
+
|
|
11
14
|
def publish(pctx, prefix: nil) # rubocop:disable Lint/UnusedMethodArgument
|
|
12
15
|
target_rel = entry.publish_tree
|
|
13
16
|
target_dir = repo_abs(pctx, target_rel)
|
|
@@ -30,20 +33,13 @@ module Textus
|
|
|
30
33
|
|
|
31
34
|
def validate!
|
|
32
35
|
publish_tree = entry.publish_tree
|
|
33
|
-
raise UsageError.new("entry '#{entry.key}':
|
|
34
|
-
|
|
35
|
-
unless entry.index_filename.nil?
|
|
36
|
-
raise UsageError.new(
|
|
37
|
-
"entry '#{entry.key}': index_filename and publish_tree are mutually exclusive — " \
|
|
38
|
-
"publish_tree mirrors a whole subtree by path and never enumerates an index.",
|
|
39
|
-
)
|
|
40
|
-
end
|
|
36
|
+
raise UsageError.new("entry '#{entry.key}': publish.tree must be a string") unless publish_tree.is_a?(String)
|
|
41
37
|
|
|
42
38
|
used_vars = publish_tree.scan(Template::VAR_RE).flatten
|
|
43
39
|
return if used_vars.empty?
|
|
44
40
|
|
|
45
41
|
raise UsageError.new(
|
|
46
|
-
"entry '#{entry.key}':
|
|
42
|
+
"entry '#{entry.key}': publish.tree names a single directory and takes no template variable(s) " \
|
|
47
43
|
"#{used_vars.map { |v| "{#{v}}" }.join(", ")} — it mirrors the whole subtree to one target dir.",
|
|
48
44
|
)
|
|
49
45
|
end
|
|
@@ -5,26 +5,28 @@ module Textus
|
|
|
5
5
|
# realized as one resolved sum type. Each directory entry resolves, once,
|
|
6
6
|
# to one Publish::* mode that owns its publish algorithm — no nil-cascade,
|
|
7
7
|
# no pairwise exclusivity guards, one shared subtree mirror. ADR 0051
|
|
8
|
-
# removed `publish_each` (both leaf modes);
|
|
8
|
+
# removed `publish_each` (both leaf modes); ADR 0052 folded the two surviving
|
|
9
|
+
# keys into one `publish:` block (`to:` xor `tree:`). The surface is two modes:
|
|
9
10
|
#
|
|
10
|
-
# None — nothing to publish
|
|
11
|
-
# ToPaths —
|
|
12
|
-
# Tree —
|
|
11
|
+
# None — nothing to publish (no publish: block)
|
|
12
|
+
# ToPaths — publish: { to: [...] } — 1 stored file -> N fixed repo paths
|
|
13
|
+
# Tree — publish: { tree: "dir" } — whole entry subtree -> 1 dir, no keys
|
|
13
14
|
module Publish
|
|
14
|
-
# Resolve an entry to its single publish mode.
|
|
15
|
-
#
|
|
16
|
-
#
|
|
17
|
-
#
|
|
15
|
+
# Resolve an entry to its single publish mode. The publish config is the
|
|
16
|
+
# ADR 0052 `publish:` block, sourced into entry.publish_to/publish_tree.
|
|
17
|
+
# Raises one UsageError if both `publish.to` and `publish.tree` are set —
|
|
18
|
+
# the block groups the two but does not make exclusivity structural, so
|
|
19
|
+
# this stays the one enforcement point (ADR 0052 D2).
|
|
18
20
|
def self.resolve(entry)
|
|
19
21
|
reject_removed_publish_each(entry)
|
|
20
22
|
|
|
21
23
|
set = []
|
|
22
|
-
set << "
|
|
23
|
-
set << "
|
|
24
|
+
set << "publish.to" unless Array(entry.publish_to).empty?
|
|
25
|
+
set << "publish.tree" unless entry.publish_tree.nil?
|
|
24
26
|
|
|
25
27
|
if set.length > 1
|
|
26
28
|
raise Textus::UsageError.new(
|
|
27
|
-
"entry '#{entry.key}': #{set.join("
|
|
29
|
+
"entry '#{entry.key}': #{set.join(" and ")} are mutually exclusive — an entry publishes exactly one way",
|
|
28
30
|
)
|
|
29
31
|
end
|
|
30
32
|
|
|
@@ -36,15 +38,15 @@ module Textus
|
|
|
36
38
|
|
|
37
39
|
raise Textus::UsageError.new(
|
|
38
40
|
"entry '#{entry.key}': publish_each was removed in 0.42.0 (ADR 0051) — " \
|
|
39
|
-
"mirror the subtree with
|
|
41
|
+
"mirror the subtree with `publish: { tree: \"...\" }`.",
|
|
40
42
|
)
|
|
41
43
|
end
|
|
42
44
|
private_class_method :reject_removed_publish_each
|
|
43
45
|
|
|
44
46
|
def self.mode_for(entry, key)
|
|
45
47
|
case key
|
|
46
|
-
when "
|
|
47
|
-
when "
|
|
48
|
+
when "publish.to" then ToPaths.new(entry)
|
|
49
|
+
when "publish.tree" then Tree.new(entry)
|
|
48
50
|
else None.new(entry)
|
|
49
51
|
end
|
|
50
52
|
end
|
|
@@ -8,11 +8,13 @@ module Textus
|
|
|
8
8
|
# the scattered pairwise "not-both" guards of the old PublishEach +
|
|
9
9
|
# PublishTree validators. Misuse on a non-nested entry is still caught
|
|
10
10
|
# here from raw, since the typed attrs stub nil on Base. (publish_each was
|
|
11
|
-
# removed in 0.42.0 — ADR 0051;
|
|
11
|
+
# removed in 0.42.0 — ADR 0051; the publish_to/publish_tree keys were folded
|
|
12
|
+
# into the `publish:` block in 0.43.0 — ADR 0052; Schema rejects the retired
|
|
13
|
+
# flat keys at load.)
|
|
12
14
|
module Publish
|
|
13
15
|
def self.call(entry, policy: nil) # rubocop:disable Lint/UnusedMethodArgument
|
|
14
16
|
unless entry.nested?
|
|
15
|
-
raise UsageError.new("entry '#{entry.key}':
|
|
17
|
+
raise UsageError.new("entry '#{entry.key}': publish.tree requires nested: true") if entry.raw.dig("publish", "tree")
|
|
16
18
|
|
|
17
19
|
return
|
|
18
20
|
end
|
|
@@ -51,13 +51,8 @@ module Textus
|
|
|
51
51
|
else
|
|
52
52
|
raise UnknownKey.new(key, suggestions: suggestions_for(key)) unless nested_entry?(entry)
|
|
53
53
|
|
|
54
|
-
|
|
55
|
-
path =
|
|
56
|
-
File.join(@data.root, "zones", entry.path, *remaining, index_fn)
|
|
57
|
-
else
|
|
58
|
-
primary_ext = Textus::Entry.for_format(entry.format).extensions.first
|
|
59
|
-
File.join(@data.root, "zones", entry.path, *remaining) + primary_ext
|
|
60
|
-
end
|
|
54
|
+
primary_ext = Textus::Entry.for_format(entry.format).extensions.first
|
|
55
|
+
path = File.join(@data.root, "zones", entry.path, *remaining) + primary_ext
|
|
61
56
|
Resolution.new(entry: entry, path: path, remaining: remaining)
|
|
62
57
|
end
|
|
63
58
|
end
|
|
@@ -68,33 +63,22 @@ module Textus
|
|
|
68
63
|
end
|
|
69
64
|
|
|
70
65
|
def enumerate_nested(entry)
|
|
66
|
+
# publish_tree mirrors opaque payload by path — its files are never
|
|
67
|
+
# enumerated as keys (ADR 0047). Ask the resolved mode, not the path.
|
|
68
|
+
return [] if entry.publish_mode.keyless?
|
|
69
|
+
|
|
71
70
|
base = File.join(@data.root, "zones", entry.path)
|
|
72
71
|
return [] unless File.directory?(base)
|
|
73
72
|
|
|
74
|
-
|
|
75
|
-
|
|
76
|
-
return Dir.glob(File.join(base, nested_glob(entry.format)))
|
|
77
|
-
.filter_map { |path| nested_row_for(entry, base, path) }
|
|
78
|
-
end
|
|
79
|
-
|
|
80
|
-
claimed = []
|
|
81
|
-
Dir.glob(File.join(base, "**", entry_index_filename))
|
|
82
|
-
.sort_by { |path| path.count("/") }
|
|
83
|
-
.filter_map do |path|
|
|
84
|
-
leaf_dir = File.dirname(path)
|
|
85
|
-
next nil if claimed.any? { |d| leaf_dir.start_with?("#{d}/") }
|
|
86
|
-
|
|
87
|
-
claimed << leaf_dir
|
|
88
|
-
nested_row_for(entry, base, path)
|
|
89
|
-
end
|
|
73
|
+
Dir.glob(File.join(base, nested_glob(entry.format)))
|
|
74
|
+
.filter_map { |path| nested_row_for(entry, base, path) }
|
|
90
75
|
end
|
|
91
76
|
|
|
92
77
|
def nested_row_for(entry, base, path)
|
|
93
78
|
rel = path.sub(%r{\A#{Regexp.escape(base)}/?}, "")
|
|
94
79
|
return nil if entry.ignored?(rel)
|
|
95
80
|
|
|
96
|
-
|
|
97
|
-
stripped = entry_if ? File.dirname(rel) : rel.sub(/#{Regexp.escape(File.extname(rel))}\z/, "")
|
|
81
|
+
stripped = rel.sub(/#{Regexp.escape(File.extname(rel))}\z/, "")
|
|
98
82
|
segs = stripped.split("/").reject { |s| s.empty? || s == "." }
|
|
99
83
|
return nil if segs.empty?
|
|
100
84
|
|
|
@@ -24,9 +24,12 @@ module Textus
|
|
|
24
24
|
KIND_REQUIRES_VERB = LANES
|
|
25
25
|
ENTRY_KEYS = %w[
|
|
26
26
|
key path zone kind schema owner nested format
|
|
27
|
-
compute template
|
|
28
|
-
intake events inject_boot
|
|
27
|
+
compute template publish
|
|
28
|
+
intake events inject_boot ignore tracked
|
|
29
29
|
].freeze
|
|
30
|
+
# ADR 0052: the typed publish block — `publish: { to: [...] }` (file
|
|
31
|
+
# fan-out) xor `publish: { tree: "dir" }` (subtree mirror).
|
|
32
|
+
PUBLISH_KEYS = %w[to tree].freeze
|
|
30
33
|
COMPUTE_KEYS = %w[kind select pluck sort_by limit transform command sources].freeze
|
|
31
34
|
INTAKE_KEYS = %w[handler config].freeze
|
|
32
35
|
RULE_KEYS = %w[match fetch intake_handler_allowlist guard retention].freeze
|
|
@@ -73,25 +76,62 @@ module Textus
|
|
|
73
76
|
def self.validate_entries!(entries)
|
|
74
77
|
Array(entries).each_with_index do |e, i|
|
|
75
78
|
path = "$.entries[#{i}]"
|
|
76
|
-
|
|
79
|
+
reject_retired_publish_keys!(e, path)
|
|
77
80
|
walk(e, ENTRY_KEYS, path)
|
|
81
|
+
validate_publish_block!(e, path)
|
|
78
82
|
walk(e["compute"], COMPUTE_KEYS, "#{path}.compute") if e["compute"].is_a?(Hash)
|
|
79
83
|
walk(e["intake"], INTAKE_KEYS, "#{path}.intake") if e["intake"].is_a?(Hash)
|
|
80
84
|
end
|
|
81
85
|
end
|
|
82
86
|
|
|
83
|
-
#
|
|
84
|
-
#
|
|
85
|
-
#
|
|
86
|
-
|
|
87
|
-
|
|
87
|
+
# Retired keys are no longer allowed, so `walk` would reject them as merely
|
|
88
|
+
# "unknown"; intercept first with the migration path so a pre-0.43 manifest
|
|
89
|
+
# gets a useful error. `publish_each` was removed (ADR 0051); `publish_to`/
|
|
90
|
+
# `publish_tree` were folded into the `publish:` block (ADR 0052);
|
|
91
|
+
# `index_filename` was removed (ADR 0053).
|
|
92
|
+
def self.reject_retired_publish_keys!(entry, path)
|
|
93
|
+
return unless entry.is_a?(Hash)
|
|
94
|
+
|
|
95
|
+
if entry.key?("publish_each")
|
|
96
|
+
raise BadManifest.new(
|
|
97
|
+
"publish_each was removed in 0.42.0 (ADR 0051) at '#{path}' — " \
|
|
98
|
+
"mirror the subtree with `publish: { tree: \"...\" }`.",
|
|
99
|
+
)
|
|
100
|
+
end
|
|
101
|
+
|
|
102
|
+
if entry.key?("publish_to")
|
|
103
|
+
raise BadManifest.new(
|
|
104
|
+
"publish_to was replaced by the publish: block in 0.43.0 (ADR 0052) at '#{path}' — " \
|
|
105
|
+
"use `publish: { to: [...] }`.",
|
|
106
|
+
)
|
|
107
|
+
end
|
|
108
|
+
|
|
109
|
+
if entry.key?("publish_tree")
|
|
110
|
+
raise BadManifest.new(
|
|
111
|
+
"publish_tree was replaced by the publish: block in 0.43.0 (ADR 0052) at '#{path}' — " \
|
|
112
|
+
"use `publish: { tree: \"...\" }`.",
|
|
113
|
+
)
|
|
114
|
+
end
|
|
115
|
+
|
|
116
|
+
return unless entry.key?("index_filename")
|
|
88
117
|
|
|
89
118
|
raise BadManifest.new(
|
|
90
|
-
"
|
|
91
|
-
"
|
|
119
|
+
"index_filename was removed in 0.43.0 (ADR 0053) at '#{path}' — a nested entry now enumerates " \
|
|
120
|
+
"each file as a key; to mirror a directory of files to a consumer path use `publish: { tree: \"...\" }`.",
|
|
92
121
|
)
|
|
93
122
|
end
|
|
94
123
|
|
|
124
|
+
# Shape of the ADR 0052 publish block: a Hash whose only keys are to/tree.
|
|
125
|
+
# Exclusivity (both set) and per-mode rules stay in Publish.resolve (ADR 0049).
|
|
126
|
+
def self.validate_publish_block!(entry, path)
|
|
127
|
+
return unless entry.is_a?(Hash) && entry.key?("publish")
|
|
128
|
+
|
|
129
|
+
block = entry["publish"]
|
|
130
|
+
raise BadManifest.new("publish: must be a mapping with `to:` or `tree:` at '#{path}.publish'") unless block.is_a?(Hash)
|
|
131
|
+
|
|
132
|
+
walk(block, PUBLISH_KEYS, "#{path}.publish")
|
|
133
|
+
end
|
|
134
|
+
|
|
95
135
|
def self.validate_rules!(rules)
|
|
96
136
|
Array(rules).each_with_index do |r, i|
|
|
97
137
|
path = "$.rules[#{i}]"
|
data/lib/textus/version.rb
CHANGED
metadata
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: textus
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 0.
|
|
4
|
+
version: 0.43.0
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
7
|
- Patrick
|
|
@@ -271,7 +271,6 @@ files:
|
|
|
271
271
|
- lib/textus/manifest/entry/validators/events.rb
|
|
272
272
|
- lib/textus/manifest/entry/validators/format_matrix.rb
|
|
273
273
|
- lib/textus/manifest/entry/validators/ignore.rb
|
|
274
|
-
- lib/textus/manifest/entry/validators/index_filename.rb
|
|
275
274
|
- lib/textus/manifest/entry/validators/inject_boot.rb
|
|
276
275
|
- lib/textus/manifest/entry/validators/publish.rb
|
|
277
276
|
- lib/textus/manifest/policy.rb
|
|
@@ -1,47 +0,0 @@
|
|
|
1
|
-
module Textus
|
|
2
|
-
class Manifest
|
|
3
|
-
class Entry
|
|
4
|
-
module Validators
|
|
5
|
-
module IndexFilename
|
|
6
|
-
def self.call(entry, policy: nil) # rubocop:disable Lint/UnusedMethodArgument
|
|
7
|
-
# Use raw to detect misuse on non-nested entries (typed attr stubs nil on Base).
|
|
8
|
-
index_filename = entry.nested? ? entry.index_filename : entry.raw["index_filename"]
|
|
9
|
-
return if index_filename.nil?
|
|
10
|
-
|
|
11
|
-
check_shape!(entry, index_filename)
|
|
12
|
-
check_extension!(entry, index_filename)
|
|
13
|
-
end
|
|
14
|
-
|
|
15
|
-
def self.check_shape!(entry, index_filename)
|
|
16
|
-
raise UsageError.new("entry '#{entry.key}': index_filename requires nested: true") unless entry.nested?
|
|
17
|
-
|
|
18
|
-
unless index_filename.is_a?(String) && !index_filename.empty?
|
|
19
|
-
raise UsageError.new("entry '#{entry.key}': index_filename must be a non-empty string")
|
|
20
|
-
end
|
|
21
|
-
|
|
22
|
-
return unless index_filename.include?("/") || File.basename(index_filename) != index_filename
|
|
23
|
-
|
|
24
|
-
raise UsageError.new("entry '#{entry.key}': index_filename must be a bare basename (no slashes)")
|
|
25
|
-
end
|
|
26
|
-
|
|
27
|
-
def self.check_extension!(entry, index_filename)
|
|
28
|
-
ext = File.extname(index_filename)
|
|
29
|
-
inferred = Textus::Entry.infer_from_extension(ext)
|
|
30
|
-
|
|
31
|
-
if inferred.nil?
|
|
32
|
-
raise UsageError.new(
|
|
33
|
-
"entry '#{entry.key}': index_filename #{index_filename.inspect} has unknown extension #{ext.inspect}",
|
|
34
|
-
)
|
|
35
|
-
end
|
|
36
|
-
return if inferred == entry.format
|
|
37
|
-
|
|
38
|
-
raise UsageError.new(
|
|
39
|
-
"entry '#{entry.key}': index_filename extension #{ext.inspect} implies format #{inferred.inspect}, " \
|
|
40
|
-
"but entry format is #{entry.format.inspect}",
|
|
41
|
-
)
|
|
42
|
-
end
|
|
43
|
-
end
|
|
44
|
-
end
|
|
45
|
-
end
|
|
46
|
-
end
|
|
47
|
-
end
|