textus 0.53.0 → 0.54.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: c7df129e69143765baa5302608a7813c0666d3c9d91266e0a47a4ece61a4f9f6
-  data.tar.gz: 2362c085078165a6da46e55dac29b75346d0f14527de514898f1f5136b094b21
+  metadata.gz: 0f98dbc5f461b8cffaa4cf8fb17c8b79cf51f4c5f78af62527e0abe27d84d828
+  data.tar.gz: 0bfd928765a9797078f7534aecbf89321de754a4d56ee71986c00fb6a3a7b255
 SHA512:
-  metadata.gz: a120d5d78f679fb9019817bf8491e00abe1145416c95faf6f80d5f62d078dbe8a054d15e5ec080ff5544eb3b2e02466130617db2d7d4fbf32dab05d3d8295fe1
-  data.tar.gz: a4dd565844225f88ae27683e37b6f508a3e64a6828a4b09ee472b815576b57eb9fd1ccf86d4cea91ecd92dde7ca59f0288ac01abf786afb9cce4833c28bb088c
+  metadata.gz: 32fd23741a0f3e69368dfde1fb8733381190b17eb592c459079020a692c98c181a689ab5a83af6b3bf2d16c37ab2b52e40faf6a47ce876e4bafc0709e082ebed
+  data.tar.gz: daadc9db41cf87e2a348ddf9b4472fc515a48b4f5e7ca77d9c00a6c95ed736d26c59b3ad1ec799a42e3eba940052236dc77e5ee3edaf4737150e8f030a5fbcaa

data/CHANGELOG.md

@@ -9,6 +9,40 @@ The **gem version** (`0.x.y`) is distinct from the **protocol version**
 bump is a breaking change that requires a store migration; the gem version
 tracks both additive improvements and breaking protocol bumps independently.
 
+## 0.54.0 — 2026-06-16 — Workflow system, raw ingest pipeline, MCP resources
+
+### Added
+
+- **Workflow system** (PR #218): Ruby DSL files in `.textus/workflows/` replace the `step/` extension model. `Workflow::Registry` (loaded from `.textus/workflows/**/*.rb`) is resolved by `Produce::Engine` at produce time; `Workflow::Runner` threads data through each named step and persists. Core components: `Workflow::Context`, `Workflow::Pattern` (glob matching), `Workflow::DSL`, `Workflow::Collector`, `Workflow::Registry`, `Workflow::Loader`, `Workflow::Runner`.
+- **`artifacts.index` produced workflow**: pre-computed full-store catalog (`artifacts.index`) served as a produced artifact — enumerates every manifest entry with its key, lane, format, etag, and `generated_at` timestamp.
+- **MCP `resources/list` and `resources/read`** (PR #221): machine-lane `produced` entries are now exposed as MCP resources at `textus://<key>` URIs with correct MIME types. Clients discover them via the `resources` capability advertised in the `initialize` handshake.
+- **Raw ingest pipeline** (PR #219, [ADR 0114](docs/architecture/decisions/0114-foundation-refactor.md), [ADR 0116](docs/architecture/decisions/0116-raw-lane-and-ingest-verb.md)): new `raw` zone-kind with a `write-once` gate and an `ingest` capability/verb (`Action::Ingest`). Doctor checks and an asset sentinel guard the lane. The `raw` bijection entry maps `raw → ingest`.
+
+### Changed
+
+- **`artifacts.derived.*` → `artifacts.*`**: the `derived` key segment is dropped — all machine-lane entries flatten to `artifacts.<name>` in both the manifest and the on-disk store. Workflows, boot, and all other callers updated.
+- **`boot` reads from `artifacts.index`**: inline computation removed from the boot action; the pre-computed catalog drives the response. `--lean` flag removed (PR #220).
+- **`pulse` slimmed**: `stale`, `doctor`, and `next_due_at` removed from the pulse envelope; `index_etag` added so clients can cheaply detect catalog drift without a full list.
+- **`ContractDrift` moved to core** (PR #220): `Textus::ContractDrift` extracted from the MCP surface into the core library so it is reusable across surfaces.
+- **MCP `Server` refactored per Sandi Metz rules** (PR #220): routing extracted to `Routing` module; methods decomposed to ≤ 5 lines each.
+- **Plugin manifest wiring** (PR #220): `claude_plugin` uses the installed `textus` binary (external use); `mcp_config` keeps `bundle exec` (dev environment). `--lean` references removed from the plugin manifest spec.
+- **Namespace renames** (PR #218, internal): `entry/` → `format/`, `envelope/io/` → `envelope/`, `Ports::Queue` → `Ports::JobStore`, `background/` → `jobs/`, `pipeline/` → `produce/`.
+- **Workflows reorganised**: workflow files split into `artifacts/` and `config/` subdirectories under `.textus/workflows/`.
+
+### Removed
+
+- **Step system** (PR #218): entire `lib/textus/step/` directory deleted along with all step-related specs, `container.steps`, dead `hooks.rb` doctor check, and `ports/audit_subscriber.rb`. **Migration:** rewrite step files as `.textus/workflows/*.rb` using the Workflow DSL.
+- **`Jobs::Refresh`** ([ADR 0115](docs/architecture/decisions/0115-role-trust-model.md)): workflow-based periodic re-derivation replaces the background refresh job.
+- **`handler_permit` manifest field** (PR #218): doctor-only field with no runtime enforcement deleted along with its policy class and schema key.
+- **Dead guards and constants**: `derived_write?` no-op guard from `WriteVerb#cascade_to_rdeps`; `publish_each` runtime guard from `Entry::Publish`; duplicate inline `check_action!` from `put`/`key_delete`/`reject`; `BURN = :sync` constant; cross-lane notebook side-effect from `Action::Ingest`.
+- **`source.from: fetch` and `source.from: derive`** narrowed to `external` only — fetch/derive methods removed from `Produced`; freshness/pulse use retention rules; boot drops intake/derived keys.
+
+### Fixed
+
+- **MCP `resources` capability missing from `initialize` handshake** (PR #221): the server only advertised `tools`, so MCP clients never called `resources/list`. Adding `"resources" => {}` makes all 9 produced artifacts discoverable as resources.
+- **`adr_log` workflow**: `include_keyless: true` added for tree-publish of `knowledge.decisions`.
+- **SpecLayout violations** (PR #221): `workflow_index_spec` and `workflow/errors_spec` (string-described) moved to `spec/conformance/workflow/`.
+
 ## 0.53.0 — 2026-06-15 — Auth consolidation and code quality
 
 ### Added

data/SPEC.md

@@ -899,16 +899,13 @@ The agent's MCP write surface includes the single-key `key_delete` and `key_mv`
 {
   "cursor":         1845,
   "changed":        [ { "seq": 1843, "key": "knowledge.notes.x", "verb": "put", "role": "human", "ts": "..." } ],
-  "stale":          [ "artifacts.marketplace" ],
   "pending_review": [ "proposals.proposal.123" ],
-  "doctor":         { "ok": true, "warn": 0, "fail": 0 },
   "contract_etag":  "sha256:1f3a…",
-  "next_due_at":    "2026-06-01T09:00:00Z",
-  "hook_errors":    [ { "seq": 1844, "event": "after_put", "hook": "notify", "key": "knowledge.notes.x", "error_class": "Timeout::Error", "error_message": "…", "at": "..." } ]
+  "index_etag":     "sha256:8f3c…"
 }
 ```
 
-`cursor` is the new high-water mark; pass it as `--since` on the next call. `changed` is sourced from `audit --seq-since`. `stale` is computed by the internal lifecycle scan (the former `freshness` verb, now Ruby-only — ADR 0085 folded its agent-facing output into `pulse`) — it lists intake entries past their `source.ttl`. `pending_review` lists all keys in the queue zone. `doctor` is an `{ok, warn, fail}` count summary. `contract_etag` is the `sha256:`-prefixed composite content hash of the contract — the manifest plus hooks and schemas (ADR 0074, via ADR 0025) — for cheap change-detection. `next_due_at` is the soonest upcoming lifecycle deadline across entries (ISO-8601, or `null` if none). `hook_errors` lists hook failures recorded since the cursor. When `--since` is below the oldest available seq (due to audit log rotation), pulse returns `CursorExpired`.
+`cursor` is the new high-water mark; pass it as `--since` on the next call. `changed` is sourced from `audit --seq-since`. `pending_review` lists all keys in the queue zone. `contract_etag` is the `sha256:`-prefixed composite content hash of the contract — the manifest plus hooks and schemas (ADR 0074, via ADR 0025) — for cheap change-detection. `index_etag` is the etag of the `artifacts.index` catalog file, or `null` when it does not exist — agents use this to detect when the catalog has been rebuilt. When `--since` is below the oldest available seq (due to audit log rotation), pulse returns `CursorExpired`.
 
 **`put` input** (read from stdin when `--stdin` is given):
 

data/docs/architecture/README.md

@@ -1,139 +1,154 @@
 # Textus architecture
 
 > **Explanation** · for contributors · **read this first** for orientation before SPEC
-> **SSoT for** the Ruby implementation layout (layers, container, ports, dispatch/pipeline paths) · **reviewed** 2026-06 (v0.46)
+> **SSoT for** the Ruby implementation layout (layers, container, ports, dispatch paths) · **reviewed** 2026-06 (v0.54)
 
 ```mermaid
 flowchart TD
-    surfaces["Surfaces — CLI verbs · MCP gate (JSON-RPC) · RoleScope"]
+    surfaces["Surfaces — CLI · MCP · RoleScope"]
     contract["Contract — per-verb DSL (source of truth for public interfaces)"]
-    dispatch["Dispatch — Gate · Auth · Ledger · Executor · Actions<br/>planner/ · pipeline/ · runtime/ · catalog/"]
+    gate["Gate — routing (VERB_COMMAND) · Auth"]
+    action["Actions — per-verb use cases (action/)"]
+    jobs["Jobs — Worker · Planner · Materialize · Retention · Sweep"]
+    produce["Produce — Engine · Render"]
+    workflow["Workflow — Runner · Registry · Loader · DSL"]
     manifest["Manifest — declarative config, no IO (policy/, schema/, entry/)"]
-    core["Core — pure value types (Freshness, Job, Duration, Sentinel)"]
-    ports["Ports — IO adapters (FileStore, AuditLog, Queue, Publisher…)"]
-    step["Step — user-injectable wrappers (Fetch, Transform, Validate, Observe)"]
+    core["Core — pure value types (Freshness, Retention, Duration, Sentinel)"]
+    ports["Ports — IO adapters (FileStore, AuditLog, JobStore, Publisher…)"]
     surfaces --> contract
-    contract --> dispatch
-    dispatch --> manifest
-    dispatch --> core
-    dispatch --> ports
-    dispatch --> step
+    contract --> gate
+    gate --> action
+    action --> jobs
+    action --> produce
+    produce --> workflow
+    action --> manifest
+    action --> core
+    action --> ports
+    jobs --> produce
 ```
 
-*Dependency rule: inward only.* `dispatch/planner/`, `dispatch/pipeline/`, and `dispatch/runtime/` are private sub-namespaces of `dispatch/` — never referenced directly from `surfaces/` or `contract/`. Use cases are plain classes receiving `(container:, call:)`. Verbs are looked up in the static `Dispatcher::VERBS` table.
+*Dependency rule: inward only.* Surfaces → Contract → Gate → Actions → inner layers. Actions never reference surfaces.
 
 ### What lives in each layer
 
-**Interface**
+**Surfaces**
 
 ```
-CLI verbs:  store.<verb>(..., role:)
-            store.as(role).<verb>(...)    # (put/get/fetch/…)
+surfaces/cli/     CLI command generation from contracts
+surfaces/mcp/     MCP server — stdio JSON-RPC 2.0, tools derived from contracts
+surfaces/role_scope.rb
+                  (Store#as(role)) — holds (container, role, dry_run, correlation_id);
+                  all verb methods injected via define_method in textus.rb
+```
+
+**Contract**
 
-MCP gate:   textus mcp serve — same use cases, JSON-RPC.
+```
+contract/         Per-verb DSL — verb, summary, surfaces, arg, view.
+                  Contract::Binder.inputs_from_ordered splits the uniform inputs hash
+                  into positional/keyword args for every surface.
 ```
 
-The CLI is a **projection of the per-verb `Contract`** (ADR 0063), the operator
-mirror of `MCP::Catalog`. The contract now owns the whole request lifecycle —
-`acquire → bind → invoke → render` (ADRs 0066–0068): one `Contract::Binder.bind`
-splits the uniform by-name `inputs` hash into the use-case's positional/keyword
-args for every surface; per-surface `view`s shape the output (`view` for
-MCP/Ruby, `view(:cli)` for the operator envelope); declarative `source:`/
-`coerce:`/`cli_stdin` populate inputs from files and stdin; `around:` resources
-wrap the single dispatch site (`RoleScope#dispatch_bound`) for stateful verbs;
-and `cli_default:` declares a CLI default that diverges from the agent default.
-`CLI::Runner` generates a command per `:cli` contract, dispatching `contract.verb`
-by construction. Only verbs with genuine *behavior* — `put` (entry persistence),
-`get` (UnknownKey + resolver suggestions, CLI-only), and `doctor` (not yet
-generatable) — stay hand-authored, plus commands with no dispatcher verb (`init`,
-`hook`, `mcp serve`, `schema diff/init`). `boot` is auto-generated from its
-contract. Total reconciliation specs make name/dispatch/facet drift unrepresentable.
+**Gate + Auth**
 
-**Surfaces**
+```
+gate.rb           VERB_COMMAND  (verb symbol → Command class)
+                  Gate#dispatch(cmd) — Auth → action call
+gate/auth.rb      Authorization engine — FLOOR predicates + rule guards
+```
+
+**Actions**
 
 ```
-CLI verbs:  store.<verb>(..., role:)
-            store.as(role).<verb>(...)
+action/{get,list,put,key_delete,key_mv,accept,reject,propose,
+        drain,enqueue,audit,blame,deps,rdeps,published,boot,doctor,
+        rule_explain,rule_list,rule_lint,pulse,
+        data_mv,key_mv_prefix,key_delete_prefix,
+        schema_envelope,where,uid,jobs}.rb
+```
 
-MCP gate:   textus mcp serve — same actions, JSON-RPC.
-RoleScope   (Store#as(role) — builds Call, forwards to Dispatcher)
+**Jobs**
+
+```
+jobs/planner.rb   Rules-driven job planning — seeds materialize/refresh/sweep jobs
+jobs/worker.rb    Queue drain — leases and runs jobs from JobStore
+jobs/materialize.rb  Per-key produce job → Produce::Engine.converge
+jobs/refresh.rb   Per-key refresh job (retention-rule-triggered)
+jobs/retention.rb Retention policy check
+jobs/sweep.rb     Lane sweep job
 ```
 
-**Dispatch (all runtime)**
+**Produce**
 
 ```
-Gate             (thin coordinator: Auth → Ledger → Executor)
-Auth             (authorization engine — FLOOR predicates + rule guards)
-Ledger           (append event to audit before execution)
-Executor         (sync/async routing per action BURN mode)
-Event            (Data.define: name, actor, target, payload, actions)
-
-actions/{get,list,put,key_delete,key_mv,accept,reject,propose,
-         drain,materialize,refresh_data,sweep,observe,
-         enqueue,audit,blame,deps,rdeps,published,boot,doctor,
-         rule_explain,rule_list,rule_lint,pulse,
-         data_mv,key_mv_prefix,key_delete_prefix,
-         schema_envelope,where,uid,jobs}.rb
-
-planner/{planner,scheduler,seeder}.rb  (rules-driven job planning)
-pipeline/{engine,render,acquire/{intake,handler,projection,serializer}}.rb
-runtime/{worker,watch,retention/apply,plan}.rb
-catalog/events.rb                      (dotted event name constants)
+produce/engine.rb         Engine.converge(container:, call:, keys:)
+                          For each key: looks up a registered workflow and runs it,
+                          or publishes existing bytes for entries with publish targets.
+produce/render.rb         Mustache template expansion for publish targets
+```
+
+**Workflow**
+
+```
+workflow/runner.rb    Runs a Definition: build_context → execute_steps → publish
+workflow/registry.rb  In-memory list of registered Definitions; Registry#for(key)
+workflow/loader.rb    Loads .textus/workflows/*.rb files via Collector DSL
+workflow/dsl.rb       Textus.workflow "name" { match "...", step :fetch { ... }, publish }
+workflow/context.rb   Context passed to each step (key, entry, config, container, call)
+workflow/pattern.rb   Key-matching pattern (glob via File.fnmatch?)
+workflow/errors.rb    NotFound, StepFailed
 ```
 
 **Core (pure value types)**
 
 ```
 Freshness::{Verdict,Evaluator}
-Jobs::Job          (immutable job value object)
-Duration  Sentinel
+Core::Duration  Core::Sentinel
 ```
 
 **Infrastructure**
 
 ```
-Store              (composition root — wires ports,
-                    vends a Container + dispatches verbs)
+Store              (composition root — wires ports, vends Container)
 Storage::FileStore (bytes-only port: read/write/delete/exists?/etag)
 Manifest           (Data, Resolver, Policy, Rules)
 Schemas            (eager-load cache)
-Ports::{AuditLog,AuditSubscriber,Publisher,Clock,
-        BuildLock,Queue,SentinelStore,WatcherLock}
-Step::{EventBus,RegistryStore,Loader,Context,FireReport,
-       Signature,Builtin,ErrorLog,Fetch,Transform,Validate,Observe}
+Ports::{AuditLog,JobStore,Publisher,Clock,
+        BuildLock,SentinelStore}
 Entry::{Markdown,Json,Yaml,Text}  (format strategies)
-Doctor::Validator  (schema + role-authority validation — called by doctor check)
 ```
 
 ## How a verb becomes a method
 
-All actions live under `lib/textus/dispatch/actions/`. The shape is uniform:
+All actions live under `lib/textus/action/`. The shape is uniform:
 
 ```ruby
 module Textus
-  module Dispatch
-    module Actions
-      class Get < Base
-        BURN = :sync
-
-        def call(container:, call:)
-          ...
-        end
+  module Action
+    class Get < Base
+      extend Textus::Contract::DSL
+
+      verb :get
+      summary "Read an entry by key."
+      surfaces :cli, :mcp
+      arg :key, String, required: true, positional: true
+
+      BURN = :sync
+
+      def initialize(key:)
+        super()
+        @key = key
+      end
+
+      def call(container:, call:)
+        ...
       end
     end
   end
 end
 ```
 
-Verbs are looked up in a static frozen table (`Textus::Dispatcher::VERBS`) that maps `:get → Dispatch::Actions::Get`, `:put → Dispatch::Actions::Put`, etc. Adding a new verb is **one entry in `Dispatcher::VERBS`** plus the class — no metaprogramming.
-
-The instantiate-and-call step lives in `Dispatcher.invoke`. `RoleScope` builds the `Call` (request state) and delegates to `Dispatcher.invoke`. Every system interaction flows through `Dispatch::Gate#fire(event)` — surfaces, internal cascades (rdeps), and async job workers all use the same path. Gate runs Auth → Ledger → Executor in sequence.
-
-`boot` and `doctor` are actions like any other — reached through `Dispatcher::VERBS`.
-
-One collaborator lives outside the dispatcher because it's composed by actions, not invoked as a verb:
-
-- `Envelope::IO::{Reader,Writer}` — own the parse and persist halves of the write pipeline; the audit-append-as-final-step invariant lives in `Writer`.
+Verbs are looked up in a static frozen table (`Textus::Action::VERBS`) that maps `:get → Action::Get`, `:put → Action::Put`, etc. Adding a new verb is one entry in `VERBS` plus the class — no metaprogramming.
 
 ## Container
 
@@ -142,130 +157,105 @@ Use cases never see the raw `Store`. `Textus::Container` is a single record hold
 ```ruby
 Container = Data.define(
   :manifest, :file_store, :schemas, :root,
-  :audit_log, :steps, :gate
+  :audit_log, :workflows, :gate
 )
 ```
 
-The `Store` builds one `Container` at boot; every action receives it via `(container:, call:)`. Step handlers (Fetch, Transform, Observe) receive `caps: <Container>` — they access `caps.manifest`, `caps.steps`, etc.
+The `Store` builds one `Container` at boot; every action receives it via `(container:, call:)`. Workflow steps receive a `Workflow::Context` (key, entry, config, container, call).
 
 ## Ports
 
-Ports are infrastructure adapters with an interface defined by the domain. Each port is independently replaceable — swap the implementation for tests or alternative runtimes without touching application or domain code.
-
 | Class | Role |
 |---|---|
-| `Ports::Storage::FileStore` | Bytes-only FS I/O — `read`, `write`, `delete`, `exists?`, `etag`. No knowledge of envelopes or schemas. |
-| `Ports::AuditLog` | Append-only structured log (`audit.log`). Owns seq numbering, file-locking, and rotation. |
-| `Ports::Clock` | Supplies `Time.now` — a module-function so tests can swap it without dependency injection boilerplate. |
-| `Ports::Publisher` | Copies a built artifact to a repo-relative consumer path and writes a sentinel so the next publish can confirm the target is managed. |
-| `Ports::BuildLock` | Process-exclusive `flock` guard over the produce pipeline. Raises `BuildInProgress` if a build is already running. |
-| `Ports::Queue` | Persistent job queue used by `drain`/`watch` workers; tracks ready/leased/done/failed jobs and powers async dispatch actions (`materialize`, `observe`). |
-| `Ports::SentinelStore` | Reads and writes the per-target sentinel file that `Publisher` uses to detect unmanaged overwrites. |
-| `Ports::WatcherLock` | Single-watcher `flock` guard used by `Dispatch::Runtime::Watch` to ensure only one watcher loop is active per store root. |
+| `Ports::Storage::FileStore` | Bytes-only FS I/O — `read`, `write`, `delete`, `exists?`, `etag`. |
+| `Ports::AuditLog` | Append-only structured log (`audit.log`). Owns seq numbering, file-locking, rotation. |
+| `Ports::Clock` | Supplies `Time.now` — module-function so tests can swap without DI boilerplate. |
+| `Ports::Publisher` | Copies a built artifact to a repo-relative consumer path and writes a sentinel. |
+| `Ports::BuildLock` | Process-exclusive `flock` guard over the produce pipeline. |
+| `Ports::JobStore` | Persistent job queue used by `drain` workers; tracks ready/leased/done/failed jobs. |
+| `Ports::SentinelStore` | Reads and writes per-target sentinel files for managed-file detection. |
 
 Application use cases access ports only through `Container` fields — never through the raw `Store`.
 
-### EnvelopeIO
-
-`Envelope::IO::Reader` and `Envelope::IO::Writer` split the envelope pipeline into read-only parse and write-with-audit halves.
+### Envelope
 
-**Reader** (`lib/textus/envelope/io/reader.rb`) — resolves a key through `manifest.resolver`, reads bytes via `FileStore`, delegates parsing to the format strategy (`Entry.for_format`), and returns an `Envelope`. No audit, no events, no permission checks. Also used by `Writer` for the existing-uid lookup on `put`.
+`Envelope::Reader` and `Envelope::Writer` split the envelope pipeline into read-only parse and write-with-audit halves.
 
-**Writer** (`lib/textus/envelope/io/writer.rb`) — owns the full write pipeline: serialize → schema-validate → etag-check → `FileStore#write` → `AuditLog#append`. The class comment states the invariant directly: every public method's final action is `@audit_log.append(...)`. If the audit append fails, the caller sees the underlying error — the byte write already happened, but the pipeline contract treats audit as the commit step. No permission check, no event firing — those stay in the calling use case (`Write::Put`, `Write::Delete`, `Write::Mv`).
+**Reader** (`lib/textus/envelope/reader.rb`) — resolves a key through `manifest.resolver`, reads bytes via `FileStore`, parses via the format strategy, returns an `Envelope`. No audit, no permissions.
 
-The three public methods are `put`, `delete`, and `move`; all follow the same validate → write → audit sequence.
+**Writer** (`lib/textus/envelope/writer.rb`) — owns the full write pipeline: serialize → schema-validate → etag-check → `FileStore#write` → `AuditLog#append`. The audit append is the commit step.
 
-Both are built from a `Container` via named constructors — `Writer.from(container:, call:)` (which builds its own `Reader.from`) and `Reader.from(container:)` (ADR 0026). Write use cases call `Writer.from` rather than reconstructing the object graph by hand, so a change to the Writer's dependencies is a one-line edit in one place.
+Both are built from a `Container` via named constructors — `Writer.from(container:, call:)` and `Reader.from(container:)`.
 
 ## Manifest carving
 
-Manifest carving means slicing the parsed manifest YAML into four purpose-specific sub-objects. Each consumer sees only the fields it needs; none reach into the full raw document.
-
-`Manifest` itself is a `Data.define` struct — a composition record with four named members:
+`Manifest` is a `Data.define` struct with four named members:
 
 | Member | Class | Responsibility |
 |---|---|---|
-| `data` | `Manifest::Data` | Frozen value: `raw`, `root`, `zones`, `entries`, `audit_config`, `role_caps` (role name → capability set). Structural data only — no behaviour beyond accessors and key validation. |
-| `resolver` | `Manifest::Resolver` | Key → `Resolution(entry, path, remaining)`. Handles nested entry enumeration and fuzzy-match suggestions. |
-| `policy` | `Manifest::Policy` | Zone/capability authority — `verb_for_zone` (zone-kind → required verb), `roles_with_capability(verb)`, `zone_writers` (derived: roles holding the verb the zone's kind requires), `permission_for`, `declared_kind`, `proposer_role`, `propose_zone_for(role)`. Write authority is derived from capabilities × zone-kind (ADR 0030); no filesystem I/O. `propose_zone_for` returns the single `kind: queue` zone when the role can write it (ADR 0027). |
-| `rules` | `Manifest::Rules` | Pattern-matched rule engine. `rules.for(key)` returns a `RuleSet(fetch, handler_allowlist, guard, retention)` by evaluating all `match:` blocks against the key. |
-
-Rationale: cleaner test seams — a use case that only needs key resolution constructs a `Manifest::Resolver` from a stub `Data`; one that only needs rule lookup constructs a `Manifest::Rules` directly. No consumer is forced to build the full manifest to exercise one sub-view.
-
-The four members are wired in `Manifest.build` (`lib/textus/manifest.rb`). `Manifest::Data` constructs `Policy` internally during `initialize`; the others are assembled by the loader and handed in as named arguments.
+| `data` | `Manifest::Data` | Frozen value: raw, root, lanes, entries, audit_config, role_caps. |
+| `resolver` | `Manifest::Resolver` | Key → `Resolution(entry, path, remaining)`. Nested entry enumeration and fuzzy-match suggestions. |
+| `policy` | `Manifest::Policy` | Zone/capability authority — `verb_for_lane`, `roles_with_capability`, `propose_lane_for(role)`. |
+| `rules` | `Manifest::Rules` | Pattern-matched rule engine. `rules.for(key)` → `RuleSet(guard, retention, react)`. |
 
 ## Read path (`store.get(key)`)
 
-`Read::Get` is the single public read verb. It is a **pure read** (ADR 0089): it resolves the path, reads bytes, parses the envelope, and annotates a freshness verdict — it NEVER ingests and NEVER mutates. The read-through that once refreshed a stale entry in-process (ADR 0062) is removed; quarantine freshness is system-pushed via `drain` (scheduled sweep) and `hook run` (event push).
+`Action::Get` is a **pure read** — it resolves the path, reads bytes, parses the envelope, and annotates a freshness verdict. It never ingests and never mutates.
 
-1. CLI verb (or MCP tool) calls `store.get(key, role:)` (or `store.as(role).get(key)`).
-2. `Store#get` looks up `Dispatcher::VERBS[:get] → Read::Get`, builds a `Call`, instantiates `Read::Get.new(container:, call:).call(key)`. The verb takes only `key` — there is no `fetch` flag on any surface.
-3. `Read::Get#call(key)` resolves the path through `container.manifest`, reads bytes via `container.file_store`, parses the envelope, and annotates a freshness verdict (`stale`, `reason`, `fetching: false`). When the key has no `upkeep` rule, the envelope is annotated fresh. A stale entry with `upkeep: { ttl:, action: refresh }` is returned **stale** — the read does not refresh it; the next `drain` does.
+1. CLI/MCP surface calls `store.as(role).get(key)`.
+2. `Gate#dispatch` runs Auth → `Action::Get#call`.
+3. `Get` resolves path via `manifest.resolver`, reads bytes via `file_store`, parses the envelope, annotates `freshness` based on retention-rule TTL (if any).
 
-Because the read is always pure, every caller — interactive reads, dashboards, and the direct in-process callers (accept/reject/publish, materializer, uid, schema/tools, hooks/context) — gets the same orchestrator-free, side-effect-free read. The prior read-through path (`get_or_fetch`, then the `fetch:`-flagged `Read::Get`, ADR 0062) and its `Write::FetchOrchestrator` are gone (ADR 0089).
+Staleness is age-based (retention-rule TTL vs file mtime). A stale entry is returned stale — the read does not refresh it; `drain` does.
 
 ## Write path (`store.put(key, ...)`)
 
-1. CLI/MCP surface calls `store.as(role).put(key, meta:, body:, content:, if_etag:)`.
-2. `Surfaces::RoleScope#dispatch_bound` fires `Gate.fire(Event.new("entry.put", actor: role, ...))`.
-3. `Dispatch::Gate` runs Auth → Ledger → Executor. `Auth#check_event!` evaluates FLOOR predicates (`lane_writable_by`) plus any rule-declared guards — raises `WriteForbidden` / `GuardFailed` on failure.
-4. `Actions::Put#call` validates the key, resolves the manifest entry, delegates persistence to `Envelope::IO::Writer#put` (serialize → schema-validate → etag-check → `FileStore#write` → `AuditLog#append`).
-5. Publishes `:entry_written` via `container.steps` and fires a cascade Gate event for rdep materialization.
-
-`Actions::{KeyDelete,KeyMv,Accept,Reject,Propose}` follow the same shape. All write actions inherit `WriteVerb#run_with_cascade`, which enqueues `materialize` jobs for rdeps after the write completes.
+1. CLI/MCP surface calls `store.as(role).put(key, meta:, body:)`.
+2. `Gate#dispatch` runs Auth → `Action::Put#call`.
+3. `Put` validates, resolves manifest entry, delegates to `Envelope::Writer#put` (serialize → schema-validate → etag-check → FileStore#write → AuditLog#append).
+4. `WriteVerb#cascade_to_rdeps` enqueues `materialize` jobs for any entries with publish_tree that depend on the written key.
 
-## Pipeline path (`drain` + reactive `entry.written`)
+`Action::{KeyDelete,KeyMv,Accept,Reject,Propose}` follow the same shape.
 
-The pipeline handles two concerns — **acquire** (pull live data via an intake handler) and **render** (template-driven artifact publish) — unified under `Dispatch::Pipeline::Engine`.
+## Workflow path (`drain` + materialize jobs)
 
-`Pipeline::Engine.converge(container:, call:, keys:)` is the entry point `Actions::Materialize` calls. Both the batch path (`drain` seeds jobs via `Planner::Seeder`) and the reactive path (write actions enqueue `materialize` jobs via `WriteVerb#cascade_to_rdeps`) flow through the queue worker into `converge`.
+The workflow system owns the produce pipeline. `Produce::Engine.converge(container:, call:, keys:)` is the entry point that `Jobs::Materialize` calls.
 
 For each key, `Engine#produce_one`:
 
-1. **Acquire phase** — `Pipeline::Acquire::Intake#run(key)`:
-   - Resolves the manifest entry; looks up the step handler via `container.steps`.
-   - Publishes `:entry_fetch_started` via `container.steps`.
-   - Invokes the `Step::Fetch` handler under a timeout deadline.
-   - On error: publishes `:entry_fetch_failed`, re-raises.
-   - On success: normalises the handler result, checks auth, persists via `Envelope::IO::Writer`, publishes `:entry_fetched` unless the etag is unchanged.
-   - `Acquire::Handler` resolves and invokes the step under the timeout deadline. (The sibling **projection** sub-path — `from: derive` entries — runs `Acquire::Projection`, which renders data files through `Acquire::Serializer::{Json,Yaml,Text}` before persisting.)
-2. **Render phase** — `entry.publish_via(context)` calls `Pipeline::Render#bytes_for(target:, data:, boot:)` to expand the Mustache template and copy the result to the publish target via `Ports::Publisher`. Returns `nil` if no publish is configured (skipped).
-
-Per-entry failures are published as `:produce_failed` by `Actions::Materialize` after `Engine.converge` returns. A held `BuildLock` is a soft miss — the in-flight build already produces fresh output.
-
-Reactive produce is enqueued as `materialize` jobs onto `Ports::Queue` when `entry_written`/`entry_deleted`/`entry_renamed` fires; a worker (`drain`/`serve`) runs them through `converge`. A held `BuildLock` is a soft miss — the in-flight build already produces fresh output.
+1. Looks up a registered workflow via `container.workflows.for(key)` (Pattern matching against the key).
+2. If a workflow matches: `Workflow::Runner.new(definition, container:, call:).run(key)`.
+   - `Runner` builds a `Workflow::Context`, executes each step in sequence, then publishes.
+   - **Built-in publish**: writes the step output to the entry via `Envelope::Writer`, then calls `entry.publish_via(pctx)` for any `publish_to` or `publish_tree` targets.
+3. If no workflow matches but the entry has publish targets: runs `publish_only` — publishes existing store bytes via `entry.publish_via` without re-fetching.
 
-## Hook payload contract
+**Workflow files** live in `.textus/workflows/*.rb`. The DSL:
 
-Pub-sub hooks (`:entry_written`, `:entry_fetched`, …) receive `ctx:` — a `Textus::Hooks::Context` that exposes a narrow surface (`get`, `list`, `put`, `delete`, `audit`, `publish_followup`, plus `role` and `correlation_id`). The raw `Store` is not handed out.
-
-RPC hooks (`:resolve_handler`, `:transform_rows`, `:validate`) receive `caps:` — a `Textus::Container`. They are gem-internal: the framework calls them, not user pub-sub.
+```ruby
+Textus.workflow "my-producer" do
+  match "artifacts.derived.*"
+  step :fetch do |data, ctx|
+    { content: { "key" => ctx.key } }
+  end
+  publish  # uses built-in publish (writes to entry, then to publish targets)
+end
+```
 
 ## Agent surface (boot + pulse + MCP)
 
-Agents and plugins talk to a textus store through three layers:
-
 ```
-soul (skill/agent)  ──▶  gate (CLI | MCP)  ──▶  Store  ──▶  memory (.textus/)
+agent/plugin  ──▶  gate (CLI | MCP)  ──▶  Store  ──▶  memory (.textus/)
 ```
 
 Two transports, one façade:
 
 - **CLI** — human/script surface. `textus boot`, `textus pulse --since=N`, `textus get/put/...`.
-- **MCP** — agent surface. `textus mcp serve` runs a stdio JSON-RPC 2.0 server speaking MCP draft 2024-11-05. Tools are auto-derived from the manifest. Session state (cursor, role, contract_etag) is server-side.
-
-Both transports call `store.<verb>(..., role:)` (or `store.as(role).<verb>(...)`). No duplicate logic.
-
-The agent loop (cadence guide in [`agents-mcp.md`](../how-to/agents-mcp.md)):
-
-1. **Session start:** `boot()` → contract envelope (zones, entries, schemas, write_flows, agent_quickstart with `latest_seq`).
-2. **Per turn:** `pulse(since=cursor)` → `{cursor, changed, stale, pending_review, doctor}`.
-3. **On demand:** `get`, `put`, `propose`, `fetch`, `schema_show`, `rule_explain`.
-
-Contract drift surfaces as `ContractDrift` (contract_etag mismatch — a change to the manifest, hooks, or schemas; ADR 0074); audit cursor falls off the keep window as `CursorExpired`. Both signal "call `boot` again."
+- **MCP** — agent surface. `textus mcp serve` runs a stdio JSON-RPC 2.0 server. Tools are auto-derived from contracts. Session state (cursor, role, contract_etag) is server-side.
 
-## Hooks event catalog
+The agent loop:
 
-`Hooks::Signature` is the single home of callable keyword-introspection — both `EventBus` (pub-sub dispatch) and `RpcRegistry` (RPC dispatch) delegate to it for `accepts_keyrest?`, `declared_keys`, `missing`, and `filter` rather than each maintaining a hand-rolled copy (ADR 0027). RPC handlers declare `caps:` (single handler); pub-sub handlers declare `ctx:` (0..N handlers).
+1. **Session start:** `boot()` → contract envelope (lanes, entries, workflows, write_flows, agent_quickstart).
+2. **Per turn:** `pulse(since=cursor)` → `{cursor, changed, stale, pending_review, doctor, next_due_at}`.
+3. **On demand:** `get`, `put`, `propose`, `schema_show`, `rule_explain`, `drain`.
 
-The event names, payloads, and per-verb firing order are documented once in [`reference/events.md`](../reference/events.md) (the friendly SSoT); the authoritative source is `lib/textus/step/catalog.rb` (`Catalog::RPC` and `Catalog::PUBSUB`) and `lib/textus/dispatch/catalog/events.rb` (dotted Gate event name constants).
+Contract drift surfaces as `ContractDrift` (contract_etag mismatch — a change to manifest/schemas); audit cursor expiry as `CursorExpired`. Both signal "call `boot` again."

data/lib/textus/action/accept.rb

@@ -11,8 +11,6 @@ module Textus
       cli "accept"
       arg :pending_key, String, required: true, positional: true, description: "the queued proposal's key"
 
-      BURN = :sync
-
       def initialize(pending_key:)
         super()
         @pending_key = pending_key
@@ -39,13 +37,6 @@ module Textus
 
         Textus::Action::KeyDelete.new(key: @pending_key).call(container: container, call: call)
 
-        container.steps.publish(
-          :proposal_accepted,
-          ctx: Textus::Step::Context.for(container: container, call: call),
-          key: @pending_key,
-          target_key: target,
-        )
-
         { "protocol" => Textus::PROTOCOL, "accepted" => @pending_key, "target_key" => target, "action" => action }
       end
     end

data/lib/textus/action/audit.rb

@@ -24,8 +24,6 @@ module Textus
       arg :limit, Integer, required: false, description: "maximum number of rows to return"
       view(:cli) { |rows, _i| { "verb" => "audit", "rows" => rows } }
 
-      BURN = :sync
-
       def initialize(**kwargs)
         super()
         @query = Query.build(**kwargs.slice(:key, :lane, :role, :verb, :since, :seq_since, :correlation_id, :limit))

data/lib/textus/action/blame.rb

@@ -15,8 +15,6 @@ module Textus
       arg :limit, Integer, required: false, description: "maximum number of audit rows to return"
       view(:cli) { |rows, inputs| { "verb" => "blame", "key" => inputs[:key], "rows" => rows } }
 
-      BURN = :sync
-
       def initialize(key:, limit: nil)
         super()
         @key = key

data/lib/textus/action/boot.rb

@@ -6,20 +6,11 @@ module Textus
       extend Textus::Contract::DSL
 
       verb :boot
-      summary "Return the orientation contract: zones, entries, schemas, write_flows, agent_quickstart."
+      summary "Return the orientation contract: lanes, agent_quickstart, agent_protocol, and pre-computed artifacts."
       surfaces :cli, :mcp
-      arg :lean, :boolean,
-          description: "return only orientation essentials (zones, agent_quickstart, contract_etag) for cheap session-start injection"
-
-      BURN = :sync
-
-      def initialize(lean: nil)
-        super()
-        @lean = lean
-      end
 
       def call(container:, **)
-        Textus::Boot.build(container: container, lean: !@lean.nil?)
+        Textus::Boot.build(container: container)
       end
     end
   end

data/lib/textus/action/data_mv.rb

@@ -19,8 +19,6 @@ module Textus
                                            "defaults to false, so omitting it applies the move immediately"
       view { |v, _i| v.to_h }
 
-      BURN = :sync
-
       def initialize(from:, to:, dry_run: false)
         super()
         @from = from
@@ -45,7 +43,7 @@ module Textus
           { "op" => "mv", "from" => key, "to" => "#{@to}#{key[@from.length..]}" }
         end
 
-        plan = Textus::Background::Plan.new(steps: steps, warnings: [])
+        plan = Textus::Jobs::Plan.new(steps: steps, warnings: [])
         return plan if @dry_run
 
         rewrite_manifest!(root)