soturail 1.0.1 → 1.2.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (110) hide show
  1. package/README.md +60 -13
  2. package/dist/cli.js +6 -0
  3. package/dist/cli.js.map +1 -1
  4. package/dist/commands/agents.js +37 -7
  5. package/dist/commands/agents.js.map +1 -1
  6. package/dist/commands/feature.d.ts +2 -0
  7. package/dist/commands/feature.js +28 -0
  8. package/dist/commands/feature.js.map +1 -0
  9. package/dist/commands/handoff.d.ts +2 -0
  10. package/dist/commands/handoff.js +14 -0
  11. package/dist/commands/handoff.js.map +1 -0
  12. package/dist/commands/harness.js +20 -0
  13. package/dist/commands/harness.js.map +1 -1
  14. package/dist/commands/mcp.js +10 -1
  15. package/dist/commands/mcp.js.map +1 -1
  16. package/dist/commands/report.js +14 -3
  17. package/dist/commands/report.js.map +1 -1
  18. package/dist/commands/session.d.ts +2 -0
  19. package/dist/commands/session.js +17 -0
  20. package/dist/commands/session.js.map +1 -0
  21. package/dist/core/agent-exporter.d.ts +39 -2
  22. package/dist/core/agent-exporter.js +290 -24
  23. package/dist/core/agent-exporter.js.map +1 -1
  24. package/dist/core/agent-profile.d.ts +1 -1
  25. package/dist/core/agent-registry.js +12 -0
  26. package/dist/core/agent-registry.js.map +1 -1
  27. package/dist/core/agent-runtime.d.ts +15 -1
  28. package/dist/core/agent-runtime.js +120 -14
  29. package/dist/core/agent-runtime.js.map +1 -1
  30. package/dist/core/code-health.js +3 -0
  31. package/dist/core/code-health.js.map +1 -1
  32. package/dist/core/config.d.ts +7 -0
  33. package/dist/core/config.js +8 -0
  34. package/dist/core/config.js.map +1 -1
  35. package/dist/core/harness-lifecycle.d.ts +63 -0
  36. package/dist/core/harness-lifecycle.js +397 -0
  37. package/dist/core/harness-lifecycle.js.map +1 -0
  38. package/dist/core/harness-rail.js +1 -0
  39. package/dist/core/harness-rail.js.map +1 -1
  40. package/dist/core/mcp-resources.d.ts +27 -0
  41. package/dist/core/mcp-resources.js +104 -1
  42. package/dist/core/mcp-resources.js.map +1 -1
  43. package/dist/core/release-preflight.js +3 -0
  44. package/dist/core/release-preflight.js.map +1 -1
  45. package/dist/core/report-rail.d.ts +1 -1
  46. package/dist/core/report-rail.js +33 -8
  47. package/dist/core/report-rail.js.map +1 -1
  48. package/dist/core/schema-readiness.js +12 -1
  49. package/dist/core/schema-readiness.js.map +1 -1
  50. package/dist/core/skill-schema.d.ts +2 -2
  51. package/dist/core/version.d.ts +1 -1
  52. package/dist/core/version.js +1 -1
  53. package/docs/agent-export-contract.md +42 -0
  54. package/docs/agent-governance-rail.md +89 -0
  55. package/docs/agent-harness-synthesis-2026.md +101 -0
  56. package/docs/agent-hosts.md +24 -5
  57. package/docs/agent-qa-rail.md +92 -0
  58. package/docs/agents.md +31 -12
  59. package/docs/assets/demos/README.md +3 -0
  60. package/docs/assets/screenshots/agents-matrix.svg +35 -0
  61. package/docs/assets/screenshots/host-doctor.svg +21 -0
  62. package/docs/assets/screenshots/status-json.svg +30 -0
  63. package/docs/benchmarking.md +2 -2
  64. package/docs/conductor-mode.md +44 -0
  65. package/docs/context-packs.md +18 -0
  66. package/docs/dashboard-rail.md +6 -0
  67. package/docs/ecosystem-influences.md +65 -0
  68. package/docs/eval-datasets.md +40 -0
  69. package/docs/evaluation-suite.md +6 -0
  70. package/docs/evidence-provenance-rail.md +70 -0
  71. package/docs/external-projects-audit.md +29 -0
  72. package/docs/future-rails-index.md +75 -17
  73. package/docs/golden-agent-tests.md +44 -0
  74. package/docs/governance-cost-rail.md +10 -0
  75. package/docs/harness-lifecycle-rail.md +95 -0
  76. package/docs/harness-rail.md +27 -0
  77. package/docs/host-compatibility-rail.md +30 -6
  78. package/docs/host-matrix-schema.md +43 -0
  79. package/docs/host-router-rail.md +73 -0
  80. package/docs/knowledge-rail.md +76 -0
  81. package/docs/llm-as-judge-policy.md +45 -0
  82. package/docs/mcp-host-manifest.md +33 -0
  83. package/docs/mcp-report-resources.md +9 -0
  84. package/docs/mcp.md +4 -0
  85. package/docs/media-guide.md +27 -0
  86. package/docs/multi-agent-workflow-templates.md +63 -0
  87. package/docs/observability-rail.md +36 -0
  88. package/docs/quickstart.md +1 -1
  89. package/docs/rate-limit-and-fallback-policy.md +45 -0
  90. package/docs/release-workflow.md +12 -1
  91. package/docs/releases/README.md +3 -0
  92. package/docs/releases/RELEASE_NOTES_v1.1.0.md +55 -0
  93. package/docs/releases/RELEASE_NOTES_v1.2.0.md +43 -0
  94. package/docs/repo-docs-audit-2026-06-05.md +55 -0
  95. package/docs/report-rail.md +12 -0
  96. package/docs/resilience-rail.md +48 -0
  97. package/docs/schema-contracts.md +20 -0
  98. package/docs/security-boundaries.md +34 -0
  99. package/docs/skill-rail-2.md +11 -0
  100. package/docs/stable-command-surface.md +16 -1
  101. package/docs/tasklet-rail.md +62 -0
  102. package/docs/tutorial-antigravity.md +7 -2
  103. package/docs/tutorial-deep-agents-role-packs.md +4 -0
  104. package/docs/tutorial-gemini-cli.md +4 -0
  105. package/docs/tutorial-opencode.md +37 -0
  106. package/docs/v1-contract.md +5 -3
  107. package/docs/workflow-rail.md +12 -0
  108. package/examples/agents/README.md +6 -1
  109. package/examples/agents/opencode.md +26 -0
  110. package/package.json +2 -2
@@ -46,6 +46,8 @@ SotuRail should remain the local rail layer that prepares those artifacts for an
46
46
  | `murillo-romeu/sonar-totvs` | domain-specific skill/report | Skill Rail 2.0 |
47
47
  | `Acauhi99/opencode-agent-system` | OpenCode agent system packaging | OpenCode export and role/skill packaging |
48
48
  | `ComposioHQ/composio` | tool/provider integration ecosystem | compatibility manifests, not marketplace cloning |
49
+ | Hermes Agent | self-improving agent runtime, skills, routines, subagents and trajectory compression | context optimization, role packs and tasklet inspiration without becoming the runtime |
50
+ | Odysseus | self-hosted AI workspace, runtime, UI and local services | local dashboard, host-fit and evidence-report inspiration without adding a required server |
49
51
 
50
52
  ### Product Rule
51
53
 
@@ -57,6 +59,19 @@ SotuRail should absorb the durable patterns and avoid cloning products:
57
59
  - Skill Rail 2.0 should package safe domain skills but not hide risky commands.
58
60
  - Governance And Cost Rail should warn about context/workflow risk but not claim provider billing accuracy without evidence.
59
61
 
62
+ ### Hermes Agent And Odysseus Boundary
63
+
64
+ Hermes and Odysseus reinforce why SotuRail must distinguish agents from harness components:
65
+
66
+ ```txt
67
+ Agent = model + tools + state/memory + decision/execution loop.
68
+ SotuRail = local context, harness, evidence, policy and host handoff layer.
69
+ ```
70
+
71
+ Hermes contributes useful inspiration for trajectory compression, session search, toolset profiles, skills and subagent role packs. Odysseus contributes useful inspiration for local dashboard cards, host fit checks, visual evidence reports and privacy/security documentation.
72
+
73
+ SotuRail does not copy their runtime, chat UI, model serving, local-service stack or central shell behavior. See [`agent-harness-synthesis-2026.md`](agent-harness-synthesis-2026.md), [`security-boundaries.md`](security-boundaries.md) and [`conductor-mode.md`](conductor-mode.md).
74
+
60
75
  ## 2026 Agent Runtime Update
61
76
 
62
77
  Newer agent hosts are converging around the same architecture: a coding agent surface, local or cloud workspaces, MCP or tool adapters, reusable skills/instructions, hooks/approvals, context budgeting and evidence that proves the task is actually complete.
@@ -472,3 +487,53 @@ These ideas are intentionally staged after the core rails are stable:
472
487
  15. **Auth Rail**: optional agent-readable auth docs and redaction checks.
473
488
  16. **UI/Report Rail**: local HTML dashboard and optional MCP Apps/AG-UI-style event outputs.
474
489
  17. **Gateway Lite**: local event routing only after memory, context selection, policy and reports are mature.
490
+
491
+ ## 2026 Agent Harness Synthesis Update
492
+
493
+ A later review wave added QA-agent, multi-agent orchestration, pipeline-agent, self-improving harness, harness-engineering, cross-host ECC, Feynman-style provenance, book-to-skill, Tasklet and 9Router-style context-routing ideas.
494
+
495
+ See [`agent-harness-synthesis-2026.md`](agent-harness-synthesis-2026.md) for the consolidated table.
496
+
497
+ The main product update is:
498
+
499
+ ```txt
500
+ SotuRail should evolve from context manager into a local harness manager:
501
+ context + state + verification + scope + lifecycle + evidence + host export.
502
+ ```
503
+
504
+ New patterns to absorb:
505
+
506
+ - Agent QA with offline datasets and golden export checks.
507
+ - Validate -> fix -> verify -> report pipelines with evidence per stage.
508
+ - File-based handoff and provenance sidecars.
509
+ - Knowledge packs generated from docs, loaded on demand.
510
+ - Host router behavior for context formats, not model traffic.
511
+ - Rate-limit/fallback policy docs, not provider proxying.
512
+ - Human approval gates for improve/eval/apply loops.
513
+
514
+ Hard boundaries:
515
+
516
+ - no SoturAI/trading scope in SotuRail docs or exports;
517
+ - no mandatory provider APIs;
518
+ - no MITM/proxy/account/quota bypass features;
519
+ - no autonomous patching without approval;
520
+ - no hidden cloud telemetry.
521
+
522
+ ## Coverage Checklist For The 2026 Harness Review
523
+
524
+ The reviewed materials are now mapped into SotuRail planning as follows:
525
+
526
+ | Source idea | SotuRail docs now covering it |
527
+ | --- | --- |
528
+ | QA agent with tests, datasets, CI and traces | [`agent-qa-rail.md`](agent-qa-rail.md), [`eval-datasets.md`](eval-datasets.md), [`golden-agent-tests.md`](golden-agent-tests.md), [`llm-as-judge-policy.md`](llm-as-judge-policy.md) |
529
+ | CrewAI/LiteLLM-style roles, fallback and rate limits | [`multi-agent-workflow-templates.md`](multi-agent-workflow-templates.md), [`resilience-rail.md`](resilience-rail.md), [`rate-limit-and-fallback-policy.md`](rate-limit-and-fallback-policy.md) |
530
+ | Validate -> fix -> verify -> report agent pipeline | [`observability-rail.md`](observability-rail.md), [`workflow-rail.md`](workflow-rail.md), [`examples/workflows/agent-pipeline-workflow.md`](../examples/workflows/agent-pipeline-workflow.md) |
531
+ | OpenTracy-style trace, ledger, approval and experiments | [`agent-governance-rail.md`](agent-governance-rail.md), [`evidence-provenance-rail.md`](evidence-provenance-rail.md) |
532
+ | Harness engineering lifecycle | [`harness-lifecycle-rail.md`](harness-lifecycle-rail.md), [`harness-rail.md`](harness-rail.md), [`workflow-rail.md`](workflow-rail.md) |
533
+ | ECC-style cross-host harness, doctor, audit and skills | [`host-compatibility-rail.md`](host-compatibility-rail.md), [`agent-hosts.md`](agent-hosts.md), [`skill-rail-2.md`](skill-rail-2.md), [`future-rails-index.md`](future-rails-index.md) |
534
+ | Feynman-style provenance and verifier status | [`evidence-provenance-rail.md`](evidence-provenance-rail.md), [`report-rail.md`](report-rail.md) |
535
+ | book-to-skill-style document-to-skill packs | [`knowledge-rail.md`](knowledge-rail.md), [`skill-rail-2.md`](skill-rail-2.md), [`context-packs.md`](context-packs.md) |
536
+ | Tasklet-style small reusable task blocks | [`tasklet-rail.md`](tasklet-rail.md), [`workflow-rail.md`](workflow-rail.md) |
537
+ | 9Router-style router metaphor and token/context savings | [`host-router-rail.md`](host-router-rail.md), [`context-packs.md`](context-packs.md), [`governance-cost-rail.md`](governance-cost-rail.md) |
538
+
539
+ This checklist is intentionally documentation-only. Runtime implementation should happen gradually through roadmap milestones and tests.
@@ -0,0 +1,40 @@
1
+ # Eval Datasets
2
+
3
+ Eval datasets are planned local fixtures for checking whether SotuRail outputs preserve the facts, paths, warnings and contracts that agents need.
4
+
5
+ ## Dataset Shape
6
+
7
+ A minimal dataset case can include:
8
+
9
+ ```json
10
+ {
11
+ "id": "host-export-readonly-mcp",
12
+ "input": {
13
+ "command": "soturail agents export --agent claude",
14
+ "fixture": "basic-typescript-project"
15
+ },
16
+ "expected": {
17
+ "mustContain": ["read-only", "MCP", "safe next commands"],
18
+ "mustNotContain": ["destructive MCP", "cloud telemetry required"],
19
+ "jsonPaths": ["host", "capabilities", "limitations"]
20
+ }
21
+ }
22
+ ```
23
+
24
+ ## Dataset Families
25
+
26
+ | Family | What it protects |
27
+ | --- | --- |
28
+ | host compatibility | exports for Claude, Codex, Cursor, OpenCode, Gemini and generic hosts |
29
+ | context quality | selected files, commands, errors and policy notes survive compaction |
30
+ | skill routing | only task-relevant skills are selected |
31
+ | evidence/provenance | reports include source paths, verification status and missing-proof notes |
32
+ | governance/cost | huge docs, broad MCP exposure and always-loaded skills warn correctly |
33
+ | release checks | version, changelog, pack, docs and evidence are connected |
34
+
35
+ ## Rules
36
+
37
+ - Datasets must be small enough to run during normal development.
38
+ - Datasets must be deterministic by default.
39
+ - Dataset results should be written as JSON and Markdown.
40
+ - A dataset failure should say what evidence was missing, not only that text did not match.
@@ -247,3 +247,9 @@ Evaluation Suite changes should not be promoted until:
247
247
  - token savings and quality are separated;
248
248
  - benchmark reports are refreshed only when intentionally requested;
249
249
  - public claims match reproducible local results.
250
+
251
+ ## Agent QA Rail Expansion
252
+
253
+ Future Agent QA work is tracked in [`agent-qa-rail.md`](agent-qa-rail.md), [`eval-datasets.md`](eval-datasets.md), [`golden-agent-tests.md`](golden-agent-tests.md) and [`llm-as-judge-policy.md`](llm-as-judge-policy.md).
254
+
255
+ The important rule remains: default evals must stay offline, deterministic and provider-agnostic. Provider-backed judges can exist only as explicit optional integration evidence.
@@ -0,0 +1,70 @@
1
+ # Evidence And Provenance Rail
2
+
3
+ Evidence And Provenance Rail is a planned expansion that makes SotuRail reports more auditable.
4
+
5
+ The core idea:
6
+
7
+ ```txt
8
+ Every important output should say what it used, what it changed, what was verified and what is still uncertain.
9
+ ```
10
+
11
+ ## Provenance Sidecars
12
+
13
+ Reports can have sidecar files:
14
+
15
+ ```txt
16
+ .soturail/reports/<slug>.md
17
+ .soturail/reports/<slug>.provenance.md
18
+ ```
19
+
20
+ Per-run evidence can be grouped as:
21
+
22
+ ```txt
23
+ .soturail/evidence/<run-id>/
24
+ report.md
25
+ provenance.md
26
+ tests.log
27
+ files-read.json
28
+ files-changed.json
29
+ verification.json
30
+ ```
31
+
32
+ ## Verification Status Values
33
+
34
+ Use explicit status labels:
35
+
36
+ | Status | Meaning |
37
+ | --- | --- |
38
+ | `verified` | backed by local file, command, test, schema or report evidence |
39
+ | `unverified` | plausible but not proven by available evidence |
40
+ | `blocked` | cannot be verified due to missing file, command failure or unavailable dependency |
41
+ | `inferred` | derived from available evidence but not directly stated |
42
+
43
+ ## Proposed Commands
44
+
45
+ ```bash
46
+ soturail evidence collect
47
+ soturail evidence verify
48
+ soturail evidence report
49
+ soturail sources compare
50
+ soturail review report
51
+ ```
52
+
53
+ ## Report Requirements
54
+
55
+ Agent-readable reports should include:
56
+
57
+ - source paths;
58
+ - command/eval/report ids;
59
+ - changed files;
60
+ - verification status;
61
+ - missing evidence;
62
+ - safe next commands;
63
+ - redaction status.
64
+
65
+ ## Non-Goals
66
+
67
+ - no fake citations;
68
+ - no unsupported certainty;
69
+ - no cloud evidence store by default;
70
+ - no raw secret exposure in provenance files.
@@ -27,9 +27,19 @@ It is not the model, not the agent brain, not a heavy gateway and not a clone of
27
27
  | `murillo-romeu/sonar-totvs` | High | Domain-specific AI skill/report | Add Skill Rail 2.0 domain skill templates and safety gates |
28
28
  | `Acauhi99/opencode-agent-system` | Medium | OpenCode agent system patterns | Add OpenCode host export and role/skill packaging |
29
29
  | `ComposioHQ/composio` | High | Tool/provider integration layer | Stay compatible through manifests and reports, do not become a tool marketplace |
30
+ | Hermes Agent | High | Self-improving personal agent runtime with tools, skills, routines, subagents and trajectory compression | Absorb context optimization and role-pack patterns while keeping SotuRail a harness |
31
+ | Odysseus | High | Self-hosted AI workspace combining runtime, UI, local services, memory and tools | Absorb dashboard/host-fit/report patterns without adding a required server or model manager |
30
32
 
31
33
  ## What SotuRail Should Absorb
32
34
 
35
+ ### Hermes And Odysseus Classification
36
+
37
+ Hermes is an agent runtime. Odysseus is a workspace plus runtime and local-service stack. SotuRail remains the local-first harness/context OS that prepares and governs artifacts for those kinds of hosts.
38
+
39
+ Useful patterns include trajectory compression, session search, toolset profiles, role packs, local dashboard cards, visual evidence and explicit privacy boundaries. Model serving, mandatory web UI, central shell access and bundled personal productivity services remain outside SotuRail scope.
40
+
41
+ See [Agent And Harness Synthesis 2026](agent-harness-synthesis-2026.md) and [Security Boundaries](security-boundaries.md).
42
+
33
43
  ### 1. Host compatibility without becoming a host
34
44
 
35
45
  OpenCode, Claude-compatible hosts, Antigravity-style hosts, Codex, Cursor and Deep Agents-style harnesses all need different context formats, rules, reports and safety guidance.
@@ -113,3 +123,22 @@ For security-oriented workflows, SotuRail should emphasize:
113
123
  | v1.3.0 Knowledge Graph Rail | Understand-Anything and Project Brain evolution |
114
124
  | v1.4.0 Skill Rail 2.0 | Sonar/TOTVS-style domain skill, Deep Agents skills, host exports |
115
125
  | v1.5.0 Governance And Cost Rail | dynamic workflows, long-horizon agents, context/token budget risks |
126
+
127
+ ## 2026 Harness/Eval/Provenance Review Addendum
128
+
129
+ This addendum records the later review wave that directly affects post-v1 docs and roadmap planning.
130
+
131
+ | Project/Product | Confidence | Primary pattern | SotuRail action |
132
+ | --- | --- | --- | --- |
133
+ | `ijmf/qa-ai-agent` | High | Agent QA through tests, datasets, traces and CI | Add Agent QA Rail, eval datasets, golden exports and optional judge policy |
134
+ | `duckdogersxd/Orquestrando-Agents-CrewAI` | Medium | Multi-agent role workflow plus fallback/rate-limit lessons | Add multi-agent workflow templates and Resilience Rail notes |
135
+ | `CaioTakedaIA/agentesdeIA` | Medium | Validate/fix/revalidate/analyze pipeline with visible logs | Add pipeline recorder concept and dashboard timeline ideas |
136
+ | `OpenTracy/OpenTracy` | High | Propose/eval/approve/apply loop, trace, ledger and candidates | Add Agent Governance/Evolution Rail after governance foundations |
137
+ | `walkinglabs/learn-harness-engineering` | High | Instructions, state, verification, scope, lifecycle | Add Harness Lifecycle Rail docs and feature/session handoff planning |
138
+ | `affaan-m/ECC` | High | Cross-host harness system with skills/rules/doctor/repair/install state | Add install profiles, audit score, skills/rules profiles and host export polish |
139
+ | `companion-inc/feynman` | High | Provenance sidecars and verification statuses | Add Evidence/Provenance Rail |
140
+ | `virgiliojr94/book-to-skill` | High | Document-to-skill with on-demand chapters/glossary/patterns | Add Knowledge Rail and skill build/fold-in planning |
141
+ | Tasklet.ai | Low | Public information was limited; small reusable task concept only | Add Tasklet Rail as local templates, not a vendor integration |
142
+ | 9Router | Medium | Router metaphor, multi-host compatibility, token/context savings | Add Host Router Rail for context exports; explicitly avoid proxy/MITM behavior |
143
+
144
+ The safe SotuRail interpretation is to generate local artifacts for external agents, not to become a model router, hosted agent platform, provider gateway or automation system that edits without approval.
@@ -19,16 +19,19 @@ SotuRail should remain:
19
19
  - independent from any single agent host;
20
20
  - small enough to use in normal developer projects.
21
21
 
22
- v1.0.0 freezes the first stable local Context OS surface. The post-v1 sequence remains staged:
22
+ v1.0.0 froze the first stable local Context OS surface. v1.1.0 delivered Host Compatibility Rail 1.0. The remaining post-v1 sequence is now staged with the 2026 agent-harness synthesis:
23
23
 
24
24
  ```txt
25
- v1.1.0 Host Compatibility Rail
26
- v1.2.0 Spec, Design And Diagram Rail
27
- v1.3.0 Knowledge Graph Rail
28
- v1.4.0 Skill Rail 2.0
29
- v1.5.0 Governance And Cost Rail
25
+ v1.1.1 Host Compatibility Polish, ecosystem docs and golden export checks
26
+ v1.2.0 Spec, Design, Diagram and Harness Lifecycle Rail
27
+ v1.3.0 Knowledge, Evidence and Evaluation Rail
28
+ v1.4.0 Skill Rail 2.0, Knowledge-to-Skill and Tasklet Packs
29
+ v1.5.0 Governance, Cost, Resilience and Host Router Rail
30
+ v1.6.0 Agent Governance / Evolution Rail
30
31
  ```
31
32
 
33
+ v1.2.0 also delivers a focused Harness Lifecycle slice: safe scaffold initialization, lifecycle audit, feature state, sessions and handoffs. Spec/design/diagram expansion remains staged and must be documented honestly when not implemented.
34
+
32
35
  ## 2026 Agent Runtime Update
33
36
 
34
37
  The newest planning layer is tracked in [`docs/roadmap-agent-runtime-addendum.md`](roadmap-agent-runtime-addendum.md).
@@ -56,6 +59,7 @@ It tightens how the future rails connect around current agent-runtime patterns:
56
59
  | MCP Exposure Rail | Report exposed MCP tools/resources/prompts/roots and local risk notes | v0.5.0 seed | `docs/roadmap-agent-runtime-addendum.md`, `docs/mcp.md`, `docs/policy-rail.md` |
57
60
  | Skill Boundary Rail | Route skills by task, role, evidence and host capability instead of always loading them | v0.5.0 seed | `docs/roadmap-agent-runtime-addendum.md`, `docs/skill-rail.md` |
58
61
  | Harness Rail | setup/plan/work/review/release discipline, evidence packs and failure ledger | v0.5.0 seeds, v0.7.0 expansion | `docs/harness-rail.md`, `docs/workflow-rail.md` |
62
+ | Harness Lifecycle Rail | Safe local instructions, state, sessions, features, audits and handoffs | v1.2.0 implemented | `docs/harness-lifecycle-rail.md`, `docs/security-boundaries.md` |
59
63
  | Acceptance Harness Contracts | Require build/typecheck/lint/test/coverage/docs/policy gates before accepting work | v0.5.0 seed, v0.7.0 expansion | `docs/roadmap-agent-runtime-addendum.md`, `docs/harness-rail.md` |
60
64
  | Policy Rail | Rules, approvals, risky action queue, auth checks and MCP exposure reports | v0.5.0+ | `docs/policy-rail.md`, `docs/security-model.md`, `docs/rules.md` |
61
65
  | Structured Payload Rail | Target-aware Markdown/JSON/tagged/TOON-table/Mermaid context formats | v0.5.1+ | `docs/structured-payload-rail.md`, `docs/context-packs.md` |
@@ -66,7 +70,14 @@ It tightens how the future rails connect around current agent-runtime patterns:
66
70
  | Evaluation Suite | Quality benchmarks for context, payload formats, diagrams, evidence and role packs | v0.6.1 | `docs/evaluation-suite.md`, `docs/benchmarking.md`, `ROADMAP.md` |
67
71
  | Reverse Specification Rail | Turn existing code/docs/config/logs into claims, rules, specs, gaps and validation tasks | v0.8.0 primary | `docs/reverse-specification-rail.md`, `docs/knowledge-to-rules.md` |
68
72
  | Project Brain | Verified claims, decisions, bugs, gaps, rules, stale events and agent-safe briefs | v0.8.0 | `docs/project-brain.md`, `ROADMAP.md` |
69
- | Host Compatibility Rail | Host-aware exports, capability matrix and conservative prompt-only fallback for OpenCode, Antigravity, Claude, Codex, Cursor, Deep Agents-style and generic hosts | v1.1.0 | `docs/host-compatibility-rail.md`, `docs/agents.md`, `docs/mcp.md` |
73
+ | Host Compatibility Rail | Host-aware exports, capability matrix, host doctors and conservative prompt-only fallback for OpenCode, Antigravity, Claude, Codex, Cursor, Deep Agents-style and generic hosts | v1.1.0 implemented | `docs/host-compatibility-rail.md`, `docs/agents.md`, `docs/mcp.md`, `docs/agent-export-contract.md` |
74
+ | Agent QA Rail | Offline datasets, golden exports, regression reports and optional LLM-as-judge policy | v1.1.1 docs, v1.3.0 planned | `docs/agent-qa-rail.md`, `docs/eval-datasets.md`, `docs/golden-agent-tests.md`, `docs/llm-as-judge-policy.md` |
75
+ | Evidence And Provenance Rail | Provenance sidecars, verification statuses and evidence per run/report | v1.3.0 | `docs/evidence-provenance-rail.md`, `docs/report-rail.md`, `docs/filesystem-evidence-rail.md` |
76
+ | Knowledge Rail | Compile docs/specs/notes into on-demand SKILL.md/topic/glossary/pattern packs | v1.3.0 docs, v1.4.0 skill integration | `docs/knowledge-rail.md`, `docs/skill-rail-2.md`, `docs/project-brain.md` |
77
+ | Resilience Rail | Rate-limit, fallback and provider-risk documentation/reporting without proxying traffic | v1.5.0 | `docs/resilience-rail.md`, `docs/rate-limit-and-fallback-policy.md`, `docs/governance-cost-rail.md` |
78
+ | Host Router Rail | Route one local context source into host-specific export formats with safe fallback | v1.5.0 | `docs/host-router-rail.md`, `docs/host-compatibility-rail.md`, `docs/context-packs.md` |
79
+ | Tasklet Rail | Small local reusable task templates for agents | v1.4.0 exploration | `docs/tasklet-rail.md`, `docs/skill-rail-2.md`, `docs/workflow-rail.md` |
80
+ | Agent Governance/Evolution Rail | Trace, ledger, experiments, approval gates and improve/eval/apply loop | v1.6.0 | `docs/agent-governance-rail.md`, `docs/evaluation-suite.md`, `docs/policy-rail.md` |
70
81
  | Spec Rail | PRD, requirements, design, tasks and acceptance criteria as workflow inputs | v1.2.0 | `docs/spec-driven-workflow.md`, `docs/design-rail.md`, `docs/diagram-rail.md` |
71
82
  | Design Rail | Local `DESIGN.md`, design token lint/diff/export and agent-readable visual guidance | v1.2.0 | `docs/design-rail.md`, `docs/dashboard-rail.md` |
72
83
  | Knowledge Graph Rail | Local graph of files, claims, decisions, tests, workflows, diagrams and releases | v1.3.0 | `docs/knowledge-graph-rail.md`, `docs/code-graph.md`, `docs/project-brain.md` |
@@ -74,6 +85,7 @@ It tightens how the future rails connect around current agent-runtime patterns:
74
85
  | Governance And Cost Rail | Context budget, dynamic workflow risk and MCP/skill exposure warnings | v1.5.0 | `docs/governance-cost-rail.md`, `docs/report-rail.md`, `docs/policy-rail.md` |
75
86
  | Redacted Evidence Sharing | Local redacted evidence bundles for reports/logs without hosting by default | v1.4+ exploration | `docs/report-redaction.md`, `docs/external-projects-audit.md` |
76
87
  | Local Dashboard | Local reports, trace viewer, Mermaid rendering and policy/evidence views | v0.10.0 | `ROADMAP.md` |
88
+ | SotuRail Conductor | Optional future planner/verifier/reviewer/tasklet coordinator behind approval gates | Future proposed | `docs/conductor-mode.md`, `docs/security-boundaries.md` |
77
89
 
78
90
  ## Version Summary
79
91
 
@@ -214,15 +226,27 @@ Focus:
214
226
 
215
227
  Focus:
216
228
 
217
- - Host Compatibility Rail;
218
- - OpenCode, Antigravity, Deep Agents-style and generic host exports;
219
- - host capability matrix;
229
+ - Host Compatibility Rail 1.0 delivered;
230
+ - OpenCode, Antigravity, DeepAgents-style, Gemini legacy-compatible and generic host exports;
231
+ - host capability matrix 2.0 fields with backward-compatible schema;
232
+ - per-host doctor reports;
220
233
  - read-only MCP host manifests.
221
234
 
235
+ ### v1.1.1
236
+
237
+ Focus:
238
+
239
+ - 2026 agent-harness synthesis docs;
240
+ - Agent QA, golden export and optional judge policy docs;
241
+ - Evidence/Provenance, Knowledge, Resilience, Host Router, Tasklet and Agent Governance planning docs;
242
+ - validate -> fix -> verify -> report workflow example;
243
+ - multi-agent researcher/analyst/writer/verifier template example.
244
+
222
245
  ### v1.2.0
223
246
 
224
247
  Focus:
225
248
 
249
+ - Harness Lifecycle Rail implemented with `harness init`, `harness audit`, sessions, handoffs and feature state;
226
250
  - Spec, Design And Diagram Rail;
227
251
  - PRD/requirements/design/tasks scaffolds;
228
252
  - local `DESIGN.md` lint/diff/export;
@@ -232,29 +256,47 @@ Focus:
232
256
 
233
257
  Focus:
234
258
 
235
- - Knowledge Graph Rail;
259
+ - Knowledge, Evidence and Evaluation Rail;
236
260
  - graph build/explain/impact/tour;
237
- - local dashboard graph views;
238
- - stale-edge detection.
261
+ - Knowledge Rail ingest/estimate/compile/update/verify;
262
+ - evidence and provenance sidecars;
263
+ - local eval datasets, golden checks and regression reports;
264
+ - optional LLM-as-judge outside default release gates;
265
+ - stale-edge and missing-evidence detection.
239
266
 
240
267
  ### v1.4.0
241
268
 
242
269
  Focus:
243
270
 
244
- - Skill Rail 2.0;
271
+ - Skill Rail 2.0, Knowledge-to-Skill and Tasklet Packs;
245
272
  - domain skill templates;
246
273
  - skill lint/eval/report;
247
- - role-aware exports and safety gates.
274
+ - role-aware exports and safety gates;
275
+ - `skill build` and `skill fold-in` planning;
276
+ - small reusable tasklet templates.
248
277
 
249
278
  ### v1.5.0
250
279
 
251
280
  Focus:
252
281
 
253
- - Governance And Cost Rail;
254
- - context budget reports;
282
+ - Governance, Cost, Resilience and Host Router Rail;
283
+ - context budget reports and compact context variants;
284
+ - rate-limit/fallback policy reports;
285
+ - host-format fallback without provider proxying;
255
286
  - dynamic workflow guardrails;
256
287
  - MCP/skill exposure risk summaries.
257
288
 
289
+ ### v1.6.0
290
+
291
+ Focus:
292
+
293
+ - Agent Governance / Evolution Rail;
294
+ - trace and ledger artifacts;
295
+ - agent boundary policy;
296
+ - experiments/candidates/results;
297
+ - propose -> eval -> approve -> apply loop;
298
+ - approval gates before any patch application.
299
+
258
300
 
259
301
  ## What Should Not Happen
260
302
 
@@ -298,3 +340,19 @@ SotuRail should not become:
298
340
  - `docs/ecosystem-influences.md`
299
341
  - `docs/comparisons.md`
300
342
  - `docs/roadmap-harness-diagram-payload-addendum.md`
343
+ - `docs/agent-harness-synthesis-2026.md`
344
+ - `docs/agent-qa-rail.md`
345
+ - `docs/eval-datasets.md`
346
+ - `docs/golden-agent-tests.md`
347
+ - `docs/llm-as-judge-policy.md`
348
+ - `docs/evidence-provenance-rail.md`
349
+ - `docs/agent-governance-rail.md`
350
+ - `docs/harness-lifecycle-rail.md`
351
+ - `docs/knowledge-rail.md`
352
+ - `docs/resilience-rail.md`
353
+ - `docs/rate-limit-and-fallback-policy.md`
354
+ - `docs/multi-agent-workflow-templates.md`
355
+ - `docs/host-router-rail.md`
356
+ - `docs/tasklet-rail.md`
357
+ - `docs/security-boundaries.md`
358
+ - `docs/conductor-mode.md`
@@ -0,0 +1,44 @@
1
+ # Golden Agent Tests
2
+
3
+ Golden agent tests are snapshot-like checks for agent-facing outputs. They are not tests of a real LLM. They protect SotuRail exports, reports and context packs from accidental regressions.
4
+
5
+ ## Golden Targets
6
+
7
+ Planned golden targets:
8
+
9
+ - `AGENTS.md` guidance generated by `harness init`;
10
+ - Claude, Codex, Cursor, OpenCode, Gemini and generic exports;
11
+ - host matrix JSON;
12
+ - MCP host manifest JSON;
13
+ - report and dashboard summaries;
14
+ - skill export bundles;
15
+ - tasklet definitions;
16
+ - evidence/provenance sidecars.
17
+
18
+ ## What A Golden Test Should Check
19
+
20
+ Golden tests should favor semantic assertions over brittle full-file string matches:
21
+
22
+ ```txt
23
+ must include: local-first boundary
24
+ must include: safe next commands
25
+ must include: read-only MCP warning
26
+ must include: evidence paths when available
27
+ must not include: secrets
28
+ must not include: destructive tool promises
29
+ must not include: unrelated project identity
30
+ must parse: JSON artifacts
31
+ must keep: schemaVersion
32
+ ```
33
+
34
+ ## Update Policy
35
+
36
+ Golden outputs should be updated deliberately:
37
+
38
+ ```bash
39
+ soturail eval golden --update
40
+ soturail eval report
41
+ soturail release check --strict --with-evals
42
+ ```
43
+
44
+ A golden change should be explained in release evidence. If the change affects host behavior, update host docs too.
@@ -79,3 +79,13 @@ soturail brain stale --repair-plan
79
79
  | MCP Report Resources | exposure inventory |
80
80
  | Workflow Rail | phase depth and evidence completeness |
81
81
  | Benchmark Rail | performance evidence and stale report warnings |
82
+
83
+ ## Resilience And Host Router Expansion
84
+
85
+ Future v1.5 planning now includes Resilience Rail and Host Router Rail:
86
+
87
+ - [`resilience-rail.md`](resilience-rail.md) for retry/fallback/rate-limit documentation and risk reports;
88
+ - [`rate-limit-and-fallback-policy.md`](rate-limit-and-fallback-policy.md) for local policy shape;
89
+ - [`host-router-rail.md`](host-router-rail.md) for context-format routing across hosts.
90
+
91
+ This does not turn SotuRail into a model proxy, account manager, MITM bridge or billing gateway.
@@ -0,0 +1,95 @@
1
+ # Harness Lifecycle Rail
2
+
3
+ Harness Lifecycle Rail is the implemented v1.2.0 local state layer for carrying agent-assisted work across sessions and hosts without turning SotuRail into an autonomous agent runtime.
4
+
5
+ It organizes five subsystems:
6
+
7
+ ```txt
8
+ Instructions
9
+ State
10
+ Verification
11
+ Scope
12
+ Session Lifecycle
13
+ ```
14
+
15
+ The purpose is to keep coding agents in scope across sessions and prevent premature "done" states.
16
+
17
+ ## Implemented Commands
18
+
19
+ ```bash
20
+ soturail harness init
21
+ soturail harness audit
22
+ soturail harness audit --json
23
+ soturail session start "objective"
24
+ soturail session end --summary "completed work"
25
+ soturail handoff generate
26
+ soturail feature add "feature"
27
+ soturail feature start <id>
28
+ soturail feature done <id> --evidence tests/example.test.ts
29
+ soturail feature list
30
+ ```
31
+
32
+ `harness init` creates local files without overwriting existing content:
33
+
34
+ ```txt
35
+ .soturail/harness/AGENTS.md
36
+ .soturail/harness/instructions.md
37
+ .soturail/harness/verification.md
38
+ .soturail/harness/scope.md
39
+ .soturail/harness/lifecycle.md
40
+ .soturail/state/feature_list.json
41
+ .soturail/state/progress.md
42
+ .soturail/state/session-handoff.md
43
+ ```
44
+
45
+ Use `--force` only after reviewing the scaffold files that will be replaced.
46
+
47
+ ## Audit Model
48
+
49
+ `harness audit` checks Instructions, State, Verification, Scope, Session Lifecycle, Host Compatibility, Evidence/Reports and Security Boundaries. It writes:
50
+
51
+ ```txt
52
+ .soturail/harness/audit.json
53
+ .soturail/harness/audit.md
54
+ ```
55
+
56
+ The audit is deterministic and read-only. It does not run commands from `verification.md`.
57
+
58
+ ## Feature And Session State
59
+
60
+ Feature lists prevent agents from doing many tasks and finishing none. `feature_list.json` has the stable local shape:
61
+
62
+ ```json
63
+ {
64
+ "schemaVersion": "soturail.feature-list.v1",
65
+ "active": null,
66
+ "features": []
67
+ }
68
+ ```
69
+
70
+ Only one feature can be active. Completion evidence is recorded as paths or local references supplied by the user.
71
+
72
+ `handoff generate` writes a bounded handoff with the current objective, completed work, changed-file names, verification status, blockers and next steps. It does not read private shell history or run verification automatically.
73
+
74
+ ## Progressive Disclosure
75
+
76
+ Root agent docs should stay short and point to specialized docs.
77
+
78
+ ```txt
79
+ Read first: .soturail/harness/AGENTS.md
80
+ If editing tests: .soturail/harness/verification.md
81
+ If continuing work: .soturail/state/session-handoff.md
82
+ If preparing release: docs/release-workflow.md
83
+ ```
84
+
85
+ ## Planned Extensions
86
+
87
+ Commands such as `harness benchmark`, `session verify` and a dedicated `session handoff` alias remain proposed. They are not implemented in v1.2.0.
88
+
89
+ ## Boundaries
90
+
91
+ - SotuRail prepares lifecycle state and evidence; the agent host still reasons and edits.
92
+ - No cloud telemetry, mandatory server or LLM API key is required.
93
+ - No destructive MCP tool or arbitrary MCP shell execution is added.
94
+ - No Claude-only harness, giant root instruction file or acceptance without evidence.
95
+ - See [Security Boundaries](security-boundaries.md), [Harness Rail](harness-rail.md), [Conductor Mode](conductor-mode.md) and [Agent Harness Synthesis](agent-harness-synthesis-2026.md).
@@ -15,6 +15,11 @@ Harness Rail focuses on workflow discipline, policy decisions, review evidence,
15
15
 
16
16
  ```bash
17
17
  soturail harness note "agent said done before tests passed"
18
+ soturail harness init
19
+ soturail harness audit
20
+ soturail session start "objective"
21
+ soturail handoff generate
22
+ soturail feature list
18
23
  soturail harness list
19
24
  soturail harness explain <id>
20
25
  soturail harness doctor
@@ -25,6 +30,12 @@ soturail workflow evidence <id>
25
30
 
26
31
  `harness contract check` validates the local contract. It does not run build, typecheck or test commands by default.
27
32
 
33
+ ## v1.2.0 Harness Lifecycle
34
+
35
+ Harness Lifecycle Rail adds safe project-local state for instructions, scope, verification, sessions, handoffs and features. `harness init` preserves existing files by default, and `harness audit` scores lifecycle readiness without executing verification commands.
36
+
37
+ See [Harness Lifecycle Rail](harness-lifecycle-rail.md) and [Security Boundaries](security-boundaries.md).
38
+
28
39
  ## v0.7.0 Workflow Connection
29
40
 
30
41
  Harness Rail now connects to Workflow Rail 2.0:
@@ -139,3 +150,19 @@ Harness Rail is successful only if it makes SotuRail more predictable without ma
139
150
  - tests cover clean workflow fixtures;
140
151
  - reports distinguish token savings from quality preservation;
141
152
  - no arbitrary shell execution is exposed through MCP by default.
153
+
154
+ ## Harness Lifecycle Expansion
155
+
156
+ Future harness lifecycle work is tracked in [`harness-lifecycle-rail.md`](harness-lifecycle-rail.md).
157
+
158
+ The expansion adds five explicit subsystems:
159
+
160
+ ```txt
161
+ Instructions
162
+ State
163
+ Verification
164
+ Scope
165
+ Session Lifecycle
166
+ ```
167
+
168
+ The goal is to make `harness init`, `harness audit`, `session start/end`, feature lists and handoff files first-class local artifacts without becoming a Claude-only plugin or autonomous runtime.