@azure-id/orc 1.9.2 → 2.0.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +321 -0
- package/README-id.md +21 -36
- package/README.md +25 -36
- package/bin/build-agents.js +117 -20
- package/bin/cli.js +725 -29
- package/bin/gotcha-import.js +1081 -0
- package/bin/gotcha.js +1286 -0
- package/bin/graph-query.js +1 -1
- package/bin/graph.js +717 -717
- package/bin/habit.js +1453 -0
- package/bin/mockrun-catalog.js +281 -276
- package/bin/run-undo.js +398 -0
- package/bin/trace-write.js +657 -0
- package/bin/verify-contracts.js +525 -79
- package/bin/verify-package.js +51 -4
- package/bin/webui/api.js +26 -0
- package/bin/webui/app.html +239 -232
- package/bin/webui/css/00-tokens.css +110 -92
- package/bin/webui/css/04-motion.css +87 -0
- package/bin/webui/css/06-responsive.css +203 -178
- package/bin/webui/css/panels/behaviour.css +205 -0
- package/bin/webui/fixtures/behaviour.js +532 -0
- package/bin/webui/fixtures/index.js +34 -0
- package/bin/webui/fixtures/knowledge.js +7 -1
- package/bin/webui/fixtures/stats.js +16 -0
- package/bin/webui/i18n/en/behaviour.json +143 -0
- package/bin/webui/i18n/en/nav.json +25 -24
- package/bin/webui/i18n/en/tour.json +37 -35
- package/bin/webui/i18n/id/behaviour.json +143 -0
- package/bin/webui/i18n/id/nav.json +25 -24
- package/bin/webui/i18n/id/tour.json +37 -35
- package/bin/webui/js/01-i18n.js +155 -154
- package/bin/webui/js/90-tour.js +498 -494
- package/bin/webui/js/91-shortcuts.js +126 -126
- package/bin/webui/js/99-boot.js +121 -118
- package/bin/webui/js/panels/behaviour.js +1022 -0
- package/mock-run/INDEX.md +109 -107
- package/mock-run/gotcha-import.md +118 -0
- package/mock-run/habits.md +129 -0
- package/mock-run/orc-quick.md +6 -1
- package/package.json +1 -1
- package/templates/agents/MODEL-MAPPING.md +7 -7
- package/templates/agents/orc-advisor-opus-5-xhigh.md +1 -7
- package/templates/agents/orc-analyze-mini-opus-5-med.md +1 -6
- package/templates/agents/orc-analyze-mini-sonnet-5-high.md +1 -4
- package/templates/agents/orc-claude-writer-opus-4-8-high.md +48 -53
- package/templates/agents/orc-claude-writer-opus-5-med.md +1 -8
- package/templates/agents/orc-context-combiner-opus-5-high.md +1 -11
- package/templates/agents/orc-executor-haiku-4-5.md +14 -6
- package/templates/agents/orc-executor-opus-4-7-high.md +14 -6
- package/templates/agents/orc-executor-opus-4-7-med.md +14 -6
- package/templates/agents/orc-executor-opus-4-8-high.md +14 -6
- package/templates/agents/orc-executor-opus-5-high.md +14 -6
- package/templates/agents/orc-executor-opus-5-low.md +14 -6
- package/templates/agents/orc-executor-opus-5-med.md +14 -6
- package/templates/agents/orc-executor-sonnet-4-6-high.md +14 -6
- package/templates/agents/orc-executor-sonnet-4-6-med.md +14 -6
- package/templates/agents/orc-executor-sonnet-5-high.md +14 -6
- package/templates/agents/orc-graph-noter-sonnet-4-6-med.md +1 -10
- package/templates/agents/orc-judge-opus-5-xhigh.md +5 -9
- package/templates/agents/orc-learn-writer-opus-5-low.md +1 -7
- package/templates/agents/orc-pattern-codifier-opus-5-med.md +1 -8
- package/templates/agents/orc-pattern-codifier-sonnet-5-high.md +58 -63
- package/templates/agents/orc-planner-mini-opus-5-med.md +1 -4
- package/templates/agents/orc-planner-mini-sonnet-5-high.md +1 -2
- package/templates/agents/orc-planner-opus-5-med.md +1 -4
- package/templates/agents/orc-recon-opus-5-low.md +1 -8
- package/templates/agents/orc-recon-sonnet-4-6-med.md +1 -8
- package/templates/agents/orc-retro-opus-5-med.md +6 -8
- package/templates/agents/orc-retro-sonnet-5-high.md +6 -7
- package/templates/agents/orc-reviewer-opus-5-med.md +52 -16
- package/templates/agents/orc-scout-opus-5-low.md +1 -6
- package/templates/agents/orc-scout-sonnet-4-6-high.md +35 -39
- package/templates/agents/orc-system-analyst-opus-5-high.md +1 -6
- package/templates/agents/orc-test-author-opus-5-med.md +4 -5
- package/templates/agents/orc-trace-writer-haiku-4-5.md +3 -7
- package/templates/agents/orc-verifier-opus-5-med.md +16 -8
- package/templates/agents/orc-wiki-scanner-opus-4-8-high.md +74 -79
- package/templates/agents/orc-wiki-scanner-opus-5-med.md +1 -8
- package/templates/agents/orc-wiki-scanner-sonnet-5-high.md +97 -106
- package/templates/commands/orc-analyze.md +13 -21
- package/templates/commands/orc-fast.md +10 -15
- package/templates/commands/orc-poly.md +12 -21
- package/templates/commands/orc-pr-driver.md +11 -30
- package/templates/commands/orc-pr-setup.md +10 -31
- package/templates/commands/orc-route.md +11 -41
- package/templates/commands/orc-test.md +5 -60
- package/templates/hooks/README.md +34 -0
- package/templates/hooks/orc-session-hook.js +264 -0
- package/templates/hooks/orc-statusline.js +3 -1
- package/templates/skills/_shared/README.md +9 -0
- package/templates/skills/_shared/code-graph.md +47 -55
- package/templates/skills/_shared/config-precedence.md +3 -1
- package/templates/skills/_shared/extra-dispatch.md +73 -88
- package/templates/skills/_shared/gotchas.md +228 -177
- package/templates/skills/_shared/habits.md +101 -0
- package/templates/skills/_shared/lane-contract.md +84 -0
- package/templates/skills/_shared/phases/README.md +142 -83
- package/templates/skills/_shared/phases/analyst-gates.md +10 -21
- package/templates/skills/_shared/phases/execution.md +8 -14
- package/templates/skills/_shared/phases/house-rules.md +27 -32
- package/templates/skills/_shared/phases/intake.md +127 -133
- package/templates/skills/_shared/phases/mock-example.md +46 -56
- package/templates/skills/_shared/phases/plan-handoff.md +91 -97
- package/templates/skills/_shared/phases/planning.md +7 -17
- package/templates/skills/_shared/phases/preflight.md +19 -42
- package/templates/skills/_shared/phases/review.md +23 -27
- package/templates/skills/_shared/phases/rules.md +18 -42
- package/templates/skills/_shared/phases/scoring.md +55 -65
- package/templates/skills/_shared/phases/security-checklist.md +46 -50
- package/templates/skills/_shared/phases/security.md +45 -55
- package/templates/skills/_shared/phases/ship.md +6 -15
- package/templates/skills/_shared/phases/stop-resume.md +2 -5
- package/templates/skills/_shared/phases/summary.md +73 -48
- package/templates/skills/_shared/phases/testgen.md +41 -51
- package/templates/skills/_shared/phases/trace-verbs.md +433 -0
- package/templates/skills/_shared/phases/trace.md +136 -367
- package/templates/skills/_shared/phases/verify.md +62 -70
- package/templates/skills/_shared/phases/wave-grouping.md +128 -133
- package/templates/skills/_shared/phases/wiki-consult.md +10 -6
- package/templates/skills/_shared/read-ladder.md +2 -55
- package/templates/skills/_shared/return-validation.md +17 -70
- package/templates/skills/_shared/review-slice.md +79 -0
- package/templates/skills/_shared/smoke-gate.md +46 -28
- package/templates/skills/context-combiner/SKILL.md +15 -44
- package/templates/skills/orc/SKILL.md +34 -62
- package/templates/skills/orc/references/pattern-gate.md +89 -89
- package/templates/skills/orc/references/phases/intake.md +41 -47
- package/templates/skills/orc/references/phases/integration.md +13 -19
- package/templates/skills/orc/references/preflight-report.md +8 -9
- package/templates/skills/orc/references/ultra-mode.md +8 -6
- package/templates/skills/orc/subskills/orc-execution/SKILL.md +27 -73
- package/templates/skills/orc/subskills/orc-execution/core.md +12 -99
- package/templates/skills/orc/subskills/orc-execution/subagent.md +14 -13
- package/templates/skills/orc/subskills/orc-review-verify/SKILL.md +11 -52
- package/templates/skills/orc/subskills/orc-review-verify/core.md +52 -135
- package/templates/skills/orc/subskills/orc-review-verify/subagent.md +7 -7
- package/templates/skills/orc/subskills/orc-testgen/SKILL.md +11 -22
- package/templates/skills/orc/subskills/orc-testgen/core.md +20 -59
- package/templates/skills/orc/subskills/orc-testgen/subagent.md +7 -7
- package/templates/skills/orc-advisor/SKILL.md +56 -60
- package/templates/skills/orc-analyze/SKILL.md +30 -66
- package/templates/skills/orc-analyze/schemas/report-audit.md +2 -1
- package/templates/skills/orc-analyze/schemas/report-prose.md +2 -1
- package/templates/skills/orc-analyze-mini/SKILL.md +35 -70
- package/templates/skills/orc-diy/README.md +31 -0
- package/templates/skills/orc-diy/SKILL.md +23 -74
- package/templates/skills/orc-diy/references/blocks/pattern.md +18 -18
- package/templates/skills/orc-fast/SKILL.md +44 -72
- package/templates/skills/orc-judge/SKILL.md +77 -82
- package/templates/skills/orc-mini/SKILL.md +61 -109
- package/templates/skills/orc-pattern/SKILL.md +27 -48
- package/templates/skills/orc-poly/SKILL.md +32 -61
- package/templates/skills/orc-pr-driver/SKILL.md +25 -51
- package/templates/skills/orc-pr-driver/references/green-gate.md +113 -105
- package/templates/skills/orc-pr-setup/SKILL.md +20 -45
- package/templates/skills/orc-quick/README.md +43 -2
- package/templates/skills/orc-quick/SKILL.md +76 -107
- package/templates/skills/orc-quick/references/dispatch-gate.md +16 -5
- package/templates/skills/orc-quick/references/gh-mode.md +48 -1
- package/templates/skills/orc-quick/references/look.md +3 -1
- package/templates/skills/orc-retro/SKILL.md +19 -18
- package/templates/skills/orc-retro/examples/retro-mock.md +1 -1
- package/templates/skills/orc-route/SKILL.md +25 -45
- package/templates/skills/orc-test/SKILL.md +16 -37
- package/templates/skills/orc-verify/SKILL.md +14 -32
- package/templates/skills/orc-wait/SKILL.md +156 -163
- package/templates/skills/orc-wiki/references/phases/phase-0.md +1 -6
- package/templates/skills/orc-wiki/references/phases/phase-1.md +1 -6
- package/templates/skills/orc-wiki/references/phases/phase-2.md +1 -6
- package/templates/skills/orc-wiki/references/phases/phase-3.md +1 -6
- package/templates/skills/orc-wiki/references/phases/phase-3c.md +1 -6
|
@@ -1,13 +1,14 @@
|
|
|
1
|
-
# orc-execution — Subagent wrapper (orchestrator prepends this at spawn)
|
|
2
|
-
|
|
3
|
-
You are an isolated execution worker. You have no memory of the wider run
|
|
4
|
-
beyond the slice below. Do exactly one task.
|
|
5
|
-
|
|
6
|
-
- Work only within your slice's declared_files and worktree_path (if set).
|
|
7
|
-
- Do not touch the checkpoint, state-of-play, or the raw decision log — your
|
|
8
|
-
log_entries are returned, and the orchestrator appends them.
|
|
9
|
-
- Emit milestone pings as you progress.
|
|
10
|
-
- When done (or blocked), emit the return structure
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
1
|
+
# orc-execution — Subagent wrapper (orchestrator prepends this at spawn)
|
|
2
|
+
|
|
3
|
+
You are an isolated execution worker. You have no memory of the wider run
|
|
4
|
+
beyond the slice below. Do exactly one task.
|
|
5
|
+
|
|
6
|
+
- Work only within your slice's declared_files and worktree_path (if set).
|
|
7
|
+
- Do not touch the checkpoint, state-of-play, or the raw decision log — your
|
|
8
|
+
log_entries are returned, and the orchestrator appends them.
|
|
9
|
+
- Emit milestone pings as you progress.
|
|
10
|
+
- When done (or blocked), emit the return structure your agent file defines
|
|
11
|
+
and STOP.
|
|
12
|
+
Do not continue past your task.
|
|
13
|
+
|
|
14
|
+
[Orchestrator: append the input slice here at spawn time.]
|
|
@@ -17,58 +17,17 @@ description: >
|
|
|
17
17
|
|
|
18
18
|
# orc-review-verify
|
|
19
19
|
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
(file:line findings, P1–P3 by impact, never auto-P0); classify EVERY
|
|
32
|
-
finding on the ladder — **P0** (failing tests/build, unmet acceptance
|
|
33
|
-
criteria, runtime errors, invariant violations — caller auto-fixes, no ask),
|
|
34
|
-
**P1** (correctness/security risk, constraint violations — caller asks the
|
|
35
|
-
user before fixing), **P2** (maintainability — advisory fix-batch offer),
|
|
36
|
-
**P3** (cosmetic — advisory, counted). Never fix P2/P3; P0/P1 fixes are the
|
|
37
|
-
caller's call. **Evidence-or-advisory:** every P0–P2 finding carries
|
|
38
|
-
`file:line` + the offending line(s) quoted VERBATIM; an unanchored finding is
|
|
39
|
-
AUTO-P3 (never gates, never triggers a fix) — the caller spot-checks quotes
|
|
40
|
-
before acting on P0/P1.
|
|
41
|
-
- **phase=verify (two halves, v0.33.0):** FIRST the **TDD gate** — run the
|
|
42
|
-
plan's TDD suite (`tdd_suite[]` in the slice) plus the build + full test
|
|
43
|
-
suite; green is the definition-of-done for non-exempt requirements, and each
|
|
44
|
-
red TDD test is a P0 tied to its requirement (the caller owns the
|
|
45
|
-
`tdd_loop_max` repair loop). THEN the **adversarial review** — attack the
|
|
46
|
-
green implementation: edge cases the spec missed, error paths, contract
|
|
47
|
-
violations, race/ordering, workflow breaks (dead wiring, broken commands) —
|
|
48
|
-
findings on the same P0–P3 ladder. Also fold the enforceable
|
|
49
|
-
`validation_gate[]` lines into the criteria set, then check EACH criterion
|
|
50
|
-
individually (pass/fail, nothing invented; an unmet gate line = unmet
|
|
51
|
-
criterion = P0), each with per-criterion `evidence` (the test/output line or
|
|
52
|
-
file:line that proves it); report failures precisely. You don't fix — the
|
|
53
|
-
caller owns the auto-fix-once loop.
|
|
54
|
-
- **phase=security (opt-in):** sweep only `changed_files[]` against the supplied
|
|
55
|
-
`security_checklist[]` (wrap Semgrep if installed, never install it); findings
|
|
56
|
-
on the same ladder (exploitable-in-diff = P0, hardening gap = P1,
|
|
57
|
-
defense-in-depth = P2/P3). Report-only, no `result` verdict.
|
|
58
|
-
|
|
59
|
-
## Return shape (summary — full contract in `core.md`)
|
|
60
|
-
|
|
61
|
-
`{ phase, findings[]{severity: P0|P1|P2|P3, location "file:line", quote (verbatim,
|
|
62
|
-
required P0–P2; unanchored ⇒ AUTO-P3), description, criterion},
|
|
63
|
-
criteria[] (verify only){criterion, result, evidence}, tests{added,updated,passing},
|
|
64
|
-
result (verify only): passed|failed, actual_model, actual_effort, failure_reason }`
|
|
65
|
-
|
|
66
|
-
**Validation checkpoint before returning:** every finding carries a `severity`
|
|
67
|
-
from the P0–P3 ladder; every P0–P2 finding carries `file:line` + a VERBATIM
|
|
68
|
-
`quote` (else downgrade it to P3 yourself);
|
|
69
|
-
verify sets `result` + per-criterion `evidence`; `actual_model` is quoted
|
|
70
|
-
VERBATIM (never inferred). A
|
|
71
|
-
malformed return is treated as failure by the caller.
|
|
20
|
+
A pointer. The orchestrator spawns the agent via the Task tool, prepending
|
|
21
|
+
`subagent.md` framing + the input slice. The worker reports; the orchestrator
|
|
22
|
+
owns the auto-fix-once loop.
|
|
23
|
+
|
|
24
|
+
- **Input slice** (the orchestrator builds it): `core.md`.
|
|
25
|
+
- **Procedure + return contract** (the ONE source): the agent file —
|
|
26
|
+
`phase=review` and `phase=security` → `.claude/agents/orc-reviewer-opus-5-med.md`;
|
|
27
|
+
`phase=verify` → `.claude/agents/orc-verifier-opus-5-med.md`.
|
|
28
|
+
- **Validator** (the caller checks every return against it):
|
|
29
|
+
`../../../_shared/return-validation.md`. A malformed return is treated as
|
|
30
|
+
failure by the caller.
|
|
72
31
|
|
|
73
32
|
Fixed models (from `../../references/effort-and-mode.md`): review on the OpenSpec/self
|
|
74
33
|
path = Opus 5.5 medium; review on the Superpowers path is delegated to the
|
|
@@ -1,135 +1,52 @@
|
|
|
1
|
-
# orc-review-verify — Core (
|
|
2
|
-
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
The caller spot-checks quotes before acting on P0/P1.
|
|
54
|
-
6. Classify EVERY finding on the P0–P3 ladder:
|
|
55
|
-
- P0 — objective breakage: failing tests, broken build, unmet acceptance
|
|
56
|
-
criteria, runtime errors, invariant violations. Gates ship; the caller
|
|
57
|
-
auto-fixes immediately (no ask).
|
|
58
|
-
- P1 — correctness or security risk, constraint violations (judgment-level
|
|
59
|
-
blockers that don't break the build). Gates ship; the caller asks the user
|
|
60
|
-
before fixing.
|
|
61
|
-
- P2 — maintainability: duplication, missing tests for a changed path,
|
|
62
|
-
unclear structure. Advisory; itemized in the summary as an optional fix-batch.
|
|
63
|
-
- P3 — cosmetic: naming, formatting, length, style. Advisory; counted only.
|
|
64
|
-
7. Never fix P2/P3. P0/P1 fixes are the caller's decision, not yours.
|
|
65
|
-
|
|
66
|
-
## Verify procedure (phase=verify — two halves, v0.33.0)
|
|
67
|
-
|
|
68
|
-
**Half 1 — TDD gate (deterministic):**
|
|
69
|
-
1. Run the build and full test suite — INCLUDING every `tdd_suite[]` test.
|
|
70
|
-
2. Per non-exempt requirement: its TDD test green = that requirement's
|
|
71
|
-
definition-of-done met; red = a P0 finding tied to that requirement
|
|
72
|
-
(`criterion` = the requirement id). Report `tdd: {green: n, red: n,
|
|
73
|
-
exempt: n}` — the caller owns the `tdd_loop_max` repair loop; you never fix.
|
|
74
|
-
An empty `tdd_suite[]` (whole-run exemption / older plan) → skip this half
|
|
75
|
-
and SAY so in the return; never invent tests here.
|
|
76
|
-
|
|
77
|
-
**Half 2 — adversarial review (attack the green implementation):**
|
|
78
|
-
3. Hunt what the spec missed: edge cases (empty/zero/max inputs, unicode,
|
|
79
|
-
pagination edges), error paths (failure of each external call, partial
|
|
80
|
-
writes), contract violations (response shapes, status codes, event
|
|
81
|
-
payloads vs consumers), race/ordering hazards on shared state, and
|
|
82
|
-
workflow breaks — dead wiring (a route/handler/command nothing reaches),
|
|
83
|
-
broken commands, config keys read by nothing. Findings on the P0–P3
|
|
84
|
-
ladder with the same evidence-or-advisory rule (verbatim quote or AUTO-P3).
|
|
85
|
-
|
|
86
|
-
**Criteria sweep (unchanged):**
|
|
87
|
-
4. Fold every `validation_gate[]` line into the criteria set (each enforceable
|
|
88
|
-
line IS an acceptance criterion; the slice only carries enforceable ones —
|
|
89
|
-
measurability was decided at reconciliation, don't re-litigate it).
|
|
90
|
-
5. Check each criterion individually — pass/fail per criterion, each with
|
|
91
|
-
`evidence`: the test name/output line that proves it, or the `file:line`
|
|
92
|
-
that satisfies it (quoted, never asserted from memory). An unmet gate
|
|
93
|
-
line is an unmet criterion (P0).
|
|
94
|
-
6. Report failures precisely (which criterion, what observed). You do not fix;
|
|
95
|
-
the caller owns the auto-fix-once loop.
|
|
96
|
-
|
|
97
|
-
## Security procedure (phase=security — opt-in, config `security_review`)
|
|
98
|
-
|
|
99
|
-
1. Sweep ONLY `changed_files[]` against each `security_checklist[]` item
|
|
100
|
-
(OWASP/STRIDE-derived; supplied in the slice, never invented).
|
|
101
|
-
2. If Semgrep is installed in the environment (`semgrep --version` succeeds),
|
|
102
|
-
run it scoped to the changed files and fold its results in; skip silently
|
|
103
|
-
otherwise — never install tooling.
|
|
104
|
-
3. Findings on the same P0–P3 ladder: a directly exploitable flaw introduced by
|
|
105
|
-
the diff (injection, authz bypass, secret in code) is P0; a hardening gap or
|
|
106
|
-
risky-but-guarded path is P1; defense-in-depth suggestions are P2/P3.
|
|
107
|
-
4. Report only; you never fix. Same return contract (no `result` field —
|
|
108
|
-
security is a findings pass, not a verdict).
|
|
109
|
-
|
|
110
|
-
## Return contract (emit EXACTLY this)
|
|
111
|
-
|
|
112
|
-
- phase
|
|
113
|
-
- findings[]: { severity: P0|P1|P2|P3, location ("file:line" — REQUIRED for
|
|
114
|
-
P0–P2), quote (offending line(s) VERBATIM — REQUIRED for P0–P2;
|
|
115
|
-
missing/unanchored ⇒ the finding is AUTO-P3), description,
|
|
116
|
-
criterion|null }
|
|
117
|
-
- criteria[] (verify only): { criterion, result: pass|fail, evidence — the test
|
|
118
|
-
name/output line or file:line that proves it }
|
|
119
|
-
- tdd (verify only): { green: int, red: int, exempt: int } — the TDD-gate tally
|
|
120
|
-
(omit only when the slice carried no tdd_suite[])
|
|
121
|
-
- tests: { added: int, updated: int, passing: "x/y" }
|
|
122
|
-
- result (verify only): passed | failed
|
|
123
|
-
- actual_model — the model id quoted VERBATIM from your system prompt ("The exact
|
|
124
|
-
model ID is …"); NEVER inferred; `unknown` if absent
|
|
125
|
-
- actual_effort — the value of $CLAUDE_EFFORT (read via Bash)
|
|
126
|
-
- failure_reason — required if the pass itself could not run; else null
|
|
127
|
-
- gotcha_recorded — REQUIRED only when a repair loop CLOSED inside this same run
|
|
128
|
-
and you re-checked it (a P0/P1 you raised and that was fixed; a
|
|
129
|
-
verify criterion that was unmet and is now met): the entry body
|
|
130
|
-
{trigger, symptom, cause, fix, scope}, or `none` + a one-line
|
|
131
|
-
reason. Not required otherwise. A finding left OPEN returns
|
|
132
|
-
`none` — an unsolved failure is not a gotcha. You RETURN it;
|
|
133
|
-
the caller writes the file (`_shared/return-validation.md` §7)
|
|
134
|
-
|
|
135
|
-
Malformed returns are treated as failure by the caller.
|
|
1
|
+
# orc-review-verify — Core (the input slice)
|
|
2
|
+
|
|
3
|
+
The INPUT SLICE the orchestrator builds for ONE review, verify or security
|
|
4
|
+
dispatch. The procedure and the return contract live in ONE place, the agent
|
|
5
|
+
file: `phase=review` and `phase=security` → `.claude/agents/orc-reviewer-opus-5-med.md`;
|
|
6
|
+
`phase=verify` → `.claude/agents/orc-verifier-opus-5-med.md`. The caller owns
|
|
7
|
+
the auto-fix-once loop and the `tdd_loop_max` repair loop, and validates the
|
|
8
|
+
return against `../../../_shared/return-validation.md`.
|
|
9
|
+
|
|
10
|
+
## Input slice
|
|
11
|
+
|
|
12
|
+
Canonical shape + how to build it: `../../../_shared/review-slice.md` (read it at
|
|
13
|
+
the dispatch). The verifier gets the same `gotcha_card` + `tool_findings[]`.
|
|
14
|
+
|
|
15
|
+
Slice fields: changed_files[] · diff_ranges[] · acceptance_criteria[] · constraints[] · code_pattern · invariants[] · validation_gate[] · fe_rules[] · security_checklist[] · graph_changes · tool_findings[] · gotcha_card · rules_card · previous_findings[] · mode
|
|
16
|
+
|
|
17
|
+
- phase: review | verify | security
|
|
18
|
+
- acceptance_criteria[] — the intent-spec's definition-of-done, verbatim
|
|
19
|
+
(verify checks EXACTLY these; nothing invented)
|
|
20
|
+
- code_pattern — resolved/user-provided style guide, or null (review bare)
|
|
21
|
+
- invariants[] — BLOCKING code-pattern rules to re-check, or empty
|
|
22
|
+
(a violation is a P0 finding)
|
|
23
|
+
- validation_gate[] — the pattern's enforceable acceptance checks (already
|
|
24
|
+
measurability-filtered at reconciliation), or empty.
|
|
25
|
+
Verify treats each line as an acceptance criterion;
|
|
26
|
+
review re-checks them against the diff.
|
|
27
|
+
- fe_rules[] — impact-ordered FE rule-pack rules (a11y/perf) when the
|
|
28
|
+
diff touches FE files, else empty. Findings from these
|
|
29
|
+
are P1–P3 by impact (never automatic P0), always with
|
|
30
|
+
file:line.
|
|
31
|
+
- security_checklist[] — OWASP/STRIDE checklist items (phase=security only),
|
|
32
|
+
else empty
|
|
33
|
+
- tdd_suite[] — (phase=verify, v0.33.0) the plan's materialized TDD
|
|
34
|
+
acceptance tests: {requirement, test_path} per
|
|
35
|
+
non-exempt requirement, plus the run's exemptions
|
|
36
|
+
(`tdd: exempt — <reason>` lines). Empty on a
|
|
37
|
+
whole-run exemption or a pre-v0.33.0 plan.
|
|
38
|
+
- gotcha_card — the gotcha card's `text` (slice §2), or null (no
|
|
39
|
+
match is the normal case). ALWAYS built when anything
|
|
40
|
+
matches. A CHECKLIST, not a rule set: a confirmed hit
|
|
41
|
+
is a normal finding, never an automatic P0.
|
|
42
|
+
- tool_findings[] — the free check's lines on changed files (never
|
|
43
|
+
re-reported), or empty
|
|
44
|
+
- diff_ranges[], rules_card, graph_changes, previous_findings[] (re-review
|
|
45
|
+
only), mode (review · disprove · security) — as the canonical slice defines them
|
|
46
|
+
- changed_files[] — the surface to examine
|
|
47
|
+
- constraints[] — intent-spec hard rules (a violation is a P1 finding)
|
|
48
|
+
- model, effort — informational
|
|
49
|
+
|
|
50
|
+
The P0–P3 ladder and the AUTO-P3 evidence rule (an unanchored finding never
|
|
51
|
+
gates) are defined in the agent files. Malformed returns are treated as failure
|
|
52
|
+
by the caller.
|
|
@@ -1,7 +1,7 @@
|
|
|
1
|
-
# orc-review-verify — Subagent wrapper (orchestrator prepends at spawn)
|
|
2
|
-
|
|
3
|
-
You are an isolated review/verify worker. Examine only what the slice gives
|
|
4
|
-
you. You do not fix anything — you classify, test, and report. Emit the return
|
|
5
|
-
structure
|
|
6
|
-
|
|
7
|
-
[Orchestrator: append the input slice here at spawn time.]
|
|
1
|
+
# orc-review-verify — Subagent wrapper (orchestrator prepends at spawn)
|
|
2
|
+
|
|
3
|
+
You are an isolated review/verify worker. Examine only what the slice gives
|
|
4
|
+
you. You do not fix anything — you classify, test, and report. Emit the return
|
|
5
|
+
structure your agent file defines and STOP.
|
|
6
|
+
|
|
7
|
+
[Orchestrator: append the input slice here at spawn time.]
|
|
@@ -12,29 +12,18 @@ description: >
|
|
|
12
12
|
|
|
13
13
|
# orc-testgen
|
|
14
14
|
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
15
|
+
A pointer. The orchestrator spawns `orc-test-author-opus-5-med` via the Task
|
|
16
|
+
tool, prepending `subagent.md` framing + the input slice. It WRITES test cases;
|
|
17
|
+
it never runs them and never gates the ship.
|
|
18
18
|
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
(env-var placeholders — never real secrets).
|
|
28
|
-
5. Run NOTHING. Advisory `notes[]` may flag a case the code likely won't satisfy.
|
|
29
|
-
|
|
30
|
-
The manual deliverables (TEST-PLAN.md + test-cases.http) are pinned to
|
|
31
|
-
**`test-generator/<change-slug>/` at the project root** — a visible user
|
|
32
|
-
deliverable, never inside `.claude/` or the run folder (see `core.md`).
|
|
33
|
-
|
|
34
|
-
**Validation checkpoint before returning:** confirm each promised deliverable
|
|
35
|
-
actually exists on disk **at the pinned path** (test files in the project's
|
|
36
|
-
conventions; TEST-PLAN.md and — when the stack exposes HTTP — test-cases.http
|
|
37
|
-
under `test-generator/<change-slug>/`) before emitting the return contract in `core.md`.
|
|
19
|
+
- **Input slice** (the orchestrator builds it): `core.md`.
|
|
20
|
+
- **Procedure + return contract** (the ONE source): the agent file,
|
|
21
|
+
`.claude/agents/orc-test-author-opus-5-med.md`. The manual deliverables
|
|
22
|
+
(TEST-PLAN.md + test-cases.http) are pinned to
|
|
23
|
+
**`test-generator/<change-slug>/` at the project root** — a visible user
|
|
24
|
+
deliverable, never inside `.claude/` or the run folder.
|
|
25
|
+
- **Validator** (the caller checks every return against it):
|
|
26
|
+
`../../../_shared/return-validation.md`.
|
|
38
27
|
|
|
39
28
|
Fixed model: `orc-test-author-opus-5-med` (Opus 5.5 medium — authoring good
|
|
40
29
|
integration tests is a judgment task). Opt-in: the orchestrator dispatches this
|
|
@@ -1,59 +1,20 @@
|
|
|
1
|
-
# orc-testgen — Core (
|
|
2
|
-
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
-
|
|
11
|
-
-
|
|
12
|
-
-
|
|
13
|
-
-
|
|
14
|
-
-
|
|
15
|
-
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
2. Derive a **test matrix** from changed_files + acceptance_criteria + flows —
|
|
22
|
-
one row per case {id, type, target, asserts, external_deps}. Bound regression
|
|
23
|
-
to the diff's blast radius; never test the whole app.
|
|
24
|
-
3. Author **automated test files** in the project's framework/conventions where
|
|
25
|
-
feasible. Match existing test style. These stay in the project's own test
|
|
26
|
-
conventions (`output_conventions`) — do NOT move them.
|
|
27
|
-
4. **Pin the manual-QA output folder.** The two manual deliverables below are
|
|
28
|
-
USER deliverables, not run state — write BOTH to
|
|
29
|
-
**`test-generator/<change-slug>/` at the PROJECT ROOT** (create the folder if
|
|
30
|
-
absent). `<change-slug>` = the run's existing kebab-case run-folder slug (e.g.
|
|
31
|
-
`post-users`). NEVER write them inside `.claude/`, and NEVER inside the run
|
|
32
|
-
folder — a hidden path is invisible for self-QA.
|
|
33
|
-
5. Write **`test-generator/<change-slug>/TEST-PLAN.md`** (manual cases: scenario,
|
|
34
|
-
setup, steps, expected) with two CLEARLY SEPARATED sections:
|
|
35
|
-
- "Run the automated test suite" — the exact CLI command(s), pasted.
|
|
36
|
-
- "Exercise the real running service" — manual steps / curl.
|
|
37
|
-
6. If `is_http_api`: write **`test-generator/<change-slug>/test-cases.http`** —
|
|
38
|
-
one Postman-importable `curl` per endpoint/flow (env-var placeholders for base
|
|
39
|
-
URL + auth; NEVER real secrets). Reference it from TEST-PLAN.md.
|
|
40
|
-
7. Advisory only: note (do not gate) any case the code likely won't satisfy.
|
|
41
|
-
|
|
42
|
-
## Return contract (emit EXACTLY this; the caller validates)
|
|
43
|
-
|
|
44
|
-
- test_matrix[] — the rows above (or counts by type)
|
|
45
|
-
- files_authored[] — automated test files created/updated
|
|
46
|
-
- test_plan_path — path to TEST-PLAN.md; MUST be inside
|
|
47
|
-
`test-generator/<change-slug>/` (any other location is
|
|
48
|
-
a malformed return)
|
|
49
|
-
- curl_bundle_path — path to test-cases.http (also inside
|
|
50
|
-
`test-generator/<change-slug>/`), or null (non-API projects)
|
|
51
|
-
- run_command — exact CLI command(s) to run the authored tests
|
|
52
|
-
- notes[] — advisory gaps noticed while authoring (non-blocking); else []
|
|
53
|
-
- actual_model — model id quoted VERBATIM from your system prompt ("The
|
|
54
|
-
exact model ID is …"); NEVER inferred; `unknown` if absent
|
|
55
|
-
- actual_effort — the value of $CLAUDE_EFFORT (read via Bash)
|
|
56
|
-
- failure_reason — required if you could not author; else null
|
|
57
|
-
|
|
58
|
-
Malformed returns are treated as failure by the caller. Never run tests; never
|
|
59
|
-
spawn subagents.
|
|
1
|
+
# orc-testgen — Core (the input slice)
|
|
2
|
+
|
|
3
|
+
The INPUT SLICE the orchestrator builds for ONE `orc-test-author-opus-5-med`
|
|
4
|
+
dispatch. The procedure and the return contract live in ONE place: the agent
|
|
5
|
+
file, `.claude/agents/orc-test-author-opus-5-med.md`. The orchestrator never
|
|
6
|
+
runs this itself. **Authoring only — RUN NOTHING, GATE NOTHING.** The user tests manually.
|
|
7
|
+
|
|
8
|
+
## Input slice (you receive exactly this)
|
|
9
|
+
|
|
10
|
+
- changed_files[] — the surface the change touched (from the run's actual_files)
|
|
11
|
+
- acceptance_criteria[] — the intent-spec's definition-of-done (the "new behaviour")
|
|
12
|
+
- touched_flows[] — user journeys through the changed code (may be empty)
|
|
13
|
+
- constraints[] — intent-spec hard rules
|
|
14
|
+
- stack — {language, test_framework, is_http_api}; detect if absent
|
|
15
|
+
- test_types[] — subset of {new_behaviour, flow, change, regression}; default all
|
|
16
|
+
- output_conventions — where tests live in this repo
|
|
17
|
+
|
|
18
|
+
The manual deliverables go to `test-generator/<change-slug>/` at the PROJECT
|
|
19
|
+
ROOT (`<change-slug>` = the run's kebab-case run-folder slug). Malformed returns
|
|
20
|
+
are treated as failure by the caller.
|
|
@@ -1,7 +1,7 @@
|
|
|
1
|
-
# orc-testgen — Subagent wrapper (orchestrator prepends at spawn)
|
|
2
|
-
|
|
3
|
-
You are an isolated test-authoring worker. You WRITE test cases from the slice
|
|
4
|
-
below; you never run them, never fix code, never gate the ship. Make manual
|
|
5
|
-
testing easy for the user. Emit the return structure
|
|
6
|
-
|
|
7
|
-
[Orchestrator: append the input slice here at spawn time.]
|
|
1
|
+
# orc-testgen — Subagent wrapper (orchestrator prepends at spawn)
|
|
2
|
+
|
|
3
|
+
You are an isolated test-authoring worker. You WRITE test cases from the slice
|
|
4
|
+
below; you never run them, never fix code, never gate the ship. Make manual
|
|
5
|
+
testing easy for the user. Emit the return structure your agent file defines and STOP.
|
|
6
|
+
|
|
7
|
+
[Orchestrator: append the input slice here at spawn time.]
|
|
@@ -1,60 +1,56 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: orc-advisor
|
|
3
|
-
description: >
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
brief
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
|
|
55
|
-
|
|
56
|
-
|
|
57
|
-
($CLAUDE_EFFORT). The orchestrator validates the return, emits the `ADVISE`
|
|
58
|
-
trace line when logging, relays the open questions to the user in ONE batched
|
|
59
|
-
round, folds the answers into the intent-spec, and records unanswered
|
|
60
|
-
defaults as UNCONFIRMED in the assumption ledger.
|
|
1
|
+
---
|
|
2
|
+
name: orc-advisor
|
|
3
|
+
description: >
|
|
4
|
+
Internal to /orc-ultra: the pre-analysis Advisor. Runs ONCE at Phase U0 and
|
|
5
|
+
writes the advisory brief, the security-risk section and the rubric the ultra
|
|
6
|
+
judges score against. No slash command of its own.
|
|
7
|
+
disable-model-invocation: true
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# ORC-ADVISOR (ultra-lane advisory brief)
|
|
11
|
+
|
|
12
|
+
Ultra-complex tasks fail on wrong interpretation, silent assumptions, and
|
|
13
|
+
generic quality bars. The Advisor front-loads the fix: one max-effort pass
|
|
14
|
+
that frames the request against the REAL codebase and hands every downstream
|
|
15
|
+
role — analyst, planner, judges, executors — the same request-specific brief.
|
|
16
|
+
|
|
17
|
+
Ultra lane ONLY. There is no `/orc-advisor` command; the orchestrator
|
|
18
|
+
dispatches `orc-advisor-opus-5-xhigh` at Phase U0 of an `/orc-ultra` run.
|
|
19
|
+
Cost is accepted by definition of the lane — no consent prompt.
|
|
20
|
+
|
|
21
|
+
## Hard rules
|
|
22
|
+
|
|
23
|
+
1. **The orchestrator never advises — it spawns.** Dispatch
|
|
24
|
+
`orc-advisor-opus-5-xhigh` with the slice below; the advisor writes the
|
|
25
|
+
brief; the orchestrator relays and injects.
|
|
26
|
+
2. **The advisor is read-only on the project** (Read/Glob/Grep + Bash for
|
|
27
|
+
git introspection). It never edits code, never spawns subagents.
|
|
28
|
+
3. **One dispatch per run.** The advisor is never re-dispatched for
|
|
29
|
+
revisions — post-brief quality is the judges' job.
|
|
30
|
+
4. **The brief is injected LITERALLY** (never a file pointer) into the
|
|
31
|
+
analyst slice, the planner slice, all three judge slices, and — as
|
|
32
|
+
advisory notes — the executor slices.
|
|
33
|
+
5. **The security section may not be skipped.** "No security surface" is a
|
|
34
|
+
legitimate conclusion but must be stated with reasoning.
|
|
35
|
+
|
|
36
|
+
## Dispatch slice (orchestrator → advisor)
|
|
37
|
+
|
|
38
|
+
- The user's request verbatim (plus the doc path when one exists).
|
|
39
|
+
- The run-folder path for `advisory-brief.md`.
|
|
40
|
+
- Detected stack summary (from intake — never re-detected).
|
|
41
|
+
|
|
42
|
+
## Brief contents (see the agent file for the full section spec)
|
|
43
|
+
|
|
44
|
+
Risks & pitfalls (anchored) · alternatives + trade-offs · security risks
|
|
45
|
+
(mandatory) · the three-part RUBRIC (correct analysis / correct plan /
|
|
46
|
+
faithful implementation) · open questions with proposed defaults · seed
|
|
47
|
+
assumption-ledger entries.
|
|
48
|
+
|
|
49
|
+
## Return contract
|
|
50
|
+
|
|
51
|
+
`brief_path`, `open_questions[]`, `assumptions[]`, `actual_model` (verbatim
|
|
52
|
+
from the agent's system-prompt model-id line), `actual_effort`
|
|
53
|
+
($CLAUDE_EFFORT). The orchestrator validates the return, emits the `ADVISE`
|
|
54
|
+
trace line when logging, relays the open questions to the user in ONE batched
|
|
55
|
+
round, folds the answers into the intent-spec, and records unanswered
|
|
56
|
+
defaults as UNCONFIRMED in the assumption ledger.
|