@nathapp/nax 0.20.0 → 0.22.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude/settings.json +15 -0
- package/.mcp.json +8 -0
- package/docs/20260304-review-nax.md +492 -0
- package/docs/ROADMAP.md +65 -18
- package/docs/adr/ADR-005-implementation-plan.md +655 -0
- package/docs/adr/ADR-005-pipeline-re-architecture.md +464 -0
- package/docs/specs/bug-039-orphan-processes.md +131 -0
- package/docs/specs/bug-040-review-rectification.md +82 -0
- package/docs/specs/bug-041-cross-story-test-isolation.md +88 -0
- package/docs/specs/bug-042-verifier-failure-capture.md +117 -0
- package/docs/specs/feat-010-smart-runner-git-history.md +96 -0
- package/docs/specs/feat-011-file-context-strategy.md +73 -0
- package/docs/specs/feat-012-tdd-writer-tier.md +79 -0
- package/docs/specs/feat-013-test-after-review.md +89 -0
- package/docs/specs/feat-014-heartbeat-observability.md +127 -0
- package/memory/topic/feat-010-baseref.md +28 -0
- package/memory/topic/feat-013-test-after-deprecation.md +22 -0
- package/nax/config.json +7 -4
- package/nax/features/bug-039-medium/prd.json +45 -0
- package/package.json +2 -2
- package/src/agents/claude.ts +109 -15
- package/src/config/types.ts +11 -0
- package/src/context/builder.ts +9 -1
- package/src/execution/dry-run.ts +81 -0
- package/src/execution/escalation/tier-outcome.ts +29 -44
- package/src/execution/executor-types.ts +65 -0
- package/src/execution/index.ts +0 -17
- package/src/execution/iteration-runner.ts +132 -0
- package/src/execution/lifecycle/index.ts +0 -1
- package/src/execution/lifecycle/run-regression.ts +5 -5
- package/src/execution/pipeline-result-handler.ts +51 -254
- package/src/execution/sequential-executor.ts +72 -315
- package/src/execution/story-selector.ts +75 -0
- package/src/pipeline/event-bus.ts +276 -0
- package/src/pipeline/runner.ts +51 -77
- package/src/pipeline/stages/autofix.ts +133 -0
- package/src/pipeline/stages/completion.ts +22 -30
- package/src/pipeline/stages/index.ts +30 -13
- package/src/pipeline/stages/rectify.ts +93 -0
- package/src/pipeline/stages/regression.ts +88 -0
- package/src/pipeline/stages/review.ts +19 -153
- package/src/pipeline/stages/verify.ts +19 -3
- package/src/pipeline/subscribers/hooks.ts +133 -0
- package/src/pipeline/subscribers/interaction.ts +68 -0
- package/src/pipeline/subscribers/reporters.ts +174 -0
- package/src/pipeline/types.ts +12 -1
- package/src/review/orchestrator.ts +105 -0
- package/src/review/runner.ts +39 -4
- package/src/routing/router.ts +3 -3
- package/src/routing/strategies/keyword.ts +5 -2
- package/src/routing/strategies/llm.ts +27 -1
- package/src/tdd/prompts.ts +1 -1
- package/src/utils/git.ts +49 -25
- package/src/verification/executor.ts +8 -2
- package/src/verification/index.ts +1 -1
- package/src/verification/orchestrator-types.ts +145 -0
- package/src/verification/orchestrator.ts +76 -0
- package/src/{execution/post-verify-rectification.ts → verification/rectification-loop.ts} +13 -20
- package/src/verification/{gate.ts → runners.ts} +17 -105
- package/src/verification/smart-runner.ts +6 -10
- package/src/verification/strategies/acceptance.ts +133 -0
- package/src/verification/strategies/regression.ts +90 -0
- package/src/verification/strategies/scoped.ts +123 -0
- package/test/COVERAGE-GAPS.md +333 -0
- package/test/{acceptance → e2e}/cm-003-default-view.test.ts +1 -0
- package/test/{integration/e2e.test.ts → e2e/plan-analyze-run.test.ts} +1 -0
- package/test/integration/{agent-validation.test.ts → cli/agent-validation.test.ts} +3 -3
- package/test/integration/{cli-config-default-edge-cases.test.ts → cli/cli-config-default-edge-cases.test.ts} +6 -5
- package/test/integration/{cli-config-default-view.test.ts → cli/cli-config-default-view.test.ts} +8 -7
- package/test/integration/{cli-config-diff.test.ts → cli/cli-config-diff.test.ts} +3 -2
- package/test/integration/{cli-config.test.ts → cli/cli-config.test.ts} +3 -2
- package/test/integration/{cli-diagnose.test.ts → cli/cli-diagnose.test.ts} +5 -4
- package/test/integration/{cli-logs.test.ts → cli/cli-logs.test.ts} +12 -3
- package/test/integration/{cli-plugins.test.ts → cli/cli-plugins.test.ts} +4 -3
- package/test/integration/{cli-precheck.test.ts → cli/cli-precheck.test.ts} +4 -3
- package/test/integration/{cli-run-headless.test.ts → cli/cli-run-headless.test.ts} +3 -2
- package/test/integration/{cli.test.ts → cli/cli.test.ts} +2 -1
- package/test/integration/{precheck-integration.test.ts → cli/precheck-integration.test.ts} +10 -9
- package/test/integration/{precheck-orchestrator.test.ts → cli/precheck-orchestrator.test.ts} +4 -3
- package/test/integration/{precheck.test.ts → cli/precheck.test.ts} +5 -4
- package/test/integration/{config-loader.test.ts → config/config-loader.test.ts} +2 -1
- package/test/integration/{config.test.ts → config/config.test.ts} +2 -2
- package/test/integration/config/merger.test.ts +1 -0
- package/test/integration/config/paths.test.ts +1 -0
- package/test/integration/{security-loader.test.ts → config/security-loader.test.ts} +2 -2
- package/test/integration/{context-integration.test.ts → context/context-integration.test.ts} +7 -6
- package/test/integration/{path-security.test.ts → context/context-path-security.test.ts} +2 -2
- package/test/integration/{context-provider-injection.test.ts → context/context-provider-injection.test.ts} +7 -6
- package/test/integration/{context-verification-integration.test.ts → context/context-verification-integration.test.ts} +5 -4
- package/test/integration/{s5-greenfield-fallback.test.ts → context/s5-greenfield-fallback.test.ts} +4 -3
- package/test/integration/{isolation.test.ts → execution/execution-isolation.test.ts} +1 -1
- package/test/integration/{execution.test.ts → execution/execution.test.ts} +8 -8
- package/test/integration/{parallel.test.ts → execution/parallel.test.ts} +2 -1
- package/test/integration/{prd-pause.test.ts → execution/prd-pause.test.ts} +2 -2
- package/test/integration/{prd-resolvers.test.ts → execution/prd-resolvers.test.ts} +3 -2
- package/test/integration/{progress.test.ts → execution/progress.test.ts} +1 -1
- package/test/integration/execution/runner-batching.test.ts +682 -0
- package/test/integration/{runner-config-plugins.test.ts → execution/runner-config-plugins.test.ts} +3 -2
- package/test/integration/execution/runner-escalation.test.ts +561 -0
- package/test/integration/{runner-fixes.test.ts → execution/runner-fixes.test.ts} +4 -3
- package/test/integration/{runner-plugin-integration.test.ts → execution/runner-plugin-integration.test.ts} +6 -5
- package/test/integration/execution/runner-queue-and-attempts.test.ts +476 -0
- package/test/integration/{status-file-integration.test.ts → execution/status-file-integration.test.ts} +9 -8
- package/test/integration/{status-file.test.ts → execution/status-file.test.ts} +3 -2
- package/test/integration/{status-writer.test.ts → execution/status-writer.test.ts} +5 -4
- package/test/integration/{story-id-in-events.test.ts → execution/story-id-in-events.test.ts} +9 -8
- package/test/integration/{interaction-chain-pipeline.test.ts → interaction/interaction-chain-pipeline.test.ts} +26 -14
- package/test/integration/{hooks.test.ts → pipeline/hooks.test.ts} +4 -2
- package/test/integration/{pipeline-acceptance.test.ts → pipeline/pipeline-acceptance.test.ts} +7 -6
- package/test/integration/{pipeline-events.test.ts → pipeline/pipeline-events.test.ts} +7 -6
- package/test/integration/{pipeline.test.ts → pipeline/pipeline.test.ts} +9 -7
- package/test/integration/{reporter-lifecycle.test.ts → pipeline/reporter-lifecycle.test.ts} +9 -7
- package/test/integration/{verify-stage.test.ts → pipeline/verify-stage.test.ts} +7 -5
- package/test/integration/{analyze-integration.test.ts → plan/analyze-integration.test.ts} +3 -2
- package/test/integration/{analyze-scanner.test.ts → plan/analyze-scanner.test.ts} +8 -7
- package/test/integration/{logger.test.ts → plan/logger.test.ts} +1 -1
- package/test/integration/{plan.test.ts → plan/plan.test.ts} +3 -3
- package/test/integration/plugins/config-integration.test.ts +1 -0
- package/test/integration/plugins/config-resolution.test.ts +1 -0
- package/test/integration/plugins/loader.test.ts +1 -0
- package/test/integration/plugins/{registry.test.ts → plugins-registry.test.ts} +1 -0
- package/test/integration/plugins/validator.test.ts +1 -0
- package/test/integration/{review-config-commands.test.ts → review/review-config-commands.test.ts} +4 -3
- package/test/integration/{review-config-schema.test.ts → review/review-config-schema.test.ts} +3 -2
- package/test/integration/{review-plugin-integration.test.ts → review/review-plugin-integration.test.ts} +5 -4
- package/test/integration/{review.test.ts → review/review.test.ts} +3 -2
- package/test/integration/routing/plugin-routing-advanced.test.ts +461 -0
- package/test/integration/{plugin-routing.test.ts → routing/plugin-routing-core.test.ts} +10 -404
- package/test/integration/{routing-stage-bug-021.test.ts → routing/routing-stage-bug-021.test.ts} +8 -7
- package/test/integration/{routing-stage-greenfield.test.ts → routing/routing-stage-greenfield.test.ts} +7 -6
- package/test/integration/{tdd-cleanup.test.ts → tdd/tdd-cleanup.test.ts} +1 -1
- package/test/integration/tdd/tdd-orchestrator-core.test.ts +565 -0
- package/test/integration/tdd/tdd-orchestrator-failureCategory.test.ts +355 -0
- package/test/integration/tdd/tdd-orchestrator-fallback.test.ts +311 -0
- package/test/integration/tdd/tdd-orchestrator-lite.test.ts +289 -0
- package/test/integration/tdd/tdd-orchestrator-prompts.test.ts +260 -0
- package/test/integration/tdd/tdd-orchestrator-verdict.test.ts +536 -0
- package/test/integration/tmp/headless-test/test.jsonl +30 -0
- package/test/integration/{test-scanner.test.ts → verification/test-scanner.test.ts} +1 -1
- package/test/integration/{verification-asset-check.test.ts → verification/verification-asset-check.test.ts} +3 -2
- package/test/unit/acceptance.test.ts +1 -0
- package/test/unit/agent-stderr-capture.test.ts +1 -0
- package/test/unit/agents/claude.test.ts +107 -0
- package/test/unit/analyze-classifier.test.ts +1 -0
- package/test/unit/auto-detect.test.ts +1 -0
- package/test/unit/cli-status.test.ts +1 -0
- package/test/unit/commands/common.test.ts +1 -0
- package/test/unit/commands/logs.test.ts +1 -0
- package/test/unit/commands/unlock.test.ts +1 -0
- package/test/unit/config/defaults.test.ts +1 -0
- package/test/unit/config/regression-gate-schema.test.ts +1 -0
- package/test/unit/config/smart-runner-flag.test.ts +1 -0
- package/test/unit/constitution-generators.test.ts +1 -0
- package/test/unit/constitution.test.ts +1 -0
- package/test/unit/context/context-autodetect.test.ts +297 -0
- package/test/unit/context/context-build.test.ts +575 -0
- package/test/unit/context/context-coverage.test.ts +236 -0
- package/test/unit/context/context-error.test.ts +93 -0
- package/test/unit/context/context-estimate-tokens.test.ts +201 -0
- package/test/unit/context/context-format.test.ts +302 -0
- package/test/unit/context/context-isolation.test.ts +267 -0
- package/test/unit/context/context-sort.test.ts +93 -0
- package/test/unit/context/context-story.test.ts +108 -0
- package/test/{context → unit/context}/prior-failures.test.ts +5 -4
- package/test/unit/context.test.ts +7 -3
- package/test/unit/crash-recovery.test.ts +1 -0
- package/test/unit/escalation.test.ts +1 -0
- package/test/unit/execution/lifecycle/run-completion.test.ts +1 -0
- package/test/unit/execution/lifecycle/run-regression.test.ts +2 -0
- package/test/{execution → unit/execution}/pid-registry.test.ts +2 -1
- package/test/{execution → unit/execution}/structured-failure.test.ts +3 -2
- package/test/unit/execution-logging-stderr.test.ts +1 -0
- package/test/unit/execution-stage.test.ts +1 -0
- package/test/unit/fix-generator.test.ts +1 -0
- package/test/unit/greenfield.test.ts +1 -0
- package/test/unit/interaction/human-review-trigger.test.ts +1 -0
- package/test/unit/interaction-network-failures.test.ts +1 -0
- package/test/unit/interaction-plugins.test.ts +1 -0
- package/test/unit/logging/formatter.test.ts +1 -0
- package/test/unit/merge.test.ts +1 -0
- package/test/unit/pipeline/event-bus.test.ts +105 -0
- package/test/unit/pipeline/routing-partial-override.test.ts +1 -0
- package/test/unit/pipeline/runner-retry.test.ts +89 -0
- package/test/unit/pipeline/stages/autofix.test.ts +97 -0
- package/test/unit/pipeline/stages/rectify.test.ts +101 -0
- package/test/unit/pipeline/stages/regression-stage.test.ts +69 -0
- package/test/unit/pipeline/stages/verify.test.ts +1 -0
- package/test/unit/pipeline/subscribers/hooks.test.ts +45 -0
- package/test/unit/pipeline/subscribers/interaction.test.ts +31 -0
- package/test/unit/pipeline/subscribers/reporters.test.ts +90 -0
- package/test/unit/pipeline/verify-smart-runner.test.ts +2 -1
- package/test/unit/prd-auto-default.test.ts +3 -2
- package/test/unit/prd-failure-category.test.ts +1 -0
- package/test/unit/prd-get-next-story.test.ts +1 -0
- package/test/unit/precheck-checks.test.ts +1 -0
- package/test/unit/precheck-story-size-gate.test.ts +1 -0
- package/test/unit/precheck-types.test.ts +1 -0
- package/test/unit/prompts.test.ts +1 -0
- package/test/unit/rectification.test.ts +2 -1
- package/test/unit/registry.test.ts +1 -0
- package/test/unit/routing/routing-stability.test.ts +2 -1
- package/test/unit/routing/strategies/llm.test.ts +251 -0
- package/test/unit/routing-advanced.test.ts +313 -0
- package/test/unit/routing-core.test.ts +341 -0
- package/test/unit/routing-strategies.test.ts +442 -0
- package/test/unit/storyid-events.test.ts +1 -0
- package/test/{ui → unit/ui}/tui-controls.test.ts +8 -7
- package/test/{ui → unit/ui}/tui-cost-and-pty.test.ts +4 -3
- package/test/{ui → unit/ui}/tui-layout.test.ts +5 -4
- package/test/{ui → unit/ui}/tui-stories.test.ts +5 -4
- package/test/unit/{isolation.test.ts → unit-isolation.test.ts} +1 -0
- package/test/unit/{helpers.test.ts → utils-helpers.test.ts} +1 -0
- package/test/unit/verdict.test.ts +1 -0
- package/test/unit/verification/orchestrator-types.test.ts +54 -0
- package/test/unit/verification/orchestrator.test.ts +66 -0
- package/test/unit/verification/smart-runner-config.test.ts +1 -0
- package/test/unit/verification/smart-runner-discovery.test.ts +8 -7
- package/test/unit/verification/strategies/acceptance.test.ts +33 -0
- package/test/unit/verification/strategies/regression.test.ts +87 -0
- package/test/unit/verification/strategies/scoped.test.ts +100 -0
- package/test/unit/worktree-manager.test.ts +1 -0
- package/src/execution/lifecycle/story-hooks.ts +0 -38
- package/src/execution/post-verify.ts +0 -193
- package/src/execution/rectification.ts +0 -13
- package/src/execution/verification.ts +0 -72
- package/test/integration/rectification-flow.test.ts +0 -512
- package/test/integration/runner.test.ts +0 -1679
- package/test/integration/tdd-orchestrator.test.ts +0 -1762
- package/test/unit/execution/post-verify-regression.test.ts +0 -362
- package/test/unit/execution/post-verify.test.ts +0 -236
- package/test/unit/routing.test.ts +0 -1039
- /package/test/{integration → helpers}/helpers.test.ts +0 -0
- /package/test/integration/worktree/{merge.test.ts → worktree-merge.test.ts} +0 -0
|
@@ -0,0 +1,655 @@
|
|
|
1
|
+
# ADR-005: Implementation Plan
|
|
2
|
+
|
|
3
|
+
**Parent:** ADR-005-pipeline-re-architecture.md
|
|
4
|
+
**Date:** 2026-03-06
|
|
5
|
+
**Target Version:** v0.22.0
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## Overview
|
|
10
|
+
|
|
11
|
+
4 phases, each independently shippable. Each phase must pass the full test suite (2083+ tests) before proceeding.
|
|
12
|
+
|
|
13
|
+
| Phase | Name | Scope | Est. Stories |
|
|
14
|
+
|-------|------|-------|-------------|
|
|
15
|
+
| 0 | Test Suite Cleanup | Reorganize, split, align test files | 4 |
|
|
16
|
+
| 1 | Event Bus + Verification Orchestrator | Foundation — no behavior change | 6 |
|
|
17
|
+
| 2 | New Pipeline Stages | Add rectify, autofix, regression stages + retry action | 5 |
|
|
18
|
+
| 3 | Subscriber Consolidation | Wire hooks/reporters/interaction to event bus | 4 |
|
|
19
|
+
| 4 | Executor Simplification | Remove ad-hoc code, delete deprecated files | 4 |
|
|
20
|
+
|
|
21
|
+
**Total:** 23 stories
|
|
22
|
+
|
|
23
|
+
---
|
|
24
|
+
|
|
25
|
+
## Phase 0: Test Preparation (Prerequisite)
|
|
26
|
+
|
|
27
|
+
**Goal:** Prepare the test suite for the re-architecture. Don't clean up tests that will be deleted — tag them and let them die with their source code. Focus on structure and clarity.
|
|
28
|
+
|
|
29
|
+
**Approach by layer:**
|
|
30
|
+
|
|
31
|
+
| Layer | Action | Why |
|
|
32
|
+
|-------|--------|-----|
|
|
33
|
+
| Tests for code being deleted (~11 files) | Tag `// RE-ARCH: delete-with-source` | Don't waste effort cleaning code that dies in Phase 4 |
|
|
34
|
+
| Tests for stable code (~90 files) | Keep, move to correct paths | Config, routing, CLI, context, PRD, etc. — unaffected by re-arch |
|
|
35
|
+
| Integration tests for re-arch behavior (~15 files) | Tag `// RE-ARCH: rewrite` — keep assertions, rewrite setup when source changes | The *behavior* is valid, the *internals* will change |
|
|
36
|
+
| Monster files (42 files >400 lines) | Split by describe block | Smaller files are easier to keep/delete/rewrite per-block |
|
|
37
|
+
| New architecture code | Write fresh tests per phase | Orchestrator, event bus, subscribers, new stages |
|
|
38
|
+
|
|
39
|
+
### US-P0-001: Organize Folder Structure
|
|
40
|
+
|
|
41
|
+
Move stray tests into `unit/` or `integration/` subdirectories. No logic changes.
|
|
42
|
+
|
|
43
|
+
**Stray tests to move:**
|
|
44
|
+
|
|
45
|
+
| Current path | New path |
|
|
46
|
+
|-------------|----------|
|
|
47
|
+
| `test/context/prior-failures.test.ts` | `test/unit/context/prior-failures.test.ts` |
|
|
48
|
+
| `test/execution/pid-registry.test.ts` | `test/unit/execution/pid-registry.test.ts` |
|
|
49
|
+
| `test/execution/structured-failure.test.ts` | `test/unit/execution/structured-failure.test.ts` |
|
|
50
|
+
| `test/acceptance/cm-003-default-view.test.ts` | `test/e2e/cm-003-default-view.test.ts` |
|
|
51
|
+
| `test/ui/*.test.ts` (4 files) | `test/unit/ui/*.test.ts` |
|
|
52
|
+
| `test/integration/e2e.test.ts` | `test/e2e/plan-analyze-run.test.ts` |
|
|
53
|
+
|
|
54
|
+
**Integration subdirectories:** Group 61 flat files into `cli/`, `config/`, `context/`, `execution/`, `pipeline/`, `review/`, `tdd/`, `verification/`, `interaction/`, `routing/`.
|
|
55
|
+
|
|
56
|
+
**Resolve 5 duplicate filenames** with module prefix.
|
|
57
|
+
|
|
58
|
+
**Gate:** All 2083+ tests pass after moves.
|
|
59
|
+
|
|
60
|
+
### US-P0-002: Split Monster Test Files
|
|
61
|
+
|
|
62
|
+
Split 42 files >400 lines by `describe` block. Target <400 lines each.
|
|
63
|
+
|
|
64
|
+
**Priority targets (>800 lines, 6 files):**
|
|
65
|
+
|
|
66
|
+
| File | Lines | Split into |
|
|
67
|
+
|------|-------|-----------|
|
|
68
|
+
| `tdd-orchestrator.test.ts` | 1762 | core, lite-mode, verdict, prompts |
|
|
69
|
+
| `context.test.ts` | 1725 | builder, elements, tokens |
|
|
70
|
+
| `runner.test.ts` | 1679 | batching, escalation, queue |
|
|
71
|
+
| `routing.test.ts` | 1039 | classify, strategy-chain, keywords |
|
|
72
|
+
| `plugin-routing.test.ts` | 921 | chain, integration |
|
|
73
|
+
| `e2e.test.ts` | 896 | split by workflow |
|
|
74
|
+
|
|
75
|
+
**Secondary (400-800 lines, 36 files):** Split by describe block.
|
|
76
|
+
|
|
77
|
+
**Rule:** One top-level `describe` per file. Shared fixtures in `test/helpers/`.
|
|
78
|
+
|
|
79
|
+
**Gate:** Same test count, all pass.
|
|
80
|
+
|
|
81
|
+
### US-P0-003: Tag Tests for Re-Architecture Impact
|
|
82
|
+
|
|
83
|
+
Add comment header to every test file indicating its re-arch fate:
|
|
84
|
+
|
|
85
|
+
```ts
|
|
86
|
+
// RE-ARCH: keep — stable code, unaffected
|
|
87
|
+
// RE-ARCH: rewrite — behavior valid, internals will change
|
|
88
|
+
// RE-ARCH: delete-with-source — source file being deleted in Phase 4
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
**Files tagged `delete-with-source`:**
|
|
92
|
+
|
|
93
|
+
| Test file | Source file being deleted |
|
|
94
|
+
|-----------|-------------------------|
|
|
95
|
+
| `test/unit/execution/post-verify.test.ts` | `src/execution/post-verify.ts` |
|
|
96
|
+
| `test/unit/execution/post-verify-regression.test.ts` | `src/execution/post-verify.ts` |
|
|
97
|
+
| `test/unit/execution/lifecycle/run-regression.test.ts` | (rewriting to thin wrapper) |
|
|
98
|
+
| `test/integration/rectification-flow.test.ts` | `src/execution/post-verify-rectification.ts` |
|
|
99
|
+
|
|
100
|
+
**Files tagged `rewrite`:**
|
|
101
|
+
|
|
102
|
+
| Test file | Reason |
|
|
103
|
+
|-----------|--------|
|
|
104
|
+
| `test/integration/pipeline.test.ts` | New stage order, new stages |
|
|
105
|
+
| `test/integration/verify-stage.test.ts` | Verify delegates to orchestrator |
|
|
106
|
+
| `test/integration/hooks.test.ts` | Hooks move to event bus subscriber |
|
|
107
|
+
| `test/integration/interaction-chain-pipeline.test.ts` | Triggers move to subscriber |
|
|
108
|
+
| `test/integration/reporter-lifecycle.test.ts` | Reporters move to subscriber |
|
|
109
|
+
|
|
110
|
+
**Gate:** Every test file has a RE-ARCH tag.
|
|
111
|
+
|
|
112
|
+
### US-P0-004: Coverage Gap Analysis
|
|
113
|
+
|
|
114
|
+
Document which new files need tests (checklist for Phases 1-4):
|
|
115
|
+
|
|
116
|
+
| New file (Phase) | Test file needed |
|
|
117
|
+
|-----------------|-----------------|
|
|
118
|
+
| `src/verification/orchestrator.ts` (P1) | `test/unit/verification/orchestrator.test.ts` |
|
|
119
|
+
| `src/verification/strategies/scoped.ts` (P1) | `test/unit/verification/strategies/scoped.test.ts` |
|
|
120
|
+
| `src/verification/strategies/regression.ts` (P1) | `test/unit/verification/strategies/regression.test.ts` |
|
|
121
|
+
| `src/verification/strategies/acceptance.ts` (P1) | `test/unit/verification/strategies/acceptance.test.ts` |
|
|
122
|
+
| `src/pipeline/event-bus.ts` (P1) | `test/unit/pipeline/event-bus.test.ts` |
|
|
123
|
+
| `src/pipeline/stages/rectify.ts` (P2) | `test/unit/pipeline/stages/rectify.test.ts` |
|
|
124
|
+
| `src/pipeline/stages/autofix.ts` (P2) | `test/unit/pipeline/stages/autofix.test.ts` |
|
|
125
|
+
| `src/pipeline/stages/regression.ts` (P2) | `test/unit/pipeline/stages/regression.test.ts` |
|
|
126
|
+
| `src/review/orchestrator.ts` (P2) | `test/unit/review/orchestrator.test.ts` |
|
|
127
|
+
| `src/pipeline/subscribers/hooks.ts` (P3) | `test/unit/pipeline/subscribers/hooks.test.ts` |
|
|
128
|
+
| `src/pipeline/subscribers/reporters.ts` (P3) | `test/unit/pipeline/subscribers/reporters.test.ts` |
|
|
129
|
+
| `src/pipeline/subscribers/interaction.ts` (P3) | `test/unit/pipeline/subscribers/interaction.test.ts` |
|
|
130
|
+
|
|
131
|
+
Document which integration behaviors must be preserved (extracted from `rewrite`-tagged tests):
|
|
132
|
+
- Verify fail → rectify → retry → pass
|
|
133
|
+
- Review fail → autofix → retry → pass
|
|
134
|
+
- Escalation exhausted → human-review trigger fires
|
|
135
|
+
- Story complete → hook fires + reporter receives event
|
|
136
|
+
- Full pipeline flow: routing → execution → verify → review → completion
|
|
137
|
+
|
|
138
|
+
**Gate:** Coverage gap doc written, referenced by Phase 1-4 stories.
|
|
139
|
+
|
|
140
|
+
### Phase 0 Gate
|
|
141
|
+
- [ ] All 2083+ tests pass
|
|
142
|
+
- [ ] Zero test files outside `test/unit/`, `test/integration/`, `test/e2e/`, `test/helpers/`
|
|
143
|
+
- [ ] Zero duplicate filenames
|
|
144
|
+
- [ ] Zero test files > 400 lines
|
|
145
|
+
- [ ] Integration tests in subdirectories
|
|
146
|
+
- [ ] Every test file has `RE-ARCH` tag
|
|
147
|
+
- [ ] Coverage gap doc complete
|
|
148
|
+
|
|
149
|
+
---
|
|
150
|
+
|
|
151
|
+
## Phase 1: Foundation (Event Bus + Verification Orchestrator)
|
|
152
|
+
|
|
153
|
+
**Goal:** Build the new infrastructure without changing any existing behavior. All existing code paths continue to work. New code is tested independently.
|
|
154
|
+
|
|
155
|
+
### US-P1-001: Verification Orchestrator Types
|
|
156
|
+
|
|
157
|
+
**Create:** `src/verification/types.ts` (update existing)
|
|
158
|
+
|
|
159
|
+
- Define unified `VerifyResult` with `success`, `status`, `passCount`, `failCount`, `totalCount`, `failures[]`, `rawOutput`, `durationMs`
|
|
160
|
+
- Define `VerifyContext` (config, workdir, storyId, testCommand, timeout, smartRunnerConfig, etc.)
|
|
161
|
+
- Define `StructuredTestFailure` (file, testName, error, stackTrace)
|
|
162
|
+
- Define strategy enum: `scoped | regression | deferred-regression | acceptance`
|
|
163
|
+
|
|
164
|
+
**Tests:** Unit tests for type guards and result builders
|
|
165
|
+
**Files:** `src/verification/types.ts`, `test/unit/verification/types.test.ts`
|
|
166
|
+
**Risk:** Low — additive only
|
|
167
|
+
|
|
168
|
+
### US-P1-002: Verification Orchestrator — Scoped Strategy
|
|
169
|
+
|
|
170
|
+
**Create:** `src/verification/strategies/scoped.ts`
|
|
171
|
+
|
|
172
|
+
- Extract smart-runner logic from `src/pipeline/stages/verify.ts` (lines 40-164)
|
|
173
|
+
- Accept `VerifyContext`, return `VerifyResult`
|
|
174
|
+
- Use existing `smart-runner.ts` for test file discovery
|
|
175
|
+
- Use existing `executor.ts` for test execution
|
|
176
|
+
- Use existing `parser.ts` for output parsing
|
|
177
|
+
- **Must produce identical results** to current verify stage
|
|
178
|
+
|
|
179
|
+
**Tests:** Port `test/unit/pipeline/stages/verify.test.ts` and `test/unit/pipeline/verify-smart-runner.test.ts` assertions
|
|
180
|
+
**Files:** `src/verification/strategies/scoped.ts`, `test/unit/verification/strategies/scoped.test.ts`
|
|
181
|
+
**Deps:** US-P1-001
|
|
182
|
+
|
|
183
|
+
### US-P1-003: Verification Orchestrator — Regression Strategy
|
|
184
|
+
|
|
185
|
+
**Create:** `src/verification/strategies/regression.ts`
|
|
186
|
+
|
|
187
|
+
- Extract full-suite logic from `src/execution/post-verify.ts` (lines 130-190)
|
|
188
|
+
- Extract full-suite logic from `src/execution/lifecycle/run-regression.ts` (lines 125-185)
|
|
189
|
+
- Single function: accept `VerifyContext`, return `VerifyResult`
|
|
190
|
+
- Support both inline (per-story) and deferred (end-of-run) modes via context flag
|
|
191
|
+
|
|
192
|
+
**Tests:** Port `test/unit/execution/post-verify-regression.test.ts` and `test/unit/execution/lifecycle/run-regression.test.ts` assertions
|
|
193
|
+
**Files:** `src/verification/strategies/regression.ts`, `test/unit/verification/strategies/regression.test.ts`
|
|
194
|
+
**Deps:** US-P1-001
|
|
195
|
+
|
|
196
|
+
### US-P1-004: Verification Orchestrator — Acceptance Strategy
|
|
197
|
+
|
|
198
|
+
**Create:** `src/verification/strategies/acceptance.ts`
|
|
199
|
+
|
|
200
|
+
- Extract AC test logic from `src/pipeline/stages/acceptance.ts` (lines 50-100)
|
|
201
|
+
- Extract AC test logic from `src/execution/lifecycle/acceptance-loop.ts` (lines 80-120)
|
|
202
|
+
- Accept `VerifyContext` (with specPath for AC patterns), return `VerifyResult`
|
|
203
|
+
|
|
204
|
+
**Tests:** Port `test/unit/acceptance.test.ts` and `test/integration/pipeline-acceptance.test.ts` assertions
|
|
205
|
+
**Files:** `src/verification/strategies/acceptance.ts`, `test/unit/verification/strategies/acceptance.test.ts`
|
|
206
|
+
**Deps:** US-P1-001
|
|
207
|
+
|
|
208
|
+
### US-P1-005: Verification Orchestrator — Entry Point + Rectification
|
|
209
|
+
|
|
210
|
+
**Create:** `src/verification/orchestrator.ts`
|
|
211
|
+
|
|
212
|
+
- Orchestrator class with `verifyScoped()`, `verifyRegression()`, `verifyDeferredRegression()`, `verifyAcceptance()`
|
|
213
|
+
- Each method delegates to the corresponding strategy
|
|
214
|
+
- Integrate shared rectification loop from `src/verification/rectification.ts`
|
|
215
|
+
- Consistent structured logging: `[verify:<strategy>]` prefix with `{storyId, passCount, failCount, totalCount}`
|
|
216
|
+
- Output preview always uses tail (last 20 lines), never head
|
|
217
|
+
|
|
218
|
+
**Tests:** Integration tests verifying orchestrator delegates correctly and returns unified `VerifyResult`
|
|
219
|
+
**Files:** `src/verification/orchestrator.ts`, `test/integration/verification-orchestrator.test.ts`
|
|
220
|
+
**Deps:** US-P1-002, US-P1-003, US-P1-004
|
|
221
|
+
|
|
222
|
+
### US-P1-006: Pipeline Event Bus
|
|
223
|
+
|
|
224
|
+
**Update:** `src/pipeline/events.ts` → `src/pipeline/event-bus.ts`
|
|
225
|
+
|
|
226
|
+
- Extend existing `PipelineEventEmitter` (already has `stage:enter`, `stage:exit`, `story:start`, `story:complete`, `story:escalate`, `run:complete`)
|
|
227
|
+
- Add new events:
|
|
228
|
+
- `story:fail(story, reason)`
|
|
229
|
+
- `story:skip(story, reason)`
|
|
230
|
+
- `verify:start(strategy, storyId)`
|
|
231
|
+
- `verify:result(result: VerifyResult)`
|
|
232
|
+
- `rectify:attempt(attempt, maxAttempts, remainingFailures)`
|
|
233
|
+
- `review:start(checks[])`
|
|
234
|
+
- `review:result(result: ReviewResult)`
|
|
235
|
+
- `autofix:attempt(fixType, command)`
|
|
236
|
+
- `run:start(feature, totalStories)`
|
|
237
|
+
- `run:pause(reason)`
|
|
238
|
+
- `run:error(error)`
|
|
239
|
+
- `escalation:tier-change(from, to, storyId)`
|
|
240
|
+
- `escalation:exhausted(storyId, attempts)`
|
|
241
|
+
- `interaction:request(trigger, request)`
|
|
242
|
+
- `interaction:response(trigger, response)`
|
|
243
|
+
- Keep backward compat: existing event signatures unchanged
|
|
244
|
+
- Keep old `events.ts` as re-export shim during migration
|
|
245
|
+
|
|
246
|
+
**Tests:** Unit tests for event emission and type safety
|
|
247
|
+
**Files:** `src/pipeline/event-bus.ts`, `test/unit/pipeline/event-bus.test.ts`
|
|
248
|
+
**Deps:** None (can parallel with US-P1-001–005)
|
|
249
|
+
|
|
250
|
+
### Phase 1 Gate
|
|
251
|
+
- [ ] All 2083+ existing tests pass
|
|
252
|
+
- [ ] New orchestrator tests pass
|
|
253
|
+
- [ ] Event bus tests pass
|
|
254
|
+
- [ ] No existing code modified (only new files added)
|
|
255
|
+
|
|
256
|
+
---
|
|
257
|
+
|
|
258
|
+
## Phase 2: New Pipeline Stages
|
|
259
|
+
|
|
260
|
+
**Goal:** Add new stages and retry action. Existing stages gradually delegate to orchestrator. Pipeline becomes the single execution path.
|
|
261
|
+
|
|
262
|
+
### US-P2-001: Pipeline Runner — `retry` Action
|
|
263
|
+
|
|
264
|
+
**Update:** `src/pipeline/runner.ts`
|
|
265
|
+
|
|
266
|
+
- Add `retry` to `StageAction` type in `src/pipeline/types.ts`
|
|
267
|
+
- Handle `retry` in pipeline runner: find target stage index, reset loop counter
|
|
268
|
+
- Add `MAX_STAGE_RETRIES` guard (default: 5, configurable)
|
|
269
|
+
- Track retry count per stage to prevent infinite loops
|
|
270
|
+
|
|
271
|
+
**Tests:** Unit tests: retry from verify, retry from review, max retry exceeded
|
|
272
|
+
**Files:** `src/pipeline/runner.ts`, `src/pipeline/types.ts`, `test/unit/pipeline/runner-retry.test.ts`
|
|
273
|
+
**Deps:** Phase 1 complete
|
|
274
|
+
|
|
275
|
+
### US-P2-002: `rectify` Stage
|
|
276
|
+
|
|
277
|
+
**Create:** `src/pipeline/stages/rectify.ts`
|
|
278
|
+
|
|
279
|
+
- Enabled only when `ctx.verifyResult?.success === false`
|
|
280
|
+
- Calls `VerificationOrchestrator.rectify()` — shared rectification loop
|
|
281
|
+
- On fix: return `{ action: "retry", fromStage: "verify" }`
|
|
282
|
+
- On exhausted: return `{ action: "escalate" }`
|
|
283
|
+
- Emits `rectify:attempt` events via event bus
|
|
284
|
+
|
|
285
|
+
**Tests:** Unit tests: rectify succeeds → retry, rectify exhausted → escalate, rectify skipped when verify passed
|
|
286
|
+
**Files:** `src/pipeline/stages/rectify.ts`, `test/unit/pipeline/stages/rectify.test.ts`
|
|
287
|
+
**Deps:** US-P2-001, Phase 1
|
|
288
|
+
|
|
289
|
+
### US-P2-003: `autofix` Stage
|
|
290
|
+
|
|
291
|
+
**Create:** `src/pipeline/stages/autofix.ts`
|
|
292
|
+
|
|
293
|
+
- Enabled only when `ctx.reviewResult?.passed === false`
|
|
294
|
+
- Step 1: If lint failed + `quality.commands.lintFix` configured → run command (no agent)
|
|
295
|
+
- Step 2: If format failed + `quality.commands.formatFix` configured → run command (no agent)
|
|
296
|
+
- Step 3: If typecheck failed → spawn short agent session with error output (fast tier, 60s timeout)
|
|
297
|
+
- On fix: return `{ action: "retry", fromStage: "review" }`
|
|
298
|
+
- On exhausted: return `{ action: "escalate" }`
|
|
299
|
+
- Emits `autofix:attempt` events
|
|
300
|
+
|
|
301
|
+
**Config additions:**
|
|
302
|
+
```ts
|
|
303
|
+
quality.commands.lintFix?: string // e.g., "biome check --fix"
|
|
304
|
+
quality.commands.formatFix?: string // e.g., "biome format --write"
|
|
305
|
+
quality.autofix.enabled?: boolean // default: true
|
|
306
|
+
quality.autofix.maxAttempts?: number // default: 2
|
|
307
|
+
```
|
|
308
|
+
|
|
309
|
+
**Tests:** Unit tests: lint auto-fixed, typecheck auto-fixed, autofix disabled, max attempts
|
|
310
|
+
**Files:** `src/pipeline/stages/autofix.ts`, `test/unit/pipeline/stages/autofix.test.ts`
|
|
311
|
+
**Config:** Update `src/config/schema.ts` with new fields
|
|
312
|
+
**Deps:** US-P2-001, Phase 1
|
|
313
|
+
|
|
314
|
+
### US-P2-004: `regression` Stage
|
|
315
|
+
|
|
316
|
+
**Create:** `src/pipeline/stages/regression.ts`
|
|
317
|
+
|
|
318
|
+
- Enabled only when `regressionGate.mode === "inline"` AND verify passed
|
|
319
|
+
- Calls `VerificationOrchestrator.verifyRegression()`
|
|
320
|
+
- On pass: return `{ action: "continue" }`
|
|
321
|
+
- On fail: attempt rectification internally (reuse rectify logic)
|
|
322
|
+
- If rectification fixes it: return `{ action: "continue" }`
|
|
323
|
+
- If exhausted: return `{ action: "escalate" }`
|
|
324
|
+
- Emits `verify:start("regression")` and `verify:result` events
|
|
325
|
+
|
|
326
|
+
**Tests:** Port from `test/unit/execution/post-verify-regression.test.ts`
|
|
327
|
+
**Files:** `src/pipeline/stages/regression.ts`, `test/unit/pipeline/stages/regression.test.ts`
|
|
328
|
+
**Deps:** Phase 1
|
|
329
|
+
|
|
330
|
+
### US-P2-005: Wire New Stages into Pipeline + Update `verify`/`review` Stages
|
|
331
|
+
|
|
332
|
+
**Update:** `src/pipeline/stages/index.ts`
|
|
333
|
+
|
|
334
|
+
- New default pipeline order:
|
|
335
|
+
```ts
|
|
336
|
+
[queueCheck, routing, constitution, context, prompt, optimizer,
|
|
337
|
+
execution, verify, rectify, review, autofix, regression, completion]
|
|
338
|
+
```
|
|
339
|
+
- Remove `acceptance` from per-story pipeline
|
|
340
|
+
- Create `postRunPipeline`:
|
|
341
|
+
```ts
|
|
342
|
+
[deferredRegression, acceptance]
|
|
343
|
+
```
|
|
344
|
+
|
|
345
|
+
**Update:** `src/pipeline/stages/verify.ts`
|
|
346
|
+
- Delegate to `VerificationOrchestrator.verifyScoped()`
|
|
347
|
+
- Store `VerifyResult` in `ctx.verifyResult` (new context field)
|
|
348
|
+
- Emit `verify:start` and `verify:result` events
|
|
349
|
+
- On failure: return `{ action: "continue" }` (let rectify stage handle it)
|
|
350
|
+
|
|
351
|
+
**Update:** `src/pipeline/stages/review.ts`
|
|
352
|
+
- Delegate to `ReviewOrchestrator` (or keep existing logic)
|
|
353
|
+
- Store `ReviewResult` in `ctx.reviewResult`
|
|
354
|
+
- Emit `review:start` and `review:result` events
|
|
355
|
+
- On failure: return `{ action: "continue" }` (let autofix stage handle it)
|
|
356
|
+
|
|
357
|
+
**Update:** `src/pipeline/types.ts`
|
|
358
|
+
- Add `verifyResult?: VerifyResult` to `PipelineContext`
|
|
359
|
+
|
|
360
|
+
**Tests:** Full integration test of new pipeline flow: execution → verify → rectify → review → autofix → regression → completion
|
|
361
|
+
**Files:** Multiple stage files, `test/integration/pipeline-new-flow.test.ts`
|
|
362
|
+
**Deps:** US-P2-001–004
|
|
363
|
+
|
|
364
|
+
### Phase 2 Gate
|
|
365
|
+
- [ ] All existing tests pass (some may need assertion updates for new stage order)
|
|
366
|
+
- [ ] New stage tests pass
|
|
367
|
+
- [ ] Pipeline retry action works correctly
|
|
368
|
+
- [ ] End-to-end: verify fail → rectify → retry → verify pass → continue
|
|
369
|
+
- [ ] End-to-end: review fail → autofix → retry → review pass → continue
|
|
370
|
+
|
|
371
|
+
---
|
|
372
|
+
|
|
373
|
+
## Phase 3: Subscriber Consolidation
|
|
374
|
+
|
|
375
|
+
**Goal:** Replace all scattered `fireHook()`, `getReporters()`, and `executeTrigger()` calls with event bus subscribers.
|
|
376
|
+
|
|
377
|
+
### US-P3-001: Hooks Subscriber
|
|
378
|
+
|
|
379
|
+
**Create:** `src/pipeline/subscribers/hooks.ts`
|
|
380
|
+
|
|
381
|
+
- `wireHooks(bus, hooks, workdir)` function
|
|
382
|
+
- Maps pipeline events to hook events:
|
|
383
|
+
|
|
384
|
+
| Pipeline Event | Hook Event | Current call sites to remove |
|
|
385
|
+
|---------------|------------|----------------------------|
|
|
386
|
+
| `run:start` | `on-start` | `run-setup.ts:182` |
|
|
387
|
+
| `story:start` | `on-story-start` | `sequential-executor.ts:120,204` |
|
|
388
|
+
| `story:complete` | `on-story-complete` | `completion.ts:73`, `pipeline-result-handler.ts:160` |
|
|
389
|
+
| `story:fail` | `on-story-fail` | `tier-outcome.ts:46,73,117,145` |
|
|
390
|
+
| `run:pause` | `on-pause` | `sequential-executor.ts:229,365`, `tier-escalation.ts:150` |
|
|
391
|
+
| `run:complete` | `on-complete` | `parallel-executor.ts:161` |
|
|
392
|
+
| `run:error` | `on-error` | various catch blocks |
|
|
393
|
+
|
|
394
|
+
- All `fireHook()` calls fire-and-forget (errors logged, never block pipeline)
|
|
395
|
+
|
|
396
|
+
**Tests:** Unit tests: each event fires correct hook, error in hook doesn't block pipeline
|
|
397
|
+
**Files:** `src/pipeline/subscribers/hooks.ts`, `test/unit/pipeline/subscribers/hooks.test.ts`
|
|
398
|
+
**Deps:** Phase 2
|
|
399
|
+
|
|
400
|
+
### US-P3-002: Reporter Subscriber
|
|
401
|
+
|
|
402
|
+
**Create:** `src/pipeline/subscribers/reporters.ts`
|
|
403
|
+
|
|
404
|
+
- `wireReporters(bus, pluginRegistry)` function
|
|
405
|
+
- Maps pipeline events to reporter methods:
|
|
406
|
+
|
|
407
|
+
| Pipeline Event | Reporter Method | Current call sites to remove |
|
|
408
|
+
|---------------|----------------|----------------------------|
|
|
409
|
+
| `run:start` | `onRunStart()` | `run-initialization.ts` (implicit) |
|
|
410
|
+
| `story:complete` | `onStoryComplete()` | `pipeline-result-handler.ts:94,145`, `lifecycle/story-hooks.ts:38` |
|
|
411
|
+
| `run:complete` | `onRunEnd()` | `run-cleanup.ts:40`, `pipeline-result-handler.ts:369` |
|
|
412
|
+
|
|
413
|
+
- Fire-and-forget with error logging
|
|
414
|
+
|
|
415
|
+
**Tests:** Unit tests: reporter methods called with correct event data
|
|
416
|
+
**Files:** `src/pipeline/subscribers/reporters.ts`, `test/unit/pipeline/subscribers/reporters.test.ts`
|
|
417
|
+
**Deps:** Phase 2
|
|
418
|
+
|
|
419
|
+
### US-P3-003: Interaction Subscriber
|
|
420
|
+
|
|
421
|
+
**Create:** `src/pipeline/subscribers/interaction.ts`
|
|
422
|
+
|
|
423
|
+
- `wireInteraction(bus, interactionChain, config)` function
|
|
424
|
+
- Maps pipeline events to triggers:
|
|
425
|
+
|
|
426
|
+
| Pipeline Event | Trigger | Current call site to remove |
|
|
427
|
+
|---------------|---------|---------------------------|
|
|
428
|
+
| `escalation:exhausted` | `human-review` | `pipeline-result-handler.ts:222` |
|
|
429
|
+
| `escalation:exhausted` | `max-retries` | `pipeline-result-handler.ts` |
|
|
430
|
+
| `review:result` (security fail) | `security-review` | not yet wired |
|
|
431
|
+
| `verify:result` (conflict) | `merge-conflict` | not yet wired |
|
|
432
|
+
| `run:complete` (pre-merge) | `pre-merge` | not yet wired |
|
|
433
|
+
| `story:start` (ambiguous) | `story-ambiguity` | not yet wired |
|
|
434
|
+
| `review:result` (gate) | `review-gate` | not yet wired |
|
|
435
|
+
|
|
436
|
+
- `cost-exceeded` and `cost-warning` → emit from executor when cost check runs
|
|
437
|
+
|
|
438
|
+
**Tests:** Unit tests: triggers fire on correct events, disabled triggers don't fire
|
|
439
|
+
**Files:** `src/pipeline/subscribers/interaction.ts`, `test/unit/pipeline/subscribers/interaction.test.ts`
|
|
440
|
+
**Deps:** Phase 2
|
|
441
|
+
|
|
442
|
+
### US-P3-004: Wire Subscribers at Startup
|
|
443
|
+
|
|
444
|
+
**Update:** `src/execution/sequential-executor.ts`
|
|
445
|
+
|
|
446
|
+
- At loop start: create event bus, call `wireHooks()`, `wireReporters()`, `wireInteraction()`
|
|
447
|
+
- Pass event bus to `runPipeline()` (already accepts `eventEmitter` param)
|
|
448
|
+
- **Remove** all direct `fireHook()` calls from sequential-executor
|
|
449
|
+
- **Remove** all direct `getReporters()` calls from pipeline-result-handler
|
|
450
|
+
- **Remove** all direct `executeTrigger()` calls from pipeline-result-handler
|
|
451
|
+
|
|
452
|
+
**Update:** `src/execution/parallel-executor.ts`
|
|
453
|
+
- Same: wire subscribers, remove direct calls
|
|
454
|
+
|
|
455
|
+
**Update:** `src/pipeline/stages/completion.ts`
|
|
456
|
+
- Remove direct `fireHook("on-story-complete")` — now fires from subscriber
|
|
457
|
+
- Instead: emit `story:complete` event
|
|
458
|
+
|
|
459
|
+
**Update:** `src/execution/escalation/tier-outcome.ts`
|
|
460
|
+
- Remove 4x `fireHook()` calls — now fires from subscriber
|
|
461
|
+
- Instead: emit `story:fail` event from escalation handler
|
|
462
|
+
|
|
463
|
+
**Tests:** Integration tests verifying hooks/reporters/triggers fire correctly via event bus
|
|
464
|
+
**Files:** Multiple files updated, `test/integration/subscriber-wiring.test.ts`
|
|
465
|
+
**Deps:** US-P3-001–003
|
|
466
|
+
|
|
467
|
+
### Phase 3 Gate
|
|
468
|
+
- [ ] All existing tests pass
|
|
469
|
+
- [ ] Zero direct `fireHook()` calls remain in pipeline stages
|
|
470
|
+
- [ ] Zero direct `fireHook()` calls remain in execution/ (except lifecycle setup/cleanup if needed)
|
|
471
|
+
- [ ] Zero direct `getReporters()` calls remain in pipeline-result-handler
|
|
472
|
+
- [ ] Zero direct `executeTrigger()` calls remain in pipeline-result-handler
|
|
473
|
+
- [ ] All hooks fire correctly via event bus
|
|
474
|
+
- [ ] All reporters receive events via event bus
|
|
475
|
+
|
|
476
|
+
---
|
|
477
|
+
|
|
478
|
+
## Phase 4: Executor Simplification
|
|
479
|
+
|
|
480
|
+
**Goal:** Remove all ad-hoc orchestration code. Delete deprecated files. Simplify executor to ~80-100 lines.
|
|
481
|
+
|
|
482
|
+
### US-P4-001: Remove Routing Duplication
|
|
483
|
+
|
|
484
|
+
**Update:** `src/execution/sequential-executor.ts`
|
|
485
|
+
|
|
486
|
+
- Remove `routeTask()` call (lines ~170-200)
|
|
487
|
+
- Remove `applyCachedRouting()` call
|
|
488
|
+
- Pipeline `routing` stage is now the single source of routing
|
|
489
|
+
- Executor reads routing result from `pipelineResult.context.routing`
|
|
490
|
+
|
|
491
|
+
**Tests:** Verify routing works correctly via pipeline stage only
|
|
492
|
+
**Files:** `src/execution/sequential-executor.ts`
|
|
493
|
+
**Deps:** Phase 3
|
|
494
|
+
|
|
495
|
+
### US-P4-002: Remove Post-Verify from Result Handler
|
|
496
|
+
|
|
497
|
+
**Update:** `src/execution/pipeline-result-handler.ts`
|
|
498
|
+
|
|
499
|
+
- Remove `runPostAgentVerification()` call from `handlePipelineSuccess()`
|
|
500
|
+
- Pipeline `regression` stage now handles this
|
|
501
|
+
- `handlePipelineSuccess()` reduces to: collect metrics, update PRD, log progress
|
|
502
|
+
- `handlePipelineFailure()` reduces to: check escalation budget, update story status
|
|
503
|
+
|
|
504
|
+
**Tests:** Port `test/unit/execution/post-verify.test.ts` assertions to regression stage tests
|
|
505
|
+
**Files:** `src/execution/pipeline-result-handler.ts`
|
|
506
|
+
**Deps:** Phase 3
|
|
507
|
+
|
|
508
|
+
### US-P4-003: Simplify Executor Loop
|
|
509
|
+
|
|
510
|
+
**Update:** `src/execution/sequential-executor.ts`
|
|
511
|
+
|
|
512
|
+
- Remove `preIterationTierCheck()` — escalation now handled by pipeline stages returning `escalate`
|
|
513
|
+
- Remove story-level hook calls — handled by subscribers
|
|
514
|
+
- Remove cost check logic — emit to event bus, interaction subscriber handles it
|
|
515
|
+
- Simplified loop:
|
|
516
|
+
```ts
|
|
517
|
+
for (let i = 0; i < maxIterations; i++) {
|
|
518
|
+
const story = getNextStory(prd)
|
|
519
|
+
if (!story) break
|
|
520
|
+
|
|
521
|
+
bus.emit("story:start", story, routing)
|
|
522
|
+
const result = await runPipeline(defaultPipeline, pipelineContext, bus)
|
|
523
|
+
|
|
524
|
+
switch (result.finalAction) {
|
|
525
|
+
case "complete": storiesCompleted++; break
|
|
526
|
+
case "escalate": bumpTier(story); break
|
|
527
|
+
case "fail": markFailed(story); break
|
|
528
|
+
case "pause": bus.emit("run:pause", result.reason); return
|
|
529
|
+
case "skip": break
|
|
530
|
+
}
|
|
531
|
+
}
|
|
532
|
+
|
|
533
|
+
await runPipeline(postRunPipeline, postRunContext, bus)
|
|
534
|
+
bus.emit("run:complete", buildSummary())
|
|
535
|
+
```
|
|
536
|
+
|
|
537
|
+
**Tests:** Full integration test of simplified executor
|
|
538
|
+
**Files:** `src/execution/sequential-executor.ts`
|
|
539
|
+
**Deps:** US-P4-001, US-P4-002
|
|
540
|
+
|
|
541
|
+
### US-P4-004: Delete Deprecated Files + Cleanup
|
|
542
|
+
|
|
543
|
+
**Delete:**
|
|
544
|
+
|
|
545
|
+
| File | Lines | Replaced by |
|
|
546
|
+
|------|-------|------------|
|
|
547
|
+
| `src/execution/post-verify.ts` | 193 | `src/pipeline/stages/regression.ts` |
|
|
548
|
+
| `src/execution/post-verify-rectification.ts` | 190 | `src/pipeline/stages/rectify.ts` |
|
|
549
|
+
| `src/execution/verification.ts` | 72 | `src/verification/orchestrator.ts` |
|
|
550
|
+
| `src/execution/rectification.ts` | 13 | `src/verification/orchestrator.ts` |
|
|
551
|
+
| `src/verification/gate.ts` | 208 | `src/verification/orchestrator.ts` |
|
|
552
|
+
| `src/execution/lifecycle/story-hooks.ts` | 38 | `src/pipeline/subscribers/reporters.ts` |
|
|
553
|
+
|
|
554
|
+
**Update test files:**
|
|
555
|
+
|
|
556
|
+
| Test file | Action |
|
|
557
|
+
|-----------|--------|
|
|
558
|
+
| `test/unit/execution/post-verify.test.ts` | Delete (replaced by regression stage tests) |
|
|
559
|
+
| `test/unit/execution/post-verify-regression.test.ts` | Delete (replaced by regression strategy tests) |
|
|
560
|
+
| `test/unit/execution/lifecycle/run-regression.test.ts` | Update to test thin wrapper |
|
|
561
|
+
| `test/integration/rectification-flow.test.ts` | Update to use orchestrator |
|
|
562
|
+
| `test/integration/verify-stage.test.ts` | Update to verify orchestrator delegation |
|
|
563
|
+
|
|
564
|
+
**Cleanup:**
|
|
565
|
+
- Remove all `@deprecated` shim re-exports from `src/execution/index.ts`
|
|
566
|
+
- Remove unused imports across codebase
|
|
567
|
+
- Run `biome check --fix` for final cleanup
|
|
568
|
+
|
|
569
|
+
**Tests:** Full test suite must pass with zero skipped tests
|
|
570
|
+
**Files:** Multiple deletions and updates
|
|
571
|
+
**Deps:** US-P4-001–003
|
|
572
|
+
|
|
573
|
+
### Phase 4 Gate
|
|
574
|
+
- [ ] All tests pass
|
|
575
|
+
- [ ] Zero deprecated shim files remain
|
|
576
|
+
- [ ] `sequential-executor.ts` < 120 lines
|
|
577
|
+
- [ ] `pipeline-result-handler.ts` < 200 lines
|
|
578
|
+
- [ ] No direct `fireHook()` in stages or executors
|
|
579
|
+
- [ ] No direct `getReporters()` in result handlers
|
|
580
|
+
- [ ] No direct `executeTrigger()` in result handlers
|
|
581
|
+
- [ ] `bun run typecheck` clean
|
|
582
|
+
- [ ] `bun run lint` clean
|
|
583
|
+
|
|
584
|
+
---
|
|
585
|
+
|
|
586
|
+
## Summary: File Changes
|
|
587
|
+
|
|
588
|
+
### New Files (12)
|
|
589
|
+
|
|
590
|
+
| File | Phase |
|
|
591
|
+
|------|-------|
|
|
592
|
+
| `src/verification/strategies/scoped.ts` | 1 |
|
|
593
|
+
| `src/verification/strategies/regression.ts` | 1 |
|
|
594
|
+
| `src/verification/strategies/acceptance.ts` | 1 |
|
|
595
|
+
| `src/verification/orchestrator.ts` | 1 |
|
|
596
|
+
| `src/pipeline/event-bus.ts` | 1 |
|
|
597
|
+
| `src/pipeline/stages/rectify.ts` | 2 |
|
|
598
|
+
| `src/pipeline/stages/autofix.ts` | 2 |
|
|
599
|
+
| `src/pipeline/stages/regression.ts` | 2 |
|
|
600
|
+
| `src/pipeline/subscribers/hooks.ts` | 3 |
|
|
601
|
+
| `src/pipeline/subscribers/reporters.ts` | 3 |
|
|
602
|
+
| `src/pipeline/subscribers/interaction.ts` | 3 |
|
|
603
|
+
| `src/review/orchestrator.ts` | 2 |
|
|
604
|
+
|
|
605
|
+
### Modified Files (Key)
|
|
606
|
+
|
|
607
|
+
| File | Phase | Change |
|
|
608
|
+
|------|-------|--------|
|
|
609
|
+
| `src/verification/types.ts` | 1 | Add VerifyResult, VerifyContext |
|
|
610
|
+
| `src/pipeline/types.ts` | 2 | Add retry action, verifyResult to context |
|
|
611
|
+
| `src/pipeline/runner.ts` | 2 | Handle retry action |
|
|
612
|
+
| `src/pipeline/stages/index.ts` | 2 | New stage order |
|
|
613
|
+
| `src/pipeline/stages/verify.ts` | 2 | Delegate to orchestrator |
|
|
614
|
+
| `src/pipeline/stages/review.ts` | 2 | Delegate to orchestrator |
|
|
615
|
+
| `src/config/schema.ts` | 2 | Add lintFix, formatFix, autofix config |
|
|
616
|
+
| `src/execution/sequential-executor.ts` | 3-4 | Wire subscribers, simplify loop |
|
|
617
|
+
| `src/execution/pipeline-result-handler.ts` | 4 | Remove post-verify, simplify |
|
|
618
|
+
| `src/execution/escalation/tier-outcome.ts` | 3 | Remove fireHook calls |
|
|
619
|
+
| `src/pipeline/stages/completion.ts` | 3 | Remove fireHook, emit event |
|
|
620
|
+
|
|
621
|
+
### Deleted Files (6)
|
|
622
|
+
|
|
623
|
+
| File | Phase | Lines removed |
|
|
624
|
+
|------|-------|--------------|
|
|
625
|
+
| `src/execution/post-verify.ts` | 4 | 193 |
|
|
626
|
+
| `src/execution/post-verify-rectification.ts` | 4 | 190 |
|
|
627
|
+
| `src/execution/verification.ts` | 4 | 72 |
|
|
628
|
+
| `src/execution/rectification.ts` | 4 | 13 |
|
|
629
|
+
| `src/verification/gate.ts` | 4 | 208 |
|
|
630
|
+
| `src/execution/lifecycle/story-hooks.ts` | 4 | 38 |
|
|
631
|
+
|
|
632
|
+
**Net:** +12 files, -6 files, ~714 lines deleted from deprecated code
|
|
633
|
+
|
|
634
|
+
---
|
|
635
|
+
|
|
636
|
+
## Risk Mitigation
|
|
637
|
+
|
|
638
|
+
| Risk | Mitigation |
|
|
639
|
+
|------|-----------|
|
|
640
|
+
| Regression from large refactor | Each phase independently testable; full suite gate between phases |
|
|
641
|
+
| Retry infinite loops | `MAX_STAGE_RETRIES` hard cap (default: 5) |
|
|
642
|
+
| Event bus debugging difficulty | Structured logging on all event emissions; `debug` log level shows all events |
|
|
643
|
+
| Backward compatibility | Phase 1 is additive only; deprecated shims kept until Phase 4 |
|
|
644
|
+
| Test file updates | Track which tests need updating per phase; never delete a test without replacement |
|
|
645
|
+
| TDD verdict.ts integration | Phase 2 — update verdict.ts to call orchestrator; test TDD flow end-to-end |
|
|
646
|
+
|
|
647
|
+
---
|
|
648
|
+
|
|
649
|
+
## Implementation Order Within Each Phase
|
|
650
|
+
|
|
651
|
+
Phase 1: P1-001 → P1-002 → P1-003 → P1-004 → P1-005 (sequential, each builds on types)
|
|
652
|
+
Phase 1: P1-006 can run in parallel with P1-001–005
|
|
653
|
+
Phase 2: P2-001 first (retry action), then P2-002–004 in parallel, then P2-005 last (wiring)
|
|
654
|
+
Phase 3: P3-001–003 in parallel (independent subscribers), then P3-004 (wiring)
|
|
655
|
+
Phase 4: P4-001 → P4-002 → P4-003 → P4-004 (sequential, each simplifies more)
|