@tekyzinc/gsd-t 3.29.11 → 4.0.14

package/CHANGELOG.md

@@ -2,6 +2,177 @@
 
 All notable changes to GSD-T are documented here. Updated with each release.
 
+## [4.0.14] - 2026-05-29 (M67 Scan Deep Document Phase — patch)
+
+### Added — deterministic deep document cross-population in the scan Workflow
+
+M66 made the tech-debt register deep but left living-document cross-population as a non-deterministic "lead-agent follow-on" — effectively dropped, a regression vs the old prose scan's Step 5. M67 adds a `Document` phase to `templates/workflows/gsd-t-scan.workflow.js` (between Synthesis and Render) that fans out **one agent per document**, each drawing on the same slices + verified findings the finders produced, so the docs are as thorough as the register.
+
+- `templates/workflows/gsd-t-scan.workflow.js`: new `Document` phase produces `docs/{architecture,workflows,infrastructure,requirements}.md` + `README.md` (merge-not-overwrite, Edit-not-Write on existing files) and the five `.gsd-t/scan/{architecture,security,quality,business-rules,contract-drift}.md` dimension files in the renderer's parsed formats. Component map + a user journey per feature-domain slice. Synthesis no longer writes the dimension files (moved to the doc stage); runs before Render so the HTML report reads the deep `architecture.md`.
+- Red Team (FAIL → GRUDGING-PASS, 1 fix cycle): HIGH-1 doc-clobber data-loss → deterministic `.gsd-t/scan/.doc-backup/` snapshot before the fan-out; HIGH-2 render double-count → grand total written as a `| Grand Total | N files | LOC |` table row that the parser short-circuits on (verified 1809, not 1919); LOW → dropped `-f` from git add + pathspec-excluded and gitignored `.doc-backup`.
+- `commands/gsd-t-scan.md`, `commands/gsd-t-help.md`, `templates/CLAUDE-global.md`: doc-ripple for the new phase. `.gitignore`: `.gsd-t/scan/.doc-backup/`.
+
+Suite: 1267 pass / 0 fail / 4 skip — zero regressions.
+
+## [4.0.13] - 2026-05-29 (M66 Scan Volume-Scaled Workflow Migration — patch)
+
+### Fixed — scan-depth regression: scan now fans out by codebase volume, not a fixed 5-teammate count
+
+Scan was the only major phase never migrated to a native Workflow. It hard-coded exactly 5 teammates (one per dimension) with zero volume scaling — a 5-file repo and a 1,809-file repo both got 5 agents, so a single `quality` agent sampled the top ~5 issues across the whole codebase and stopped. On a large codebase that produced a cursory 16-item register where a deep per-domain scan surfaced 117 findings. It also referenced a retired `autoSpawnHeadless()` + `headless-default-contract v2.0.0`.
+
+- `templates/workflows/gsd-t-scan.workflow.js` (NEW): `preflight → volume-probe (derives a per-area slice list, scaling 1-3 slices tiny → 15-40 large) → pipeline(per-slice deep finder "enumerate don't sample" → single verify) → deterministic JS archive + TD-numbering → synthesis (dedup/merge/re-rank) → render`. Slice depth is budget-aware.
+- `commands/gsd-t-scan.md`: rewritten as a thin `Workflow({scriptPath, args})` invoker; dead `autoSpawnHeadless`/`headless-default-contract v2.0.0` references stripped.
+- Red Team (FAIL → GRUDGING-PASS, 2 fix cycles): prose-driven archive/TD-numbering → deterministic JS (`fs.renameSync` collision-safe + `_parseMaxTd` + prior register content threaded into synthesis); render hollow-report guard + prompt↔parser format alignment; pipeline stage-2 defensive signature; probe model haiku→sonnet.
+- Doc-ripple: removed retired fixed-5-teammate scan-dimension references from `gsd-t-{complete-milestone,gap-analysis,feature,init-scan-setup}.md`; `templates/CLAUDE-global.md` + `commands/gsd-t-help.md`.
+
+Suite: 1267 pass / 0 fail / 4 skip — zero regressions.
+
+## [4.0.12] - 2026-05-29
+
+### Removed — M61-carryover test cleanup (green the suite)
+
+The SC7 cockpit walkthrough surfaced ~23 unit + ~19 E2E pre-existing failures, all tests asserting conventions or files that M61 intentionally retired (command→Workflow conversion removed the marker/wire-in blocks; D4 retired the viewer/dashboard). Delete-with-subject cleanup — no behavior change.
+
+- Removed wire-in/marker tests: `m56-d3-wire-in`, `m56-d4-wire-in`, `m55-d5-wire-in-{execute,verify}`, `m56-d5-stream-json-gap-closures` (the last required D3-deleted `gsd-t-capture-lint.cjs`).
+- Removed 8 viewer/transcript unit tests + 3 journey-coverage staging tests coupled to the deleted viewer HTML.
+- Removed orphaned E2E specs: all 6 `e2e/viewer/*`, 13 viewer-dependent `e2e/journeys/*`, `main-session-stream`, all 4 `e2e/live-journeys/*`. Kept the 3 `verify-gate-blocks-*` journeys (verify-gate is KEEP).
+- Deleted `scripts/gsd-t-transcript.html` (96KB retired D4 viewer); pruned `.gsd-t/journey-manifest.json` 19→3 specs; generalized `bin/journey-coverage.cjs` `VIEWER_FILE_PATTERNS` to `scripts/*.html`; cleaned 2 pre-commit hooks.
+- `test/stack-rules.test.js`: dropped per-command-file Detection-block assertions (kept engine + QA-protocol checks). `test/filesystem.test.js`: command counts 55→51 / 49→45 (D2 retired 4 commands).
+
+Suite now 1267 pass / 1 known flake (`verifyPlaywrightHealth` — passes 20/0 isolated; suite-contention subprocess timeout) / 3 sqlite-skip. E2E 3 pass. journey-coverage clean. bin/ unchanged at 20,271 LOC.
+
+## [4.0.11] - 2026-05-29 (M65 Orchestration-Shell Retirement — patch)
+
+Completes the M61 D6 deferral: deletes the M40/M44 orchestration shell that the native Workflow scripts replaced. Scope was corrected from the raw brief after a live reference scan proved `parallel-cli*` and `gsd-t-parallel.cjs` are KEEP-list substrate (verify-gate Track-2 + the `_lib` file-disjointness prover), not retireable shell — they were retained.
+
+### Removed (bin/, −1,780 LOC: 22,051 → 20,271)
+
+| File(s) | Native replacement |
+|---------|--------------------|
+| `bin/gsd-t-orchestrator.js` + `-worker.cjs` + `-queue.cjs` + `-config.cjs` | `templates/workflows/gsd-t-execute.workflow.js` |
+| `bin/spawn-plan-{writer,status-updater,derive}.cjs` + `scripts/spawn-plan-fmt-tokens.cjs` | Native `/workflows` progress + Agent View |
+| `bin/headless-exit-codes.cjs` | `mapHeadlessExitCode` inlined into `bin/gsd-t.js` (5-code contract + M45 boundary-anchored regexes verbatim) |
+| `scripts/gsd-t-post-commit-spawn-plan.sh` + `templates/hooks/post-commit-spawn-plan.sh` | — (spawn-plan panel retired with the M61-D4 viewer) |
+
+### Removed CLI subcommands
+- `gsd-t orchestrate` — superseded by `gsd-t-execute.workflow.js`.
+
+### Removed tests (delete-with-subject)
+- `test/m40-orchestrator-{config,queue,worker}.test.js`, `test/m44-d8-{spawn-plan-writer,spawn-plan-status-updater,post-commit-hook}.test.js` (each tested only a co-deleted module).
+
+### Changed
+- `bin/gsd-t-parallel.cjs` — inlined `computeInSessionHeadroom`/`computeUnattendedGate`/`DEFAULT_SUMMARY_SIZE_PCT` (wave-join-contract §Mode-Aware Gating Math, constants 85/60/4) off the deleted orchestrator-config; refreshed stale header.
+- `bin/gsd-t.js` — purged 10 stale `PROJECT_BIN_TOOLS` entries pointing at M61-deleted files (would have broken `update-all`).
+- `commands/gsd-t-help.md` — removed spawn-plan/parallelism panel bullets (referenced deleted hook + retired dashboard).
+- `commands/gsd-t-resume.md` — removed dead Step 0.3 "Orchestrator Run Recovery" section.
+
+### Deferred (NOT in M65)
+- `bin/orchestrator.js` + `bin/design-orchestrator.js` — the design-build pipeline orchestrator; `gsd-t design-build` is documented but has no live dispatch case (unwired). Wire-back-or-retire is a separate decision.
+
+### Verification
+- Red Team (opus): GRUDGING PASS — 0 CRITICAL/HIGH, both inlines byte-faithful (25-case adversarial corpus → 100% parity vs parent sources).
+- QA (sonnet): PASS — zero M65-caused failures; −66 test-count drop fully accounted by the 6 deleted files.
+- `/code-review ultra`: skipped (pure deletion + verbatim inlines, covered by RT+QA).
+- `gsd-t doctor` clean; `gsd-t build-coverage` PASS; `gsd-t parallel --dry-run` exit 0 (KEEP-canary).
+- Verdict **VERIFIED-WITH-WARNINGS**: the verify-gate/ci-parity reds are 100% inherited M61 D1–D8 carryover (23 broken unit tests + ~18 orphaned viewer E2E specs importing the M61-D4-deleted `gsd-t-dashboard-server.js`), proven against parent commit `5a5c6c0^` (1427 pass / 22 fail). M65 introduced zero regressions. Carryover flagged for a dedicated M61-cleanup milestone.
+
+## [4.0.10] - 2026-05-29 (M61 Platform Reconciliation — major)
+
+### BREAKING CHANGES
+
+GSD-T v4.0.10 retires ~18,000 LOC of orchestration infrastructure built across M34–M55 to compensate for limitations Claude Code has since absorbed natively (1M context window, native background Workflows with `parallel()`/`pipeline()`/`budget`/schema-validation, `/usage`, `/context`, `/workflows`, comprehensive hooks, `/code-review ultra`).
+
+The v3.x source is preserved on the `v3.x-legacy` git branch as a safety net. `npm install @tekyzinc/gsd-t@3.x` continues to work.
+
+#### Removed CLI subcommands
+
+| Subcommand | Replacement |
+|------------|-------------|
+| `gsd-t unattended` (+ `-watch`, `-stop`) | Native background Workflows + `/loop` skill |
+| `gsd-t backfill-tokens` | None — historical analysis was never load-bearing |
+| `gsd-t capture-lint` | None — the OBSERVABILITY block convention itself is retired |
+| `gsd-t tool-cost` | OpenTelemetry exports (Enterprise) or `/usage` aggregate |
+| `gsd-t report tokens` | `/usage` |
+| `gsd-t stream-feed` | `/workflows` + Agent View |
+| `gsd-t benchmark-orchestrator` | None — operator-run benchmark driver |
+
+#### Removed slash commands
+
+| Command | Replacement |
+|---------|-------------|
+| `/gsd-t-unattended`, `/gsd-t-unattended-watch`, `/gsd-t-unattended-stop` | Native background Workflows |
+| `/gsd-t-visualize` | `/workflows` |
+
+#### Removed CLAUDE.md rules
+
+| Rule (global + project) | Replacement |
+|------------------------|-------------|
+| **Observability Logging (MANDATORY)** | Workflow `budget` global + native `/usage` |
+| **Token Capture Rule (MANDATORY)** | Same |
+| **In-Session Conversation Capture (M45 D2)** | Native session transcript + `/workflows` view |
+| **Always-Headless Spawn (M43 D4) — Channel Separation** | Native Workflows are inherently background |
+| **Context Meter (M34/M38)** | Native `/context` + Workflow `budget.remaining()` |
+| **Mandatory Preflight Before Spawn (M55)** | REWRITTEN as Preflight Gate — invoked inside Workflow scripts via `_lib.runPreflight()` |
+| **Brief-First Worker Rule (M55)** | REWRITTEN — invoked inside Workflow `agent()` calls; per-domain briefs generated inside `parallel()` map |
+| **Two-Track Verify-Gate (M55)** | REWRITTEN as a stage inside `gsd-t-verify.workflow.js`, now followed by M57 CI-parity + M58 test-data purge + orthogonal validation triad |
+
+#### Removed contracts
+
+`headless-contract.md`, `headless-default-contract.md`, `context-meter-contract.md`, `dashboard-server-contract.md`, `conversation-capture-contract.md`, `live-activity-contract.md`, `parallelism-report-contract.md`, `compaction-events-contract.md`, `event-schema-contract.md`, `economics-estimator-contract.md`, `metrics-schema-contract.md`.
+
+#### Added contracts
+
+- **`orthogonal-validation-contract.md` v1.0.0 STABLE** — locks `/code-review ultra` + Red Team + QA as orthogonal objective functions. No collapse, no substitution, no transitive trust. `skipUltra=true` is INELIGIBLE for `VERIFIED`.
+
+#### Added files
+
+- **`templates/workflows/_lib.js`** — shared Workflow helpers (`runPreflight`, `generateBrief`, `proveFileDisjointness`, `runVerifyGate`, `loadProtocol`, `readDomainTasks`, `readScope`). Prefers project-local `bin/<tool>.cjs` with PATH fallback.
+- **`templates/workflows/gsd-t-execute.workflow.js`** — canonical execute phase as native Workflow.
+- **`templates/workflows/gsd-t-verify.workflow.js`** — verify phase with M57 + M58 gates + orthogonal triad.
+- **`templates/workflows/gsd-t-wave.workflow.js`** — composes execute + verify.
+- **`templates/workflows/gsd-t-integrate.workflow.js`**, **`-debug`**, **`-quick`**, **`-phase`** (generic upper-stage runner).
+
+#### Reframed validation protocols
+
+`templates/prompts/{qa,red-team,design-verify}-subagent.md` methodology bodies unchanged. Only the invocation-context preamble updated: when invoked as a Workflow `agent()` stage, final emission is a StructuredOutput JSON envelope matching the schema; when invoked as a Task subagent (legacy path), final emission is the markdown report. Same methodology; different envelope.
+
+Red Team verdict string canonicalized: `GRUDGING PASS` → `GRUDGING-PASS` across schema enum, protocol body, global rule, and 3 command files.
+
+#### Command file conversions
+
+All 12 GSD-T command files converted from prose-orchestrator scaffolding (~6,000 lines total) to thin Workflow invokers (~700 lines total):
+- `execute` (984 → 67), `verify` (595 → 78), `wave` (454 → 65), `integrate` (394 → 69), `debug` (558 → 72), `quick` (legacy preserved → minimal), `partition` (560 → 49), `plan` (491 → 45), `impact` (314 → 45), `milestone` (143 → 44), `prd` (330 → 44), `design-decompose` (517 → 44), `doc-ripple` (156 → 40).
+
+Each command file now describes WHAT (its phase's purpose) and invokes its corresponding Workflow script with explicit `args` shape.
+
+#### Migration guide
+
+| If you were using… | …now use this |
+|--------------------|---------------|
+| `gsd-t-unattended` for cross-session orchestration | Native background Workflows + `/loop` for recurring tasks |
+| `gsd-t backfill-tokens` for historical cost analysis | OpenTelemetry exports (Enterprise) |
+| `captureSpawn`/`recordSpawnRow` wrappers in your own scripts | Workflow `budget.spent()` / `/usage` |
+| `gsd-t stream-feed` watching dashboard | `/workflows` + Agent View |
+| Custom orchestrator code on top of `gsd-t-orchestrator.js` | Write a Workflow script in `templates/workflows/` style |
+| Editing `commands/gsd-t-*.md` to add steps | Edit the corresponding `templates/workflows/*.workflow.js` |
+
+If you cannot migrate immediately, pin `"@tekyzinc/gsd-t": "3.x"` in package.json. v3.x is preserved on the `v3.x-legacy` git branch.
+
+### Verification
+
+- Baseline locked at v3.29.11: bin/ = 37,785 LOC / 109 files.
+- Post-M61: bin/ = 19,855 LOC / 78 files. Reduction: -17,930 LOC (47% of bin/ retired; 70% of way to SC1 target ≤12,000).
+- Full unit suite: 41 failures remain post-Wave-3. 100% are command-file format tests (M56-D3 markers, Stack Rules, preflight wire-in blocks, OBSERVABILITY LOGGING tests, `shim_one_liner_*`) for the legacy command-file shape the Workflow conversions explicitly replace, + command-count tests for retired subcommands. Zero new behavior regressions.
+- 4.8 audit (fresh-context Opus 4.8 review Workflow) returned `agree-with-edits` on all 8 artifact groups: core architecture sound, no revert needed.
+- Retire→native map archived under `.gsd-t/milestones/m61-platform-reconciliation-2026-05-29/retire-to-native-map.md`.
+
+### Deferred to follow-up milestones
+
+- **M62 (post-M61): Cross-project propagation** — run `gsd-t version-update-all` to propagate v4.0.10 to all registered projects (rewrite their CLAUDE.md + retire docs; cleanup `~/.claude/settings.json` hooks for retired infrastructure).
+- **SC7 cockpit walkthrough** — scripted desktop-only walkthrough of a small post-M61 backlog item (zero terminal keystrokes). User-driven.
+- **D6 port-then-delete completion** — `bin/gsd-t-orchestrator.js`, `gsd-t-orchestrator-{worker,queue,config}.cjs`, `gsd-t-parallel.cjs`, `parallel-cli.cjs`, `spawn-plan-writer.cjs` are stubbed to load cleanly post-D2/D4 but await final deletion after a real M58 reproduction via the Workflow scripts validates the migration. Expected ~6,000 LOC additional reduction.
+- **Deeper SC7 walkthrough on a UI-heavy milestone** — broader test of desktop's browser-tooling advantage.
+
 ## [3.29.11] - 2026-05-29 09:57 PDT
 
 ### Fixed — CRITICAL test-data adapter data-destruction bug (M60)

package/bin/gsd-t-parallel.cjs

@@ -10,14 +10,15 @@
  *   - D1 task graph           (bin/gsd-t-task-graph.cjs)
  *   - D4 depgraph validation  (bin/gsd-t-depgraph-validate.cjs)
  *   - D5 file-disjointness    (bin/gsd-t-file-disjointness.cjs)
- *   - D6 economics estimator  (bin/gsd-t-economics.cjs)
- *   - token-budget            (bin/token-budget.cjs) — in-session ctxPct
- *   - mode-aware gating math  (bin/gsd-t-orchestrator-config.cjs)
+ *   - mode-aware gating math  (inlined below — formerly bin/gsd-t-orchestrator-config.cjs)
  *
- * Does NOT replace `bin/gsd-t-orchestrator.js`. `runParallel` prepares the
- * validated ready-task set and plan; the existing orchestrator machinery
- * owns the actual worker spawn. In T2 this module emits the plan;
- * the downstream orchestrator consumes it.
+ * M61/M65 note: the economics estimator (gsd-t-economics.cjs), token-budget,
+ * and the M40 orchestrator (bin/gsd-t-orchestrator.js) were retired — the
+ * orchestration core moved to native Workflow scripts (templates/workflows/).
+ * This module survives as the file-disjointness/ready-task planner consumed by
+ * `_lib.proveFileDisjointness()`; its mode-aware gating helpers, which used to
+ * live in gsd-t-orchestrator-config.cjs, are inlined below (M65) so this file
+ * no longer depends on the retired orchestrator config.
  *
  * Contract: `.gsd-t/contracts/wave-join-contract.md` v1.1.0 (§Mode-Aware Gating Math).
  *
@@ -35,11 +36,61 @@ const path = require("node:path");
 const { buildTaskGraph, getReadyTasks } = require(path.join(__dirname, "gsd-t-task-graph.cjs"));
 const { validateDepGraph } = require(path.join(__dirname, "gsd-t-depgraph-validate.cjs"));
 const { proveDisjointness } = require(path.join(__dirname, "gsd-t-file-disjointness.cjs"));
-const { estimateTaskFootprint } = require(path.join(__dirname, "gsd-t-economics.cjs"));
-const {
-  computeInSessionHeadroom,
-  computeUnattendedGate,
-} = require(path.join(__dirname, "gsd-t-orchestrator-config.cjs"));
+// M61 D3: gsd-t-economics retired. estimateTaskFootprint produced a per-task
+// token+cost estimate the planner could consult for in-session-headroom
+// math. Native budget primitives (Workflow `budget` + /usage) replace it.
+// Stub to a zero-footprint estimate so the planner proceeds with default
+// assumptions instead of crashing.
+const estimateTaskFootprint = () => ({
+  inputTokens: 0, outputTokens: 0, costUSD: 0, source: "m61-stub",
+});
+
+// ─── Mode-aware gating math (inlined from gsd-t-orchestrator-config.cjs, M65) ──
+// Contract: `.gsd-t/contracts/wave-join-contract.md` v1.1.0 §Mode-Aware Gating Math.
+const IN_SESSION_CW_CEILING_PCT = 85;
+const UNATTENDED_PER_WORKER_CW_PCT = 60;
+const DEFAULT_SUMMARY_SIZE_PCT = 4;
+
+/**
+ * [in-session] headroom gate. Returns `{ok, reducedCount}`.
+ *   ok=true iff `ctxPct + workerCount * summarySize ≤ IN_SESSION_CW_CEILING_PCT`.
+ *   Otherwise reduces N repeatedly; final floor is N=1. NEVER refuses.
+ */
+function computeInSessionHeadroom(opts) {
+  const o = opts || {};
+  const ctxPct = Number.isFinite(o.ctxPct) ? o.ctxPct : 0;
+  const requested = Number.isFinite(o.workerCount) ? Math.max(0, Math.floor(o.workerCount)) : 0;
+  const summarySize = Number.isFinite(o.summarySize) ? o.summarySize : DEFAULT_SUMMARY_SIZE_PCT;
+  const ceiling = IN_SESSION_CW_CEILING_PCT;
+
+  if (ctxPct + requested * summarySize <= ceiling) {
+    return { ok: true, reducedCount: requested };
+  }
+  let n = requested - 1;
+  while (n > 1) {
+    if (ctxPct + n * summarySize <= ceiling) {
+      return { ok: true, reducedCount: n };
+    }
+    n -= 1;
+  }
+  return { ok: true, reducedCount: 1 };
+}
+
+/**
+ * [unattended] per-worker CW gate. Returns `{ok, split}`.
+ *   ok=true, split=false if `estimatedCwPct ≤ threshold` (default 60).
+ *   ok=false, split=true otherwise — caller MUST slice the task into multiple
+ *   iters (this function only signals the split requirement).
+ */
+function computeUnattendedGate(opts) {
+  const o = opts || {};
+  const estimatedCwPct = Number.isFinite(o.estimatedCwPct) ? o.estimatedCwPct : 0;
+  const threshold = Number.isFinite(o.threshold) ? o.threshold : UNATTENDED_PER_WORKER_CW_PCT;
+  if (estimatedCwPct > threshold) {
+    return { ok: false, split: true };
+  }
+  return { ok: true, split: false };
+}
 
 // token-budget is optional at require-time so unit tests can stub via dependency injection.
 let _tokenBudget = null;
@@ -155,7 +206,7 @@ function runParallel(opts) {
   const dryRun = !!(opts && opts.dryRun);
   const summarySize = Number.isFinite(opts && opts.summarySize)
     ? opts.summarySize
-    : require(path.join(__dirname, "gsd-t-orchestrator-config.cjs")).DEFAULT_SUMMARY_SIZE_PCT;
+    : DEFAULT_SUMMARY_SIZE_PCT;
 
   const graph = buildTaskGraph({ projectDir });
   let candidates = getReadyTasks(graph);