testguard-cli 0.1.3 → 0.2.1

package/CHANGELOG.md

@@ -7,6 +7,38 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [0.2.1] - 2026-09-17
+
+### Added
+
+- **Provisional verdicts** (#5). A run with `--confirm` below 3 declares
+  `run.provisional: true` — a spec field whose equivalence with
+  `confirmRuns < 3` the validator enforces both ways. Provisional verdicts
+  print with a `?`, the summary is prefixed `PROVISIONAL`, a warning is
+  printed on stderr, evidence is written to `.testguard/evidence-provisional.json`
+  so the canonical file only ever holds confirmed runs, `brief` warns at the
+  top, and `baseline` refuses provisional evidence unless
+  `--allow-provisional`. A confirmed prior verdict is never reused by a
+  provisional run, nor the reverse.
+
+## [0.2.0] - 2026-09-17
+
+### Added
+
+- **`testguard scaffold <file>`** — mechanical fault producer (#6). Proposes
+  the five shapes both field reports found behind ~80% of hand-written
+  faults: guard forced false, single-line guard or state change removed,
+  `return <check>` → `return true`, security literal weakened, check call
+  removed. Every proposal is an exact-line anchor with `expectHits` and
+  `occurrence` computed from the file (verifiable by construction; anything
+  `locate()` would reject is never emitted), `producedBy: derived`,
+  `defendedBy` prefilled from the tests that import the module, grouped
+  under a preceding `@claim` annotation or by enclosing function.
+  Statements are `TODO:` placeholders; the output is a draft under
+  `.testguard/`, never the claims file. `--claim <ID>` puts everything under
+  one claim and copies it if it exists; `--json` prints instead.
+- Self-claim `TG-SCAFFOLD-ANCHORS-HIT`; install smoke exercises `scaffold`.
+
 ## [0.1.3] - 2026-09-17
 
 From a second field report on a real codebase (456 tests, 27 claims, 35

package/README.md

@@ -52,7 +52,7 @@ tests were written against the survivors, 39/39 were killed.
 | npm | `npm i -D testguard-cli` then `npx testguard probe` |
 | pip | `pip install testguard-cli` then `testguard probe` (needs Node ≥ 20) |
 | Homebrew | `brew tap raccioly/tap && brew install testguard` |
-| GitHub Action | `uses: raccioly/testguard@v0.1.3` — see [`action.yml`](./action.yml) |
+| GitHub Action | `uses: raccioly/testguard@v0.2.1` — see [`action.yml`](./action.yml) |
 | pre-commit | `repo: https://github.com/raccioly/testguard`, hooks `testguard-claims`, `testguard-probe` |
 
 Projects that set `min-release-age` in `.npmrc` cannot see a version published
@@ -66,6 +66,7 @@ npx testguard-cli claims      # what does this project claim, and is every claim
 npx testguard-cli probe       # try to falsify each claim; report what the tests missed
 npx testguard-cli baseline    # freeze today's unproven findings; from now on only new ones gate
 npx testguard-cli brief       # tell the agent where the suite is blind, before it writes
+npx testguard-cli scaffold src/x.ts   # propose faults for a file, as a draft to keep or drop
 ```
 
 1. **Claims** live in `testguard.claims.json` (editors validate it against
@@ -111,7 +112,10 @@ npx testguard-cli brief       # tell the agent where the suite is blind, before
    Practical loop: first pass `--no-escalate` (escalation re-runs the whole
    suite N times per survivor); iterate on one claim with `--claim <ID>` and
    either `--include-dirty` or `--in-place` (only fault target files must be
-   clean there; test files may be dirty); final pass with defaults. By default
+   clean there; test files may be dirty), optionally `--confirm 1` for a fast
+   **provisional** signal — verdicts print with a `?`, evidence goes to
+   `evidence-provisional.json`, and `baseline` refuses it; final pass with
+   defaults. By default
    the stream shows only unproven faults plus a killed count — `--verbose`
    shows every fault. A custom
    runner (`pnpm --filter`, a specific config) goes in
@@ -135,6 +139,34 @@ npx testguard-cli brief       # tell the agent where the suite is blind, before
    `--text` prints only, and exits 0 silently when there is no evidence yet,
    so the hook can never break a session.
 
+### Authoring faults mechanically
+
+Writing faults by hand means reading the code to find exact anchors. Two
+field reports found that ~80% of hand-written faults are one of five shapes,
+so `scaffold` proposes them for you:
+
+```bash
+npx testguard-cli scaffold src/auth.ts          # → .testguard/scaffold-auth.json (a draft, never your claims file)
+npx testguard-cli scaffold src/auth.ts --claim AUTH-ADMIN   # every proposal under one claim; copies it if it exists
+```
+
+| Shape | What it proposes |
+|---|---|
+| `condition-forced` | `if (<guard>) {` → `if (false) {` — a guard is a `!…` condition or one whose body returns, throws or 4xx-es |
+| `statement-deleted` | a single-line guard (`if (…) return …;`) or a state change (`x = …;`) removed |
+| `return-altered` | `return <check>;` (`===`, `.includes(`, `&&`, …) → `return true;` |
+| `literal-changed` | `httpOnly`/`secure` flipped, `sameSite` → `none`, a cost/rounds → `1`, a ttl/tolerance/window/limit ×1000 |
+| `call-removed` | a bare `verify…()` / `validate…()` / `check…()` / `authorize…()` call removed |
+
+Every proposal's `find` is the exact line with `expectHits`/`occurrence`
+computed from the file, so it is verifiable by construction; provenance is
+`producer: derived`; `defendedBy` is prefilled from the tests that import
+the module; proposals are grouped under a preceding `@claim <ID>` annotation
+or by enclosing function. Statements are `TODO:` placeholders — a proposal
+becomes a claim only when a human states what it defends. Deterministic
+heuristics, no AST, no LLM; a proposal the tool cannot anchor is never
+emitted.
+
 **Commit `.testguard/baseline.json`; ignore `evidence.json` and `brief.json`.**
 The baseline is the frozen contract; the other two are regenerated per run.
 
@@ -160,13 +192,14 @@ through every verdict.
 
 ## Status
 
-**v0.1.** Four commands, vitest runner, hand-authored faults. The contract
+**v0.2.** Five commands, vitest runner, hand-authored faults plus a
+mechanical scaffold for the five common shapes. The contract
 spine — six JSON Schemas shared with the other Guard tools — is under
 [`spec/`](spec/). One exact-pinned runtime dependency (`ajv`, for schema validation); Node ≥ 20.
 
 Not yet: test generation (the two-gate acceptance loop), other runners,
-mechanical fault producers, and calibration of fault classes against real
-escaped bugs. Each is designed for; none is claimed.
+AST-aware producers, and calibration of fault classes against real escaped
+bugs. Each is designed for; none is claimed.
 
 ## Licence
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "testguard-cli",
-  "version": "0.1.3",
+  "version": "0.2.1",
   "description": "Proves a test suite defends the claims a project makes: injects the faults those claims forbid and reports every one the tests fail to detect.",
   "type": "module",
   "license": "MIT",

package/spec/GATE-SEMANTICS.md

@@ -22,7 +22,11 @@ Rules that follow from the table:
 1. **Green baseline first.** Defenders run N times unmodified before any fault
    is applied. Anything short of N/N pass is `flaky-defender` and stops there.
 2. **Confirm over N runs.** `killed` and `survived` both require exactly N
-   probe runs, all agreeing. Default N is 3.
+   probe runs, all agreeing. Default N is 3. **Fewer than three runs is
+   provisional**: the evidence declares `run.provisional: true`, every
+   rendering marks the verdicts as unconfirmed, and a provisional run is
+   never frozen into a baseline. Provisional runs exist for the fix loop —
+   a fast signal while writing a test — not for a gate.
 3. **Only a test body rejecting the behaviour kills.** A test that fails by
    assertion — or by an exception the fault provoked inside it — counts. A
    timeout does not, and a suite that fails to load does not: neither is

package/spec/lib/validate.mjs

@@ -45,6 +45,8 @@ const semantic = {
   evidence(doc) {
     const errors = [];
     const n = doc.run.confirmRuns;
+    if (n < 3 && doc.run.provisional !== true) errors.push({ path: '/run/provisional', message: `confirmRuns ${n} is below 3; the run must declare provisional: true` });
+    if (n >= 3 && doc.run.provisional === true) errors.push({ path: '/run/provisional', message: `confirmRuns ${n} is confirmed; provisional must be absent or false` });
     doc.records.forEach((r, i) => {
       const p = `/records/${i}`;
       const expected = fingerprint({ claimId: r.claim.id, subjectId: r.subject.id, file: r.subject.file ?? '', verdict: r.verdict });

package/spec/schemas/evidence.schema.json

@@ -43,6 +43,10 @@
           "type": "integer",
           "minimum": 1
         },
+        "provisional": {
+          "description": "True iff confirmRuns < 3. A provisional run's verdicts are not confirmed: they must not be frozen into a baseline and must be rendered as provisional wherever they appear. Validators enforce the equivalence in both directions.",
+          "type": "boolean"
+        },
         "mode": {
           "description": "`worktree` = faults were applied in a scratch git worktree (default). `in-place` = the user's working tree was mutated and restored.",
           "enum": ["worktree", "in-place"]

package/src/brief/brief.mjs

@@ -55,7 +55,7 @@ export function buildBrief(evidence, baseline, { max = 20, generatedAt = new Dat
     baselined: g.baselined.length,
   };
   const doc = { schemaVersion: 1, tool: evidence.tool, generatedAt, head: evidence.run.repo.head, heading: HEADING, summary, items, text: '' };
-  doc.text = renderBriefText(doc, { hasBaseline: Boolean(baseline), total: evidence.records.length });
+  doc.text = renderBriefText({ ...doc, provisional: Boolean(evidence.run.provisional) }, { hasBaseline: Boolean(baseline), total: evidence.records.length });
   return doc;
 }
 
@@ -64,6 +64,7 @@ export function renderBriefText(brief, { hasBaseline, total }) {
   const lines = [
     brief.heading,
     '',
+    ...(brief.provisional ? ['**PROVISIONAL** — this evidence came from fewer than three confirmation runs; treat every verdict below as unconfirmed and re-probe with --confirm 3 before acting on it.', ''] : []),
     `testguard ${brief.tool.version}${brief.head ? ` @ ${brief.head.slice(0, 12)}` : ''} — ${brief.summary.claims} claims, ${total} faults probed, ${unproven} unproven` +
       (hasBaseline ? ` (${brief.summary.new} new since baseline).` : ' (no baseline; everything is new).'),
   ];

package/src/cli.mjs

@@ -10,6 +10,7 @@ import { probeCommand } from './commands/probe.mjs';
 import { claimsCommand } from './commands/claims.mjs';
 import { baselineCommand } from './commands/baseline.mjs';
 import { briefCommand } from './commands/brief.mjs';
+import { scaffoldCommand } from './commands/scaffold.mjs';
 
 const VERSION = JSON.parse(readFileSync(join(fileURLToPath(import.meta.url), '..', '..', 'package.json'), 'utf8')).version;
 
@@ -19,6 +20,7 @@ const USAGE = `testguard ${VERSION} — proves a test suite defends the claims a
   testguard probe [dir]      inject each claim's faults, run its defenders, report what survived
   testguard baseline [dir]   freeze today's unproven findings so only new ones gate
   testguard brief [dir]      emit the blind-spot block for an agent's session-start context
+  testguard scaffold <file>  propose faults mechanically for one source file, as a draft claims document
 
 probe
   --claims <path>      claims file             (default: <dir>/testguard.claims.json)
@@ -31,6 +33,7 @@ probe
   --claim <ID,ID>      probe only these claims; writes .testguard/evidence-partial.json
   --include-dirty      probe the working tree (a snapshot commit) instead of HEAD; uncommitted tests count
   --verbose            also print each killed fault (default: only unproven ones, plus a count)
+                       --confirm below 3 is PROVISIONAL: verdicts print with "?", evidence goes to .testguard/evidence-provisional.json
   --runner-cmd "<cmd>" custom runner; must contain {files} and {out}, e.g. "pnpm vitest run {files} --reporter=json --outputFile={out}"
   --node-modules <dir> node_modules to link into the scratch worktree (or TESTGUARD_NODE_MODULES)
   --in-place           mutate the working tree instead of a scratch worktree
@@ -38,14 +41,17 @@ probe
   --no-reuse           re-probe claims whose inputs have not changed
   --quiet              suppress the per-fault stream and ranked block; print only the summary and evidence path
 
+scaffold   --claim <ID> (put every proposal under this claim; copies it if it exists)  --out <path>  --json
+           shapes: if-guard → if (false) · single-line guard/mutation removed · return <check> → return true
+                   · security flag/window/cost literal weakened · verify/validate/check call removed
 claims     --json
-baseline   --evidence <path>  --out <path>
+baseline   --evidence <path>  --out <path>  --allow-provisional (freeze unconfirmed evidence; normally refused)
 brief      --evidence <path>  --baseline <path>  --max <n>  --text (print only; safe for hooks)
 
 exit codes: 0 nothing new to prove · 1 unproven claims (or claim drift) · 2 precondition failed · 3 usage
 `;
 
-const COMMANDS = { probe: probeCommand, claims: claimsCommand, baseline: baselineCommand, brief: briefCommand };
+const COMMANDS = { probe: probeCommand, claims: claimsCommand, baseline: baselineCommand, brief: briefCommand, scaffold: scaffoldCommand };
 
 export async function main(argv, io = { out: (s) => process.stdout.write(s + '\n'), err: (s) => process.stderr.write(s + '\n') }) {
   let parsed;
@@ -65,6 +71,7 @@ export async function main(argv, io = { out: (s) => process.stdout.write(s + '\n
         ref: { type: 'string', default: 'HEAD' },
         claim: { type: 'string' },
         'include-dirty': { type: 'boolean', default: false },
+        'allow-provisional': { type: 'boolean', default: false },
         verbose: { type: 'boolean', default: false },
         'runner-cmd': { type: 'string' },
         'node-modules': { type: 'string' },
@@ -104,7 +111,8 @@ export async function main(argv, io = { out: (s) => process.stdout.write(s + '\n
     return 3;
   }
   try {
-    return await handler({ projectDir: resolve(dirArg ?? '.'), values, version: VERSION }, io);
+    const projectDir = command === 'scaffold' ? resolve('.') : resolve(dirArg ?? '.');
+    return await handler({ projectDir, file: dirArg, values, version: VERSION }, io);
   } catch (e) {
     if (e instanceof ClaimsError || e instanceof PreconditionError || e instanceof GitError || e instanceof SpecDocError) {
       io.err(`error: ${e.message}`);

package/src/commands/baseline.mjs

@@ -11,11 +11,15 @@ export async function baselineCommand({ projectDir, values }, io) {
     return 2;
   }
   const evidence = readSpecDoc('evidence', evPath);
+  if (evidence.run.provisional && !values['allow-provisional']) {
+    io.err(`error: ${evPath} is provisional (confirmRuns ${evidence.run.confirmRuns} < 3); a baseline must be frozen from confirmed evidence. Re-run probe with --confirm 3, or pass --allow-provisional if you accept unconfirmed findings as the frozen contract.`);
+    return 2;
+  }
   const baseline = buildBaseline(evidence);
   const outPath = values.out ? resolve(values.out) : baselinePath(projectDir);
   writeSpecDoc('baseline', outPath, baseline);
   const n = Object.values(baseline.fingerprints).reduce((a, b) => a + b, 0);
-  io.out(`baseline: ${n} unproven finding${n === 1 ? '' : 's'} frozen at ${baseline.head.slice(0, 12)}${baseline.dirty ? ' (working tree was dirty)' : ''} → ${outPath}`);
+  io.out(`baseline: ${n} unproven finding${n === 1 ? '' : 's'} frozen at ${baseline.head.slice(0, 12)}${baseline.dirty ? ' (working tree was dirty)' : ''}${evidence.run.provisional ? ' — FROM PROVISIONAL EVIDENCE (--allow-provisional)' : ''} → ${outPath}`);
   io.out('Commit this file; from now on only new findings gate. Ignore the regenerated ones — add to .gitignore:');
   io.out('  .testguard/evidence.json');
   io.out('  .testguard/brief.json');

package/src/commands/probe.mjs

@@ -4,7 +4,8 @@ import { loadClaims, defaultClaimsPath } from '../claims/load.mjs';
 import { probe } from '../probe/probe.mjs';
 import { writeSpecDoc, readSpecDoc } from '../evidence/writer.mjs';
 import { gate } from '../baseline/baseline.mjs';
-import { renderRecord, renderSummary, sortForReport } from '../render.mjs';
+import { renderRecord, renderSummary, sortForReport, PROVISIONAL_WARNING } from '../render.mjs';
+export const provisionalEvidencePath = (projectDir) => join(projectDir, '.testguard', 'evidence-provisional.json');
 
 export const evidencePath = (projectDir) => join(projectDir, '.testguard', 'evidence.json');
 export const baselinePath = (projectDir) => join(projectDir, '.testguard', 'baseline.json');
@@ -23,7 +24,10 @@ export async function probeCommand({ projectDir, values, version }, io) {
   }
   const only = values.claim ? values.claim.split(',').map((s) => s.trim()).filter(Boolean) : undefined;
   // A --claim run is partial evidence; keep it away from the canonical file unless --out says otherwise.
-  const outPath = values.out ? resolve(values.out) : only ? join(projectDir, '.testguard', 'evidence-partial.json') : evidencePath(projectDir);
+  const provisional = confirmRuns < 3;
+  // Provisional and partial runs never overwrite the canonical evidence: only confirmed, complete runs may feed a baseline.
+  const outPath = values.out ? resolve(values.out) : only ? join(projectDir, '.testguard', 'evidence-partial.json') : provisional ? provisionalEvidencePath(projectDir) : evidencePath(projectDir);
+  if (provisional && !values.quiet) io.err(PROVISIONAL_WARNING(confirmRuns));
   const previous = !values['no-reuse'] && existsSync(outPath) ? readSpecDoc('evidence', outPath) : undefined;
   const basePath = values.baseline ? resolve(values.baseline) : baselinePath(projectDir);
   const baseline = existsSync(basePath) ? readSpecDoc('baseline', basePath) : undefined;
@@ -45,7 +49,7 @@ export async function probeCommand({ projectDir, values, version }, io) {
     onStage: !values.quiet && process.stderr.isTTY ? ({ claimId, faultId, stage, i, n }) => process.stderr.write(`\r\x1b[K  … ${claimId}/${faultId} ${stage} ${i}/${n}`) : undefined,
     onProgress: values.quiet ? undefined : (r) => {
       if (process.stderr.isTTY) process.stderr.write('\r\x1b[K');
-      if (values.verbose || r.verdict !== 'killed') io.out(renderRecord(r) + (r.reusedFrom ? '  (reused)' : ''));
+      if (values.verbose || r.verdict !== 'killed') io.out(renderRecord(r, { provisional }) + (r.reusedFrom ? '  (reused)' : ''));
     },
   });
   writeSpecDoc('evidence', outPath, evidence);
@@ -54,7 +58,7 @@ export async function probeCommand({ projectDir, values, version }, io) {
   if (!values.quiet && baseline) {
     io.out('');
     const tag = (r) => (g.new.includes(r) ? '[NEW]      ' : g.baselined.includes(r) ? '[baseline] ' : '[below floor] ');
-    for (const r of sortForReport(evidence.records).filter((x) => x.verdict !== 'killed')) io.out('  ' + tag(r) + renderRecord(r));
+    for (const r of sortForReport(evidence.records).filter((x) => x.verdict !== 'killed')) io.out('  ' + tag(r) + renderRecord(r, { provisional }));
   }
   io.out('');
   if (!values.quiet && !values.verbose) {
@@ -62,6 +66,7 @@ export async function probeCommand({ projectDir, values, version }, io) {
     if (killed) io.out(`  ${killed} killed (not listed; --verbose to see them)`);
   }
   io.out(renderSummary(evidence.records, evidence.run) + (baseline ? ` ${g.new.length} new since baseline, ${g.baselined.length} baselined.` : ' No baseline.'));
-  io.out(`evidence: ${outPath}${only ? ` (partial: --claim ${only.join(',')}; not the canonical evidence file)` : ''}`);
+  io.out(`evidence: ${outPath}${only ? ` (partial: --claim ${only.join(',')}; not the canonical evidence file)` : provisional ? ' (provisional; not the canonical evidence file)' : ''}`);
+  if (provisional && !values.quiet) io.err(PROVISIONAL_WARNING(confirmRuns));
   return g.new.length > 0 ? 1 : 0;
 }

package/src/commands/scaffold.mjs

@@ -0,0 +1,34 @@
+import { existsSync } from 'node:fs';
+import { join, resolve, relative, basename, extname } from 'node:path';
+import { scaffoldFile } from '../scaffold/scaffold.mjs';
+import { loadClaims, defaultClaimsPath } from '../claims/load.mjs';
+import { writeSpecDoc } from '../evidence/writer.mjs';
+import { PreconditionError } from '../probe/worktree.mjs';
+
+export async function scaffoldCommand({ projectDir, file, values, version }, io) {
+  if (!file) {
+    io.err('usage: testguard scaffold <source-file> [--claim <ID>] [--out <path>] [--json]');
+    return 3;
+  }
+  const abs = resolve(file);
+  if (!existsSync(abs)) throw new PreconditionError(`no such file: ${file}`);
+  const rel = relative(projectDir, abs);
+  if (rel.startsWith('..')) throw new PreconditionError(`${file} is outside the project directory ${projectDir}`);
+
+  const claimsPath = values.claims ? resolve(values.claims) : defaultClaimsPath(projectDir);
+  const existingClaims = existsSync(claimsPath) ? loadClaims(claimsPath) : undefined;
+  const { doc, stats } = scaffoldFile({ projectDir, file: rel, claimId: values.claim, existingClaims, toolVersion: version });
+
+  if (values.json) {
+    io.out(JSON.stringify(doc, null, 2));
+    return 0;
+  }
+  const outPath = values.out ? resolve(values.out) : join(projectDir, '.testguard', `scaffold-${basename(rel, extname(rel))}.json`);
+  writeSpecDoc('claims', outPath, doc);
+  const shapes = Object.entries(stats.byClass).map(([k, v]) => `${v} ${k}`).join(', ');
+  io.out(`${stats.proposals} proposed fault${stats.proposals === 1 ? '' : 's'} in ${stats.claims} draft claim${stats.claims === 1 ? '' : 's'} for ${rel}${shapes ? ` — ${shapes}` : ''}`);
+  io.out(stats.defendedBy.length ? `defendedBy prefilled from imports: ${stats.defendedBy.join(', ')}` : 'no test file imports this module; probing the draft as-is will report NOCOVER');
+  io.out(`draft: ${outPath}`);
+  io.out('Next: replace each TODO statement, drop proposals that are not claims, then move the claims into testguard.claims.json.');
+  return 0;
+}

package/src/probe/probe.mjs

@@ -132,6 +132,7 @@ export async function probe({
       repo: { head, dirty: isDirty(root), ...(snapshot ? { snapshot } : {}) },
       runner: { name: vitest.name, ...((runnerVersion ?? readRunnerVersion(projectDir)) ? { version: runnerVersion ?? readRunnerVersion(projectDir) } : {}) },
       confirmRuns,
+      ...(confirmRuns < 3 ? { provisional: true } : {}),
       mode,
     },
     records,

package/src/render.mjs

@@ -1,10 +1,12 @@
 const ORDER = ['survived', 'nocover', 'unverifiable', 'fault-invalid', 'timeout', 'flaky-defender', 'killed'];
 
 /** Non-passing verdicts shout; the one pass does not. */
-export const formatVerdict = (v) => (v === 'killed' ? 'killed' : v.toUpperCase());
+export const formatVerdict = (v, provisional = false) => (v === 'killed' ? 'killed' : v.toUpperCase()) + (provisional ? '?' : '');
 
-export function renderRecord(r) {
-  const head = `${formatVerdict(r.verdict).padEnd(15)} ${r.claim.id}/${r.subject.id}`.padEnd(38);
+export const PROVISIONAL_WARNING = (n) => `PROVISIONAL — confirmRuns ${n} (< 3): nothing below is confirmed. Verdicts carry a "?"; this evidence cannot be frozen into a baseline. Re-run with --confirm 3 before trusting it.`;
+
+export function renderRecord(r, { provisional = false } = {}) {
+  const head = `${formatVerdict(r.verdict, provisional).padEnd(15)} ${r.claim.id}/${r.subject.id}`.padEnd(38);
   let why = '';
   if (r.detail.reason === 'killed-by-undeclared-tests' && r.detail.undeclaredKillers?.length) {
     const files = [...new Set(r.detail.undeclaredKillers.map((k) => k.split('::')[0]))];
@@ -26,11 +28,11 @@ export function summarize(records) {
 
 export function renderSummary(records, run) {
   const byVerdict = summarize(records);
-  const parts = ORDER.filter((v) => byVerdict[v]).map((v) => `${byVerdict[v]} ${formatVerdict(v)}`);
+  const parts = ORDER.filter((v) => byVerdict[v]).map((v) => `${byVerdict[v]} ${formatVerdict(v, run?.provisional)}`);
   const unproven = records.filter((r) => r.verdict !== 'killed');
   const claims = new Set(unproven.map((r) => r.claim.id)).size;
   const where = run ? ` Probed ${run.repo.snapshot ? `working tree (snapshot ${run.repo.snapshot.slice(0, 7)} of ${run.repo.head.slice(0, 7)})` : run.mode === 'in-place' ? `in place at ${run.repo.head.slice(0, 7)}${run.repo.dirty ? ' (dirty)' : ''}` : run.repo.head.slice(0, 7)}.` : '';
-  return `${records.length} faults probed: ${parts.join(', ')}. ${unproven.length} unproven fault${unproven.length === 1 ? '' : 's'} across ${claims} claim${claims === 1 ? '' : 's'}.${where}`;
+  return `${run?.provisional ? 'PROVISIONAL: ' : ''}${records.length} faults probed: ${parts.join(', ')}. ${unproven.length} unproven fault${unproven.length === 1 ? '' : 's'} across ${claims} claim${claims === 1 ? '' : 's'}.${where}`;
 }
 
 /** Survivors first, then by rank score; killed last. */

package/src/scaffold/producers.mjs

@@ -0,0 +1,85 @@
+/**
+ * Mechanical fault producers. Deterministic, line-oriented, no AST, no LLM.
+ *
+ * Two independent field reports found that ~80% of hand-written faults are
+ * one of these shapes. Each producer looks at one line (plus a little
+ * context) and proposes a fault whose `find` is the exact line, so the anchor
+ * hits by construction. A human keeps or drops every proposal.
+ */
+
+const COMMENT = /^\s*(\/\/|\*|\/\*)/;
+const GUARD_BODY = /\b(return|throw)\b|\.status\(\s*4\d\d|\bredirect\(|\bfalse\b|\bnull\b/;
+const IF_LINE = /^(\s*)(?:\}\s*)?(?:else\s+)?if\s*\((.+)\)\s*(\{\s*|(?:return|throw)\b.*;\s*)?$/;
+const RETURN_CHECK = /^\s*return\s+(.+);\s*$/;
+const CHECK_EXPR = /(===|!==|\.includes\(|\.has\(|\.some\(|\.every\(|\.test\(|\.startsWith\(|\.endsWith\(|\binstanceof\b|&&|\|\||^!)/;
+const CHECK_CALL = /^\s*(?:await\s+)?(?:[\w$]+\.)*(verify|validate|assert|check|require|ensure|authoriz|authentic|rateLimit|throttle|enforce|guard)\w*\s*\(.*\)\s*;\s*$/i;
+const MUTATION = /^\s*(?!(?:const|let|var|return|if|for|while|else|switch|case|import|export|throw)\b)[\w$]+(?:[.\[][\w$'"\]]+)*\s*(=|\+=|-=|\|\|=|&&=|\?\?=)\s*(?!=)[^;]*;\s*$/;
+const FLAG_TRUE = /\b(httpOnly|secure|signed|requireTLS|rejectUnauthorized|strict)\s*:\s*true\b/;
+const SAME_SITE = /\bsameSite\s*:\s*(['"])(strict|lax)\1/i;
+const COST_NUM = /\b(\w*(?:cost|rounds|iterations)\w*)\s*([:=])\s*(\d+)\b/i;
+const WINDOW_NUM = /\b(\w*(?:ttl|expir|tolerance|window|maxAge|max_age|timeout|limit|attempts|length|minLength|clockSkew|skew)\w*)\s*([:=])\s*(\d+)\b/i;
+const FUNCTION_HEAD = [
+  /^\s*(?:export\s+)?(?:default\s+)?(?:async\s+)?function\s*\*?\s*([\w$]+)\s*\(/,
+  /^\s*(?:export\s+)?(?:const|let|var)\s+([\w$]+)\s*=\s*(?:async\s*)?(?:\([^)]*\)|[\w$]+)\s*=>/,
+  /^\s*(?:export\s+)?(?:const|let|var)\s+([\w$]+)\s*=\s*(?:async\s+)?function\b/,
+  /^\s*(?:public\s+|private\s+|protected\s+)?(?:static\s+)?(?:async\s+)?([\w$]+)\s*\([^)]*\)\s*(?::\s*[\w<>\[\]| ]+)?\s*\{\s*$/,
+];
+const NOT_A_FUNCTION = new Set(['if', 'for', 'while', 'switch', 'catch', 'else', 'return', 'function', 'constructor']);
+
+/** Name of the function whose head is on this line, or null. */
+export function functionHead(line) {
+  for (const re of FUNCTION_HEAD) {
+    const m = re.exec(line);
+    if (m && !NOT_A_FUNCTION.has(m[1])) return m[1];
+  }
+  return null;
+}
+
+function isGuard(cond, lines, i) {
+  if (/^\s*!/.test(cond)) return true;
+  const tail = lines.slice(i, i + 4).join('\n');
+  return GUARD_BODY.test(tail);
+}
+
+/** Proposals for one line. Each: { faultClass, description, replace } where find is the line itself. */
+export function proposalsForLine(lines, i) {
+  const line = lines[i];
+  const out = [];
+  if (!line.trim() || COMMENT.test(line)) return out;
+
+  const ifm = IF_LINE.exec(line);
+  if (ifm && isGuard(ifm[2], lines, i)) {
+    const singleLine = ifm[3] && /^(return|throw)\b/.test(ifm[3].trim());
+    if (singleLine) {
+      out.push({ faultClass: 'statement-deleted', description: `Guard removed: \`${line.trim()}\` no longer runs.`, replace: '' });
+    } else {
+      out.push({ faultClass: 'condition-forced', description: `Guard never triggers: \`if (${ifm[2].trim()})\` becomes \`if (false)\`.`, replace: line.replace(`(${ifm[2]})`, '(false)') });
+    }
+    return out; // an `if` line is not also a mutation/return/call
+  }
+
+  const rm = RETURN_CHECK.exec(line);
+  if (rm && CHECK_EXPR.test(rm[1]) && !/^(new|await)\b/.test(rm[1].trim())) {
+    out.push({ faultClass: 'return-altered', description: `Check always passes: \`return ${rm[1].trim()}\` becomes \`return true\`.`, replace: line.replace(/return\s+.+;/, 'return true;') });
+  }
+
+  if (CHECK_CALL.test(line)) {
+    out.push({ faultClass: 'call-removed', description: `Check call removed: \`${line.trim()}\` no longer runs.`, replace: '' });
+  } else if (MUTATION.test(line)) {
+    out.push({ faultClass: 'statement-deleted', description: `State change removed: \`${line.trim()}\` no longer runs.`, replace: '' });
+  }
+
+  let m;
+  if ((m = FLAG_TRUE.exec(line))) {
+    out.push({ faultClass: 'literal-changed', description: `Security flag flipped: \`${m[1]}: true\` becomes \`${m[1]}: false\`.`, replace: line.replace(m[0], `${m[1]}: false`) });
+  }
+  if ((m = SAME_SITE.exec(line))) {
+    out.push({ faultClass: 'literal-changed', description: `sameSite weakened: \`${m[2]}\` becomes \`none\`.`, replace: line.replace(m[0], `sameSite: ${m[1]}none${m[1]}`) });
+  }
+  if ((m = COST_NUM.exec(line))) {
+    out.push({ faultClass: 'literal-changed', description: `Work factor collapsed: \`${m[1]}\` ${m[3]} becomes 1.`, replace: line.replace(m[0], `${m[1]}${m[2] === ':' ? ': ' : ' = '}1`) });
+  } else if ((m = WINDOW_NUM.exec(line))) {
+    out.push({ faultClass: 'literal-changed', description: `Window widened ×1000: \`${m[1]}\` ${m[3]} becomes ${Number(m[3]) * 1000}.`, replace: line.replace(m[0], `${m[1]}${m[2] === ':' ? ': ' : ' = '}${Number(m[3]) * 1000}`) });
+  }
+  return out;
+}

package/src/scaffold/scaffold.mjs

@@ -0,0 +1,118 @@
+import { readFileSync } from 'node:fs';
+import { basename, extname, join } from 'node:path';
+import { proposalsForLine, functionHead } from './producers.mjs';
+import { locate } from '../probe/inject.mjs';
+import { discoverDefenders } from '../probe/discover.mjs';
+import { validate } from '../../spec/lib/validate.mjs';
+
+const ANNOTATION = /@claim\s+([A-Za-z0-9]+(?:[._]?[A-Za-z0-9]+)*-[A-Za-z0-9._-]*[A-Za-z0-9])\b/;
+
+const idPart = (s) => s.replace(/[^A-Za-z0-9]+/g, '-').replace(/^-+|-+$/g, '').toUpperCase();
+
+/** How many times `find` occurs, and which occurrence the line at `offset` is. */
+function anchorFor(source, find, offset) {
+  let hits = 0;
+  let occurrence = 0;
+  let i = -1;
+  while ((i = source.indexOf(find, i + 1)) !== -1) {
+    hits++;
+    if (i === offset) occurrence = hits;
+  }
+  return { hits, occurrence };
+}
+
+/**
+ * Scan one source file and produce a DRAFT claims document: every proposal is
+ * an exact-line anchor that `locate()` accepts, grouped by enclosing function
+ * (or by a preceding `@claim <ID>` annotation, or entirely under `claimId`),
+ * with `producedBy: { producer: "derived" }` and TODO statements a human must
+ * replace. Never touches the real claims file.
+ */
+export function scaffoldFile({ projectDir, file, claimId, existingClaims, toolVersion = '0.0.0' }) {
+  const source = readFileSync(join(projectDir, file), 'utf8');
+  const lines = source.split('\n');
+  const stem = idPart(basename(file, extname(file)));
+  const producedBy = { producer: 'derived', by: `testguard scaffold ${toolVersion}` };
+
+  const groups = new Map(); // key → { id, proposals[] , annotated }
+  const groupFor = (key, id) => {
+    if (!groups.has(key)) groups.set(key, { id, proposals: [] });
+    return groups.get(key);
+  };
+
+  let offset = 0;
+  let fn = null;
+  let fnDepth = 0;
+  let depth = 0;
+  let pendingAnnotation = null;
+  const proposals = [];
+  lines.forEach((line, i) => {
+    const ann = ANNOTATION.exec(line);
+    if (ann && /^\s*(\/\/|\*|\/\*)/.test(line)) pendingAnnotation = ann[1];
+
+    const head = functionHead(line);
+    if (head) {
+      fn = head;
+      fnDepth = depth;
+    }
+
+    for (const p of proposalsForLine(lines, i)) {
+      const find = line;
+      const { hits, occurrence } = anchorFor(source, find, offset);
+      const fault = { ...p, find, replace: p.replace, expectHits: hits, occurrence, line: i + 1, fn, annotation: pendingAnnotation };
+      if (locate(source, fault).status !== 'ok') continue; // never propose an anchor that would be unverifiable
+      proposals.push(fault);
+    }
+
+    depth += (line.match(/\{/g) ?? []).length - (line.match(/\}/g) ?? []).length;
+    if (fn && depth <= fnDepth && !head) fn = null;
+    if (pendingAnnotation && !ann && !head && line.trim() && !/^\s*(\/\/|\*|\/\*)/.test(line)) pendingAnnotation = null;
+    offset += line.length + 1;
+  });
+
+  const existing = new Map((existingClaims?.claims ?? []).map((c) => [c.id, c]));
+  const usedIds = new Set();
+  for (const p of proposals) {
+    const key = claimId ? '__all__' : p.annotation ?? p.fn ?? '__file__';
+    let id = claimId ?? p.annotation ?? `${stem}-${p.fn ? idPart(p.fn) : 'FILE'}`;
+    groupFor(key, id).proposals.push(p);
+  }
+
+  const defendedBy = discoverDefenders(projectDir, file);
+  const claims = [];
+  for (const g of groups.values()) {
+    let id = g.id;
+    while (usedIds.has(id)) id += '-2';
+    usedIds.add(id);
+    const base = existing.get(id);
+    const fnLabel = g.proposals[0].fn ? `\`${g.proposals[0].fn}\`` : 'this file';
+    const claim = {
+      id,
+      statement: base?.statement ?? `TODO: state what ${fnLabel} in ${file} guarantees (${g.proposals.length} proposed fault${g.proposals.length === 1 ? '' : 's'}; keep or drop each)`,
+      source: base?.source ?? { kind: 'manual', ref: `testguard scaffold ${file}` },
+      severity: base?.severity ?? 'medium',
+      producedBy: base?.producedBy ?? producedBy,
+      ...(base?.defendedBy?.length ? { defendedBy: base.defendedBy } : defendedBy.length ? { defendedBy } : {}),
+      faults: g.proposals.map((p, n) => ({
+        id: `S${n + 1}`,
+        description: `[line ${p.line}] ${p.description}`,
+        faultClass: p.faultClass,
+        file,
+        find: p.find,
+        replace: p.replace,
+        ...(p.expectHits > 1 ? { expectHits: p.expectHits, occurrence: p.occurrence } : {}),
+        producedBy,
+      })),
+      ...(base?.tags ? { tags: base.tags } : {}),
+    };
+    claims.push(claim);
+  }
+
+  const doc = { $schema: './node_modules/testguard-cli/spec/schemas/claims.schema.json', schemaVersion: 1, claims };
+  const result = validate('claims', doc);
+  if (!result.ok) throw new Error(`scaffold produced a non-conforming draft:\n${result.errors.map((e) => `  ${e.path}: ${e.message}`).join('\n')}`);
+
+  const byClass = {};
+  for (const p of proposals) byClass[p.faultClass] = (byClass[p.faultClass] ?? 0) + 1;
+  return { doc, stats: { proposals: proposals.length, claims: claims.length, byClass, defendedBy } };
+}