@hassangameryt/freeflow 0.3.0 → 0.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +4 -4
- package/.claude-plugin/plugin.json +6 -2
- package/.codex-plugin/plugin.json +9 -9
- package/README.md +190 -127
- package/assets/feedback-loop.png +0 -0
- package/assets/freeflow_workflow_map.png +0 -0
- package/assets/workflow.png +0 -0
- package/{skills → capabilities}/output-router/SKILL.md +21 -17
- package/{skills → capabilities}/output-router/references/safety-policy.md +1 -1
- package/capabilities/output-router/references/setup.md +110 -0
- package/command-surface.json +62 -7
- package/hooks/freeflow-runtime-context.mjs +572 -154
- package/hooks/hooks.json +26 -1
- package/hooks/tests/check-runtime-context-hook.sh +375 -0
- package/package.json +24 -24
- package/pi-extension/dist/index.js +264 -80
- package/pi-extension/dist/integrations/mcp-config.js +29 -0
- package/pi-extension/dist/output-router/host-producer-identification.js +232 -0
- package/pi-extension/dist/output-router/native-safety-net.js +216 -0
- package/pi-extension/dist/output-router/observed-tool-routing.js +122 -0
- package/pi-extension/dist/output-router/renderers.js +1023 -0
- package/pi-extension/dist/output-router/router-tools.js +554 -0
- package/pi-extension/dist/output-router/schemas.js +383 -0
- package/pi-extension/dist/output-router/status.js +744 -0
- package/pi-extension/dist/output-router/utils.js +502 -0
- package/pi-extension/dist/runtime/runtime-context.js +798 -0
- package/pi-extension/dist/settings/settings-tui.js +314 -0
- package/pi-extension/dist/settings/settings-ui.js +1487 -0
- package/pi-extension/freeflow/index.js +1 -0
- package/pi-extension/src/index.ts +230 -56
- package/pi-extension/src/{host-producer-identification.ts → output-router/host-producer-identification.ts} +37 -7
- package/pi-extension/src/{native-safety-net.ts → output-router/native-safety-net.ts} +8 -12
- package/pi-extension/src/{observed-tool-routing.ts → output-router/observed-tool-routing.ts} +19 -11
- package/pi-extension/src/{renderers.ts → output-router/renderers.ts} +246 -55
- package/pi-extension/src/{router-tools.ts → output-router/router-tools.ts} +130 -29
- package/pi-extension/src/{schemas.ts → output-router/schemas.ts} +171 -43
- package/pi-extension/src/output-router/status.ts +791 -0
- package/pi-extension/src/{utils.ts → output-router/utils.ts} +80 -18
- package/pi-extension/src/runtime/runtime-context.ts +895 -0
- package/pi-extension/src/settings/settings-tui.ts +408 -0
- package/pi-extension/src/settings/settings-ui.ts +1730 -0
- package/pi-extension/tests/integration/pi-extension.test.js +4020 -0
- package/pi-extension/tests/output-router/observed-producers.test.js +132 -0
- package/pi-extension/tests/output-router/search.test.js +722 -0
- package/pi-extension/tests/settings/settings-tui.test.js +243 -0
- package/router/dist/benchmarks/benchmark-harness.d.ts +16 -13
- package/router/dist/benchmarks/benchmark-harness.js +62 -62
- package/router/dist/benchmarks/benchmarks.d.ts +80 -73
- package/router/dist/benchmarks/benchmarks.js +860 -761
- package/router/dist/benchmarks/codex-qa-benchmarks.d.ts +71 -67
- package/router/dist/benchmarks/codex-qa-benchmarks.js +429 -390
- package/router/dist/benchmarks/command-benchmarks.d.ts +107 -92
- package/router/dist/benchmarks/command-benchmarks.js +616 -571
- package/router/dist/benchmarks/context-mode-normalized-benchmarks.d.ts +64 -56
- package/router/dist/benchmarks/context-mode-normalized-benchmarks.js +679 -613
- package/router/dist/benchmarks/context-mode-real-deep-benchmark.d.ts +103 -95
- package/router/dist/benchmarks/context-mode-real-deep-benchmark.js +1188 -1103
- package/router/dist/benchmarks/context-saving-baseline.d.ts +47 -41
- package/router/dist/benchmarks/context-saving-baseline.js +405 -374
- package/router/dist/benchmarks/index-benchmarks.d.ts +74 -69
- package/router/dist/benchmarks/index-benchmarks.js +761 -661
- package/router/dist/benchmarks/storage-policy-benchmarks.d.ts +80 -69
- package/router/dist/benchmarks/storage-policy-benchmarks.js +549 -469
- package/router/dist/benchmarks/vault-index-benchmarks.d.ts +43 -34
- package/router/dist/benchmarks/vault-index-benchmarks.js +294 -229
- package/router/dist/config/config.d.ts +62 -55
- package/router/dist/config/config.js +552 -373
- package/router/dist/config/router-contract.d.ts +2 -2
- package/router/dist/config/router-contract.js +38 -38
- package/router/dist/config/schema.d.ts +19 -10
- package/router/dist/config/schema.js +586 -538
- package/router/dist/config/types.d.ts +413 -361
- package/router/dist/config/types.js +19 -8
- package/router/dist/evidence/bounded-evidence.d.ts +26 -26
- package/router/dist/evidence/bounded-evidence.js +265 -252
- package/router/dist/evidence/evidence-range-selector.d.ts +16 -14
- package/router/dist/evidence/evidence-range-selector.js +192 -191
- package/router/dist/evidence/evidence-search.d.ts +18 -16
- package/router/dist/evidence/evidence-search.js +401 -377
- package/router/dist/evidence/evidence.d.ts +17 -17
- package/router/dist/evidence/evidence.js +163 -159
- package/router/dist/evidence/failure-contracts.d.ts +25 -15
- package/router/dist/evidence/failure-contracts.js +132 -126
- package/router/dist/evidence/line-ranges.d.ts +17 -15
- package/router/dist/evidence/line-ranges.js +18 -18
- package/router/dist/experiments/local-index.d.ts +47 -41
- package/router/dist/experiments/local-index.js +477 -458
- package/router/dist/local/local-traversal.d.ts +18 -0
- package/router/dist/local/local-traversal.js +334 -0
- package/router/dist/processing/engine.d.ts +94 -70
- package/router/dist/processing/engine.js +462 -364
- package/router/dist/processing/reducers.d.ts +208 -194
- package/router/dist/processing/reducers.js +1434 -1256
- package/router/dist/processing/renderers.d.ts +24 -18
- package/router/dist/processing/renderers.js +161 -152
- package/router/dist/processing/scripts.d.ts +80 -67
- package/router/dist/processing/scripts.js +343 -290
- package/router/dist/repo/repo-traversal.d.ts +9 -9
- package/router/dist/repo/repo-traversal.js +205 -202
- package/router/dist/routing/observed-reducers.d.ts +25 -19
- package/router/dist/routing/observed-reducers.js +559 -545
- package/router/dist/routing/observed-routing.d.ts +23 -14
- package/router/dist/routing/observed-routing.js +319 -318
- package/router/dist/routing/parsers.d.ts +10 -10
- package/router/dist/routing/parsers.js +454 -406
- package/router/dist/routing/run-filters.d.ts +45 -41
- package/router/dist/routing/run-filters.js +215 -207
- package/router/dist/routing/run-reducers.d.ts +45 -26
- package/router/dist/routing/run-reducers.js +102 -90
- package/router/dist/sandbox/adapter-roots.d.ts +34 -26
- package/router/dist/sandbox/adapter-roots.js +43 -41
- package/router/dist/sandbox/eryx-python-adapter.d.ts +9 -5
- package/router/dist/sandbox/eryx-python-adapter.js +659 -588
- package/router/dist/sandbox/jq-wasm-adapter.d.ts +3 -3
- package/router/dist/sandbox/jq-wasm-adapter.js +319 -311
- package/router/dist/sandbox/quickjs-wasi-adapter.d.ts +9 -5
- package/router/dist/sandbox/quickjs-wasi-adapter.js +336 -333
- package/router/dist/sandbox/script-sandbox.d.ts +105 -84
- package/router/dist/sandbox/script-sandbox.js +294 -260
- package/router/dist/setup/script-transform-adapters.d.ts +23 -19
- package/router/dist/setup/script-transform-adapters.js +223 -204
- package/router/dist/tools/batch.d.ts +27 -16
- package/router/dist/tools/batch.js +493 -416
- package/router/dist/tools/run.d.ts +47 -35
- package/router/dist/tools/run.js +1172 -1087
- package/router/dist/tools/search.d.ts +53 -31
- package/router/dist/tools/search.js +1224 -1065
- package/router/dist/transform/engine.d.ts +121 -96
- package/router/dist/transform/engine.js +1853 -1736
- package/router/dist/vault/vault-index.d.ts +97 -78
- package/router/dist/vault/vault-index.js +347 -342
- package/router/dist/vault/vault.d.ts +109 -74
- package/router/dist/vault/vault.js +528 -533
- package/runtime/interaction-contract.md +16 -0
- package/skills/bypass/SKILL.md +52 -38
- package/skills/commit-work/SKILL.md +54 -46
- package/skills/commit-work/references/staging-decisions.md +46 -24
- package/skills/decision-gate/SKILL.md +48 -0
- package/skills/design-for-depth/SKILL.md +75 -59
- package/skills/design-for-depth/references/design-pressure-signals.md +56 -7
- package/skills/design-for-depth/references/interface-design-loop.md +156 -0
- package/skills/design-for-depth/references/software-design-philosophy.md +32 -3
- package/skills/diagnose-failure/SKILL.md +65 -60
- package/skills/diagnose-failure/references/diagnostic-loop-catalog.md +36 -0
- package/skills/diagnose-failure/references/flaky-and-performance.md +30 -18
- package/skills/discuss/SKILL.md +121 -0
- package/skills/discuss/references/checkpoints.md +66 -0
- package/skills/evaluate-skill/SKILL.md +62 -53
- package/skills/evaluate-skill/references/definition-schema.md +345 -0
- package/skills/evaluate-skill/references/evaluation-design.md +86 -0
- package/skills/evaluate-skill/references/execution-and-evidence.md +85 -0
- package/skills/evaluate-skill/references/review-and-revision.md +51 -0
- package/skills/evaluate-skill/scripts/lib/definitions.mjs +296 -0
- package/skills/evaluate-skill/scripts/lib/evidence.mjs +46 -0
- package/skills/evaluate-skill/scripts/lib/grade-comparison.mjs +60 -0
- package/skills/evaluate-skill/scripts/lib/grade-interaction.mjs +148 -0
- package/skills/evaluate-skill/scripts/lib/grade-support.mjs +126 -0
- package/skills/evaluate-skill/scripts/lib/grade-workspace.mjs +192 -0
- package/skills/evaluate-skill/scripts/lib/grade.mjs +56 -0
- package/skills/evaluate-skill/scripts/lib/pi.mjs +489 -0
- package/skills/evaluate-skill/scripts/lib/process.mjs +79 -0
- package/skills/evaluate-skill/scripts/lib/rpc.mjs +444 -0
- package/skills/evaluate-skill/scripts/lib/runner.mjs +346 -0
- package/skills/evaluate-skill/scripts/lib/sandbox.mjs +409 -0
- package/skills/evaluate-skill/scripts/lib/view.mjs +337 -0
- package/skills/evaluate-skill/scripts/pi-guard.mjs +164 -0
- package/skills/evaluate-skill/scripts/skill-eval.mjs +101 -0
- package/skills/execute-work/SKILL.md +99 -0
- package/skills/execute-work/references/code-practices.md +78 -0
- package/skills/execute-work/references/execution-loop.md +77 -0
- package/skills/finish-branch/SKILL.md +117 -0
- package/skills/finish-branch/references/integration-options.md +80 -0
- package/skills/handoff/SKILL.md +65 -39
- package/skills/handoff/references/templates.md +104 -27
- package/skills/launch-work/SKILL.md +116 -0
- package/skills/launch-work/references/launch-readiness.md +85 -0
- package/skills/migration-work/SKILL.md +115 -0
- package/skills/migration-work/references/migration-lifecycle.md +82 -0
- package/skills/mode-contract/SKILL.md +72 -52
- package/skills/release-work/SKILL.md +118 -0
- package/skills/release-work/references/release-evidence.md +78 -0
- package/skills/review-artifact/SKILL.md +77 -69
- package/skills/review-artifact/references/reviewer-prompt.md +133 -42
- package/skills/review-work/SKILL.md +82 -57
- package/skills/review-work/references/reviewer-prompt.md +97 -60
- package/skills/review-work/references/security-risk-lens.md +67 -0
- package/skills/setup-freeflow/SKILL.md +54 -68
- package/skills/setup-freeflow/references/activation-contract.md +84 -69
- package/skills/setup-freeflow/references/host-setup.md +50 -17
- package/skills/simplify-code/SKILL.md +80 -0
- package/skills/simplify-code/references/simplification-patterns.md +70 -0
- package/skills/tdd/SKILL.md +96 -0
- package/skills/tdd/references/test-design.md +96 -0
- package/skills/track-work/SKILL.md +84 -0
- package/skills/track-work/references/working-record-schema.md +378 -0
- package/skills/verify-work/SKILL.md +59 -38
- package/skills/verify-work/references/browser-runtime-evidence.md +55 -0
- package/skills/verify-work/references/integration-evidence.md +51 -0
- package/skills/verify-work/references/performance-evidence.md +57 -0
- package/skills/workflow/SKILL.md +53 -59
- package/skills/workflow/references/domain-skill-composition.md +57 -0
- package/skills/workflow/references/workflow-loop.md +92 -0
- package/skills/write-plan/SKILL.md +85 -58
- package/skills/write-plan/references/plan-shapes.md +132 -46
- package/skills/write-skill/SKILL.md +82 -51
- package/skills/write-skill/references/activation-boundaries.md +62 -0
- package/skills/write-skill/references/agent-first-instructions.md +87 -0
- package/skills/write-skill/references/progressive-disclosure.md +63 -0
- package/skills/write-skill/scripts/lib/skill-author.mjs +653 -0
- package/skills/write-skill/scripts/skill-author.mjs +104 -0
- package/skills/write-spec/SKILL.md +65 -54
- package/skills/write-spec/references/artifact-standards.md +60 -41
- package/skills/write-spec/references/decision-records.md +77 -0
- package/skills/write-spec/references/spec-shapes.md +119 -60
- package/evals/README.md +0 -32
- package/evals/fixtures/copy-conventions.md +0 -31
- package/evals/fixtures/output-router/README.md +0 -12
- package/evals/fixtures/output-router/failed-command-output.txt +0 -9
- package/evals/fixtures/output-router/large-router-manual.md +0 -63
- package/evals/fixtures/output-router/native-large-output.txt +0 -40
- package/evals/fixtures/output-router/noisy-test-output.txt +0 -30
- package/evals/fixtures/output-router/verification-output.txt +0 -8
- package/evals/fixtures/tiny-artifact-review-app/README.md +0 -5
- package/evals/fixtures/tiny-artifact-review-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/billing-webhook-api-draft.md +0 -21
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/failed-payment-grace-period.md +0 -24
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/immediate-downgrade.md +0 -17
- package/evals/fixtures/tiny-artifact-review-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-commit-ambiguous-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-ambiguous-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-ambiguous-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-ambiguous-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-ambiguous-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-app/.freeflow-eval-setup.sh +0 -14
- package/evals/fixtures/tiny-commit-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-everything-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-everything-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-everything-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-everything-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-everything-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-everything-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-staged-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-staged-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-staged-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-staged-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-staged-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-staged-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-staged-mixed-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-staged-mixed-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/docs/billing-policy.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/docs/release-notes.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-dashboard-stale-app/README.md +0 -11
- package/evals/fixtures/tiny-dashboard-stale-app/src/api-client.ts +0 -13
- package/evals/fixtures/tiny-dashboard-stale-app/src/dashboard-data.ts +0 -19
- package/evals/fixtures/tiny-dashboard-stale-app/tests/dashboard-data.test.md +0 -9
- package/evals/fixtures/tiny-decision-destination-app/README.md +0 -6
- package/evals/fixtures/tiny-decision-destination-app/src/risk.ts +0 -8
- package/evals/fixtures/tiny-decision-destination-app/tests/risk.test.md +0 -4
- package/evals/fixtures/tiny-design-depth-app/README.md +0 -15
- package/evals/fixtures/tiny-design-depth-app/src/routes.ts +0 -25
- package/evals/fixtures/tiny-design-depth-app/src/sendEmail.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/src/sendSms.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/src/telemetry.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/tests/routes.test.md +0 -12
- package/evals/fixtures/tiny-eval-method-app/README.md +0 -8
- package/evals/fixtures/tiny-eval-method-app/evals/reports/review-pr-eval-result.md +0 -5
- package/evals/fixtures/tiny-eval-method-app/evals/reports/triage-question-failure.md +0 -17
- package/evals/fixtures/tiny-eval-method-app/evals/runs/review-pr-with-skill-output.diff +0 -11
- package/evals/fixtures/tiny-eval-method-app/evals/runs/review-pr-with-skill-output.md +0 -3
- package/evals/fixtures/tiny-eval-method-app/skills/review-pr/SKILL.md +0 -10
- package/evals/fixtures/tiny-eval-method-app/skills/triage-question/SKILL.md +0 -10
- package/evals/fixtures/tiny-execute-plan-app/README.md +0 -5
- package/evals/fixtures/tiny-execute-plan-app/checks/settings-and-billing-check.sh +0 -5
- package/evals/fixtures/tiny-execute-plan-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/immediate-downgrade-plan.md +0 -11
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/settings-title-with-bad-check.md +0 -15
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/unverified-billing-plan.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/docs/specs/failed-payment-grace-period.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-execute-plan-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-execute-plan-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-execute-plan-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-execute-review-loop-app/README.md +0 -5
- package/evals/fixtures/tiny-execute-review-loop-app/docs/billing-policy.md +0 -9
- package/evals/fixtures/tiny-execute-review-loop-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-execute-review-loop-app/docs/review/previous-agent-summary.md +0 -15
- package/evals/fixtures/tiny-execute-review-loop-app/docs/review/review-pass-1-non-pass.md +0 -11
- package/evals/fixtures/tiny-execute-review-loop-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-execute-review-loop-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-execute-review-loop-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-execute-review-loop-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-execute-review-loop-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-flaky-session-app/README.md +0 -10
- package/evals/fixtures/tiny-flaky-session-app/src/session-timeout.ts +0 -13
- package/evals/fixtures/tiny-flaky-session-app/tests/session-timeout.test.md +0 -8
- package/evals/fixtures/tiny-handoff-app/README.md +0 -5
- package/evals/fixtures/tiny-handoff-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-handoff-app/docs/handoffs/old-agent-handoff.md +0 -8
- package/evals/fixtures/tiny-handoff-app/docs/plans/billing-retry-plan.md +0 -11
- package/evals/fixtures/tiny-handoff-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-handoff-report-app/README.md +0 -3
- package/evals/fixtures/tiny-handoff-report-app/evals/runs/handoff-3/hof-003/with-skill-output.diff +0 -1
- package/evals/fixtures/tiny-handoff-report-app/evals/runs/handoff-3/hof-003/with-skill-output.md +0 -1
- package/evals/fixtures/tiny-handoff-report-app/evals/scores/hof-003-score.txt +0 -4
- package/evals/fixtures/tiny-plan-app/README.md +0 -5
- package/evals/fixtures/tiny-plan-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-plan-app/docs/specs/failed-payment-grace-period.md +0 -25
- package/evals/fixtures/tiny-plan-app/src/billing.ts +0 -17
- package/evals/fixtures/tiny-plan-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-plan-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-plan-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/README.md +0 -3
- package/evals/fixtures/tiny-plan-strict-api-app/docs/billing-policy.md +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/docs/specs/billing-webhook-api.md +0 -25
- package/evals/fixtures/tiny-plan-strict-api-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/src/webhooks.ts +0 -3
- package/evals/fixtures/tiny-plan-strict-api-app/tests/billing-webhook.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/.freeflow/config.json +0 -3
- package/evals/fixtures/tiny-post-setup-invalid-config-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-post-setup-missing-config-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-post-setup-source-conflict-app/.freeflow/config.json +0 -3
- package/evals/fixtures/tiny-post-setup-source-conflict-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-report-performance-app/README.md +0 -11
- package/evals/fixtures/tiny-report-performance-app/docs/performance.md +0 -10
- package/evals/fixtures/tiny-report-performance-app/src/report-summary.ts +0 -29
- package/evals/fixtures/tiny-report-performance-app/tests/report-performance.test.md +0 -8
- package/evals/fixtures/tiny-review-request-app/README.md +0 -3
- package/evals/fixtures/tiny-review-request-app/docs/billing-policy.md +0 -5
- package/evals/fixtures/tiny-review-request-app/docs/plans/billing-webhook-api.md +0 -19
- package/evals/fixtures/tiny-review-request-app/docs/review/previous-agent-summary.md +0 -20
- package/evals/fixtures/tiny-review-request-app/docs/specs/billing-webhook-api.md +0 -25
- package/evals/fixtures/tiny-review-request-app/src/billing.ts +0 -11
- package/evals/fixtures/tiny-review-request-app/src/webhooks.ts +0 -19
- package/evals/fixtures/tiny-review-request-app/tests/billing-webhook.test.md +0 -8
- package/evals/fixtures/tiny-review-work-app/README.md +0 -5
- package/evals/fixtures/tiny-review-work-app/docs/billing-policy.md +0 -9
- package/evals/fixtures/tiny-review-work-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-review-work-app/docs/review/previous-agent-summary.md +0 -15
- package/evals/fixtures/tiny-review-work-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-review-work-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-review-work-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-review-work-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-review-work-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-saas-app/README.md +0 -16
- package/evals/fixtures/tiny-saas-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-saas-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-saas-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-saas-app/docs/specs/settings-title.md +0 -13
- package/evals/fixtures/tiny-saas-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-saas-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-saas-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-saas-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-saas-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-saas-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-saas-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-setup-agents-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-both-app/AGENTS.md +0 -5
- package/evals/fixtures/tiny-setup-both-app/CLAUDE.md +0 -5
- package/evals/fixtures/tiny-setup-claude-app/CLAUDE.md +0 -6
- package/evals/fixtures/tiny-setup-codex-rules-app/.codex/rules/shell.rules +0 -5
- package/evals/fixtures/tiny-setup-codex-rules-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-conflict-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-existing-block-app/AGENTS.md +0 -14
- package/evals/fixtures/tiny-setup-four-rules-app/CLAUDE.md +0 -6
- package/evals/fixtures/tiny-skill-dev-app/README.md +0 -10
- package/evals/fixtures/tiny-skill-dev-app/evals/prompts/review-pr-001.txt +0 -8
- package/evals/fixtures/tiny-skill-dev-app/evals/reports/review-pr-failure.md +0 -17
- package/evals/fixtures/tiny-skill-dev-app/skills/review-pr/SKILL.md +0 -13
- package/evals/fixtures/tiny-team-app/README.md +0 -5
- package/evals/fixtures/tiny-team-app/docs/product.md +0 -6
- package/evals/fixtures/tiny-team-app/src/teams.ts +0 -9
- package/evals/fixtures/tiny-team-app/src/users.ts +0 -5
- package/evals/fixtures/tiny-team-app/tests/teams.test.md +0 -7
- package/evals/fixtures/tiny-verify-app/README.md +0 -5
- package/evals/fixtures/tiny-verify-app/src/settings-nav.ts +0 -1
- package/evals/fixtures/tiny-verify-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-verify-app/tests/settings.test.md +0 -7
- package/evals/prompts/aon-001.txt +0 -2
- package/evals/prompts/byp-001.txt +0 -2
- package/evals/prompts/byp-002.txt +0 -2
- package/evals/prompts/cap-001.txt +0 -3
- package/evals/prompts/cap-002.txt +0 -3
- package/evals/prompts/cmd-001.txt +0 -3
- package/evals/prompts/cmd-002.txt +0 -3
- package/evals/prompts/cmd-003.txt +0 -6
- package/evals/prompts/cmd-004.txt +0 -5
- package/evals/prompts/cmd-005.txt +0 -5
- package/evals/prompts/cmd-006.txt +0 -5
- package/evals/prompts/cmd-007.txt +0 -5
- package/evals/prompts/cmd-008.txt +0 -5
- package/evals/prompts/cmd-009.txt +0 -8
- package/evals/prompts/cmd-010.txt +0 -5
- package/evals/prompts/cmd-011.txt +0 -5
- package/evals/prompts/cmd-012.txt +0 -5
- package/evals/prompts/cmd-013.txt +0 -5
- package/evals/prompts/cmd-014.txt +0 -7
- package/evals/prompts/cmd-015.txt +0 -7
- package/evals/prompts/cmd-016.txt +0 -5
- package/evals/prompts/cmt-001.txt +0 -1
- package/evals/prompts/cmt-002.txt +0 -1
- package/evals/prompts/cmt-003.txt +0 -1
- package/evals/prompts/cmt-004.txt +0 -1
- package/evals/prompts/cmt-005.txt +0 -1
- package/evals/prompts/dfd-001.txt +0 -3
- package/evals/prompts/dia-001.txt +0 -3
- package/evals/prompts/dia-002.txt +0 -3
- package/evals/prompts/dia-003.txt +0 -3
- package/evals/prompts/dis-001.txt +0 -5
- package/evals/prompts/dis-002.txt +0 -5
- package/evals/prompts/esk-001.txt +0 -5
- package/evals/prompts/esk-002.txt +0 -5
- package/evals/prompts/esk-003.txt +0 -5
- package/evals/prompts/grc-001.txt +0 -3
- package/evals/prompts/hof-001.txt +0 -3
- package/evals/prompts/hof-002.txt +0 -1
- package/evals/prompts/hof-003.txt +0 -1
- package/evals/prompts/hof-004.txt +0 -1
- package/evals/prompts/hof-005.txt +0 -1
- package/evals/prompts/ivg-001.txt +0 -1
- package/evals/prompts/ivg-002.txt +0 -11
- package/evals/prompts/ivg-003.txt +0 -1
- package/evals/prompts/ivg-004.txt +0 -1
- package/evals/prompts/mode-001.txt +0 -3
- package/evals/prompts/mode-002.txt +0 -1
- package/evals/prompts/mode-003.txt +0 -3
- package/evals/prompts/mode-004.txt +0 -3
- package/evals/prompts/mode-005.txt +0 -3
- package/evals/prompts/mode-006.txt +0 -3
- package/evals/prompts/mode-007.txt +0 -3
- package/evals/prompts/otr-001.txt +0 -3
- package/evals/prompts/otr-002.txt +0 -3
- package/evals/prompts/rar-001.txt +0 -5
- package/evals/prompts/rar-002.txt +0 -3
- package/evals/prompts/rar-003.txt +0 -6
- package/evals/prompts/rar-004.txt +0 -15
- package/evals/prompts/rar-005.txt +0 -10
- package/evals/prompts/rbr-001.txt +0 -3
- package/evals/prompts/rbr-002.txt +0 -3
- package/evals/prompts/rbr-003.txt +0 -7
- package/evals/prompts/rev-001.txt +0 -3
- package/evals/prompts/rev-002.txt +0 -5
- package/evals/prompts/rev-003.txt +0 -6
- package/evals/prompts/rev-004.txt +0 -1
- package/evals/prompts/rev-005.txt +0 -15
- package/evals/prompts/rev-006.txt +0 -5
- package/evals/prompts/stp-001.txt +0 -1
- package/evals/prompts/stp-002.txt +0 -1
- package/evals/prompts/stp-003.txt +0 -1
- package/evals/prompts/stp-004.txt +0 -1
- package/evals/prompts/stp-005.txt +0 -1
- package/evals/prompts/stp-006.txt +0 -1
- package/evals/prompts/stp-007.txt +0 -1
- package/evals/prompts/stp-008.txt +0 -1
- package/evals/prompts/stp-009.txt +0 -1
- package/evals/prompts/stp-010.txt +0 -1
- package/evals/prompts/stp-011.txt +0 -1
- package/evals/prompts/vfy-003.txt +0 -1
- package/evals/prompts/wpl-001.txt +0 -3
- package/evals/prompts/wpl-002.txt +0 -5
- package/evals/prompts/wpl-003.txt +0 -3
- package/evals/prompts/wpl-004.txt +0 -5
- package/evals/prompts/wpl-005.txt +0 -1
- package/evals/prompts/wrc-001.txt +0 -10
- package/evals/prompts/wrc-002.txt +0 -3
- package/evals/prompts/wsk-001.txt +0 -6
- package/evals/prompts/wsp-001.txt +0 -5
- package/evals/prompts/wsp-002.txt +0 -15
- package/evals/prompts/wsp-003.txt +0 -3
- package/evals/prompts/wsp-004.txt +0 -15
- package/evals/prompts/wsp-005.txt +0 -5
- package/evals/prompts/wsp-006.txt +0 -12
- package/evals/prompts/wsp-007.txt +0 -9
- package/evals/prompts/wsp-008.txt +0 -13
- package/evals/prompts/xpl-001.txt +0 -1
- package/evals/prompts/xpl-002.txt +0 -3
- package/evals/prompts/xpl-003.txt +0 -3
- package/evals/prompts/xpl-004.txt +0 -3
- package/evals/prompts/xpl-005.txt +0 -5
- package/evals/prompts/xpl-006.txt +0 -3
- package/evals/registries/adversarial-evals.json +0 -39
- package/evals/registries/fixture-evals.json +0 -2513
- package/evals/registries/handoff-evals.json +0 -74
- package/evals/registries/legacy-evals.json +0 -147
- package/evals/registries/skill-evidence.json +0 -193
- package/evals/registries/verify-work-evals.json +0 -46
- package/evals/reports/acceptance/v0.1-acceptance-report.md +0 -130
- package/evals/reports/by-command-surface/command-surface-1-report.md +0 -45
- package/evals/reports/by-command-surface/command-surface-10-report.md +0 -76
- package/evals/reports/by-command-surface/command-surface-11-report.md +0 -77
- package/evals/reports/by-command-surface/command-surface-12-report.md +0 -91
- package/evals/reports/by-command-surface/command-surface-13-report.md +0 -64
- package/evals/reports/by-command-surface/command-surface-14-report.md +0 -66
- package/evals/reports/by-command-surface/command-surface-15-report.md +0 -124
- package/evals/reports/by-command-surface/command-surface-16-report.md +0 -39
- package/evals/reports/by-command-surface/command-surface-2-report.md +0 -80
- package/evals/reports/by-command-surface/command-surface-3-report.md +0 -86
- package/evals/reports/by-command-surface/command-surface-4-report.md +0 -76
- package/evals/reports/by-command-surface/command-surface-5-report.md +0 -80
- package/evals/reports/by-command-surface/command-surface-6-report.md +0 -74
- package/evals/reports/by-command-surface/command-surface-7-report.md +0 -84
- package/evals/reports/by-command-surface/command-surface-8-report.md +0 -79
- package/evals/reports/by-command-surface/command-surface-9-report.md +0 -79
- package/evals/reports/by-command-surface/command-surface-matrix.md +0 -91
- package/evals/reports/by-skill/bypass-1-report.md +0 -124
- package/evals/reports/by-skill/capture-decisions-1-report.md +0 -99
- package/evals/reports/by-skill/capture-decisions-2-report.md +0 -102
- package/evals/reports/by-skill/commit-work-1-report.md +0 -165
- package/evals/reports/by-skill/commit-work-2-report.md +0 -109
- package/evals/reports/by-skill/design-for-depth-1-report.md +0 -95
- package/evals/reports/by-skill/diagnose-failure-1-report.md +0 -91
- package/evals/reports/by-skill/diagnose-failure-2-report.md +0 -94
- package/evals/reports/by-skill/discover-1-report.md +0 -118
- package/evals/reports/by-skill/evaluate-skill-2-report.md +0 -71
- package/evals/reports/by-skill/execute-plan-1-report.md +0 -103
- package/evals/reports/by-skill/execute-plan-2-report.md +0 -112
- package/evals/reports/by-skill/execute-plan-3-report.md +0 -87
- package/evals/reports/by-skill/grill-context-1-report.md +0 -103
- package/evals/reports/by-skill/handoff-1-report.md +0 -123
- package/evals/reports/by-skill/handoff-2-report.md +0 -105
- package/evals/reports/by-skill/handoff-3-report.md +0 -100
- package/evals/reports/by-skill/handoff-7-report.md +0 -77
- package/evals/reports/by-skill/interview-gate-1-report.md +0 -63
- package/evals/reports/by-skill/interview-gate-2-report.md +0 -105
- package/evals/reports/by-skill/mode-contract-1-report.md +0 -74
- package/evals/reports/by-skill/mode-contract-2-report.md +0 -87
- package/evals/reports/by-skill/mode-contract-3-report.md +0 -65
- package/evals/reports/by-skill/mode-contract-4-report.md +0 -71
- package/evals/reports/by-skill/mode-contract-5-report.md +0 -70
- package/evals/reports/by-skill/output-router-1-report.md +0 -76
- package/evals/reports/by-skill/output-router-2-report.md +0 -65
- package/evals/reports/by-skill/research-1-report.md +0 -144
- package/evals/reports/by-skill/research-brief-1-report.md +0 -94
- package/evals/reports/by-skill/research-brief-2-report.md +0 -75
- package/evals/reports/by-skill/review-artifact-1-report.md +0 -91
- package/evals/reports/by-skill/review-artifact-2-report.md +0 -79
- package/evals/reports/by-skill/review-artifact-3-report.md +0 -120
- package/evals/reports/by-skill/review-artifact-4-report.md +0 -89
- package/evals/reports/by-skill/review-artifact-5-report.md +0 -66
- package/evals/reports/by-skill/review-work-1-report.md +0 -85
- package/evals/reports/by-skill/review-work-2-report.md +0 -87
- package/evals/reports/by-skill/review-work-3-report.md +0 -104
- package/evals/reports/by-skill/review-work-4-report.md +0 -108
- package/evals/reports/by-skill/review-work-5-report.md +0 -73
- package/evals/reports/by-skill/review-work-6-report.md +0 -66
- package/evals/reports/by-skill/setup-freeflow-1-report.md +0 -199
- package/evals/reports/by-skill/setup-freeflow-2-report.md +0 -105
- package/evals/reports/by-skill/setup-freeflow-3-report.md +0 -105
- package/evals/reports/by-skill/setup-freeflow-4-report.md +0 -88
- package/evals/reports/by-skill/setup-freeflow-5-report.md +0 -115
- package/evals/reports/by-skill/skill-authoring-1-report.md +0 -81
- package/evals/reports/by-skill/verify-work-1-report.md +0 -111
- package/evals/reports/by-skill/verify-work-2-report.md +0 -120
- package/evals/reports/by-skill/workflow-1-report.md +0 -65
- package/evals/reports/by-skill/write-plan-1-report.md +0 -123
- package/evals/reports/by-skill/write-plan-2-report.md +0 -98
- package/evals/reports/by-skill/write-plan-3-report.md +0 -110
- package/evals/reports/by-skill/write-spec-1-report.md +0 -88
- package/evals/reports/by-skill/write-spec-2-report.md +0 -89
- package/evals/reports/by-skill/write-spec-3-report.md +0 -90
- package/evals/reports/by-skill/write-spec-4-report.md +0 -167
- package/evals/reports/harness/claude-harness-1-report.md +0 -103
- package/evals/reports/harness/eval-harness-1-report.md +0 -91
- package/evals/reports/iterations/iteration-1-report.md +0 -71
- package/evals/reports/iterations/iteration-2-report.md +0 -78
- package/evals/reports/iterations/iteration-3-report.md +0 -118
- package/evals/reports/iterations/iteration-4-report.md +0 -131
- package/evals/reports/iterations/iteration-5-report.md +0 -149
- package/evals/reports/iterations/iteration-6-report.md +0 -136
- package/evals/reports/runtime/always-on-runtime-1-report.md +0 -107
- package/evals/reports/runtime/context-mode-normalized-benchmark-1-report.md +0 -52
- package/evals/reports/runtime/context-mode-real-deep-baseline-1-report.md +0 -410
- package/evals/reports/runtime/context-mode-real-deep-final-slice-11-report.md +0 -203
- package/evals/reports/runtime/context-mode-real-deep-final-slice-11-review.md +0 -51
- package/evals/reports/runtime/context-saving-native-tools-baseline-1-report.md +0 -99
- package/evals/reports/runtime/eryx-python-compatibility-reprobe-1-report.md +0 -166
- package/evals/reports/runtime/eryx-python-proof-spike-1-report.md +0 -96
- package/evals/reports/runtime/eryx-python-proof-spike-2-report.md +0 -151
- package/evals/reports/runtime/eryx-python-script-derive-execution-1-report.md +0 -233
- package/evals/reports/runtime/jq-script-derive-execution-1-report.md +0 -215
- package/evals/reports/runtime/jq-wasm-proof-spike-1-report.md +0 -67
- package/evals/reports/runtime/output-router-benchmark-1-report.md +0 -81
- package/evals/reports/runtime/output-router-capture-derive-provider-eval-1-report.md +0 -35
- package/evals/reports/runtime/output-router-codex-large-index-sqlite-adhoc-report.md +0 -150
- package/evals/reports/runtime/output-router-codex-qa-benchmark-1-report.md +0 -46
- package/evals/reports/runtime/output-router-command-benchmark-1-report.md +0 -62
- package/evals/reports/runtime/output-router-index-benchmark-1-report.md +0 -64
- package/evals/reports/runtime/output-router-regression-1-report.md +0 -81
- package/evals/reports/runtime/output-router-transform-eval-1-report.md +0 -28
- package/evals/reports/runtime/pi-observed-routing-eval-1-report.md +0 -44
- package/evals/reports/runtime/quickjs-script-derive-execution-1-report.md +0 -159
- package/evals/reports/runtime/quickjs-wasi-proof-spike-1-report.md +0 -55
- package/evals/reports/runtime/render-format-row-protocol-1-report.md +0 -58
- package/evals/reports/runtime/script-sandbox-adapter-selection-review-1-report.md +0 -84
- package/evals/reports/runtime/script-sandbox-probe-resource-hardening-1-report.md +0 -51
- package/evals/reports/runtime/storage-policy-benchmark-1-report.md +0 -176
- package/evals/reports/runtime/vault-index-storage-spike-1-report.md +0 -39
- package/evals/reports/runtime/workflow-context-hook-1-report.md +0 -82
- package/evals/runbooks/adversarial-eval-runbook.md +0 -28
- package/evals/runbooks/fixture-eval-runbook.md +0 -137
- package/evals/runbooks/handoff-eval-runbook.md +0 -22
- package/evals/runbooks/verify-work-eval-runbook.md +0 -27
- package/evals/scripts/audit-command-surface.sh +0 -160
- package/evals/scripts/check-activation-contract.sh +0 -121
- package/evals/scripts/check-runtime-context-hook.sh +0 -183
- package/evals/scripts/grade-fixture-eval.sh +0 -446
- package/evals/scripts/run-claude-fixture-eval.sh +0 -26
- package/evals/scripts/run-codex-fixture-eval.sh +0 -26
- package/evals/scripts/run-eryx-python-proof-spike.js +0 -559
- package/evals/scripts/run-fixture-eval-by-id.sh +0 -23
- package/evals/scripts/run-fixture-eval.sh +0 -464
- package/evals/scripts/run-jq-wasm-proof-spike.js +0 -299
- package/evals/scripts/run-output-router-transform-eval.js +0 -115
- package/evals/scripts/run-pi-observed-routing-eval.js +0 -478
- package/evals/scripts/run-quickjs-wasi-proof-spike.js +0 -339
- package/evals/scripts/skill-evidence.sh +0 -316
- package/evals/scripts/validate-release-metadata.sh +0 -486
- package/evals/suites/v0.1-acceptance-suite.md +0 -131
- package/pi-extension/dist/host-producer-identification.js +0 -186
- package/pi-extension/dist/mcp-config.js +0 -30
- package/pi-extension/dist/native-safety-net.js +0 -209
- package/pi-extension/dist/observed-tool-routing.js +0 -114
- package/pi-extension/dist/renderers.js +0 -835
- package/pi-extension/dist/router-tools.js +0 -438
- package/pi-extension/dist/runtime-context.js +0 -288
- package/pi-extension/dist/schemas.js +0 -254
- package/pi-extension/dist/status.js +0 -449
- package/pi-extension/dist/utils.js +0 -467
- package/pi-extension/src/runtime-context.ts +0 -347
- package/pi-extension/src/status.ts +0 -505
- package/plugin-docs/README.md +0 -40
- package/plugin-docs/adr/0001-three-modes.md +0 -27
- package/plugin-docs/adr/0002-evals-before-hooks.md +0 -17
- package/plugin-docs/adr/0003-release-boundary.md +0 -21
- package/plugin-docs/adr/0004-discover-replaces-shallow-discovery-skills.md +0 -26
- package/plugin-docs/adr/README.md +0 -10
- package/plugin-docs/architecture.md +0 -89
- package/plugin-docs/output-router.md +0 -396
- package/plugin-docs/release-evidence.md +0 -77
- package/plugin-docs/skills.md +0 -44
- package/plugin-docs/workflow.md +0 -57
- package/skills/diagnose-failure/references/feedback-loop-catalog.md +0 -25
- package/skills/discover/ARTIFACT-DESTINATIONS.md +0 -58
- package/skills/discover/CHECKPOINTS.md +0 -74
- package/skills/discover/SKILL.md +0 -173
- package/skills/evaluate-skill/references/eval-patterns.md +0 -41
- package/skills/evaluate-skill/references/grading-priority.md +0 -33
- package/skills/execute-plan/SKILL.md +0 -133
- package/skills/execute-plan/references/execution-map.md +0 -122
- package/skills/interview-gate/SKILL.md +0 -90
- package/skills/setup-freeflow/references/output-router-setup.md +0 -102
- package/skills/workflow/references/workflow-map.md +0 -104
- /package/pi-extension/src/{mcp-config.ts → integrations/mcp-config.ts} +0 -0
|
@@ -1,57 +1,148 @@
|
|
|
1
|
-
# Artifact Reviewer
|
|
1
|
+
# Independent Artifact Reviewer Contract
|
|
2
2
|
|
|
3
|
-
Use this when
|
|
3
|
+
Use this when preparing an independent review of a durable artifact.
|
|
4
4
|
|
|
5
|
-
|
|
6
|
-
You are an artifact reviewer. Review whether this artifact is fit to guide future work.
|
|
5
|
+
The reviewer did not produce the artifact. Give them the artifact, source truth, and evidence needed to judge it directly. The reviewer reports review items without editing.
|
|
7
6
|
|
|
8
|
-
|
|
9
|
-
[ARTIFACT_PATH]
|
|
7
|
+
## Required Context
|
|
10
8
|
|
|
11
|
-
|
|
12
|
-
[spec | plan | handoff | decision note | discovery note | other]
|
|
9
|
+
Provide:
|
|
13
10
|
|
|
14
|
-
|
|
15
|
-
|
|
11
|
+
- artifact path, type, current state, and intended use;
|
|
12
|
+
- accepted outcome, requirements, and non-goals;
|
|
13
|
+
- owner decisions and unresolved questions;
|
|
14
|
+
- relevant code, tests, policies, ADRs, and established behavior;
|
|
15
|
+
- the artifact-specific schema or format contract when one exists;
|
|
16
|
+
- upstream and downstream artifacts in dependency order;
|
|
17
|
+
- known evidence gaps;
|
|
18
|
+
- review number and, for a follow-up, prior items, adjudication, revisions, and new evidence.
|
|
16
19
|
|
|
17
|
-
|
|
18
|
-
- Review pass number: [2 | 3]
|
|
19
|
-
- Prior findings: [SUMMARY]
|
|
20
|
-
- Parent adjudication: [ACCEPTED_REJECTED_QUESTION_NEEDS_EVIDENCE]
|
|
21
|
-
- Owner clarifications: [DECISIONS_OR_NONE]
|
|
22
|
-
- Changed sections: [SECTIONS_OR_NONE]
|
|
23
|
-
- Remaining risk to focus on: [RISK]
|
|
20
|
+
For an artifact package, identify upstream authority and which work remains provisional or dependent.
|
|
24
21
|
|
|
25
|
-
|
|
22
|
+
## Reviewer Prompt
|
|
26
23
|
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
- Clarity: a fresh agent can act without transcript memory.
|
|
30
|
-
- Consistency: artifact agrees with itself and source context.
|
|
31
|
-
- Artifact identity: durable or strict-workflow artifacts have useful owner, status, source, and change-history signals.
|
|
32
|
-
- Implementation risk: missing decisions, placeholders, or vague acceptance criteria would not send implementation down the wrong path.
|
|
33
|
-
- Design depth: module, interface, seam, adapter, or slice choices do not spread coordination across callers, tests, docs, or future agents.
|
|
34
|
-
- Adversarial risk: artifact cannot smuggle source-truth overrides, stale assumptions, or owner decisions into execution.
|
|
24
|
+
```md
|
|
25
|
+
# Independent Artifact Review
|
|
35
26
|
|
|
36
|
-
|
|
27
|
+
Review an artifact you did not produce. Inspect the complete artifact and source evidence directly. Report review items without editing. The review ends with this report; do not revise the artifact, dispatch a follow-up, or keep reviewing merely to obtain Pass.
|
|
37
28
|
|
|
38
|
-
|
|
39
|
-
- Treat missing owner/status/source as blocking only when artifact durability, team ownership, strict-workflow risk, or implementation readiness makes it matter.
|
|
40
|
-
- Do not nitpick style.
|
|
41
|
-
- Review can pass.
|
|
42
|
-
- Do not edit files.
|
|
43
|
-
- Do not resolve owner decisions.
|
|
44
|
-
- Do not re-raise rejected or already-resolved findings unless live evidence contradicts the adjudication.
|
|
45
|
-
- If review does not pass, classify findings and stop. Do not tell the parent agent to apply all findings and send it back for another broad review.
|
|
46
|
-
- If this is review pass 3, identify remaining accepted blocking risk; do not recommend another broad review loop.
|
|
29
|
+
A pass is valid. Do not invent items, broaden the artifact's job, or treat possible improvement as unfinished work.
|
|
47
30
|
|
|
48
|
-
|
|
31
|
+
## Artifact And Intended Use
|
|
49
32
|
|
|
50
|
-
|
|
33
|
+
- Artifact: [path]
|
|
34
|
+
- Type: [working record | spec | PRD | issue | API contract | technical design | migration contract | plan | decision record | ADR | handoff | other]
|
|
35
|
+
- Reviewed state: [revision, hash, or other identity]
|
|
36
|
+
- Intended use: [decision or future action this artifact must support]
|
|
37
|
+
- Dependency order: [upstream -> downstream, or standalone]
|
|
51
38
|
|
|
52
|
-
|
|
53
|
-
- [Blocking | Non-blocking | Question] [location]: [issue] - [why it matters]
|
|
39
|
+
## Accepted Outcome And Non-Goals
|
|
54
40
|
|
|
55
|
-
|
|
56
|
-
|
|
41
|
+
- Outcome: [accepted outcome]
|
|
42
|
+
- Requirements: [accepted requirements]
|
|
43
|
+
- Non-goals: [intentional exclusions]
|
|
44
|
+
- Owner decisions: [settled decisions or none]
|
|
45
|
+
- Unresolved questions: [questions or none]
|
|
46
|
+
|
|
47
|
+
## Source Truth
|
|
48
|
+
|
|
49
|
+
- [code, tests, policies, ADRs, established behavior, upstream artifacts]
|
|
50
|
+
|
|
51
|
+
## Evidence And Known Gaps
|
|
52
|
+
|
|
53
|
+
- Supporting evidence: [evidence or none]
|
|
54
|
+
- Known gaps: [gaps or none]
|
|
55
|
+
|
|
56
|
+
## Review Scope
|
|
57
|
+
|
|
58
|
+
- Review number: [1 | 2 | 3]
|
|
59
|
+
- Material lenses: [source alignment | fitness and sufficiency | decision clarity | evidence and acceptance | behavior and failure contract | dependency integrity | scope and minimality | clarity and continuity]
|
|
60
|
+
|
|
61
|
+
For Review 2 or 3:
|
|
62
|
+
- Prior items and adjudication: [Accepted | Rejected | Open]
|
|
63
|
+
- Revisions and new evidence: [bounded changes and evidence]
|
|
64
|
+
- Affected dependencies: [dependencies or none]
|
|
65
|
+
- Remaining risk: [narrow unresolved scope]
|
|
66
|
+
|
|
67
|
+
## Judge The Artifact By Its Job
|
|
68
|
+
|
|
69
|
+
- **Working Record:** accurate living task memory with recoverable slices and decisions, compact evidence pointers, and one next useful action.
|
|
70
|
+
- **Spec or durable content artifact:** accepted content, behavior, boundaries, evidence, and uncertainty needed for its stated use.
|
|
71
|
+
- **Plan:** inspectable ordered strategy with scope, dependencies, assumptions, checks, and stop conditions.
|
|
72
|
+
- **Decision record or ADR:** decision, owner, alternatives, rationale, consequences, and revisit or supersession conditions.
|
|
73
|
+
- **Handoff:** point-in-time continuation package that preserves what its recipient needs without replacing live task memory.
|
|
74
|
+
- **Other artifact:** its stated purpose without taking over another artifact's job.
|
|
75
|
+
|
|
76
|
+
## Check
|
|
77
|
+
|
|
78
|
+
Apply only the selected lenses:
|
|
79
|
+
|
|
80
|
+
- The artifact agrees with accepted requirements, owner decisions, and live facts.
|
|
81
|
+
- It contains enough for its intended use without pretending every future question is settled.
|
|
82
|
+
- Required, tentative, open, deferred, and superseded information cannot be confused.
|
|
83
|
+
- Load-bearing claims and acceptance conditions have suitable supporting or falsifying mechanisms.
|
|
84
|
+
- Consequential behavior, failure states, forbidden outcomes, observers, and recovery are explicit where required.
|
|
85
|
+
- Upstream and downstream artifacts remain consistent; provisional work is identified honestly.
|
|
86
|
+
- It avoids speculative scope, unnecessary process, transcript history, and duplicated information owned elsewhere.
|
|
87
|
+
- A future reader can use it without transcript memory or volatile copied context.
|
|
88
|
+
|
|
89
|
+
Do not demand exhaustive edge cases. A possible condition is not an Issue unless the artifact's intended use requires it, evidence shows it matters, or omission creates material risk. Use Question when expected behavior is undefined, Needs evidence when support is missing, and Improvement for useful content not required by this boundary.
|
|
90
|
+
|
|
91
|
+
If an upstream issue invalidates downstream assumptions, mark the affected material contingent instead of generating exhaustive downstream items.
|
|
92
|
+
|
|
93
|
+
For Review 2 or 3, inspect only accepted revisions, affected dependencies, new evidence, and remaining risk. Do not reopen Rejected items without contradictory evidence. For every new Blocking Issue, state whether it repeats, extends, invalidates, or exposes another consequence of a prior revision; is independent; or cannot yet be related from the evidence. Report a related pattern rather than proposing another revision. Review 3 is final for this cycle; do not recommend Review 4.
|
|
94
|
+
|
|
95
|
+
## Classify Review Items
|
|
96
|
+
|
|
97
|
+
- **Blocking Issue:** supported defect or risk that must be resolved before the artifact guides its intended use.
|
|
98
|
+
- **Non-blocking Issue:** real issue that can be deferred safely for this boundary.
|
|
99
|
+
- **Question:** material intent, requirement, or owner decision is unclear.
|
|
100
|
+
- **Needs evidence:** a load-bearing claim or condition cannot be established.
|
|
101
|
+
- **Improvement:** useful enhancement not required for this boundary. It does not affect judgment or authorize revision.
|
|
102
|
+
|
|
103
|
+
A Blocking Issue must include its exact location, violated source truth or artifact responsibility, evidence, concrete consequence for intended use, and smallest safe revision or owning activity to re-enter.
|
|
104
|
+
|
|
105
|
+
## Determine The Judgment
|
|
106
|
+
|
|
107
|
+
1. **Blocking:** one or more Blocking Issues exist.
|
|
108
|
+
2. **Inconclusive:** no Blocking Issue exists, but a material Question or Needs evidence item prevents judgment.
|
|
109
|
+
3. **Non-blocking:** only Non-blocking Issues remain.
|
|
110
|
+
4. **Pass:** no Issues or material Unresolved items remain. Improvements may still be reported.
|
|
111
|
+
|
|
112
|
+
## Output
|
|
113
|
+
|
|
114
|
+
Review type: independent
|
|
115
|
+
Review number: [1 | 2 | 3]
|
|
116
|
+
Artifact: [reviewed artifact]
|
|
117
|
+
Intended use: [reviewed boundary]
|
|
118
|
+
Reviewed state: [state identity]
|
|
119
|
+
Judgment: Pass | Non-blocking | Inconclusive | Blocking
|
|
120
|
+
Reasoning: [concise evidence-backed judgment]
|
|
121
|
+
Relationship to prior items (Review 2 or 3 only): [related consequence | independent defect | unclear, with evidence]
|
|
122
|
+
|
|
123
|
+
### Review Items
|
|
124
|
+
|
|
125
|
+
#### Issues — Blocking
|
|
126
|
+
- [location, issue, violated source or responsibility, evidence, consequence, smallest safe correction]
|
|
127
|
+
|
|
128
|
+
#### Issues — Non-blocking
|
|
129
|
+
- [location, issue, evidence, why it can be deferred]
|
|
130
|
+
|
|
131
|
+
#### Unresolved — Questions
|
|
132
|
+
- [question, effect on judgment, required answer]
|
|
133
|
+
|
|
134
|
+
#### Unresolved — Needs evidence
|
|
135
|
+
- [concern, missing evidence, evidence needed]
|
|
136
|
+
|
|
137
|
+
#### Improvements
|
|
138
|
+
- [improvement, benefit, supporting evidence]
|
|
139
|
+
|
|
140
|
+
Dependencies affected: [dependencies or none]
|
|
141
|
+
Evidence gaps: [unproved claims or none]
|
|
57
142
|
```
|
|
143
|
+
|
|
144
|
+
## Calibration
|
|
145
|
+
|
|
146
|
+
Use a high evidence bar, not a high item count. Lead with the few items that can change the artifact's fitness judgment. Prior review, artifact length, author confidence, or polished language does not establish fitness.
|
|
147
|
+
|
|
148
|
+
The review is evidence for adjudication, not authority over source truth, owner decisions, revisions, or another independent dispatch. Pass, Non-blocking, Inconclusive, and Blocking are all valid exits.
|
|
@@ -1,101 +1,126 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: review-work
|
|
3
|
-
description: Use when reviewing
|
|
3
|
+
description: Use when reviewing implementation or integrated work, whether reviewing work you produced or acting as an independent reviewer.
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Review Work
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
Judge whether work is correct, suitable, and sufficiently evidenced for its intended boundary.
|
|
9
9
|
|
|
10
|
-
Review
|
|
10
|
+
Review provides judgment. [Verify Work](../verify-work/SKILL.md) establishes what direct evidence proves. Review may challenge whether that evidence is sufficient, but it does not replace verification or authorize changes.
|
|
11
11
|
|
|
12
|
-
|
|
12
|
+
## Choose The Review Role
|
|
13
13
|
|
|
14
|
-
|
|
14
|
+
Choose the role before reviewing:
|
|
15
15
|
|
|
16
|
-
|
|
16
|
+
- **Self-review:** you produced the work. Inspect it silently using the relevant boundary and lenses below. Correct clear local issues within existing authority and re-verify. Create no formal review items, judgment, number, or cycle. Return unresolved material issues to [Workflow](../workflow/SKILL.md).
|
|
17
|
+
- **Independent review:** you did not produce the reviewed state. Inspect and report without editing. Use the formal item, judgment, and report method below. The receiving active agent adjudicates and routes the result.
|
|
17
18
|
|
|
18
|
-
|
|
19
|
+
Reading this skill does not create independence. If you produced the work, do not present your own judgment as independent review. Read [the reviewer prompt](references/reviewer-prompt.md) when preparing or performing a separately selected independent review.
|
|
19
20
|
|
|
20
|
-
|
|
21
|
+
## Establish The Boundary
|
|
21
22
|
|
|
22
|
-
|
|
23
|
+
Understand:
|
|
23
24
|
|
|
24
|
-
|
|
25
|
+
- the accepted outcome, requirements, and non-goals;
|
|
26
|
+
- the implementation, diff, or integrated work product;
|
|
27
|
+
- relevant Specs, Plans, tests, policies, ADRs, and established behavior;
|
|
28
|
+
- verification evidence and known gaps;
|
|
29
|
+
- risks and interactions material to the future action this review protects.
|
|
25
30
|
|
|
26
|
-
|
|
31
|
+
Inspect the work and source truth directly, not only the author's summary, reasoning, or claimed result. Read [the security risk lens](references/security-risk-lens.md) when the work changes a security-relevant boundary.
|
|
27
32
|
|
|
28
|
-
## Review
|
|
33
|
+
## Review Proportionately
|
|
29
34
|
|
|
30
|
-
|
|
35
|
+
Apply only lenses that can materially change the result:
|
|
31
36
|
|
|
32
|
-
|
|
37
|
+
- **Alignment and correctness:** accepted behavior is implemented without invention or omission.
|
|
38
|
+
- **Regression and integration:** affected callers, states, and components remain correct together.
|
|
39
|
+
- **Failure and risk:** relevant errors, recovery, permissions, data, and compatibility behave safely.
|
|
40
|
+
- **Evidence:** verification supports the claims and exercised the required boundary.
|
|
41
|
+
- **Design and minimality:** complexity and coordination are justified by requirements or observed failures.
|
|
42
|
+
- **Maintainability:** the work can be understood and changed without hidden policy or fragile coupling.
|
|
33
43
|
|
|
34
|
-
|
|
44
|
+
A pass is valid. Do not invent items, report preferences or hypothetical completeness, reopen intentional deferrals, or treat ordinary reversible choices as issues.
|
|
35
45
|
|
|
36
|
-
|
|
46
|
+
A possible edge case is not an Issue merely because it can be imagined:
|
|
37
47
|
|
|
38
|
-
|
|
48
|
+
```text
|
|
49
|
+
Required failure path is missing -> Issue
|
|
50
|
+
Unsettled expected behavior -> Question
|
|
51
|
+
Plausible concern without reachability or consequence evidence -> Needs evidence
|
|
52
|
+
Useful resilience outside this boundary -> Improvement or omit
|
|
53
|
+
Repeated related corrections -> diagnose the shared cause
|
|
54
|
+
```
|
|
39
55
|
|
|
40
|
-
|
|
56
|
+
## Classify Independent Review Items
|
|
41
57
|
|
|
42
|
-
-
|
|
43
|
-
-
|
|
44
|
-
-
|
|
45
|
-
-
|
|
46
|
-
-
|
|
47
|
-
- Check whether a finding is stale, already resolved, equivalent, or based on missing context.
|
|
48
|
-
- Check whether repeated findings are design pressure: shallow module, bad seam, edge-case churn, or broad refactor from a narrow comment.
|
|
58
|
+
- **Blocking Issue:** a supported defect, regression, omission, or risk that must be resolved before crossing the reviewed boundary.
|
|
59
|
+
- **Non-blocking Issue:** a real issue that can be deferred safely for this boundary.
|
|
60
|
+
- **Question:** material intent, requirements, or an owner decision is unclear.
|
|
61
|
+
- **Needs evidence:** a plausible concern cannot be established from available evidence.
|
|
62
|
+
- **Improvement:** a materially useful enhancement not required by this boundary. It does not affect judgment or authorize implementation.
|
|
49
63
|
|
|
50
|
-
|
|
64
|
+
A Blocking Issue must name the exact location, violated requirement or source truth, evidence, concrete boundary consequence, and smallest safe correction or owning activity to re-enter.
|
|
51
65
|
|
|
52
|
-
|
|
66
|
+
Use the most consequential applicable judgment:
|
|
53
67
|
|
|
54
|
-
|
|
68
|
+
1. **Blocking:** one or more Blocking Issues exist.
|
|
69
|
+
2. **Inconclusive:** no Blocking Issue exists, but a material Question or Needs evidence item prevents judgment.
|
|
70
|
+
3. **Non-blocking:** only Non-blocking Issues remain.
|
|
71
|
+
4. **Pass:** no Issues or material Unresolved items remain. Improvements may still be reported.
|
|
55
72
|
|
|
56
|
-
|
|
73
|
+
Pass, Non-blocking, Inconclusive, and Blocking are all valid review exits. A review ends with its report; it does not remain active until the work passes.
|
|
57
74
|
|
|
58
|
-
|
|
59
|
-
- Contradicts tests, docs, specs, policies, ADRs, or established behavior.
|
|
60
|
-
- Changes product, security, privacy, billing, data-loss, compatibility, public API, permissions, or architecture behavior.
|
|
61
|
-
- Requires guessing what the reviewer meant.
|
|
62
|
-
- Would cause a broad refactor from a narrow comment.
|
|
75
|
+
## Adjudicate And Route
|
|
63
76
|
|
|
64
|
-
|
|
77
|
+
After independent review, the receiving active agent adjudicates each item against the work, source truth, and evidence:
|
|
65
78
|
|
|
66
|
-
|
|
79
|
+
- **Accepted:** supported and applicable.
|
|
80
|
+
- **Rejected:** unsupported, stale, resolved, duplicate, preference-only, out of scope, or based on a source misread.
|
|
81
|
+
- **Open:** a question or evidence gap prevents acceptance or rejection.
|
|
67
82
|
|
|
68
|
-
|
|
83
|
+
Confirm whether each accepted Issue is Blocking or Non-blocking, then derive the adjudicated judgment. Do not accept the reviewer's overall judgment separately.
|
|
69
84
|
|
|
70
|
-
|
|
71
|
-
- Stop blocked items.
|
|
72
|
-
- If items interact, clarify before implementing the set.
|
|
85
|
+
Route from the adjudicated result:
|
|
73
86
|
|
|
74
|
-
|
|
87
|
+
- **Pass:** proceed.
|
|
88
|
+
- **Non-blocking:** proceed with explicit deferrals.
|
|
89
|
+
- **Inconclusive:** gather the missing evidence or decision.
|
|
90
|
+
- **Blocking:** do not cross the boundary; re-enter the narrowest owning activity, defer, or stop.
|
|
75
91
|
|
|
76
|
-
-
|
|
77
|
-
- Keep the diff scoped to the review item.
|
|
78
|
-
- Verify each fix.
|
|
79
|
-
- Push back on incorrect feedback with code, tests, or docs.
|
|
92
|
+
Review findings are evidence, not commands. They do not authorize edits. Accepted implementation corrections leave review and return to [Execute Work](../execute-work/SKILL.md); they may remain in the same [Track Work](../track-work/SKILL.md) slice while its intended result stays coherent.
|
|
80
93
|
|
|
81
|
-
|
|
94
|
+
When correction authority is not already explicit, ask once for either:
|
|
82
95
|
|
|
83
|
-
|
|
96
|
+
- the accepted corrections plus one warranted focused follow-up review; or
|
|
97
|
+
- the accepted corrections alone when direct evidence can settle the changed boundary.
|
|
84
98
|
|
|
85
|
-
|
|
99
|
+
Then wait for the user's response. Do not correct or dispatch a follow-up from the request, and do not ask again when existing authority already covers the bounded correction or review.
|
|
86
100
|
|
|
87
|
-
|
|
101
|
+
Verify authorized corrections. Run a follow-up only when the changed boundary still needs independent judgment and that dispatch is authorized. Do not change tests, Specs, policies, or accepted behavior merely to satisfy a reviewer or obtain Pass.
|
|
88
102
|
|
|
89
|
-
|
|
103
|
+
## Limit The Review Cycle
|
|
90
104
|
|
|
91
|
-
|
|
92
|
-
- Non-blocking: can defer.
|
|
93
|
-
- Question: needs owner decision or more evidence.
|
|
105
|
+
For one independently reviewed work state and boundary:
|
|
94
106
|
|
|
95
|
-
|
|
107
|
+
1. Review 1 is the normal broad review.
|
|
108
|
+
2. Review 2, when needed and authorized, focuses on accepted corrections, affected interactions, and remaining risk.
|
|
109
|
+
3. Review 3 is exceptional, authorized separately, and final for that cycle.
|
|
96
110
|
|
|
97
|
-
|
|
111
|
+
The budget is a cap, not dispatch authority. Do not request Review 4. At the cap, adjudicate and return control to Workflow; the work may proceed, remain blocked, re-enter another owner, defer, or stop.
|
|
98
112
|
|
|
99
|
-
|
|
113
|
+
After Review 2 is adjudicated Blocking, stop before proposing another correction or Review 3. Classify its relationship to the prior correction:
|
|
100
114
|
|
|
101
|
-
|
|
115
|
+
- If the blocker repeats, extends, invalidates, or exposes another consequence of the prior correction, or its cause remains unsupported, read [Diagnose Failure](../diagnose-failure/SKILL.md) and diagnose the shared cause before another patch.
|
|
116
|
+
- If it is an independent clear local defect with a supported cause, return directly to its owning activity and state why diagnosis is unnecessary.
|
|
117
|
+
|
|
118
|
+
A reviewer judgment alone does not trigger diagnosis; active-agent adjudication and evidence do. Review 3 is final judgment after the cause and correction boundary are understood, not a third attempt to discover the cause through patches. Workflow may later establish a new cycle only for a materially new reviewed state and boundary; local fixes, a different reviewer, or renamed scope do not reset it.
|
|
119
|
+
|
|
120
|
+
## Report
|
|
121
|
+
|
|
122
|
+
For self-review, report no formal review result. Correct clear local issues and surface only unresolved material issues that change the route.
|
|
123
|
+
|
|
124
|
+
For independent review, use the structured output in [the reviewer prompt](references/reviewer-prompt.md). The receiving agent reports the reviewer and adjudicated judgments, each material item's Accepted, Rejected, or Open outcome and reason, remaining open items, and authorized or proposed next route.
|
|
125
|
+
|
|
126
|
+
Omit empty groups. Support material judgments and adjudication with source or evidence rather than confidence.
|
|
@@ -1,97 +1,134 @@
|
|
|
1
|
-
# Reviewer
|
|
1
|
+
# Independent Work Reviewer Contract
|
|
2
2
|
|
|
3
|
-
Use this when preparing an
|
|
3
|
+
Use this when preparing an independent review of implementation or integrated work.
|
|
4
4
|
|
|
5
|
-
The reviewer
|
|
5
|
+
The reviewer did not produce the work. Give them the work product, source truth, and evidence needed to judge it directly. Do not provide only the author's summary, reasoning, or claimed result.
|
|
6
6
|
|
|
7
|
-
##
|
|
7
|
+
## Required Context
|
|
8
8
|
|
|
9
|
-
|
|
10
|
-
- The source authority: spec, plan, issue, ADR, policy, tests, or user-confirmed requirement.
|
|
11
|
-
- Files or diff range to inspect. If no git range exists, list concrete files.
|
|
12
|
-
- Claimed verification and what still needs independent checking.
|
|
13
|
-
- Risk lenses relevant to the work.
|
|
14
|
-
- Required output shape and severity labels.
|
|
15
|
-
- Clear instruction not to edit files unless the review task explicitly includes fixes.
|
|
16
|
-
- For review pass 2 or 3: prior findings, accepted/rejected/question/needs-evidence adjudication, owner clarifications, changed files, and narrowed remaining risk.
|
|
9
|
+
Provide:
|
|
17
10
|
|
|
18
|
-
|
|
11
|
+
- the work and future action covered by the review;
|
|
12
|
+
- accepted outcome, requirements, and non-goals;
|
|
13
|
+
- relevant specs, plans, tests, policies, ADRs, and established behavior;
|
|
14
|
+
- the implementation, changed files, or diff range;
|
|
15
|
+
- verification evidence and known gaps;
|
|
16
|
+
- only the review lenses material to this boundary;
|
|
17
|
+
- review number and, for a follow-up, prior items, adjudication, corrections, and new evidence.
|
|
19
18
|
|
|
20
|
-
|
|
19
|
+
When state transitions or proof integrity matter, also provide the invariant or state owner, affecting paths, observing mechanism, forbidden mutations, prior-state requirements, adversarial disproof, mutation footprint, and fidelity limits.
|
|
21
20
|
|
|
22
|
-
##
|
|
21
|
+
## Reviewer Prompt
|
|
23
22
|
|
|
24
|
-
|
|
23
|
+
```md
|
|
24
|
+
# Independent Work Review
|
|
25
25
|
|
|
26
|
-
|
|
27
|
-
- Regression risk: unrelated behavior changed or broad refactor from narrow work.
|
|
28
|
-
- Security/privacy: auth, secrets, permissions, sensitive data, logging, data exposure.
|
|
29
|
-
- Billing/product: pricing, downgrade/upgrade, access, entitlements, user-visible policy.
|
|
30
|
-
- Public API: route, method, payload, response status/body, compatibility, error semantics.
|
|
31
|
-
- Data safety: migrations, deletion, idempotency, rollback, duplicate processing.
|
|
32
|
-
- Test gaps: claims rely on manual checks, stale notes, or missing executable coverage.
|
|
33
|
-
- Reviewability: diff scope, generated files, hidden dependencies, unexplained deviations.
|
|
26
|
+
Review work you did not produce. Inspect the supplied work, source truth, and evidence directly. Report review items without editing. The review ends with this report; do not fix items, dispatch a follow-up, or keep reviewing merely to obtain Pass.
|
|
34
27
|
|
|
35
|
-
|
|
28
|
+
A pass is valid. Do not invent items, broaden scope, or treat possible improvement as unfinished work.
|
|
36
29
|
|
|
37
|
-
##
|
|
30
|
+
## Boundary
|
|
38
31
|
|
|
39
|
-
|
|
32
|
+
[Work and future action this review covers.]
|
|
40
33
|
|
|
41
|
-
|
|
42
|
-
## Findings
|
|
34
|
+
## Accepted Outcome And Non-Goals
|
|
43
35
|
|
|
44
|
-
|
|
45
|
-
- [
|
|
46
|
-
|
|
47
|
-
- Why it matters:
|
|
48
|
-
- Minimal fix direction:
|
|
36
|
+
- Outcome: [required result]
|
|
37
|
+
- Requirements: [accepted requirements]
|
|
38
|
+
- Non-goals: [intentional exclusions]
|
|
49
39
|
|
|
50
|
-
|
|
51
|
-
- ...
|
|
40
|
+
## Source Truth
|
|
52
41
|
|
|
53
|
-
|
|
54
|
-
- ...
|
|
42
|
+
- [specs, plans, tests, policies, ADRs, and established behavior]
|
|
55
43
|
|
|
56
|
-
##
|
|
44
|
+
## Work Product
|
|
57
45
|
|
|
58
|
-
|
|
59
|
-
|
|
60
|
-
```
|
|
46
|
+
- Reviewed state: [commit, tree, diff, or other identity]
|
|
47
|
+
- Work: [diff range, changed files, implementation, or integrated result]
|
|
61
48
|
|
|
62
|
-
|
|
49
|
+
## Verification Evidence
|
|
63
50
|
|
|
64
|
-
|
|
51
|
+
- Checks and results: [commands, observations, and results]
|
|
52
|
+
- Known gaps: [gaps or none]
|
|
53
|
+
- When relevant: [state owner, affecting paths, observer, forbidden mutations, prior-state requirements, adversarial disproof, mutation footprint, fidelity limits]
|
|
65
54
|
|
|
66
|
-
|
|
55
|
+
## Review Scope
|
|
67
56
|
|
|
68
|
-
|
|
57
|
+
- Review number: [1 | 2 | 3]
|
|
58
|
+
- Material lenses: [alignment and correctness | regression and integration | failure and risk | evidence | design and minimality | maintainability]
|
|
69
59
|
|
|
70
|
-
|
|
60
|
+
For Review 2 or 3:
|
|
61
|
+
- Prior items and adjudication: [Accepted | Rejected | Open]
|
|
62
|
+
- Clarifications: [settled decisions or none]
|
|
63
|
+
- Corrections and new evidence: [changes and verification]
|
|
64
|
+
- Remaining risk: [narrow unresolved scope]
|
|
71
65
|
|
|
72
|
-
|
|
73
|
-
# Reviewer Prompt
|
|
66
|
+
## Check
|
|
74
67
|
|
|
75
|
-
|
|
68
|
+
Apply only the selected lenses:
|
|
76
69
|
|
|
77
|
-
|
|
70
|
+
- The work satisfies accepted behavior without invention or omission.
|
|
71
|
+
- Affected callers, states, and components remain correct together.
|
|
72
|
+
- Relevant failure paths and material risks are handled safely.
|
|
73
|
+
- Verification supports the claims and exercised the required boundary.
|
|
74
|
+
- Complexity and coordination are justified by requirements or observed failures.
|
|
75
|
+
- The work remains understandable and changeable without hidden policy or fragile coupling.
|
|
78
76
|
|
|
79
|
-
|
|
77
|
+
Do not search for unrelated issues. Report an out-of-scope issue only when it materially affects whether this boundary may be crossed.
|
|
80
78
|
|
|
81
|
-
|
|
79
|
+
A possible edge case is not an Issue without accepted behavior, observed reachability, or material risk. Use Question when expected behavior is unclear, Needs evidence when reachability or consequence is unsupported, and Improvement for useful resilience not required by the boundary.
|
|
82
80
|
|
|
83
|
-
|
|
81
|
+
For Review 2 or 3, inspect only accepted corrections, affected interactions, new evidence, and remaining risk. Do not reopen Rejected items without contradictory evidence. For every new Blocking Issue, state whether it repeats, extends, invalidates, or exposes another consequence of a prior correction; is independent; or cannot yet be related from the evidence. Report a related pattern rather than proposing another patch. Review 3 is final for this cycle; do not recommend Review 4.
|
|
84
82
|
|
|
85
|
-
##
|
|
83
|
+
## Classify Review Items
|
|
86
84
|
|
|
87
|
-
-
|
|
85
|
+
- **Blocking Issue:** supported defect or risk that must be resolved before crossing this boundary.
|
|
86
|
+
- **Non-blocking Issue:** real issue that can be deferred safely for this boundary.
|
|
87
|
+
- **Question:** material intent, requirement, or owner decision is unclear.
|
|
88
|
+
- **Needs evidence:** a plausible concern cannot be established from available evidence.
|
|
89
|
+
- **Improvement:** useful enhancement not required for this boundary. It does not affect judgment or authorize implementation.
|
|
88
90
|
|
|
89
|
-
|
|
91
|
+
A Blocking Issue must include its exact location, violated requirement or source truth, evidence, concrete boundary consequence, and smallest safe correction or owning activity to re-enter.
|
|
90
92
|
|
|
91
|
-
|
|
92
|
-
|
|
93
|
+
## Determine The Judgment
|
|
94
|
+
|
|
95
|
+
1. **Blocking:** one or more Blocking Issues exist.
|
|
96
|
+
2. **Inconclusive:** no Blocking Issue exists, but a material Question or Needs evidence item prevents judgment.
|
|
97
|
+
3. **Non-blocking:** only Non-blocking Issues remain.
|
|
98
|
+
4. **Pass:** no Issues or material Unresolved items remain. Improvements may still be reported.
|
|
93
99
|
|
|
94
100
|
## Output
|
|
95
101
|
|
|
96
|
-
|
|
102
|
+
Review type: independent
|
|
103
|
+
Review number: [1 | 2 | 3]
|
|
104
|
+
Boundary: [reviewed work and future action]
|
|
105
|
+
Reviewed state: [state identity]
|
|
106
|
+
Judgment: Pass | Non-blocking | Inconclusive | Blocking
|
|
107
|
+
Reasoning: [concise evidence-backed judgment]
|
|
108
|
+
Relationship to prior items (Review 2 or 3 only): [related consequence | independent defect | unclear, with evidence]
|
|
109
|
+
|
|
110
|
+
### Review Items
|
|
111
|
+
|
|
112
|
+
#### Issues — Blocking
|
|
113
|
+
- [location, issue, violated source, evidence, consequence, smallest safe correction]
|
|
114
|
+
|
|
115
|
+
#### Issues — Non-blocking
|
|
116
|
+
- [location, issue, evidence, why it can be deferred]
|
|
117
|
+
|
|
118
|
+
#### Unresolved — Questions
|
|
119
|
+
- [question, effect on judgment, required answer]
|
|
120
|
+
|
|
121
|
+
#### Unresolved — Needs evidence
|
|
122
|
+
- [concern, missing evidence, evidence needed]
|
|
123
|
+
|
|
124
|
+
#### Improvements
|
|
125
|
+
- [improvement, benefit, supporting evidence]
|
|
126
|
+
|
|
127
|
+
Evidence gaps: [unproved claims or none]
|
|
97
128
|
```
|
|
129
|
+
|
|
130
|
+
## Calibration
|
|
131
|
+
|
|
132
|
+
Use a high evidence bar, not a high item count. Lead with the few items that can change the boundary judgment. Prior review, urgency, implementation effort, or author confidence does not establish correctness.
|
|
133
|
+
|
|
134
|
+
The review is evidence for adjudication, not authority over source truth, owner decisions, corrections, or another independent dispatch. Pass, Non-blocking, Inconclusive, and Blocking are all valid exits.
|