@hassangameryt/freeflow 0.3.0 → 0.4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +4 -4
- package/.claude-plugin/plugin.json +5 -2
- package/.codex-plugin/plugin.json +8 -9
- package/README.md +190 -128
- package/assets/feedback-loop.png +0 -0
- package/assets/freeflow_workflow_map.png +0 -0
- package/assets/workflow.png +0 -0
- package/command-surface.json +51 -7
- package/hooks/freeflow-runtime-context.mjs +264 -136
- package/hooks/tests/check-runtime-context-hook.sh +223 -0
- package/package.json +23 -24
- package/pi-extension/dist/index.js +264 -80
- package/pi-extension/dist/integrations/mcp-config.js +29 -0
- package/pi-extension/dist/output-router/host-producer-identification.js +232 -0
- package/pi-extension/dist/output-router/native-safety-net.js +216 -0
- package/pi-extension/dist/output-router/observed-tool-routing.js +122 -0
- package/pi-extension/dist/output-router/renderers.js +1023 -0
- package/pi-extension/dist/output-router/router-tools.js +554 -0
- package/pi-extension/dist/output-router/schemas.js +383 -0
- package/pi-extension/dist/output-router/status.js +744 -0
- package/pi-extension/dist/output-router/utils.js +502 -0
- package/pi-extension/dist/runtime/runtime-context.js +798 -0
- package/pi-extension/dist/settings/settings-tui.js +314 -0
- package/pi-extension/dist/settings/settings-ui.js +1487 -0
- package/pi-extension/freeflow/index.js +1 -0
- package/pi-extension/src/index.ts +230 -56
- package/pi-extension/src/{host-producer-identification.ts → output-router/host-producer-identification.ts} +37 -7
- package/pi-extension/src/{native-safety-net.ts → output-router/native-safety-net.ts} +7 -11
- package/pi-extension/src/{observed-tool-routing.ts → output-router/observed-tool-routing.ts} +19 -11
- package/pi-extension/src/{renderers.ts → output-router/renderers.ts} +246 -55
- package/pi-extension/src/{router-tools.ts → output-router/router-tools.ts} +130 -29
- package/pi-extension/src/{schemas.ts → output-router/schemas.ts} +171 -43
- package/pi-extension/src/output-router/status.ts +791 -0
- package/pi-extension/src/{utils.ts → output-router/utils.ts} +80 -18
- package/pi-extension/src/runtime/runtime-context.ts +895 -0
- package/pi-extension/src/settings/settings-tui.ts +408 -0
- package/pi-extension/src/settings/settings-ui.ts +1730 -0
- package/pi-extension/tests/integration/pi-extension.test.js +4018 -0
- package/pi-extension/tests/output-router/observed-producers.test.js +132 -0
- package/pi-extension/tests/output-router/search.test.js +722 -0
- package/pi-extension/tests/settings/settings-tui.test.js +243 -0
- package/router/dist/benchmarks/benchmark-harness.d.ts +16 -13
- package/router/dist/benchmarks/benchmark-harness.js +62 -62
- package/router/dist/benchmarks/benchmarks.d.ts +80 -73
- package/router/dist/benchmarks/benchmarks.js +860 -761
- package/router/dist/benchmarks/codex-qa-benchmarks.d.ts +71 -67
- package/router/dist/benchmarks/codex-qa-benchmarks.js +429 -390
- package/router/dist/benchmarks/command-benchmarks.d.ts +107 -92
- package/router/dist/benchmarks/command-benchmarks.js +616 -571
- package/router/dist/benchmarks/context-mode-normalized-benchmarks.d.ts +64 -56
- package/router/dist/benchmarks/context-mode-normalized-benchmarks.js +679 -613
- package/router/dist/benchmarks/context-mode-real-deep-benchmark.d.ts +103 -95
- package/router/dist/benchmarks/context-mode-real-deep-benchmark.js +1188 -1103
- package/router/dist/benchmarks/context-saving-baseline.d.ts +47 -41
- package/router/dist/benchmarks/context-saving-baseline.js +405 -374
- package/router/dist/benchmarks/index-benchmarks.d.ts +74 -69
- package/router/dist/benchmarks/index-benchmarks.js +761 -661
- package/router/dist/benchmarks/storage-policy-benchmarks.d.ts +80 -69
- package/router/dist/benchmarks/storage-policy-benchmarks.js +549 -469
- package/router/dist/benchmarks/vault-index-benchmarks.d.ts +43 -34
- package/router/dist/benchmarks/vault-index-benchmarks.js +294 -229
- package/router/dist/config/config.d.ts +61 -54
- package/router/dist/config/config.js +551 -372
- package/router/dist/config/router-contract.d.ts +2 -2
- package/router/dist/config/router-contract.js +38 -38
- package/router/dist/config/schema.d.ts +19 -10
- package/router/dist/config/schema.js +586 -538
- package/router/dist/config/types.d.ts +413 -361
- package/router/dist/config/types.js +19 -8
- package/router/dist/evidence/bounded-evidence.d.ts +26 -26
- package/router/dist/evidence/bounded-evidence.js +265 -252
- package/router/dist/evidence/evidence-range-selector.d.ts +16 -14
- package/router/dist/evidence/evidence-range-selector.js +192 -191
- package/router/dist/evidence/evidence-search.d.ts +18 -16
- package/router/dist/evidence/evidence-search.js +401 -377
- package/router/dist/evidence/evidence.d.ts +17 -17
- package/router/dist/evidence/evidence.js +163 -159
- package/router/dist/evidence/failure-contracts.d.ts +25 -15
- package/router/dist/evidence/failure-contracts.js +132 -126
- package/router/dist/evidence/line-ranges.d.ts +17 -15
- package/router/dist/evidence/line-ranges.js +18 -18
- package/router/dist/experiments/local-index.d.ts +47 -41
- package/router/dist/experiments/local-index.js +477 -458
- package/router/dist/local/local-traversal.d.ts +18 -0
- package/router/dist/local/local-traversal.js +334 -0
- package/router/dist/processing/engine.d.ts +94 -70
- package/router/dist/processing/engine.js +462 -364
- package/router/dist/processing/reducers.d.ts +208 -194
- package/router/dist/processing/reducers.js +1434 -1256
- package/router/dist/processing/renderers.d.ts +24 -18
- package/router/dist/processing/renderers.js +161 -152
- package/router/dist/processing/scripts.d.ts +80 -67
- package/router/dist/processing/scripts.js +343 -290
- package/router/dist/repo/repo-traversal.d.ts +9 -9
- package/router/dist/repo/repo-traversal.js +205 -202
- package/router/dist/routing/observed-reducers.d.ts +25 -19
- package/router/dist/routing/observed-reducers.js +559 -545
- package/router/dist/routing/observed-routing.d.ts +23 -14
- package/router/dist/routing/observed-routing.js +319 -318
- package/router/dist/routing/parsers.d.ts +10 -10
- package/router/dist/routing/parsers.js +454 -406
- package/router/dist/routing/run-filters.d.ts +45 -41
- package/router/dist/routing/run-filters.js +215 -207
- package/router/dist/routing/run-reducers.d.ts +45 -26
- package/router/dist/routing/run-reducers.js +102 -90
- package/router/dist/sandbox/adapter-roots.d.ts +34 -26
- package/router/dist/sandbox/adapter-roots.js +43 -41
- package/router/dist/sandbox/eryx-python-adapter.d.ts +9 -5
- package/router/dist/sandbox/eryx-python-adapter.js +659 -588
- package/router/dist/sandbox/jq-wasm-adapter.d.ts +3 -3
- package/router/dist/sandbox/jq-wasm-adapter.js +319 -311
- package/router/dist/sandbox/quickjs-wasi-adapter.d.ts +9 -5
- package/router/dist/sandbox/quickjs-wasi-adapter.js +336 -333
- package/router/dist/sandbox/script-sandbox.d.ts +105 -84
- package/router/dist/sandbox/script-sandbox.js +294 -260
- package/router/dist/setup/script-transform-adapters.d.ts +23 -19
- package/router/dist/setup/script-transform-adapters.js +223 -204
- package/router/dist/tools/batch.d.ts +27 -16
- package/router/dist/tools/batch.js +493 -416
- package/router/dist/tools/run.d.ts +47 -35
- package/router/dist/tools/run.js +1171 -1086
- package/router/dist/tools/search.d.ts +53 -31
- package/router/dist/tools/search.js +1224 -1065
- package/router/dist/transform/engine.d.ts +121 -96
- package/router/dist/transform/engine.js +1853 -1736
- package/router/dist/vault/vault-index.d.ts +97 -78
- package/router/dist/vault/vault-index.js +347 -342
- package/router/dist/vault/vault.d.ts +109 -74
- package/router/dist/vault/vault.js +528 -533
- package/runtime/interaction-contract.md +16 -0
- package/skills/bypass/SKILL.md +52 -38
- package/skills/commit-work/SKILL.md +54 -46
- package/skills/commit-work/references/staging-decisions.md +46 -24
- package/skills/decision-gate/SKILL.md +48 -0
- package/skills/design-for-depth/SKILL.md +75 -59
- package/skills/design-for-depth/references/design-pressure-signals.md +56 -7
- package/skills/design-for-depth/references/interface-design-loop.md +156 -0
- package/skills/design-for-depth/references/software-design-philosophy.md +32 -3
- package/skills/diagnose-failure/SKILL.md +65 -60
- package/skills/diagnose-failure/references/diagnostic-loop-catalog.md +36 -0
- package/skills/diagnose-failure/references/flaky-and-performance.md +30 -18
- package/skills/discuss/SKILL.md +121 -0
- package/skills/discuss/references/checkpoints.md +66 -0
- package/skills/evaluate-skill/SKILL.md +62 -53
- package/skills/evaluate-skill/references/definition-schema.md +345 -0
- package/skills/evaluate-skill/references/evaluation-design.md +86 -0
- package/skills/evaluate-skill/references/execution-and-evidence.md +85 -0
- package/skills/evaluate-skill/references/review-and-revision.md +51 -0
- package/skills/evaluate-skill/scripts/lib/definitions.mjs +296 -0
- package/skills/evaluate-skill/scripts/lib/evidence.mjs +46 -0
- package/skills/evaluate-skill/scripts/lib/grade-comparison.mjs +60 -0
- package/skills/evaluate-skill/scripts/lib/grade-interaction.mjs +148 -0
- package/skills/evaluate-skill/scripts/lib/grade-support.mjs +126 -0
- package/skills/evaluate-skill/scripts/lib/grade-workspace.mjs +192 -0
- package/skills/evaluate-skill/scripts/lib/grade.mjs +56 -0
- package/skills/evaluate-skill/scripts/lib/pi.mjs +489 -0
- package/skills/evaluate-skill/scripts/lib/process.mjs +79 -0
- package/skills/evaluate-skill/scripts/lib/rpc.mjs +444 -0
- package/skills/evaluate-skill/scripts/lib/runner.mjs +346 -0
- package/skills/evaluate-skill/scripts/lib/sandbox.mjs +409 -0
- package/skills/evaluate-skill/scripts/lib/view.mjs +337 -0
- package/skills/evaluate-skill/scripts/pi-guard.mjs +164 -0
- package/skills/evaluate-skill/scripts/skill-eval.mjs +101 -0
- package/skills/execute-work/SKILL.md +99 -0
- package/skills/execute-work/references/code-practices.md +78 -0
- package/skills/execute-work/references/execution-loop.md +77 -0
- package/skills/finish-branch/SKILL.md +117 -0
- package/skills/finish-branch/references/integration-options.md +80 -0
- package/skills/handoff/SKILL.md +65 -39
- package/skills/handoff/references/templates.md +104 -27
- package/skills/launch-work/SKILL.md +116 -0
- package/skills/launch-work/references/launch-readiness.md +85 -0
- package/skills/migration-work/SKILL.md +115 -0
- package/skills/migration-work/references/migration-lifecycle.md +82 -0
- package/skills/mode-contract/SKILL.md +50 -52
- package/skills/output-router/SKILL.md +21 -17
- package/skills/output-router/references/safety-policy.md +1 -1
- package/skills/release-work/SKILL.md +118 -0
- package/skills/release-work/references/release-evidence.md +78 -0
- package/skills/review-artifact/SKILL.md +77 -69
- package/skills/review-artifact/references/reviewer-prompt.md +133 -42
- package/skills/review-work/SKILL.md +82 -57
- package/skills/review-work/references/reviewer-prompt.md +97 -60
- package/skills/review-work/references/security-risk-lens.md +67 -0
- package/skills/setup-freeflow/SKILL.md +58 -66
- package/skills/setup-freeflow/references/activation-contract.md +89 -69
- package/skills/setup-freeflow/references/host-setup.md +54 -17
- package/skills/setup-freeflow/references/output-router-setup.md +62 -54
- package/skills/simplify-code/SKILL.md +80 -0
- package/skills/simplify-code/references/simplification-patterns.md +70 -0
- package/skills/tdd/SKILL.md +96 -0
- package/skills/tdd/references/test-design.md +96 -0
- package/skills/track-work/SKILL.md +84 -0
- package/skills/track-work/references/working-record-schema.md +378 -0
- package/skills/verify-work/SKILL.md +59 -38
- package/skills/verify-work/references/browser-runtime-evidence.md +55 -0
- package/skills/verify-work/references/integration-evidence.md +51 -0
- package/skills/verify-work/references/performance-evidence.md +57 -0
- package/skills/workflow/SKILL.md +53 -59
- package/skills/workflow/references/domain-skill-composition.md +57 -0
- package/skills/workflow/references/workflow-loop.md +92 -0
- package/skills/write-plan/SKILL.md +85 -58
- package/skills/write-plan/references/plan-shapes.md +132 -46
- package/skills/write-skill/SKILL.md +82 -51
- package/skills/write-skill/references/activation-boundaries.md +62 -0
- package/skills/write-skill/references/agent-first-instructions.md +87 -0
- package/skills/write-skill/references/progressive-disclosure.md +63 -0
- package/skills/write-skill/scripts/lib/skill-author.mjs +653 -0
- package/skills/write-skill/scripts/skill-author.mjs +104 -0
- package/skills/write-spec/SKILL.md +65 -54
- package/skills/write-spec/references/artifact-standards.md +60 -41
- package/skills/write-spec/references/decision-records.md +77 -0
- package/skills/write-spec/references/spec-shapes.md +119 -60
- package/evals/README.md +0 -32
- package/evals/fixtures/copy-conventions.md +0 -31
- package/evals/fixtures/output-router/README.md +0 -12
- package/evals/fixtures/output-router/failed-command-output.txt +0 -9
- package/evals/fixtures/output-router/large-router-manual.md +0 -63
- package/evals/fixtures/output-router/native-large-output.txt +0 -40
- package/evals/fixtures/output-router/noisy-test-output.txt +0 -30
- package/evals/fixtures/output-router/verification-output.txt +0 -8
- package/evals/fixtures/tiny-artifact-review-app/README.md +0 -5
- package/evals/fixtures/tiny-artifact-review-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/billing-webhook-api-draft.md +0 -21
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/failed-payment-grace-period.md +0 -24
- package/evals/fixtures/tiny-artifact-review-app/docs/specs/immediate-downgrade.md +0 -17
- package/evals/fixtures/tiny-artifact-review-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-commit-ambiguous-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-ambiguous-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-ambiguous-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-ambiguous-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-ambiguous-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-app/.freeflow-eval-setup.sh +0 -14
- package/evals/fixtures/tiny-commit-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-everything-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-everything-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-everything-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-everything-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-everything-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-everything-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-staged-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-staged-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-staged-app/docs/specs/settings-title.md +0 -5
- package/evals/fixtures/tiny-commit-staged-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-commit-staged-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-commit-staged-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-commit-staged-mixed-app/.freeflow-eval-setup.sh +0 -15
- package/evals/fixtures/tiny-commit-staged-mixed-app/README.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/docs/billing-policy.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/docs/release-notes.md +0 -3
- package/evals/fixtures/tiny-commit-staged-mixed-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-dashboard-stale-app/README.md +0 -11
- package/evals/fixtures/tiny-dashboard-stale-app/src/api-client.ts +0 -13
- package/evals/fixtures/tiny-dashboard-stale-app/src/dashboard-data.ts +0 -19
- package/evals/fixtures/tiny-dashboard-stale-app/tests/dashboard-data.test.md +0 -9
- package/evals/fixtures/tiny-decision-destination-app/README.md +0 -6
- package/evals/fixtures/tiny-decision-destination-app/src/risk.ts +0 -8
- package/evals/fixtures/tiny-decision-destination-app/tests/risk.test.md +0 -4
- package/evals/fixtures/tiny-design-depth-app/README.md +0 -15
- package/evals/fixtures/tiny-design-depth-app/src/routes.ts +0 -25
- package/evals/fixtures/tiny-design-depth-app/src/sendEmail.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/src/sendSms.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/src/telemetry.ts +0 -3
- package/evals/fixtures/tiny-design-depth-app/tests/routes.test.md +0 -12
- package/evals/fixtures/tiny-eval-method-app/README.md +0 -8
- package/evals/fixtures/tiny-eval-method-app/evals/reports/review-pr-eval-result.md +0 -5
- package/evals/fixtures/tiny-eval-method-app/evals/reports/triage-question-failure.md +0 -17
- package/evals/fixtures/tiny-eval-method-app/evals/runs/review-pr-with-skill-output.diff +0 -11
- package/evals/fixtures/tiny-eval-method-app/evals/runs/review-pr-with-skill-output.md +0 -3
- package/evals/fixtures/tiny-eval-method-app/skills/review-pr/SKILL.md +0 -10
- package/evals/fixtures/tiny-eval-method-app/skills/triage-question/SKILL.md +0 -10
- package/evals/fixtures/tiny-execute-plan-app/README.md +0 -5
- package/evals/fixtures/tiny-execute-plan-app/checks/settings-and-billing-check.sh +0 -5
- package/evals/fixtures/tiny-execute-plan-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/immediate-downgrade-plan.md +0 -11
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/settings-title-with-bad-check.md +0 -15
- package/evals/fixtures/tiny-execute-plan-app/docs/plans/unverified-billing-plan.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/docs/specs/failed-payment-grace-period.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-execute-plan-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-execute-plan-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-execute-plan-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-execute-plan-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-execute-review-loop-app/README.md +0 -5
- package/evals/fixtures/tiny-execute-review-loop-app/docs/billing-policy.md +0 -9
- package/evals/fixtures/tiny-execute-review-loop-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-execute-review-loop-app/docs/review/previous-agent-summary.md +0 -15
- package/evals/fixtures/tiny-execute-review-loop-app/docs/review/review-pass-1-non-pass.md +0 -11
- package/evals/fixtures/tiny-execute-review-loop-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-execute-review-loop-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-execute-review-loop-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-execute-review-loop-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-execute-review-loop-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-flaky-session-app/README.md +0 -10
- package/evals/fixtures/tiny-flaky-session-app/src/session-timeout.ts +0 -13
- package/evals/fixtures/tiny-flaky-session-app/tests/session-timeout.test.md +0 -8
- package/evals/fixtures/tiny-handoff-app/README.md +0 -5
- package/evals/fixtures/tiny-handoff-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-handoff-app/docs/handoffs/old-agent-handoff.md +0 -8
- package/evals/fixtures/tiny-handoff-app/docs/plans/billing-retry-plan.md +0 -11
- package/evals/fixtures/tiny-handoff-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-handoff-report-app/README.md +0 -3
- package/evals/fixtures/tiny-handoff-report-app/evals/runs/handoff-3/hof-003/with-skill-output.diff +0 -1
- package/evals/fixtures/tiny-handoff-report-app/evals/runs/handoff-3/hof-003/with-skill-output.md +0 -1
- package/evals/fixtures/tiny-handoff-report-app/evals/scores/hof-003-score.txt +0 -4
- package/evals/fixtures/tiny-plan-app/README.md +0 -5
- package/evals/fixtures/tiny-plan-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-plan-app/docs/specs/failed-payment-grace-period.md +0 -25
- package/evals/fixtures/tiny-plan-app/src/billing.ts +0 -17
- package/evals/fixtures/tiny-plan-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-plan-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-plan-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/README.md +0 -3
- package/evals/fixtures/tiny-plan-strict-api-app/docs/billing-policy.md +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/docs/specs/billing-webhook-api.md +0 -25
- package/evals/fixtures/tiny-plan-strict-api-app/src/billing.ts +0 -5
- package/evals/fixtures/tiny-plan-strict-api-app/src/webhooks.ts +0 -3
- package/evals/fixtures/tiny-plan-strict-api-app/tests/billing-webhook.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/.freeflow/config.json +0 -3
- package/evals/fixtures/tiny-post-setup-invalid-config-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-invalid-config-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-invalid-config-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-invalid-config-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-post-setup-missing-config-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-missing-config-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-missing-config-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-missing-config-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-post-setup-source-conflict-app/.freeflow/config.json +0 -3
- package/evals/fixtures/tiny-post-setup-source-conflict-app/AGENTS.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/README.md +0 -16
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-post-setup-source-conflict-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-post-setup-source-conflict-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-post-setup-source-conflict-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-report-performance-app/README.md +0 -11
- package/evals/fixtures/tiny-report-performance-app/docs/performance.md +0 -10
- package/evals/fixtures/tiny-report-performance-app/src/report-summary.ts +0 -29
- package/evals/fixtures/tiny-report-performance-app/tests/report-performance.test.md +0 -8
- package/evals/fixtures/tiny-review-request-app/README.md +0 -3
- package/evals/fixtures/tiny-review-request-app/docs/billing-policy.md +0 -5
- package/evals/fixtures/tiny-review-request-app/docs/plans/billing-webhook-api.md +0 -19
- package/evals/fixtures/tiny-review-request-app/docs/review/previous-agent-summary.md +0 -20
- package/evals/fixtures/tiny-review-request-app/docs/specs/billing-webhook-api.md +0 -25
- package/evals/fixtures/tiny-review-request-app/src/billing.ts +0 -11
- package/evals/fixtures/tiny-review-request-app/src/webhooks.ts +0 -19
- package/evals/fixtures/tiny-review-request-app/tests/billing-webhook.test.md +0 -8
- package/evals/fixtures/tiny-review-work-app/README.md +0 -5
- package/evals/fixtures/tiny-review-work-app/docs/billing-policy.md +0 -9
- package/evals/fixtures/tiny-review-work-app/docs/plans/settings-title-plan.md +0 -12
- package/evals/fixtures/tiny-review-work-app/docs/review/previous-agent-summary.md +0 -15
- package/evals/fixtures/tiny-review-work-app/docs/specs/settings-title.md +0 -9
- package/evals/fixtures/tiny-review-work-app/src/billing.ts +0 -7
- package/evals/fixtures/tiny-review-work-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-review-work-app/tests/billing.test.md +0 -7
- package/evals/fixtures/tiny-review-work-app/tests/settings.test.md +0 -5
- package/evals/fixtures/tiny-saas-app/README.md +0 -16
- package/evals/fixtures/tiny-saas-app/docs/auth-review.md +0 -15
- package/evals/fixtures/tiny-saas-app/docs/billing-policy.md +0 -10
- package/evals/fixtures/tiny-saas-app/docs/copy-conventions.md +0 -15
- package/evals/fixtures/tiny-saas-app/docs/specs/settings-title.md +0 -13
- package/evals/fixtures/tiny-saas-app/src/auth-middleware.ts +0 -12
- package/evals/fixtures/tiny-saas-app/src/billing.ts +0 -20
- package/evals/fixtures/tiny-saas-app/src/login-copy.ts +0 -1
- package/evals/fixtures/tiny-saas-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-saas-app/tests/auth-middleware.test.md +0 -8
- package/evals/fixtures/tiny-saas-app/tests/billing.test.md +0 -8
- package/evals/fixtures/tiny-saas-app/tests/copy.test.md +0 -7
- package/evals/fixtures/tiny-setup-agents-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-both-app/AGENTS.md +0 -5
- package/evals/fixtures/tiny-setup-both-app/CLAUDE.md +0 -5
- package/evals/fixtures/tiny-setup-claude-app/CLAUDE.md +0 -6
- package/evals/fixtures/tiny-setup-codex-rules-app/.codex/rules/shell.rules +0 -5
- package/evals/fixtures/tiny-setup-codex-rules-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-conflict-app/AGENTS.md +0 -6
- package/evals/fixtures/tiny-setup-existing-block-app/AGENTS.md +0 -14
- package/evals/fixtures/tiny-setup-four-rules-app/CLAUDE.md +0 -6
- package/evals/fixtures/tiny-skill-dev-app/README.md +0 -10
- package/evals/fixtures/tiny-skill-dev-app/evals/prompts/review-pr-001.txt +0 -8
- package/evals/fixtures/tiny-skill-dev-app/evals/reports/review-pr-failure.md +0 -17
- package/evals/fixtures/tiny-skill-dev-app/skills/review-pr/SKILL.md +0 -13
- package/evals/fixtures/tiny-team-app/README.md +0 -5
- package/evals/fixtures/tiny-team-app/docs/product.md +0 -6
- package/evals/fixtures/tiny-team-app/src/teams.ts +0 -9
- package/evals/fixtures/tiny-team-app/src/users.ts +0 -5
- package/evals/fixtures/tiny-team-app/tests/teams.test.md +0 -7
- package/evals/fixtures/tiny-verify-app/README.md +0 -5
- package/evals/fixtures/tiny-verify-app/src/settings-nav.ts +0 -1
- package/evals/fixtures/tiny-verify-app/src/settings-page.ts +0 -1
- package/evals/fixtures/tiny-verify-app/tests/settings.test.md +0 -7
- package/evals/prompts/aon-001.txt +0 -2
- package/evals/prompts/byp-001.txt +0 -2
- package/evals/prompts/byp-002.txt +0 -2
- package/evals/prompts/cap-001.txt +0 -3
- package/evals/prompts/cap-002.txt +0 -3
- package/evals/prompts/cmd-001.txt +0 -3
- package/evals/prompts/cmd-002.txt +0 -3
- package/evals/prompts/cmd-003.txt +0 -6
- package/evals/prompts/cmd-004.txt +0 -5
- package/evals/prompts/cmd-005.txt +0 -5
- package/evals/prompts/cmd-006.txt +0 -5
- package/evals/prompts/cmd-007.txt +0 -5
- package/evals/prompts/cmd-008.txt +0 -5
- package/evals/prompts/cmd-009.txt +0 -8
- package/evals/prompts/cmd-010.txt +0 -5
- package/evals/prompts/cmd-011.txt +0 -5
- package/evals/prompts/cmd-012.txt +0 -5
- package/evals/prompts/cmd-013.txt +0 -5
- package/evals/prompts/cmd-014.txt +0 -7
- package/evals/prompts/cmd-015.txt +0 -7
- package/evals/prompts/cmd-016.txt +0 -5
- package/evals/prompts/cmt-001.txt +0 -1
- package/evals/prompts/cmt-002.txt +0 -1
- package/evals/prompts/cmt-003.txt +0 -1
- package/evals/prompts/cmt-004.txt +0 -1
- package/evals/prompts/cmt-005.txt +0 -1
- package/evals/prompts/dfd-001.txt +0 -3
- package/evals/prompts/dia-001.txt +0 -3
- package/evals/prompts/dia-002.txt +0 -3
- package/evals/prompts/dia-003.txt +0 -3
- package/evals/prompts/dis-001.txt +0 -5
- package/evals/prompts/dis-002.txt +0 -5
- package/evals/prompts/esk-001.txt +0 -5
- package/evals/prompts/esk-002.txt +0 -5
- package/evals/prompts/esk-003.txt +0 -5
- package/evals/prompts/grc-001.txt +0 -3
- package/evals/prompts/hof-001.txt +0 -3
- package/evals/prompts/hof-002.txt +0 -1
- package/evals/prompts/hof-003.txt +0 -1
- package/evals/prompts/hof-004.txt +0 -1
- package/evals/prompts/hof-005.txt +0 -1
- package/evals/prompts/ivg-001.txt +0 -1
- package/evals/prompts/ivg-002.txt +0 -11
- package/evals/prompts/ivg-003.txt +0 -1
- package/evals/prompts/ivg-004.txt +0 -1
- package/evals/prompts/mode-001.txt +0 -3
- package/evals/prompts/mode-002.txt +0 -1
- package/evals/prompts/mode-003.txt +0 -3
- package/evals/prompts/mode-004.txt +0 -3
- package/evals/prompts/mode-005.txt +0 -3
- package/evals/prompts/mode-006.txt +0 -3
- package/evals/prompts/mode-007.txt +0 -3
- package/evals/prompts/otr-001.txt +0 -3
- package/evals/prompts/otr-002.txt +0 -3
- package/evals/prompts/rar-001.txt +0 -5
- package/evals/prompts/rar-002.txt +0 -3
- package/evals/prompts/rar-003.txt +0 -6
- package/evals/prompts/rar-004.txt +0 -15
- package/evals/prompts/rar-005.txt +0 -10
- package/evals/prompts/rbr-001.txt +0 -3
- package/evals/prompts/rbr-002.txt +0 -3
- package/evals/prompts/rbr-003.txt +0 -7
- package/evals/prompts/rev-001.txt +0 -3
- package/evals/prompts/rev-002.txt +0 -5
- package/evals/prompts/rev-003.txt +0 -6
- package/evals/prompts/rev-004.txt +0 -1
- package/evals/prompts/rev-005.txt +0 -15
- package/evals/prompts/rev-006.txt +0 -5
- package/evals/prompts/stp-001.txt +0 -1
- package/evals/prompts/stp-002.txt +0 -1
- package/evals/prompts/stp-003.txt +0 -1
- package/evals/prompts/stp-004.txt +0 -1
- package/evals/prompts/stp-005.txt +0 -1
- package/evals/prompts/stp-006.txt +0 -1
- package/evals/prompts/stp-007.txt +0 -1
- package/evals/prompts/stp-008.txt +0 -1
- package/evals/prompts/stp-009.txt +0 -1
- package/evals/prompts/stp-010.txt +0 -1
- package/evals/prompts/stp-011.txt +0 -1
- package/evals/prompts/vfy-003.txt +0 -1
- package/evals/prompts/wpl-001.txt +0 -3
- package/evals/prompts/wpl-002.txt +0 -5
- package/evals/prompts/wpl-003.txt +0 -3
- package/evals/prompts/wpl-004.txt +0 -5
- package/evals/prompts/wpl-005.txt +0 -1
- package/evals/prompts/wrc-001.txt +0 -10
- package/evals/prompts/wrc-002.txt +0 -3
- package/evals/prompts/wsk-001.txt +0 -6
- package/evals/prompts/wsp-001.txt +0 -5
- package/evals/prompts/wsp-002.txt +0 -15
- package/evals/prompts/wsp-003.txt +0 -3
- package/evals/prompts/wsp-004.txt +0 -15
- package/evals/prompts/wsp-005.txt +0 -5
- package/evals/prompts/wsp-006.txt +0 -12
- package/evals/prompts/wsp-007.txt +0 -9
- package/evals/prompts/wsp-008.txt +0 -13
- package/evals/prompts/xpl-001.txt +0 -1
- package/evals/prompts/xpl-002.txt +0 -3
- package/evals/prompts/xpl-003.txt +0 -3
- package/evals/prompts/xpl-004.txt +0 -3
- package/evals/prompts/xpl-005.txt +0 -5
- package/evals/prompts/xpl-006.txt +0 -3
- package/evals/registries/adversarial-evals.json +0 -39
- package/evals/registries/fixture-evals.json +0 -2513
- package/evals/registries/handoff-evals.json +0 -74
- package/evals/registries/legacy-evals.json +0 -147
- package/evals/registries/skill-evidence.json +0 -193
- package/evals/registries/verify-work-evals.json +0 -46
- package/evals/reports/acceptance/v0.1-acceptance-report.md +0 -130
- package/evals/reports/by-command-surface/command-surface-1-report.md +0 -45
- package/evals/reports/by-command-surface/command-surface-10-report.md +0 -76
- package/evals/reports/by-command-surface/command-surface-11-report.md +0 -77
- package/evals/reports/by-command-surface/command-surface-12-report.md +0 -91
- package/evals/reports/by-command-surface/command-surface-13-report.md +0 -64
- package/evals/reports/by-command-surface/command-surface-14-report.md +0 -66
- package/evals/reports/by-command-surface/command-surface-15-report.md +0 -124
- package/evals/reports/by-command-surface/command-surface-16-report.md +0 -39
- package/evals/reports/by-command-surface/command-surface-2-report.md +0 -80
- package/evals/reports/by-command-surface/command-surface-3-report.md +0 -86
- package/evals/reports/by-command-surface/command-surface-4-report.md +0 -76
- package/evals/reports/by-command-surface/command-surface-5-report.md +0 -80
- package/evals/reports/by-command-surface/command-surface-6-report.md +0 -74
- package/evals/reports/by-command-surface/command-surface-7-report.md +0 -84
- package/evals/reports/by-command-surface/command-surface-8-report.md +0 -79
- package/evals/reports/by-command-surface/command-surface-9-report.md +0 -79
- package/evals/reports/by-command-surface/command-surface-matrix.md +0 -91
- package/evals/reports/by-skill/bypass-1-report.md +0 -124
- package/evals/reports/by-skill/capture-decisions-1-report.md +0 -99
- package/evals/reports/by-skill/capture-decisions-2-report.md +0 -102
- package/evals/reports/by-skill/commit-work-1-report.md +0 -165
- package/evals/reports/by-skill/commit-work-2-report.md +0 -109
- package/evals/reports/by-skill/design-for-depth-1-report.md +0 -95
- package/evals/reports/by-skill/diagnose-failure-1-report.md +0 -91
- package/evals/reports/by-skill/diagnose-failure-2-report.md +0 -94
- package/evals/reports/by-skill/discover-1-report.md +0 -118
- package/evals/reports/by-skill/evaluate-skill-2-report.md +0 -71
- package/evals/reports/by-skill/execute-plan-1-report.md +0 -103
- package/evals/reports/by-skill/execute-plan-2-report.md +0 -112
- package/evals/reports/by-skill/execute-plan-3-report.md +0 -87
- package/evals/reports/by-skill/grill-context-1-report.md +0 -103
- package/evals/reports/by-skill/handoff-1-report.md +0 -123
- package/evals/reports/by-skill/handoff-2-report.md +0 -105
- package/evals/reports/by-skill/handoff-3-report.md +0 -100
- package/evals/reports/by-skill/handoff-7-report.md +0 -77
- package/evals/reports/by-skill/interview-gate-1-report.md +0 -63
- package/evals/reports/by-skill/interview-gate-2-report.md +0 -105
- package/evals/reports/by-skill/mode-contract-1-report.md +0 -74
- package/evals/reports/by-skill/mode-contract-2-report.md +0 -87
- package/evals/reports/by-skill/mode-contract-3-report.md +0 -65
- package/evals/reports/by-skill/mode-contract-4-report.md +0 -71
- package/evals/reports/by-skill/mode-contract-5-report.md +0 -70
- package/evals/reports/by-skill/output-router-1-report.md +0 -76
- package/evals/reports/by-skill/output-router-2-report.md +0 -65
- package/evals/reports/by-skill/research-1-report.md +0 -144
- package/evals/reports/by-skill/research-brief-1-report.md +0 -94
- package/evals/reports/by-skill/research-brief-2-report.md +0 -75
- package/evals/reports/by-skill/review-artifact-1-report.md +0 -91
- package/evals/reports/by-skill/review-artifact-2-report.md +0 -79
- package/evals/reports/by-skill/review-artifact-3-report.md +0 -120
- package/evals/reports/by-skill/review-artifact-4-report.md +0 -89
- package/evals/reports/by-skill/review-artifact-5-report.md +0 -66
- package/evals/reports/by-skill/review-work-1-report.md +0 -85
- package/evals/reports/by-skill/review-work-2-report.md +0 -87
- package/evals/reports/by-skill/review-work-3-report.md +0 -104
- package/evals/reports/by-skill/review-work-4-report.md +0 -108
- package/evals/reports/by-skill/review-work-5-report.md +0 -73
- package/evals/reports/by-skill/review-work-6-report.md +0 -66
- package/evals/reports/by-skill/setup-freeflow-1-report.md +0 -199
- package/evals/reports/by-skill/setup-freeflow-2-report.md +0 -105
- package/evals/reports/by-skill/setup-freeflow-3-report.md +0 -105
- package/evals/reports/by-skill/setup-freeflow-4-report.md +0 -88
- package/evals/reports/by-skill/setup-freeflow-5-report.md +0 -115
- package/evals/reports/by-skill/skill-authoring-1-report.md +0 -81
- package/evals/reports/by-skill/verify-work-1-report.md +0 -111
- package/evals/reports/by-skill/verify-work-2-report.md +0 -120
- package/evals/reports/by-skill/workflow-1-report.md +0 -65
- package/evals/reports/by-skill/write-plan-1-report.md +0 -123
- package/evals/reports/by-skill/write-plan-2-report.md +0 -98
- package/evals/reports/by-skill/write-plan-3-report.md +0 -110
- package/evals/reports/by-skill/write-spec-1-report.md +0 -88
- package/evals/reports/by-skill/write-spec-2-report.md +0 -89
- package/evals/reports/by-skill/write-spec-3-report.md +0 -90
- package/evals/reports/by-skill/write-spec-4-report.md +0 -167
- package/evals/reports/harness/claude-harness-1-report.md +0 -103
- package/evals/reports/harness/eval-harness-1-report.md +0 -91
- package/evals/reports/iterations/iteration-1-report.md +0 -71
- package/evals/reports/iterations/iteration-2-report.md +0 -78
- package/evals/reports/iterations/iteration-3-report.md +0 -118
- package/evals/reports/iterations/iteration-4-report.md +0 -131
- package/evals/reports/iterations/iteration-5-report.md +0 -149
- package/evals/reports/iterations/iteration-6-report.md +0 -136
- package/evals/reports/runtime/always-on-runtime-1-report.md +0 -107
- package/evals/reports/runtime/context-mode-normalized-benchmark-1-report.md +0 -52
- package/evals/reports/runtime/context-mode-real-deep-baseline-1-report.md +0 -410
- package/evals/reports/runtime/context-mode-real-deep-final-slice-11-report.md +0 -203
- package/evals/reports/runtime/context-mode-real-deep-final-slice-11-review.md +0 -51
- package/evals/reports/runtime/context-saving-native-tools-baseline-1-report.md +0 -99
- package/evals/reports/runtime/eryx-python-compatibility-reprobe-1-report.md +0 -166
- package/evals/reports/runtime/eryx-python-proof-spike-1-report.md +0 -96
- package/evals/reports/runtime/eryx-python-proof-spike-2-report.md +0 -151
- package/evals/reports/runtime/eryx-python-script-derive-execution-1-report.md +0 -233
- package/evals/reports/runtime/jq-script-derive-execution-1-report.md +0 -215
- package/evals/reports/runtime/jq-wasm-proof-spike-1-report.md +0 -67
- package/evals/reports/runtime/output-router-benchmark-1-report.md +0 -81
- package/evals/reports/runtime/output-router-capture-derive-provider-eval-1-report.md +0 -35
- package/evals/reports/runtime/output-router-codex-large-index-sqlite-adhoc-report.md +0 -150
- package/evals/reports/runtime/output-router-codex-qa-benchmark-1-report.md +0 -46
- package/evals/reports/runtime/output-router-command-benchmark-1-report.md +0 -62
- package/evals/reports/runtime/output-router-index-benchmark-1-report.md +0 -64
- package/evals/reports/runtime/output-router-regression-1-report.md +0 -81
- package/evals/reports/runtime/output-router-transform-eval-1-report.md +0 -28
- package/evals/reports/runtime/pi-observed-routing-eval-1-report.md +0 -44
- package/evals/reports/runtime/quickjs-script-derive-execution-1-report.md +0 -159
- package/evals/reports/runtime/quickjs-wasi-proof-spike-1-report.md +0 -55
- package/evals/reports/runtime/render-format-row-protocol-1-report.md +0 -58
- package/evals/reports/runtime/script-sandbox-adapter-selection-review-1-report.md +0 -84
- package/evals/reports/runtime/script-sandbox-probe-resource-hardening-1-report.md +0 -51
- package/evals/reports/runtime/storage-policy-benchmark-1-report.md +0 -176
- package/evals/reports/runtime/vault-index-storage-spike-1-report.md +0 -39
- package/evals/reports/runtime/workflow-context-hook-1-report.md +0 -82
- package/evals/runbooks/adversarial-eval-runbook.md +0 -28
- package/evals/runbooks/fixture-eval-runbook.md +0 -137
- package/evals/runbooks/handoff-eval-runbook.md +0 -22
- package/evals/runbooks/verify-work-eval-runbook.md +0 -27
- package/evals/scripts/audit-command-surface.sh +0 -160
- package/evals/scripts/check-activation-contract.sh +0 -121
- package/evals/scripts/check-runtime-context-hook.sh +0 -183
- package/evals/scripts/grade-fixture-eval.sh +0 -446
- package/evals/scripts/run-claude-fixture-eval.sh +0 -26
- package/evals/scripts/run-codex-fixture-eval.sh +0 -26
- package/evals/scripts/run-eryx-python-proof-spike.js +0 -559
- package/evals/scripts/run-fixture-eval-by-id.sh +0 -23
- package/evals/scripts/run-fixture-eval.sh +0 -464
- package/evals/scripts/run-jq-wasm-proof-spike.js +0 -299
- package/evals/scripts/run-output-router-transform-eval.js +0 -115
- package/evals/scripts/run-pi-observed-routing-eval.js +0 -478
- package/evals/scripts/run-quickjs-wasi-proof-spike.js +0 -339
- package/evals/scripts/skill-evidence.sh +0 -316
- package/evals/scripts/validate-release-metadata.sh +0 -486
- package/evals/suites/v0.1-acceptance-suite.md +0 -131
- package/pi-extension/dist/host-producer-identification.js +0 -186
- package/pi-extension/dist/mcp-config.js +0 -30
- package/pi-extension/dist/native-safety-net.js +0 -209
- package/pi-extension/dist/observed-tool-routing.js +0 -114
- package/pi-extension/dist/renderers.js +0 -835
- package/pi-extension/dist/router-tools.js +0 -438
- package/pi-extension/dist/runtime-context.js +0 -288
- package/pi-extension/dist/schemas.js +0 -254
- package/pi-extension/dist/status.js +0 -449
- package/pi-extension/dist/utils.js +0 -467
- package/pi-extension/src/runtime-context.ts +0 -347
- package/pi-extension/src/status.ts +0 -505
- package/plugin-docs/README.md +0 -40
- package/plugin-docs/adr/0001-three-modes.md +0 -27
- package/plugin-docs/adr/0002-evals-before-hooks.md +0 -17
- package/plugin-docs/adr/0003-release-boundary.md +0 -21
- package/plugin-docs/adr/0004-discover-replaces-shallow-discovery-skills.md +0 -26
- package/plugin-docs/adr/README.md +0 -10
- package/plugin-docs/architecture.md +0 -89
- package/plugin-docs/output-router.md +0 -396
- package/plugin-docs/release-evidence.md +0 -77
- package/plugin-docs/skills.md +0 -44
- package/plugin-docs/workflow.md +0 -57
- package/skills/diagnose-failure/references/feedback-loop-catalog.md +0 -25
- package/skills/discover/ARTIFACT-DESTINATIONS.md +0 -58
- package/skills/discover/CHECKPOINTS.md +0 -74
- package/skills/discover/SKILL.md +0 -173
- package/skills/evaluate-skill/references/eval-patterns.md +0 -41
- package/skills/evaluate-skill/references/grading-priority.md +0 -33
- package/skills/execute-plan/SKILL.md +0 -133
- package/skills/execute-plan/references/execution-map.md +0 -122
- package/skills/interview-gate/SKILL.md +0 -90
- package/skills/workflow/references/workflow-map.md +0 -104
- /package/pi-extension/src/{mcp-config.ts → integrations/mcp-config.ts} +0 -0
|
@@ -1,96 +1,123 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: write-plan
|
|
3
|
-
description: Use when
|
|
3
|
+
description: Use when writing or revising an implementation plan, execution plan, remediation plan, migration plan, or similar ordered plan.
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Write Plan
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
Write an ordered execution strategy that is expected to be followed.
|
|
9
9
|
|
|
10
|
-
|
|
11
|
-
- Bug without feedback loop: ask for or propose the feedback loop. Do not write or save a fix plan.
|
|
12
|
-
- Hidden owner decision or source conflict: name it and do not write the plan.
|
|
13
|
-
- Context-backed: say a spec is preferred, then write a lightweight plan.
|
|
14
|
-
- Missing source context: ask for context or route to `discover`.
|
|
10
|
+
A Plan defines intended phases, slices, dependencies, boundaries, and checks. It is not a Spec, progress report, task history, or rolling record.
|
|
15
11
|
|
|
16
|
-
|
|
12
|
+
## Confirm The Work Is Ready To Plan
|
|
17
13
|
|
|
18
|
-
|
|
14
|
+
Write a Plan when:
|
|
19
15
|
|
|
20
|
-
|
|
16
|
+
- the intended outcome and scope are clear;
|
|
17
|
+
- material user decisions and source conflicts are resolved;
|
|
18
|
+
- the execution approach is understood well enough to order;
|
|
19
|
+
- phases, slices, and dependencies can be stated without guessing;
|
|
20
|
+
- expected checks are known or obtainable;
|
|
21
|
+
- substantial branching or discovery is not expected.
|
|
21
22
|
|
|
22
|
-
|
|
23
|
+
If direction or major alternatives remain unsettled, read [Discuss](../discuss/SKILL.md). If one user-owned choice or source conflict blocks planning, read [Decision Gate](../decision-gate/SKILL.md). If a reported failure lacks a supported cause or diagnostic loop, read [Diagnose Failure](../diagnose-failure/SKILL.md) instead of planning a guessed fix.
|
|
23
24
|
|
|
24
|
-
|
|
25
|
+
Use [Track Work](../track-work/SKILL.md) when strategy is still evolving or actual execution, evidence, deviations, and current state need durable memory.
|
|
25
26
|
|
|
26
|
-
|
|
27
|
+
If the user asks about a Plan, answer instead of writing or revising one.
|
|
27
28
|
|
|
28
|
-
## Source
|
|
29
|
+
## Plan From Source
|
|
29
30
|
|
|
30
|
-
|
|
31
|
+
A Plan may be written directly from sufficiently clear context; a separate Spec is not required.
|
|
31
32
|
|
|
32
|
-
|
|
33
|
-
- Relevant docs, ADRs, tests, policies, and existing code.
|
|
34
|
-
- Handoffs only as memory, not authority.
|
|
33
|
+
Use the sources that establish the intended work:
|
|
35
34
|
|
|
36
|
-
|
|
35
|
+
- explicit user direction and accepted shared understanding;
|
|
36
|
+
- a Spec, issue, technical design, diagnosis, requirements, or Working Record when one exists;
|
|
37
|
+
- relevant code, tests, policies, ADRs, and established behavior;
|
|
38
|
+
- current external sources when an API, platform, or version constrains execution.
|
|
37
39
|
|
|
38
|
-
|
|
40
|
+
When a Spec or decision artifact is linked, preserve its contract rather than silently reinterpreting it. Live evidence overrides stale memory. A Working Record, handoff, review item, or earlier Plan is not authority over contradictory user decisions or source truth.
|
|
39
41
|
|
|
40
|
-
|
|
42
|
+
## Write The Ordered Strategy
|
|
41
43
|
|
|
42
|
-
|
|
44
|
+
Read [plan shapes](references/plan-shapes.md) and choose the smallest shape that makes the intended execution inspectable.
|
|
43
45
|
|
|
44
|
-
|
|
46
|
+
Include, when relevant:
|
|
45
47
|
|
|
46
|
-
|
|
48
|
+
- goal, source, scope, and non-goals;
|
|
49
|
+
- accepted decisions, assumptions, dependencies, and required order;
|
|
50
|
+
- phases and slices with coherent, bounded results;
|
|
51
|
+
- checks, integration, and final acceptance;
|
|
52
|
+
- conditions that would invalidate the Plan.
|
|
47
53
|
|
|
48
|
-
|
|
54
|
+
Include exact paths, systems, and commands when known and useful. Do not guess them to make the Plan appear complete.
|
|
49
55
|
|
|
50
|
-
|
|
56
|
+
Each slice should produce a coherent result that can be checked. A validation step may stop the Plan when a known assumption fails. If its result is expected to choose among materially different strategies, use a Working Record learning slice instead of pretending the later Plan is known.
|
|
51
57
|
|
|
52
|
-
|
|
58
|
+
## Select Useful Checkpoints
|
|
53
59
|
|
|
54
|
-
|
|
60
|
+
Every meaningful slice is verified and silently self-reviewed during execution; do not restate that default unless its evidence boundary is unusual.
|
|
55
61
|
|
|
56
|
-
|
|
62
|
+
At meaningful slice, phase, integration, risk, or continuity boundaries, consider independent review, a local commit, a user decision, or a continuity checkpoint. Record only selected checkpoints and their conditions. A slice ending or a fixed count alone does not justify a commit; prefer one when supported work forms a coherent rollback point or the next work may destabilize it.
|
|
57
63
|
|
|
58
|
-
|
|
64
|
+
Plan acceptance establishes the agreed strategy; it does not by itself authorize execution. When the user clearly approves execution of the Plan, that authority may cover its listed work, checks, reviews, Working Record updates, and local commits. It does not authorize push, integration, migration, deprecation, release, or launch. Planned commits remain conditional on live evidence and [Commit Work](../commit-work/SKILL.md) inspection.
|
|
59
65
|
|
|
60
|
-
|
|
61
|
-
- Resolve a user-owned decision.
|
|
62
|
-
- Override docs, tests, specs, policies, ADRs, or live behavior.
|
|
63
|
-
- Treat a handoff, review comment, or plan as authority over source-of-truth files.
|
|
64
|
-
- Plan a bug fix without a repro, failing test, feedback loop, or accepted diagnostic risk.
|
|
65
|
-
- Turn a missing bug repro into guessed fix steps, TTLs, invalidation rules, concurrency rules, or instrumentation requirements.
|
|
66
|
-
- Hide uncertainty inside implementation steps.
|
|
67
|
-
- Replace agreed scope with an agent-invented `v1`, MVP, roadmap, or later-version split.
|
|
66
|
+
## Keep Plan And Working Record Separate
|
|
68
67
|
|
|
69
|
-
|
|
68
|
+
The Plan records the intended execution path. The Working Record records actual execution, current slices, evidence, task-local decisions, deviations, and next action.
|
|
70
69
|
|
|
71
|
-
|
|
70
|
+
Do not revise the Plan for slice progress, expected evidence, status changes, or reversible local choices. Record those events in the Working Record when one exists.
|
|
72
71
|
|
|
73
|
-
|
|
72
|
+
Link accepted behavior, contracts, and architecture rationale from the owning Spec or decision artifact instead of duplicating them in the Plan.
|
|
74
73
|
|
|
75
|
-
|
|
74
|
+
## Stop Before Inventing A Path
|
|
76
75
|
|
|
77
|
-
|
|
78
|
-
- Goal.
|
|
79
|
-
- Source spec or context.
|
|
80
|
-
- Files likely touched.
|
|
81
|
-
- Dependency or slice order when it affects execution.
|
|
82
|
-
- Vertical slices.
|
|
83
|
-
- Tests or checks per slice.
|
|
84
|
-
- Commands where known.
|
|
85
|
-
- Stop conditions.
|
|
86
|
-
- Review or verification checkpoints.
|
|
76
|
+
Stop when writing would:
|
|
87
77
|
|
|
88
|
-
|
|
78
|
+
- invent or change requirements, scope, public behavior, compatibility, sensitive policy, failure semantics, or hard-to-reverse design;
|
|
79
|
+
- hide unresolved strategy, architecture, dependencies, or owner choices inside confident steps;
|
|
80
|
+
- plan a production fix from a guessed cause;
|
|
81
|
+
- rewrite tests, docs, policies, or acceptance merely to make the proposed path succeed;
|
|
82
|
+
- add speculative abstractions, migration machinery, retries, recovery, scale, or extension points;
|
|
83
|
+
- replace agreed scope with an unapproved MVP, v1/v2, roadmap, or later-version split.
|
|
89
84
|
|
|
90
|
-
|
|
85
|
+
Route the unresolved issue to its owner rather than writing a Plan that assumes the answer.
|
|
91
86
|
|
|
92
|
-
|
|
87
|
+
## Revise Only From Founded Evidence
|
|
93
88
|
|
|
94
|
-
|
|
95
|
-
|
|
96
|
-
|
|
89
|
+
Write Plan also owns deliberate Plan revisions.
|
|
90
|
+
|
|
91
|
+
Correct clerical mistakes directly. Do not revise the Plan for ordinary local choices or expected progress.
|
|
92
|
+
|
|
93
|
+
Revise or supersede the affected Plan when supported evidence materially changes its scope, design, architecture, order, dependencies, checks, or execution mechanism. An accepted review item may support revision. Reaching the independent-review cap does not itself justify rewriting the Plan; revise only when diagnosis or evidence shows that the Plan is wrong or insufficient.
|
|
94
|
+
|
|
95
|
+
Record the reason and execution impact in the Working Record when one exists. Revise a linked Spec or decision artifact only when its owned content changed. Preserve unaffected Plan content and history.
|
|
96
|
+
|
|
97
|
+
## Self-Check
|
|
98
|
+
|
|
99
|
+
Silently review the Plan before routing it onward:
|
|
100
|
+
|
|
101
|
+
- Are the intended result, source, and scope clear?
|
|
102
|
+
- Can coherent, checkable slices proceed in the stated order?
|
|
103
|
+
- Are dependencies, integration, final checks, and invalidation conditions represented?
|
|
104
|
+
- Are selected checkpoints useful and proportionate rather than automatic ceremony?
|
|
105
|
+
- Did the Plan invent intent, disguise material uncertainty, or absorb rolling task state?
|
|
106
|
+
|
|
107
|
+
Correct clear local issues directly. Surface only material gaps that prevent the Plan from being executable or fit for review.
|
|
108
|
+
|
|
109
|
+
## Review The Plan
|
|
110
|
+
|
|
111
|
+
After writing or materially revising the Plan, route it to [Review Artifact](../review-artifact/SKILL.md) before treating it as ready for approval and execution.
|
|
112
|
+
|
|
113
|
+
Provide the reviewer with the complete Plan, intended use, source truth, linked artifacts, dependencies, selected checkpoints, and known evidence gaps. Review Artifact owns dependency ordering, review items, judgment, adjudication, and the review cycle. Artifact review establishes fitness; the user separately accepts the Plan and grants any scoped execution authority.
|
|
114
|
+
|
|
115
|
+
## Report
|
|
116
|
+
|
|
117
|
+
State:
|
|
118
|
+
|
|
119
|
+
- Plan path and intended use;
|
|
120
|
+
- source context and linked artifacts;
|
|
121
|
+
- material assumptions, blockers, or invalidation conditions;
|
|
122
|
+
- selected review, commit, user, or continuity checkpoints;
|
|
123
|
+
- artifact-review, Plan-acceptance, and execution-authorization status.
|
|
@@ -1,70 +1,156 @@
|
|
|
1
1
|
# Plan Shapes
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
Read this when choosing the structure, destination, identity, or revision shape of an ordered Plan. Use only the sections the Plan needs.
|
|
4
4
|
|
|
5
|
-
## Durable
|
|
5
|
+
## Destination And Durable Identity
|
|
6
6
|
|
|
7
|
-
|
|
7
|
+
Follow repository convention when one exists.
|
|
8
|
+
|
|
9
|
+
When [Track Work](../../track-work/SKILL.md) owns the task, store a task-local Plan in the `plans/` location it defines unless the Plan should become a canonical repository artifact.
|
|
10
|
+
|
|
11
|
+
When no convention exists and future readers need durable identity, begin with a compact title and header:
|
|
8
12
|
|
|
9
13
|
```md
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
> **
|
|
13
|
-
> **Type:** Plan
|
|
14
|
-
> **Status:**
|
|
15
|
-
> **
|
|
14
|
+
# Billing Webhook Implementation Plan
|
|
15
|
+
|
|
16
|
+
> **Doc ID:** PLAN-001-billing-webhook
|
|
17
|
+
> **Type:** Implementation Plan
|
|
18
|
+
> **Status:** Draft
|
|
19
|
+
> **Owner:** <plan owner>
|
|
20
|
+
> **Source:** <spec, issue, Working Record, diagnosis, or accepted context>
|
|
16
21
|
```
|
|
17
22
|
|
|
18
|
-
|
|
23
|
+
Use one current status. Follow the repository or owner's vocabulary; useful states may include `Draft`, `Reviewed`, `Ready`, `Superseded`, and `Abandoned`. Writing or reviewing a Plan does not by itself make it `Ready`.
|
|
19
24
|
|
|
20
|
-
|
|
21
|
-
- `Owner`: use the spec/product owner when known. In normal workflow, use `User` only when the requester is the only known owner.
|
|
22
|
-
- `Status`: use `Draft` when decisions/checks are still incomplete; use `Ready` when the plan is executable.
|
|
23
|
-
- `Source`: cite the approved spec, clarified context, issue, ADR, or docs used as authority.
|
|
25
|
+
Add dates, supersession links, or approvers only when useful and reliable.
|
|
24
26
|
|
|
25
|
-
|
|
27
|
+
## Start With Source And Boundaries
|
|
26
28
|
|
|
27
|
-
|
|
29
|
+
Make the execution boundary and its dependencies clear:
|
|
30
|
+
|
|
31
|
+
```text
|
|
32
|
+
Goal:
|
|
33
|
+
Source and linked artifacts:
|
|
34
|
+
Scope:
|
|
35
|
+
Non-goals:
|
|
36
|
+
Accepted decisions:
|
|
37
|
+
Assumptions:
|
|
38
|
+
Dependencies:
|
|
39
|
+
Required order:
|
|
40
|
+
```
|
|
28
41
|
|
|
29
|
-
|
|
42
|
+
Link accepted behavior, architecture, and decisions instead of copying their rationale. Do not hide unsettled design or owner choices as assumptions. If an assumption could choose among materially different strategies, resolve it before treating the Plan as executable.
|
|
30
43
|
|
|
31
|
-
|
|
44
|
+
## Choose The Execution Shape
|
|
45
|
+
|
|
46
|
+
### Lightweight Ordered Plan
|
|
47
|
+
|
|
48
|
+
Use when the work is clear and short enough that phases add no value:
|
|
49
|
+
|
|
50
|
+
```text
|
|
51
|
+
Ordered actions or slices:
|
|
52
|
+
Checks:
|
|
53
|
+
Selected checkpoints, if any:
|
|
54
|
+
Completion condition:
|
|
55
|
+
```
|
|
56
|
+
|
|
57
|
+
A tiny reversible action may not need a saved Plan.
|
|
58
|
+
|
|
59
|
+
### Phased Implementation Plan
|
|
60
|
+
|
|
61
|
+
Use when execution has meaningful dependencies, integration points, or several coherent outcomes:
|
|
62
|
+
|
|
63
|
+
```text
|
|
64
|
+
## Phase 1 — <outcome>
|
|
65
|
+
Purpose:
|
|
66
|
+
Dependencies:
|
|
67
|
+
Selected checkpoints, if any:
|
|
68
|
+
Completion condition:
|
|
69
|
+
|
|
70
|
+
### Slice 1.1 — <result>
|
|
71
|
+
Scope or boundary:
|
|
72
|
+
Work:
|
|
73
|
+
Checks:
|
|
74
|
+
Completion condition:
|
|
75
|
+
|
|
76
|
+
### Slice 1.2 — <result>
|
|
77
|
+
...
|
|
78
|
+
|
|
79
|
+
## Phase 2 — <outcome>
|
|
80
|
+
...
|
|
81
|
+
```
|
|
32
82
|
|
|
33
|
-
|
|
34
|
-
- source context
|
|
35
|
-
- files likely touched
|
|
36
|
-
- short slices
|
|
37
|
-
- checks
|
|
83
|
+
Describe the whole intended strategy with enough detail to inspect and execute it. If later phases cannot yet be planned honestly, use a Working Record instead.
|
|
38
84
|
|
|
39
|
-
|
|
85
|
+
## Define Phases And Slices
|
|
40
86
|
|
|
41
|
-
|
|
87
|
+
A phase groups slices that produce one meaningful integrated outcome. State its purpose, dependencies, and completion condition.
|
|
42
88
|
|
|
43
|
-
|
|
89
|
+
For each slice, use only the fields needed to execute and check it:
|
|
90
|
+
|
|
91
|
+
```text
|
|
92
|
+
Intended result:
|
|
93
|
+
Source requirement:
|
|
94
|
+
Scope or write boundary:
|
|
95
|
+
Work:
|
|
96
|
+
Dependencies:
|
|
97
|
+
Tests or observations:
|
|
98
|
+
Verification claim and required boundary:
|
|
99
|
+
Selected independent review, if any:
|
|
100
|
+
Selected local commit, if any:
|
|
101
|
+
Other user or continuity checkpoint, if any:
|
|
102
|
+
Completion condition:
|
|
103
|
+
```
|
|
104
|
+
|
|
105
|
+
A slice is a coherent result, not a file list. Mention files, modules, or systems only when they clarify scope.
|
|
106
|
+
|
|
107
|
+
Consider checkpoints at meaningful slice, phase, integration, risk, and continuity boundaries. Record only useful additions; normal verification and silent self-review need no repeated fields.
|
|
108
|
+
|
|
109
|
+
A selected local commit names its coherent outcome and conditions, not merely “commit after this slice.” Plan approval authorizes listed local commits subject to live evidence and Commit Work inspection, but not push, integration, migration, deprecation, release, or launch. Record actual results and commit identities in the Working Record.
|
|
110
|
+
|
|
111
|
+
## Adapt For The Work Type
|
|
112
|
+
|
|
113
|
+
### Remediation
|
|
114
|
+
|
|
115
|
+
After evidence or diagnosis establishes the cause, include the observed problem, source requirement, affected scope, ordered corrections, regression checks, recovery or cleanup, and completion condition. Do not plan from a requested patch or plausible cause alone.
|
|
116
|
+
|
|
117
|
+
### Migration Or Operations
|
|
118
|
+
|
|
119
|
+
For an accepted migration, release, rollout, or operational contract, include the source and target states, prerequisites, ordered execution or cohorts, checks before/during/after, stop or recovery conditions, observation, completion, and cleanup.
|
|
120
|
+
|
|
121
|
+
The Plan implements accepted compatibility, safety, and recovery requirements; it does not invent them.
|
|
122
|
+
|
|
123
|
+
## Finish With Integration And Invalidation
|
|
124
|
+
|
|
125
|
+
End with the complete-result checks and conditions that would stop the Plan:
|
|
126
|
+
|
|
127
|
+
```text
|
|
128
|
+
Integration:
|
|
129
|
+
Final tests or observations:
|
|
130
|
+
Verification claims and required boundaries:
|
|
131
|
+
Selected independent review, if any:
|
|
132
|
+
Selected local commit, if any:
|
|
133
|
+
Other user or continuity checkpoint, if any:
|
|
134
|
+
Completion condition:
|
|
135
|
+
|
|
136
|
+
Plan invalidation conditions:
|
|
137
|
+
```
|
|
44
138
|
|
|
45
|
-
|
|
46
|
-
- source context
|
|
47
|
-
- non-goals if the spec has them
|
|
48
|
-
- files likely touched
|
|
49
|
-
- vertical slices, each with tests/checks
|
|
50
|
-
- stop conditions
|
|
51
|
-
- final verification
|
|
139
|
+
Useful invalidation conditions include:
|
|
52
140
|
|
|
53
|
-
|
|
141
|
+
- a source requirement or accepted decision changes;
|
|
142
|
+
- a material dependency behaves differently;
|
|
143
|
+
- the design or architecture cannot satisfy the contract;
|
|
144
|
+
- checks cannot establish the required claims;
|
|
145
|
+
- implementation requires materially different scope or order;
|
|
146
|
+
- accepted review items expose a Plan-level defect.
|
|
54
147
|
|
|
55
|
-
|
|
148
|
+
These conditions stop or revise the affected Plan. They are not alternate branches. Do not use a narrow final check to imply broader completion.
|
|
56
149
|
|
|
57
|
-
|
|
150
|
+
## Revise Or Supersede
|
|
58
151
|
|
|
59
|
-
|
|
60
|
-
- goal and source authority
|
|
61
|
-
- explicit assumptions from source truth
|
|
62
|
-
- likely files/modules, with "find existing pattern first" when unknown
|
|
63
|
-
- vertical slices with expected red/green checks
|
|
64
|
-
- review checkpoints before risky behavior lands
|
|
65
|
-
- stop conditions for source-truth conflicts or owner-owned decisions
|
|
66
|
-
- final verification and handoff criteria
|
|
152
|
+
A local implementation detail, expected result, or completed slice does not revise the Plan.
|
|
67
153
|
|
|
68
|
-
|
|
154
|
+
For a founded material change, update only the affected strategy and dependencies, record why it changed, preserve prior rationale, and update linked artifacts only when their content changed.
|
|
69
155
|
|
|
70
|
-
|
|
156
|
+
Use a superseding Plan when editing in place would obscure what was originally reviewed. Route a materially revised or superseding Plan through artifact review again.
|
|
@@ -1,88 +1,119 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: write-skill
|
|
3
|
-
description: Use when creating
|
|
3
|
+
description: Use when creating or revising an agent skill.
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# Write Skill
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
Write the smallest agent-first skill that changes one named behavior.
|
|
9
9
|
|
|
10
|
-
|
|
10
|
+
## Establish The First Read
|
|
11
11
|
|
|
12
|
-
|
|
12
|
+
Before writing, identify:
|
|
13
13
|
|
|
14
|
-
|
|
14
|
+
- the behavior and failure the skill must change;
|
|
15
|
+
- the earliest natural prompt or situation where its guidance becomes useful;
|
|
16
|
+
- the cues an agent can observe before reading the body;
|
|
17
|
+
- the context guaranteed to be loaded before this skill;
|
|
18
|
+
- a nearby case that should not be hijacked.
|
|
15
19
|
|
|
16
|
-
|
|
20
|
+
A description cannot rely on terminology or classifications taught only inside the skill. The body must work for an agent reading it for the first time with only declared guaranteed context.
|
|
17
21
|
|
|
18
|
-
|
|
22
|
+
If public behavior, dependencies, safety, or compatibility remain unsettled, stop and resolve that boundary before encoding it.
|
|
19
23
|
|
|
20
|
-
|
|
24
|
+
## Preserve Before Substantial Revision
|
|
21
25
|
|
|
22
|
-
|
|
26
|
+
Before rewriting or substantially editing an existing skill, snapshot the complete current package—`SKILL.md`, references, scripts, and other owned resources—and record an exact identity. Use a recoverable Git ref or task evidence outside the active package so the rewrite cannot replace its own baseline.
|
|
23
27
|
|
|
24
|
-
|
|
28
|
+
A small local wording correction does not need an extra snapshot when the exact prior state is already recoverable and the change does not alter behavior, dependencies, or package structure.
|
|
25
29
|
|
|
26
|
-
## Description
|
|
30
|
+
## Write The Description
|
|
27
31
|
|
|
28
|
-
|
|
32
|
+
Optimize for the first useful read, not repeated reads.
|
|
29
33
|
|
|
30
|
-
|
|
34
|
+
- State the broad core job in plain language.
|
|
35
|
+
- Use cues observable in the user request or immediate task state.
|
|
36
|
+
- Prefer broad recall when loading the skill is safe and the body can exit cleanly.
|
|
37
|
+
- Do not require the agent to predict an internal classification taught only after activation.
|
|
38
|
+
- Do not turn the description into an exhaustive trigger taxonomy or compressed summary of the body.
|
|
39
|
+
- Treat “Use when…” as useful advice, not required grammar.
|
|
31
40
|
|
|
32
|
-
|
|
33
|
-
- When to use it.
|
|
34
|
-
- Concrete trigger situations.
|
|
41
|
+
A nearby case may pass by not loading the skill or by loading it and exiting without changing the task incorrectly. Do not narrow a description solely to prevent harmless reads, and do not broaden it until the skill routinely overrides the actual owning job.
|
|
35
42
|
|
|
36
|
-
|
|
43
|
+
Read [activation boundaries](references/activation-boundaries.md) when the boundary is unclear or evidence shows missed, late, early, or task-hijacking activation.
|
|
37
44
|
|
|
38
|
-
|
|
39
|
-
- Marketing copy.
|
|
40
|
-
- Long taxonomies.
|
|
41
|
-
- Claims about quality.
|
|
45
|
+
## Write For The Executing Agent
|
|
42
46
|
|
|
43
|
-
|
|
47
|
+
1. Establish the skill’s job immediately.
|
|
48
|
+
2. Define necessary terms before relying on them.
|
|
49
|
+
3. Put rules where the agent first makes the affected choice.
|
|
50
|
+
4. Keep the normal route understandable from `SKILL.md`; when it requires another resource, name that dependency and its read condition before relying on it.
|
|
51
|
+
5. Say what to do, what not to do, and when to stop, exit, or route.
|
|
52
|
+
6. Lead with required behavior. Use a negative instruction only to block a plausible or observed failure, and pair it with the positive action, exit, or route.
|
|
53
|
+
7. Use direct instructions that change action or judgment.
|
|
54
|
+
8. Include why only when it helps the agent generalize, choose correctly in an unseen case, or avoid a harmful literal reading.
|
|
55
|
+
9. Repeat a shared rule only when a local reminder prevents a real failure; do not copy the owning workflow.
|
|
56
|
+
10. Keep authoring status, evaluation summaries, evidence gaps, changelog notes, and readiness prose out of the executing skill.
|
|
44
57
|
|
|
45
|
-
|
|
58
|
+
Use discussion, research, and author reasoning to understand the target behavior. Do not copy conversation history, author debate, iteration notes, rejected drafts, or explanation written for collaborators into the skill. Translate that context into only the instructions, definitions, boundaries, and examples a first-time executing agent needs.
|
|
46
59
|
|
|
47
|
-
|
|
60
|
+
A skill may rely on guaranteed base context. Do not assume an optional sibling skill, reference, or accidental earlier read. Link dependencies and state when to read them.
|
|
48
61
|
|
|
49
|
-
|
|
62
|
+
Read [agent-first instructions](references/agent-first-instructions.md) when wording, placement, undeclared context, or author explanation is obscuring execution.
|
|
50
63
|
|
|
51
|
-
Use
|
|
64
|
+
## Use Examples Deliberately
|
|
52
65
|
|
|
53
|
-
|
|
54
|
-
- Stop.
|
|
55
|
-
- Ask.
|
|
56
|
-
- Do not edit.
|
|
57
|
-
- Verify.
|
|
58
|
-
- Report.
|
|
66
|
+
Add a compact behavioral example when prose alone leaves a likely misclassification. Show the observable situation and the required action, stop, exit, or route.
|
|
59
67
|
|
|
60
|
-
|
|
68
|
+
Keep examples general enough to transfer beyond one fixture. Do not turn the body into a transcript, test suite, or scenario catalog. Inline examples teach; behavioral evals test whether the skill changes behavior under pressure.
|
|
61
69
|
|
|
62
|
-
|
|
63
|
-
- Ensure.
|
|
64
|
-
- Leverage.
|
|
65
|
-
- Try to.
|
|
66
|
-
- Be mindful.
|
|
70
|
+
## Add Resources Only When Needed
|
|
67
71
|
|
|
68
|
-
|
|
72
|
+
Read [progressive disclosure](references/progressive-disclosure.md) before adding or reorganizing references and scripts.
|
|
69
73
|
|
|
70
|
-
|
|
74
|
+
Start with one `SKILL.md`. Remove repeated prose and low-value checklists before expanding the file set.
|
|
71
75
|
|
|
72
|
-
|
|
76
|
+
- Add a required reference when normal execution genuinely needs separately owned depth; link it before the dependency is used.
|
|
77
|
+
- Add a conditional reference when a distinct branch needs depth that would obscure the normal route; state the observable condition for reading it.
|
|
78
|
+
- Add a script for repeated deterministic work or a feature the skill owns when automation is safer, clearer, or materially less wasteful than retyping it.
|
|
79
|
+
- Link every agent-facing reference, asset, declared dependency, and executable entrypoint from `SKILL.md`; internal implementation modules need not be linked.
|
|
80
|
+
- Keep owned resources inside the skill package unless a declared package dependency is required.
|
|
81
|
+
- Treat unlinked-file inspection as factual inventory, not an automatic defect.
|
|
82
|
+
- Do not add resources merely to make the package look complete.
|
|
73
83
|
|
|
74
|
-
|
|
84
|
+
There is no universal body template, section inventory, wording rule, file-count target, or requirement that a script follow an earlier failure.
|
|
75
85
|
|
|
76
|
-
|
|
86
|
+
## Evaluate The Behavioral Claim
|
|
77
87
|
|
|
78
|
-
|
|
88
|
+
Static validation proves structure, not activation or behavior. Name the exact claim being tested: description activation, first-read body behavior, nearby behavior, dependency composition, retained use, or artifact outcome.
|
|
79
89
|
|
|
80
|
-
|
|
90
|
+
Use [Evaluate Skill](../evaluate-skill/SKILL.md) to compare exact baseline and candidate environments under fixed declared inputs. Preserve adequate existing evidence, revise one measured pressure point at a time, and rerun the complete fixed group after a behavioral change.
|
|
81
91
|
|
|
82
|
-
|
|
92
|
+
Do not claim activation from body injection, retained use from one turn, or dependency behavior from ambient context. Keep behavior conclusions and missing evidence in the owning evaluation, Working Record, or delivery response rather than annotating the executing skill.
|
|
83
93
|
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
|
|
88
|
-
|
|
94
|
+
## Check The Package
|
|
95
|
+
|
|
96
|
+
Use the bundled [skill author](scripts/skill-author.mjs) for deterministic structure work:
|
|
97
|
+
|
|
98
|
+
```text
|
|
99
|
+
node <write-skill-directory>/scripts/skill-author.mjs init <directory> --name <name> --description <text>
|
|
100
|
+
node <write-skill-directory>/scripts/skill-author.mjs validate <directory> [--package-root <directory>]
|
|
101
|
+
node <write-skill-directory>/scripts/skill-author.mjs inspect <directory> [--package-root <directory>]
|
|
102
|
+
```
|
|
103
|
+
|
|
104
|
+
Choose the command by job:
|
|
105
|
+
|
|
106
|
+
- `init`: use only for a new package. It creates the directory and minimal `SKILL.md` and refuses to overwrite an existing one.
|
|
107
|
+
- `validate`: use after structural or resource changes and before claiming structural validity. It checks frontmatter, the top-level heading, recursive links, package dependencies, cycles, and containment.
|
|
108
|
+
- `inspect`: use when body sizes, resource classes, scripts, unlinked files, and validation findings are needed. It reports facts rather than quality.
|
|
109
|
+
|
|
110
|
+
Commands emit JSON. Invalid structure still emits its report and exits nonzero; command errors emit structured error JSON.
|
|
111
|
+
|
|
112
|
+
- Package root defaults to the nearest `package.json` ancestor, falling back to the skill directory’s parent. Use `--package-root` to set it explicitly.
|
|
113
|
+
- Frontmatter accepts flat plain strings or JSON-compatible double-quoted strings. Double-quote values when there is any ambiguity, especially punctuation, numbers, booleans, or null-like text.
|
|
114
|
+
|
|
115
|
+
Never import or invoke deprecated tooling.
|
|
116
|
+
|
|
117
|
+
## Stop
|
|
118
|
+
|
|
119
|
+
Stop when the requested skill is minimal, executable on first read, honest about its dependencies, and free of author-facing status. Stop and ask when public behavior, activation boundaries, dependencies, safety, or compatibility cannot be settled from evidence. Do not add resources or procedure merely to make the package look complete.
|
|
@@ -0,0 +1,62 @@
|
|
|
1
|
+
# Activation Boundaries
|
|
2
|
+
|
|
3
|
+
Read this when an activation boundary is unclear or evidence shows missed, late, early, or task-hijacking activation.
|
|
4
|
+
|
|
5
|
+
A description should make the skill available at the earliest useful moment without requiring language introduced by the skill itself.
|
|
6
|
+
|
|
7
|
+
## Diagnose The First Read
|
|
8
|
+
|
|
9
|
+
Identify:
|
|
10
|
+
|
|
11
|
+
- the earliest natural prompt or state where the method can change behavior;
|
|
12
|
+
- cues visible before the body is read;
|
|
13
|
+
- context guaranteed before activation;
|
|
14
|
+
- the consequence of missing that read;
|
|
15
|
+
- the consequence if a nearby prompt also loads the skill.
|
|
16
|
+
|
|
17
|
+
Do not optimize for repeated reads. Diagnose the first decision the skill should influence.
|
|
18
|
+
|
|
19
|
+
## Check The Cues
|
|
20
|
+
|
|
21
|
+
Useful cues include the skill’s job, natural user verbs, visible task situations, and distinctions from neighboring jobs.
|
|
22
|
+
|
|
23
|
+
Reject cues that depend on:
|
|
24
|
+
|
|
25
|
+
- vocabulary defined only in the body or an optional sibling;
|
|
26
|
+
- future-duration guesses;
|
|
27
|
+
- unexplained classifications or named phases;
|
|
28
|
+
- generic “help with” or “improve” language;
|
|
29
|
+
- marketing claims or exhaustive trigger catalogs.
|
|
30
|
+
|
|
31
|
+
Guaranteed base context may define a term. Otherwise use plain observable language.
|
|
32
|
+
|
|
33
|
+
## Test Nearby Behavior
|
|
34
|
+
|
|
35
|
+
A nearby case can pass in two ways:
|
|
36
|
+
|
|
37
|
+
- **Non-trigger:** the skill should not load.
|
|
38
|
+
- **Safe read:** loading is acceptable, but the body exits or defers without applying the wrong method.
|
|
39
|
+
|
|
40
|
+
Do not narrow a description solely to prevent harmless reads. Do not broaden it until the skill routinely overrides the actual owning job.
|
|
41
|
+
|
|
42
|
+
## Examples
|
|
43
|
+
|
|
44
|
+
Broad core trigger:
|
|
45
|
+
|
|
46
|
+
> Use when committing work.
|
|
47
|
+
|
|
48
|
+
Over-specified trigger that hides the job behind later workflow details:
|
|
49
|
+
|
|
50
|
+
> Use after final verification when a planned checkpoint requires a locally reviewable commit.
|
|
51
|
+
|
|
52
|
+
Broad safe-read trigger:
|
|
53
|
+
|
|
54
|
+
> Use when working with software design—especially boundaries, interfaces, ownership, state, and failure behavior.
|
|
55
|
+
|
|
56
|
+
The body can exit when the local interface remains sound; the description need not encode every structural-pressure case.
|
|
57
|
+
|
|
58
|
+
## Evidence Boundary
|
|
59
|
+
|
|
60
|
+
Natural activation proves the host read the exact skill snapshot from a natural prompt. Explicit body delivery tests first-read instructions, not activation. Composition tests declared dependencies. Multi-turn evidence tests later use. Artifact or transcript evidence shows whether the loaded skill helped or hijacked behavior.
|
|
61
|
+
|
|
62
|
+
Preserve the earliest useful positive prompt and at least one close nearby case before making a broad activation claim.
|