@agent-ix/quoin 0.23.1 → 0.26.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +8 -258
- package/bin/launcher.js +138 -0
- package/package.json +22 -123
- package/.agents/plugins/marketplace.json +0 -14
- package/.claude-plugin/marketplace.json +0 -16
- package/.claude-plugin/plugin.json +0 -8
- package/.codex-plugin/plugin.json +0 -27
- package/.github/plugin/marketplace.json +0 -16
- package/bin/quoin.js +0 -21
- package/default-modules.yaml +0 -107
- package/dist/advisor/advise.d.ts +0 -199
- package/dist/advisor/advise.d.ts.map +0 -1
- package/dist/advisor/index.d.ts +0 -10
- package/dist/advisor/index.d.ts.map +0 -1
- package/dist/advisor/methods.d.ts +0 -60
- package/dist/advisor/methods.d.ts.map +0 -1
- package/dist/advisor-B0rESCx1.js +0 -63
- package/dist/assurance/graph.d.ts +0 -87
- package/dist/assurance/graph.d.ts.map +0 -1
- package/dist/assurance/index.d.ts +0 -9
- package/dist/assurance/index.d.ts.map +0 -1
- package/dist/assurance/render.d.ts +0 -3
- package/dist/assurance/render.d.ts.map +0 -1
- package/dist/auditor/audit.d.ts +0 -146
- package/dist/auditor/audit.d.ts.map +0 -1
- package/dist/auditor/combinatorial.d.ts +0 -53
- package/dist/auditor/combinatorial.d.ts.map +0 -1
- package/dist/auditor/index.d.ts +0 -9
- package/dist/auditor/index.d.ts.map +0 -1
- package/dist/auditor-Dd3i9Aqx.js +0 -340
- package/dist/base-gAClyCNd.js +0 -137
- package/dist/base.d.ts +0 -23
- package/dist/base.d.ts.map +0 -1
- package/dist/catalog.d.ts +0 -33
- package/dist/catalog.d.ts.map +0 -1
- package/dist/change-assurance/attestations.d.ts +0 -7
- package/dist/change-assurance/attestations.d.ts.map +0 -1
- package/dist/change-assurance/index.d.ts +0 -14
- package/dist/change-assurance/index.d.ts.map +0 -1
- package/dist/change-assurance/integrity.d.ts +0 -11
- package/dist/change-assurance/integrity.d.ts.map +0 -1
- package/dist/change-assurance/records.d.ts +0 -22
- package/dist/change-assurance/records.d.ts.map +0 -1
- package/dist/change-assurance/schema-assets.d.ts +0 -8
- package/dist/change-assurance/schema-assets.d.ts.map +0 -1
- package/dist/change-assurance/store.d.ts +0 -18
- package/dist/change-assurance/store.d.ts.map +0 -1
- package/dist/change-assurance/types.d.ts +0 -180
- package/dist/change-assurance/types.d.ts.map +0 -1
- package/dist/change-assurance/verify.d.ts +0 -4
- package/dist/change-assurance/verify.d.ts.map +0 -1
- package/dist/change-assurance-CyKLPeKa.js +0 -1236
- package/dist/cli.d.ts +0 -61
- package/dist/cli.d.ts.map +0 -1
- package/dist/cli.js +0 -34
- package/dist/commands/advise.d.ts +0 -16
- package/dist/commands/advise.d.ts.map +0 -1
- package/dist/commands/advise.js +0 -234
- package/dist/commands/assurance.d.ts +0 -14
- package/dist/commands/assurance.d.ts.map +0 -1
- package/dist/commands/assurance.js +0 -204
- package/dist/commands/catalog/index.d.ts +0 -2
- package/dist/commands/catalog/index.d.ts.map +0 -1
- package/dist/commands/catalog/index.js +0 -2
- package/dist/commands/catalog/list.d.ts +0 -11
- package/dist/commands/catalog/list.d.ts.map +0 -1
- package/dist/commands/catalog/list.js +0 -22
- package/dist/commands/catalog/methods.d.ts +0 -12
- package/dist/commands/catalog/methods.d.ts.map +0 -1
- package/dist/commands/catalog/methods.js +0 -43
- package/dist/commands/catalog/show.d.ts +0 -13
- package/dist/commands/catalog/show.d.ts.map +0 -1
- package/dist/commands/catalog/show.js +0 -25
- package/dist/commands/catalog/validate.d.ts +0 -10
- package/dist/commands/catalog/validate.d.ts.map +0 -1
- package/dist/commands/catalog/validate.js +0 -27
- package/dist/commands/change-assurance/common.d.ts +0 -37
- package/dist/commands/change-assurance/common.d.ts.map +0 -1
- package/dist/commands/change-assurance/index.d.ts +0 -8
- package/dist/commands/change-assurance/index.d.ts.map +0 -1
- package/dist/commands/change-assurance/index.js +0 -12
- package/dist/commands/change-assurance/intake.d.ts +0 -15
- package/dist/commands/change-assurance/intake.d.ts.map +0 -1
- package/dist/commands/change-assurance/intake.js +0 -53
- package/dist/commands/change-assurance/receipt.d.ts +0 -21
- package/dist/commands/change-assurance/receipt.d.ts.map +0 -1
- package/dist/commands/change-assurance/receipt.js +0 -99
- package/dist/commands/change-assurance/recover.d.ts +0 -13
- package/dist/commands/change-assurance/recover.d.ts.map +0 -1
- package/dist/commands/change-assurance/recover.js +0 -29
- package/dist/commands/change-assurance/schema.d.ts +0 -13
- package/dist/commands/change-assurance/schema.d.ts.map +0 -1
- package/dist/commands/change-assurance/schema.js +0 -40
- package/dist/commands/change-assurance/seal-attestation.d.ts +0 -15
- package/dist/commands/change-assurance/seal-attestation.d.ts.map +0 -1
- package/dist/commands/change-assurance/seal-attestation.js +0 -58
- package/dist/commands/change-assurance/seal-record.d.ts +0 -14
- package/dist/commands/change-assurance/seal-record.d.ts.map +0 -1
- package/dist/commands/change-assurance/seal-record.js +0 -53
- package/dist/commands/change-assurance/verify-receipt.d.ts +0 -13
- package/dist/commands/change-assurance/verify-receipt.d.ts.map +0 -1
- package/dist/commands/change-assurance/verify-receipt.js +0 -41
- package/dist/commands/completeness.d.ts +0 -16
- package/dist/commands/completeness.d.ts.map +0 -1
- package/dist/commands/completeness.js +0 -49
- package/dist/commands/config/doctor.d.ts +0 -7
- package/dist/commands/config/doctor.d.ts.map +0 -1
- package/dist/commands/config/doctor.js +0 -15
- package/dist/commands/config/edit.d.ts +0 -7
- package/dist/commands/config/edit.d.ts.map +0 -1
- package/dist/commands/config/edit.js +0 -13
- package/dist/commands/config/get.d.ts +0 -11
- package/dist/commands/config/get.d.ts.map +0 -1
- package/dist/commands/config/get.js +0 -20
- package/dist/commands/config/index.d.ts +0 -2
- package/dist/commands/config/index.d.ts.map +0 -1
- package/dist/commands/config/index.js +0 -2
- package/dist/commands/config/set.d.ts +0 -12
- package/dist/commands/config/set.d.ts.map +0 -1
- package/dist/commands/config/set.js +0 -26
- package/dist/commands/evidence/affirm.d.ts +0 -17
- package/dist/commands/evidence/affirm.d.ts.map +0 -1
- package/dist/commands/evidence/affirm.js +0 -65
- package/dist/commands/evidence/audit.d.ts +0 -34
- package/dist/commands/evidence/audit.d.ts.map +0 -1
- package/dist/commands/evidence/audit.js +0 -107
- package/dist/commands/evidence/baseline.d.ts +0 -14
- package/dist/commands/evidence/baseline.d.ts.map +0 -1
- package/dist/commands/evidence/baseline.js +0 -89
- package/dist/commands/evidence/gc.d.ts +0 -13
- package/dist/commands/evidence/gc.d.ts.map +0 -1
- package/dist/commands/evidence/gc.js +0 -35
- package/dist/commands/evidence/index.d.ts +0 -8
- package/dist/commands/evidence/index.d.ts.map +0 -1
- package/dist/commands/evidence/index.js +0 -18
- package/dist/commands/evidence/inspect-mocks.d.ts +0 -16
- package/dist/commands/evidence/inspect-mocks.d.ts.map +0 -1
- package/dist/commands/evidence/inspect-mocks.js +0 -49
- package/dist/commands/evidence/record.d.ts +0 -22
- package/dist/commands/evidence/record.d.ts.map +0 -1
- package/dist/commands/evidence/record.js +0 -144
- package/dist/commands/graph/change-impact.d.ts +0 -16
- package/dist/commands/graph/change-impact.d.ts.map +0 -1
- package/dist/commands/graph/change-impact.js +0 -29
- package/dist/commands/graph/churn.d.ts +0 -14
- package/dist/commands/graph/churn.d.ts.map +0 -1
- package/dist/commands/graph/churn.js +0 -15
- package/dist/commands/graph/common.d.ts +0 -16
- package/dist/commands/graph/common.d.ts.map +0 -1
- package/dist/commands/graph/fan-out.d.ts +0 -14
- package/dist/commands/graph/fan-out.d.ts.map +0 -1
- package/dist/commands/graph/fan-out.js +0 -15
- package/dist/commands/graph/index.d.ts +0 -8
- package/dist/commands/graph/index.d.ts.map +0 -1
- package/dist/commands/graph/index.js +0 -12
- package/dist/commands/matrix.d.ts +0 -14
- package/dist/commands/matrix.d.ts.map +0 -1
- package/dist/commands/matrix.js +0 -15
- package/dist/commands/measurement/index.d.ts +0 -7
- package/dist/commands/measurement/index.d.ts.map +0 -1
- package/dist/commands/measurement/index.js +0 -11
- package/dist/commands/measurement/intervention.d.ts +0 -11
- package/dist/commands/measurement/intervention.d.ts.map +0 -1
- package/dist/commands/measurement/intervention.js +0 -31
- package/dist/commands/measurement/operational-release.d.ts +0 -11
- package/dist/commands/measurement/operational-release.d.ts.map +0 -1
- package/dist/commands/measurement/operational-release.js +0 -31
- package/dist/commands/measurement/record.d.ts +0 -10
- package/dist/commands/measurement/record.d.ts.map +0 -1
- package/dist/commands/measurement/record.js +0 -36
- package/dist/commands/module/ensure-defaults.d.ts +0 -8
- package/dist/commands/module/ensure-defaults.d.ts.map +0 -1
- package/dist/commands/module/ensure-defaults.js +0 -17
- package/dist/commands/module/index.d.ts +0 -2
- package/dist/commands/module/index.d.ts.map +0 -1
- package/dist/commands/module/index.js +0 -2
- package/dist/commands/module/install.d.ts +0 -11
- package/dist/commands/module/install.d.ts.map +0 -1
- package/dist/commands/module/install.js +0 -22
- package/dist/commands/module/list.d.ts +0 -8
- package/dist/commands/module/list.d.ts.map +0 -1
- package/dist/commands/module/list.js +0 -13
- package/dist/commands/module/remove.d.ts +0 -10
- package/dist/commands/module/remove.d.ts.map +0 -1
- package/dist/commands/module/remove.js +0 -16
- package/dist/commands/plugin/deprecation.d.ts +0 -10
- package/dist/commands/plugin/deprecation.d.ts.map +0 -1
- package/dist/commands/plugin/ensure-defaults.d.ts +0 -8
- package/dist/commands/plugin/ensure-defaults.d.ts.map +0 -1
- package/dist/commands/plugin/ensure-defaults.js +0 -12
- package/dist/commands/plugin/index.d.ts +0 -2
- package/dist/commands/plugin/index.d.ts.map +0 -1
- package/dist/commands/plugin/index.js +0 -2
- package/dist/commands/plugin/install.d.ts +0 -8
- package/dist/commands/plugin/install.d.ts.map +0 -1
- package/dist/commands/plugin/install.js +0 -12
- package/dist/commands/plugin/list.d.ts +0 -8
- package/dist/commands/plugin/list.d.ts.map +0 -1
- package/dist/commands/plugin/list.js +0 -12
- package/dist/commands/plugin/remove.d.ts +0 -8
- package/dist/commands/plugin/remove.d.ts.map +0 -1
- package/dist/commands/plugin/remove.js +0 -12
- package/dist/commands/report.d.ts +0 -19
- package/dist/commands/report.d.ts.map +0 -1
- package/dist/commands/report.js +0 -96
- package/dist/commands/review.d.ts +0 -14
- package/dist/commands/review.d.ts.map +0 -1
- package/dist/commands/review.js +0 -15
- package/dist/commands/to-plan.d.ts +0 -14
- package/dist/commands/to-plan.d.ts.map +0 -1
- package/dist/commands/to-plan.js +0 -15
- package/dist/commands/update.d.ts +0 -13
- package/dist/commands/update.d.ts.map +0 -1
- package/dist/commands/update.js +0 -34
- package/dist/commands/validate.d.ts +0 -13
- package/dist/commands/validate.d.ts.map +0 -1
- package/dist/commands/validate.js +0 -123
- package/dist/commands/write.d.ts +0 -16
- package/dist/commands/write.d.ts.map +0 -1
- package/dist/commands/write.js +0 -33
- package/dist/common-B1ZJ8CSO.js +0 -36
- package/dist/common-DTrmnvL-.js +0 -35
- package/dist/completeness/assess.d.ts +0 -82
- package/dist/completeness/assess.d.ts.map +0 -1
- package/dist/completeness/bundle.d.ts +0 -52
- package/dist/completeness/bundle.d.ts.map +0 -1
- package/dist/completeness/declarations.d.ts +0 -46
- package/dist/completeness/declarations.d.ts.map +0 -1
- package/dist/completeness/index.d.ts +0 -11
- package/dist/completeness/index.d.ts.map +0 -1
- package/dist/completeness/run.d.ts +0 -35
- package/dist/completeness/run.d.ts.map +0 -1
- package/dist/completeness-BzBuNq6w.js +0 -228
- package/dist/config-schema-Dp-vlxuR.js +0 -13
- package/dist/config-schema.d.ts +0 -52
- package/dist/config-schema.d.ts.map +0 -1
- package/dist/deprecation-fRxUHoxv.js +0 -4
- package/dist/evidence/adapters/agent-eval.d.ts +0 -26
- package/dist/evidence/adapters/agent-eval.d.ts.map +0 -1
- package/dist/evidence/adapters/audit-script.d.ts +0 -25
- package/dist/evidence/adapters/audit-script.d.ts.map +0 -1
- package/dist/evidence/adapters/cargo-mutants.d.ts +0 -3
- package/dist/evidence/adapters/cargo-mutants.d.ts.map +0 -1
- package/dist/evidence/adapters/contract-conformance.d.ts +0 -16
- package/dist/evidence/adapters/contract-conformance.d.ts.map +0 -1
- package/dist/evidence/adapters/differential-report.d.ts +0 -18
- package/dist/evidence/adapters/differential-report.d.ts.map +0 -1
- package/dist/evidence/adapters/junit.d.ts +0 -17
- package/dist/evidence/adapters/junit.d.ts.map +0 -1
- package/dist/evidence/adapters/registry.d.ts +0 -63
- package/dist/evidence/adapters/registry.d.ts.map +0 -1
- package/dist/evidence/adapters/sarif.d.ts +0 -35
- package/dist/evidence/adapters/sarif.d.ts.map +0 -1
- package/dist/evidence/adapters/sbom.d.ts +0 -35
- package/dist/evidence/adapters/sbom.d.ts.map +0 -1
- package/dist/evidence/adapters/types.d.ts +0 -86
- package/dist/evidence/adapters/types.d.ts.map +0 -1
- package/dist/evidence/index.d.ts +0 -27
- package/dist/evidence/index.d.ts.map +0 -1
- package/dist/evidence/mock-inspection.d.ts +0 -16
- package/dist/evidence/mock-inspection.d.ts.map +0 -1
- package/dist/evidence/record.d.ts +0 -58
- package/dist/evidence/record.d.ts.map +0 -1
- package/dist/evidence/store.d.ts +0 -215
- package/dist/evidence/store.d.ts.map +0 -1
- package/dist/evidence/types.d.ts +0 -281
- package/dist/evidence/types.d.ts.map +0 -1
- package/dist/evidence-OyqpqHLS.js +0 -614
- package/dist/flow-command-CCRTE5Oe.js +0 -88
- package/dist/flow-command.d.ts +0 -25
- package/dist/flow-command.d.ts.map +0 -1
- package/dist/flows.d.ts +0 -7
- package/dist/flows.d.ts.map +0 -1
- package/dist/graph-analysis/analysis.d.ts +0 -106
- package/dist/graph-analysis/analysis.d.ts.map +0 -1
- package/dist/graph-analysis/index.d.ts +0 -6
- package/dist/graph-analysis/index.d.ts.map +0 -1
- package/dist/graph-analysis/input.d.ts +0 -33
- package/dist/graph-analysis/input.d.ts.map +0 -1
- package/dist/graph-analysis/load.d.ts +0 -21
- package/dist/graph-analysis/load.d.ts.map +0 -1
- package/dist/graph-analysis/render.d.ts +0 -4
- package/dist/graph-analysis/render.d.ts.map +0 -1
- package/dist/graph-analysis-IWaoJJSN.js +0 -657
- package/dist/hooks/command-not-found.d.ts +0 -23
- package/dist/hooks/command-not-found.d.ts.map +0 -1
- package/dist/hooks/command-not-found.js +0 -8
- package/dist/index.d.ts +0 -13
- package/dist/index.d.ts.map +0 -1
- package/dist/index.js +0 -12
- package/dist/measurement/agent-eval-intervention.d.ts +0 -6
- package/dist/measurement/agent-eval-intervention.d.ts.map +0 -1
- package/dist/measurement/atomic-file.d.ts +0 -5
- package/dist/measurement/atomic-file.d.ts.map +0 -1
- package/dist/measurement/compare.d.ts +0 -4
- package/dist/measurement/compare.d.ts.map +0 -1
- package/dist/measurement/date-time.d.ts +0 -3
- package/dist/measurement/date-time.d.ts.map +0 -1
- package/dist/measurement/github-release-operational.d.ts +0 -7
- package/dist/measurement/github-release-operational.d.ts.map +0 -1
- package/dist/measurement/graph-adapters.d.ts +0 -304
- package/dist/measurement/graph-adapters.d.ts.map +0 -1
- package/dist/measurement/graph-portfolio-load.d.ts +0 -3
- package/dist/measurement/graph-portfolio-load.d.ts.map +0 -1
- package/dist/measurement/graph-portfolio.d.ts +0 -158
- package/dist/measurement/graph-portfolio.d.ts.map +0 -1
- package/dist/measurement/index.d.ts +0 -22
- package/dist/measurement/index.d.ts.map +0 -1
- package/dist/measurement/intervention-report.d.ts +0 -24
- package/dist/measurement/intervention-report.d.ts.map +0 -1
- package/dist/measurement/intervention-schema.d.ts +0 -144
- package/dist/measurement/intervention-schema.d.ts.map +0 -1
- package/dist/measurement/intervention-types.d.ts +0 -105
- package/dist/measurement/intervention-types.d.ts.map +0 -1
- package/dist/measurement/intervention.d.ts +0 -16
- package/dist/measurement/intervention.d.ts.map +0 -1
- package/dist/measurement/operational-report.d.ts +0 -17
- package/dist/measurement/operational-report.d.ts.map +0 -1
- package/dist/measurement/operational-schema.d.ts +0 -461
- package/dist/measurement/operational-schema.d.ts.map +0 -1
- package/dist/measurement/operational-types.d.ts +0 -121
- package/dist/measurement/operational-types.d.ts.map +0 -1
- package/dist/measurement/operational.d.ts +0 -13
- package/dist/measurement/operational.d.ts.map +0 -1
- package/dist/measurement/plans.d.ts +0 -6
- package/dist/measurement/plans.d.ts.map +0 -1
- package/dist/measurement/portfolio.d.ts +0 -54
- package/dist/measurement/portfolio.d.ts.map +0 -1
- package/dist/measurement/profiles.d.ts +0 -9
- package/dist/measurement/profiles.d.ts.map +0 -1
- package/dist/measurement/report.d.ts +0 -48
- package/dist/measurement/report.d.ts.map +0 -1
- package/dist/measurement/schemas/operational-evidence-v1.schema.json.d.ts +0 -384
- package/dist/measurement/store.d.ts +0 -14
- package/dist/measurement/store.d.ts.map +0 -1
- package/dist/measurement/types.d.ts +0 -85
- package/dist/measurement/types.d.ts.map +0 -1
- package/dist/measurement/validate.d.ts +0 -9
- package/dist/measurement/validate.d.ts.map +0 -1
- package/dist/measurement-j8sDSqx5.js +0 -2980
- package/dist/modules-DDQkKC4l.js +0 -23
- package/dist/modules.d.ts +0 -10
- package/dist/modules.d.ts.map +0 -1
- package/dist/org.d.ts +0 -61
- package/dist/org.d.ts.map +0 -1
- package/dist/plugins-CHpYhpEI.js +0 -77
- package/dist/plugins.d.ts +0 -13
- package/dist/plugins.d.ts.map +0 -1
- package/dist/quire/assurance.d.ts +0 -109
- package/dist/quire/assurance.d.ts.map +0 -1
- package/dist/quire/contract.d.ts +0 -88
- package/dist/quire/contract.d.ts.map +0 -1
- package/dist/quire/exec.d.ts +0 -66
- package/dist/quire/exec.d.ts.map +0 -1
- package/dist/quire/index.d.ts +0 -13
- package/dist/quire/index.d.ts.map +0 -1
- package/dist/quire/types.d.ts +0 -415
- package/dist/quire/types.d.ts.map +0 -1
- package/dist/quire/validate.d.ts +0 -39
- package/dist/quire/validate.d.ts.map +0 -1
- package/dist/quire-BsVj1xIR.js +0 -4968
- package/dist/schema-assets-HZWo_iFN.js +0 -233
- package/dist/schemas/assurance-v1.schema.json +0 -225
- package/dist/schemas/change-assurance-record-v1.schema.json +0 -234
- package/dist/schemas/coverage-v1.schema.json +0 -1111
- package/dist/schemas/operational-evidence-v1.schema.json +0 -381
- package/dist/schemas/proof-attestation-v1.schema.json +0 -96
- package/dist/schemas/properties-v1.schema.json +0 -159
- package/dist/schemas/verification-receipt-v1.schema.json +0 -208
- package/dist/validators/gates.d.ts +0 -18
- package/dist/validators/gates.d.ts.map +0 -1
- package/dist/validators/index.d.ts +0 -2
- package/dist/validators/index.d.ts.map +0 -1
- package/dist/version-CMxMIh5g.js +0 -17
- package/dist/version.d.ts +0 -3
- package/dist/version.d.ts.map +0 -1
- package/dist/write-CGTI0dRO.js +0 -157
- package/dist/write.d.ts +0 -28
- package/dist/write.d.ts.map +0 -1
- package/skills/assurance-status-report/SKILL.md +0 -135
- package/skills/assurance-status-report/references/report-contract.md +0 -110
- package/skills/gap-analysis/SKILL.md +0 -111
- package/skills/gap-analysis/references/step-1-target-selection.md +0 -53
- package/skills/gap-analysis/references/step-2-plan-completion.md +0 -49
- package/skills/gap-analysis/references/step-3-matrix-verification.md +0 -147
- package/skills/gap-analysis/references/step-4-underspecified-code.md +0 -92
- package/skills/gap-analysis/references/step-5-semantic-review.md +0 -51
- package/skills/gap-analysis/references/step-6-specreview-artifact.md +0 -108
- package/skills/spec-app-review/SKILL.md +0 -51
- package/skills/spec-app-review/references/checklist.md +0 -197
- package/skills/spec-architecture-evaluation/SKILL.md +0 -30
- package/skills/spec-correctness/SKILL.md +0 -96
- package/skills/spec-correctness/assets/strategy-table.md +0 -101
- package/skills/spec-correctness/assets/templates/fast-check.ts.md +0 -169
- package/skills/spec-correctness/assets/templates/hypothesis.py.md +0 -156
- package/skills/spec-correctness/assets/templates/proptest.rs.md +0 -147
- package/skills/spec-correctness/references/step-0-scope-and-harness.md +0 -94
- package/skills/spec-correctness/references/step-1-census.md +0 -53
- package/skills/spec-correctness/references/step-2-clause-grounding.md +0 -159
- package/skills/spec-correctness/references/step-3-strategy-selection.md +0 -85
- package/skills/spec-correctness/references/step-4-generate-tests.md +0 -117
- package/skills/spec-correctness/references/step-5-second-pass.md +0 -81
- package/skills/spec-correctness/references/step-6-review-artifact.md +0 -134
- package/skills/spec-correctness/references/step-7-report-and-handoff.md +0 -102
- package/skills/spec-dependency-analysis/SKILL.md +0 -90
- package/skills/spec-ears-analysis/SKILL.md +0 -102
- package/skills/spec-evidence-analysis/SKILL.md +0 -156
- package/skills/spec-failure-domain-analysis/SKILL.md +0 -59
- package/skills/spec-fuzz/SKILL.md +0 -133
- package/skills/spec-fuzz/assets/templates/atheris.py.md +0 -74
- package/skills/spec-fuzz/assets/templates/cargo-fuzz.rs.md +0 -83
- package/skills/spec-fuzz/assets/templates/fast-check.ts.md +0 -76
- package/skills/spec-fuzz/references/step-0-scope-and-harness.md +0 -51
- package/skills/spec-fuzz/references/step-1-select-obligations.md +0 -47
- package/skills/spec-fuzz/references/step-2-ground-entry-point.md +0 -55
- package/skills/spec-fuzz/references/step-3-emit-targets.md +0 -65
- package/skills/spec-fuzz/references/step-4-report.md +0 -56
- package/skills/spec-ideation/SKILL.md +0 -46
- package/skills/spec-integrity-analysis/SKILL.md +0 -62
- package/skills/spec-matrix/SKILL.md +0 -186
- package/skills/spec-matrix/assets/test-cases/TC-001.md +0 -35
- package/skills/spec-matrix/assets/test-cases/TC-002.md +0 -37
- package/skills/spec-matrix/assets/test-cases/TC-006.md +0 -50
- package/skills/spec-matrix/assets/test-matrix-example.md +0 -104
- package/skills/spec-matrix/assets/test-matrix-template.md +0 -123
- package/skills/spec-matrix/workflow-assets/dist/index.d.ts +0 -146
- package/skills/spec-matrix/workflow-assets/dist/index.d.ts.map +0 -1
- package/skills/spec-matrix/workflow-assets/dist/index.js +0 -7525
- package/skills/spec-matrix/workflow-assets/dist/invariants.d.ts +0 -6
- package/skills/spec-matrix/workflow-assets/dist/invariants.d.ts.map +0 -1
- package/skills/spec-matrix/workflow-assets/skills/matrix/SKILL.md +0 -35
- package/skills/spec-matrix/workflow-assets/skills/matrix/scripts/invariants.js +0 -1
- package/skills/spec-matrix/workflow-assets/skills/matrix/templates/report/default.md +0 -30
- package/skills/spec-matrix/workflow-assets/skills/matrix/workflows/matrix/def.yaml +0 -82
- package/skills/spec-object-review/SKILL.md +0 -125
- package/skills/spec-object-review/references/object-type-guide.md +0 -118
- package/skills/spec-review/SKILL.md +0 -92
- package/skills/spec-review/references/checklist.md +0 -50
- package/skills/spec-review/workflow-assets/dist/index.d.ts +0 -146
- package/skills/spec-review/workflow-assets/dist/index.d.ts.map +0 -1
- package/skills/spec-review/workflow-assets/dist/index.js +0 -7525
- package/skills/spec-review/workflow-assets/dist/invariants.d.ts +0 -6
- package/skills/spec-review/workflow-assets/dist/invariants.d.ts.map +0 -1
- package/skills/spec-review/workflow-assets/skills/review/SKILL.md +0 -96
- package/skills/spec-review/workflow-assets/skills/review/scripts/invariants.js +0 -61
- package/skills/spec-review/workflow-assets/skills/review/workflows/review/def.yaml +0 -68
- package/skills/spec-risk-complexity-analysis/SKILL.md +0 -92
- package/skills/spec-scope-boundary-analysis/SKILL.md +0 -101
- package/skills/spec-security-analysis/SKILL.md +0 -84
- package/skills/spec-security-analysis/assets/security-analysis-example.md +0 -89
- package/skills/spec-security-analysis/assets/security-analysis-template.md +0 -73
- package/skills/spec-security-analysis/references/component-type-mapping.md +0 -161
- package/skills/spec-security-analysis/references/gdpr/ChII-Principles.md +0 -58
- package/skills/spec-security-analysis/references/gdpr/ChIII-DataSubjectRights.md +0 -84
- package/skills/spec-security-analysis/references/gdpr/ChIV-ControllerProcessor.md +0 -83
- package/skills/spec-security-analysis/references/gdpr/ChV-DataTransfers.md +0 -62
- package/skills/spec-security-analysis/references/gdpr/index.md +0 -54
- package/skills/spec-security-analysis/references/iso27001/A5-OrganizationalControls.md +0 -64
- package/skills/spec-security-analysis/references/iso27001/A6-PeopleControls.md +0 -30
- package/skills/spec-security-analysis/references/iso27001/A7-PhysicalControls.md +0 -35
- package/skills/spec-security-analysis/references/iso27001/A8-TechnologicalControls.md +0 -66
- package/skills/spec-security-analysis/references/iso27001/index.md +0 -43
- package/skills/spec-security-analysis/references/nist-800-53/AC-AccessControl.md +0 -57
- package/skills/spec-security-analysis/references/nist-800-53/AU-AuditAccountability.md +0 -49
- package/skills/spec-security-analysis/references/nist-800-53/CM-ConfigurationManagement.md +0 -36
- package/skills/spec-security-analysis/references/nist-800-53/IA-IdentificationAuthentication.md +0 -44
- package/skills/spec-security-analysis/references/nist-800-53/SA-SystemServicesAcquisition.md +0 -50
- package/skills/spec-security-analysis/references/nist-800-53/SC-SystemCommunications.md +0 -53
- package/skills/spec-security-analysis/references/nist-800-53/SI-SystemInformationIntegrity.md +0 -52
- package/skills/spec-security-analysis/references/nist-800-53/index.md +0 -58
- package/skills/spec-security-analysis/references/owasp-asvs/V1-Architecture.md +0 -33
- package/skills/spec-security-analysis/references/owasp-asvs/V10-MaliciousCode.md +0 -33
- package/skills/spec-security-analysis/references/owasp-asvs/V11-BusinessLogic.md +0 -32
- package/skills/spec-security-analysis/references/owasp-asvs/V12-Files.md +0 -34
- package/skills/spec-security-analysis/references/owasp-asvs/V13-API.md +0 -34
- package/skills/spec-security-analysis/references/owasp-asvs/V14-Configuration.md +0 -35
- package/skills/spec-security-analysis/references/owasp-asvs/V2-Authentication.md +0 -36
- package/skills/spec-security-analysis/references/owasp-asvs/V3-SessionManagement.md +0 -35
- package/skills/spec-security-analysis/references/owasp-asvs/V4-AccessControl.md +0 -39
- package/skills/spec-security-analysis/references/owasp-asvs/V5-Validation.md +0 -37
- package/skills/spec-security-analysis/references/owasp-asvs/V6-Cryptography.md +0 -34
- package/skills/spec-security-analysis/references/owasp-asvs/V7-ErrorLogging.md +0 -37
- package/skills/spec-security-analysis/references/owasp-asvs/V8-DataProtection.md +0 -34
- package/skills/spec-security-analysis/references/owasp-asvs/V9-Communication.md +0 -32
- package/skills/spec-security-analysis/references/owasp-asvs/index.md +0 -59
- package/skills/spec-security-analysis/references/soc2/CC1-ControlEnvironment.md +0 -31
- package/skills/spec-security-analysis/references/soc2/CC2-CommunicationInformation.md +0 -27
- package/skills/spec-security-analysis/references/soc2/CC3-RiskAssessment.md +0 -29
- package/skills/spec-security-analysis/references/soc2/CC4-MonitoringActivities.md +0 -27
- package/skills/spec-security-analysis/references/soc2/CC5-ControlActivities.md +0 -28
- package/skills/spec-security-analysis/references/soc2/CC6-LogicalPhysicalAccess.md +0 -45
- package/skills/spec-security-analysis/references/soc2/CC7-SystemOperations.md +0 -42
- package/skills/spec-security-analysis/references/soc2/CC8-ChangeManagement.md +0 -32
- package/skills/spec-security-analysis/references/soc2/CC9-RiskMitigation.md +0 -34
- package/skills/spec-security-analysis/references/soc2/index.md +0 -46
- package/skills/spec-security-analysis/references/standards-index.md +0 -46
- package/skills/spec-to-plan/SKILL.md +0 -88
- package/skills/spec-to-plan/references/step-0-plan-selection.md +0 -121
- package/skills/spec-to-plan/references/step-1-analysis.md +0 -88
- package/skills/spec-to-plan/references/step-2-test-plan.md +0 -43
- package/skills/spec-to-plan/references/step-3-execution-plan.md +0 -218
- package/skills/spec-to-plan/workflow-assets/dist/index.d.ts +0 -146
- package/skills/spec-to-plan/workflow-assets/dist/index.d.ts.map +0 -1
- package/skills/spec-to-plan/workflow-assets/dist/index.js +0 -7525
- package/skills/spec-to-plan/workflow-assets/dist/invariants.d.ts +0 -6
- package/skills/spec-to-plan/workflow-assets/dist/invariants.d.ts.map +0 -1
- package/skills/spec-to-plan/workflow-assets/skills/to-plan/SKILL.md +0 -35
- package/skills/spec-to-plan/workflow-assets/skills/to-plan/scripts/invariants.js +0 -1
- package/skills/spec-to-plan/workflow-assets/skills/to-plan/templates/implementation-plan/default.md +0 -44
- package/skills/spec-to-plan/workflow-assets/skills/to-plan/workflows/to-plan/def.yaml +0 -85
- package/skills/specify/SKILL.md +0 -154
- package/skills/specify/assets/app-spec-template.md +0 -143
- package/skills/specify/assets/spec-template.md +0 -299
- package/skills/specify/references/integration-tests.md +0 -72
- package/skills/specify/references/us-to-fr.md +0 -40
- package/skills/specify/references/writing-good-requirements.md +0 -61
|
@@ -1,74 +0,0 @@
|
|
|
1
|
-
# atheris target template
|
|
2
|
-
|
|
3
|
-
One file per obligation, at `fuzz/fuzz_<obligation_slug>_<surface>.py`, executable.
|
|
4
|
-
|
|
5
|
-
Atheris instruments at import time, so **`atheris.instrument_imports()` must wrap the import
|
|
6
|
-
of the module under test**. An import outside that block is uninstrumented: the fuzzer runs,
|
|
7
|
-
reports coverage, finds nothing, and looks like it worked.
|
|
8
|
-
|
|
9
|
-
## Bytes in, no interpretation
|
|
10
|
-
|
|
11
|
-
```python
|
|
12
|
-
#!/usr/bin/env python3
|
|
13
|
-
"""The config loader does not raise on arbitrary input.
|
|
14
|
-
|
|
15
|
-
Trace: NFR-003-M-1
|
|
16
|
-
|
|
17
|
-
spec-fuzz: obligation=NFR-003-M-1 harness=atheris entry=myapp.config.parse_config origin=advised
|
|
18
|
-
"""
|
|
19
|
-
|
|
20
|
-
import sys
|
|
21
|
-
|
|
22
|
-
import atheris
|
|
23
|
-
|
|
24
|
-
with atheris.instrument_imports():
|
|
25
|
-
from myapp.config import parse_config
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
def test_one_input(data: bytes) -> None:
|
|
29
|
-
fdp = atheris.FuzzedDataProvider(data)
|
|
30
|
-
text = fdp.ConsumeUnicodeNoSurrogates(fdp.remaining_bytes())
|
|
31
|
-
try:
|
|
32
|
-
parse_config(text)
|
|
33
|
-
except (ValueError, KeyError):
|
|
34
|
-
# The declared rejection path. Raising a *declared* error on garbage is
|
|
35
|
-
# the requirement being met, so it must not read as a crash. Catch the
|
|
36
|
-
# exception types the requirement names — never bare `except Exception`,
|
|
37
|
-
# which would swallow the AttributeError and IndexError this exists to find.
|
|
38
|
-
pass
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
atheris.Setup(sys.argv, test_one_input)
|
|
42
|
-
atheris.Fuzz()
|
|
43
|
-
```
|
|
44
|
-
|
|
45
|
-
The narrow `except` is the whole design of the file. `except Exception` turns a target that
|
|
46
|
-
finds real bugs into one that can never fail, and it looks more careful.
|
|
47
|
-
|
|
48
|
-
## Which exceptions to catch
|
|
49
|
-
|
|
50
|
-
From the requirement, not from the code. If the requirement says *"rejects malformed input"*
|
|
51
|
-
and the code raises `ConfigError`, catch `ConfigError`. If the code also raises `TypeError`
|
|
52
|
-
on some path, that is a **finding** — the requirement says reject, and `TypeError` is a
|
|
53
|
-
crash, not a rejection.
|
|
54
|
-
|
|
55
|
-
Do not widen the catch to make the target quiet. That is the same move as widening a rule to
|
|
56
|
-
lower a finding count.
|
|
57
|
-
|
|
58
|
-
## Structured input
|
|
59
|
-
|
|
60
|
-
`FuzzedDataProvider` builds typed values without a hand-rolled decoder:
|
|
61
|
-
|
|
62
|
-
```python
|
|
63
|
-
def test_one_input(data: bytes) -> None:
|
|
64
|
-
fdp = atheris.FuzzedDataProvider(data)
|
|
65
|
-
document = fdp.ConsumeUnicodeNoSurrogates(fdp.ConsumeIntInRange(0, 4096))
|
|
66
|
-
selector = fdp.ConsumeUnicodeNoSurrogates(fdp.remaining_bytes())
|
|
67
|
-
try:
|
|
68
|
-
run_query(selector, document)
|
|
69
|
-
except QueryError:
|
|
70
|
-
pass
|
|
71
|
-
```
|
|
72
|
-
|
|
73
|
-
Consume the bounded field first and the unbounded one last, or the second field is almost
|
|
74
|
-
always empty and half the input surface is never reached.
|
|
@@ -1,83 +0,0 @@
|
|
|
1
|
-
# cargo-fuzz target template
|
|
2
|
-
|
|
3
|
-
One file per obligation, at `fuzz/fuzz_targets/fuzz_<obligation-slug>_<surface>.rs`, plus a
|
|
4
|
-
`[[bin]]` block in `fuzz/Cargo.toml`.
|
|
5
|
-
|
|
6
|
-
**The `[[bin]]` block is not optional.** cargo-fuzz discovers targets from `Cargo.toml`, not
|
|
7
|
-
from the directory — a `.rs` file with no block is a file nobody runs, which is the same
|
|
8
|
-
"green over nothing" shape this whole program exists to catch.
|
|
9
|
-
|
|
10
|
-
## Bytes in, no interpretation
|
|
11
|
-
|
|
12
|
-
```rust
|
|
13
|
-
#![no_main]
|
|
14
|
-
|
|
15
|
-
use libfuzzer_sys::fuzz_target;
|
|
16
|
-
|
|
17
|
-
use quire_rs::loader::manifest::parse_manifest;
|
|
18
|
-
|
|
19
|
-
/// The manifest loader does not panic on arbitrary input.
|
|
20
|
-
///
|
|
21
|
-
/// Trace: NFR-003-M-1
|
|
22
|
-
///
|
|
23
|
-
/// spec-fuzz: obligation=NFR-003-M-1 harness=cargo-fuzz entry=loader::manifest::parse_manifest origin=advised
|
|
24
|
-
fuzz_target!(|data: &[u8]| {
|
|
25
|
-
// `from_utf8` rather than `from_utf8_lossy`: lossy conversion silently
|
|
26
|
-
// repairs the invalid sequences that are the most interesting inputs a
|
|
27
|
-
// byte fuzzer produces, so the parser never sees them.
|
|
28
|
-
if let Ok(text) = std::str::from_utf8(data) {
|
|
29
|
-
let _ = parse_manifest(text);
|
|
30
|
-
}
|
|
31
|
-
});
|
|
32
|
-
```
|
|
33
|
-
|
|
34
|
-
Note what is absent: no `unwrap()`, no assertion on the result, no `expect`. `parse_manifest`
|
|
35
|
-
returning `Err` on garbage **is the requirement being met**. The `let _ =` is deliberate.
|
|
36
|
-
|
|
37
|
-
## Structured input, via `arbitrary`
|
|
38
|
-
|
|
39
|
-
Where the surface takes a typed value rather than bytes, derive `Arbitrary` instead of
|
|
40
|
-
hand-rolling a decoder — a hand-rolled one spends most of the corpus failing its own parse
|
|
41
|
-
before reaching the code under test.
|
|
42
|
-
|
|
43
|
-
```rust
|
|
44
|
-
#![no_main]
|
|
45
|
-
|
|
46
|
-
use arbitrary::Arbitrary;
|
|
47
|
-
use libfuzzer_sys::fuzz_target;
|
|
48
|
-
|
|
49
|
-
use quire_rs::query::{run_query, Query};
|
|
50
|
-
|
|
51
|
-
#[derive(Arbitrary, Debug)]
|
|
52
|
-
struct Input {
|
|
53
|
-
document: String,
|
|
54
|
-
selector: String,
|
|
55
|
-
}
|
|
56
|
-
|
|
57
|
-
/// The query engine does not panic on any selector against any document.
|
|
58
|
-
///
|
|
59
|
-
/// Trace: FR-010-AC-3
|
|
60
|
-
///
|
|
61
|
-
/// spec-fuzz: obligation=FR-010-AC-3 harness=cargo-fuzz entry=query::run_query origin=authored
|
|
62
|
-
fuzz_target!(|input: Input| {
|
|
63
|
-
if let Ok(query) = Query::parse(&input.selector) {
|
|
64
|
-
let _ = run_query(&query, &input.document);
|
|
65
|
-
}
|
|
66
|
-
});
|
|
67
|
-
```
|
|
68
|
-
|
|
69
|
-
`arbitrary` must be a declared dependency of the **fuzz** crate. If it is not, that is the
|
|
70
|
-
absent-tooling case from step 0 — add nothing, report it.
|
|
71
|
-
|
|
72
|
-
## The `[[bin]]` block
|
|
73
|
-
|
|
74
|
-
```toml
|
|
75
|
-
[[bin]]
|
|
76
|
-
name = "fuzz_nfr_003_m_1_parse_manifest"
|
|
77
|
-
path = "fuzz_targets/fuzz_nfr_003_m_1_parse_manifest.rs"
|
|
78
|
-
test = false
|
|
79
|
-
doc = false
|
|
80
|
-
```
|
|
81
|
-
|
|
82
|
-
`test = false` and `doc = false` keep the target out of `cargo test` and `cargo doc`, which
|
|
83
|
-
is what stops a nightly-only target from breaking a stable build.
|
|
@@ -1,76 +0,0 @@
|
|
|
1
|
-
# fast-check target template
|
|
2
|
-
|
|
3
|
-
TypeScript has no libFuzzer equivalent in ordinary use, so the harness is `fast-check`
|
|
4
|
-
running in the repo's existing test runner. That has one consequence worth stating: **this is
|
|
5
|
-
a bounded search, not a fuzzing campaign.** It runs for N cases and stops.
|
|
6
|
-
|
|
7
|
-
Say so in the report rather than implying parity with cargo-fuzz.
|
|
8
|
-
|
|
9
|
-
## Placement is the thing that bites
|
|
10
|
-
|
|
11
|
-
The `Trace:` carrier goes **immediately above `it(`** — never above `describe(`. A `describe`
|
|
12
|
-
block groups tests and registers no symbol of its own, so a tag above it binds to nothing
|
|
13
|
-
while reading correctly and matching a grep (`agent-ix/quoin#61`).
|
|
14
|
-
|
|
15
|
-
```ts
|
|
16
|
-
import fc from "fast-check";
|
|
17
|
-
import { describe, expect, it } from "vitest";
|
|
18
|
-
|
|
19
|
-
import { parseManifest } from "../src/manifest.js";
|
|
20
|
-
|
|
21
|
-
describe("the manifest parser under arbitrary input", () => {
|
|
22
|
-
// The parser does not throw an unexpected error on any string.
|
|
23
|
-
//
|
|
24
|
-
// Trace: NFR-003-M-1
|
|
25
|
-
//
|
|
26
|
-
// spec-fuzz: obligation=NFR-003-M-1 harness=fast-check entry=parseManifest origin=advised
|
|
27
|
-
it("NFR-003-M-1 never throws outside its declared rejection", () => {
|
|
28
|
-
fc.assert(
|
|
29
|
-
fc.property(fc.string(), (text) => {
|
|
30
|
-
try {
|
|
31
|
-
parseManifest(text);
|
|
32
|
-
} catch (error) {
|
|
33
|
-
// The declared rejection path. Any OTHER error is the bug this
|
|
34
|
-
// target exists to find, so it is rethrown rather than swallowed —
|
|
35
|
-
// a bare catch would make this target incapable of failing.
|
|
36
|
-
if (!(error instanceof ManifestError)) throw error;
|
|
37
|
-
}
|
|
38
|
-
}),
|
|
39
|
-
{ numRuns: 10_000 },
|
|
40
|
-
);
|
|
41
|
-
});
|
|
42
|
-
});
|
|
43
|
-
```
|
|
44
|
-
|
|
45
|
-
## Generators that reach past the first parse
|
|
46
|
-
|
|
47
|
-
`fc.string()` finds shallow crashes and then plateaus — almost every case fails validation in
|
|
48
|
-
the first few bytes and the code behind it is never reached. Where the surface takes
|
|
49
|
-
structured text, build the structure and mutate it:
|
|
50
|
-
|
|
51
|
-
```ts
|
|
52
|
-
const manifestish = fc.record({
|
|
53
|
-
name: fc.string(),
|
|
54
|
-
version: fc.oneof(fc.string(), fc.constant("1.0.0")),
|
|
55
|
-
entries: fc.array(fc.record({ id: fc.string(), ref: fc.string() }), { maxLength: 8 }),
|
|
56
|
-
});
|
|
57
|
-
|
|
58
|
-
fc.assert(
|
|
59
|
-
fc.property(manifestish, (value) => {
|
|
60
|
-
try {
|
|
61
|
-
parseManifest(JSON.stringify(value));
|
|
62
|
-
} catch (error) {
|
|
63
|
-
if (!(error instanceof ManifestError)) throw error;
|
|
64
|
-
}
|
|
65
|
-
}),
|
|
66
|
-
);
|
|
67
|
-
```
|
|
68
|
-
|
|
69
|
-
Mixing `fc.constant("1.0.0")` into an otherwise arbitrary field is deliberate: it keeps a
|
|
70
|
-
fraction of cases valid enough to get past the field's own check, which is where the
|
|
71
|
-
interesting behaviour is.
|
|
72
|
-
|
|
73
|
-
## Seeds and reproduction
|
|
74
|
-
|
|
75
|
-
`fc.assert` prints the failing counterexample and its seed. Put the seed in the bug, not a
|
|
76
|
-
copy of the input — the seed reproduces the shrink as well as the failure.
|
|
@@ -1,51 +0,0 @@
|
|
|
1
|
-
# Step 0: Scope and harness
|
|
2
|
-
|
|
3
|
-
**Goal**: know what the repository can actually run before generating anything for it.
|
|
4
|
-
|
|
5
|
-
## Detect the harness from the manifest, never from the requirement
|
|
6
|
-
|
|
7
|
-
The requirement says *"the parser SHALL NOT panic on arbitrary input"*. It does not say Rust.
|
|
8
|
-
The **repository's manifest** says Rust, and that is the only thing that may choose a harness
|
|
9
|
-
(FR-038-AC-7).
|
|
10
|
-
|
|
11
|
-
| Manifest | Harness | Present when |
|
|
12
|
-
|---|---|---|
|
|
13
|
-
| `Cargo.toml` | cargo-fuzz / libFuzzer | a `fuzz/Cargo.toml` exists with `cargo-fuzz = true`, or `cargo fuzz --version` resolves |
|
|
14
|
-
| `pyproject.toml` / `setup.py` | atheris | `atheris` is a declared dev-dependency |
|
|
15
|
-
| `package.json` | fast-check | `fast-check` is a declared dependency |
|
|
16
|
-
|
|
17
|
-
A repository with several manifests has several harnesses; scope each obligation to the one
|
|
18
|
-
its entry point lives in.
|
|
19
|
-
|
|
20
|
-
## Absent tooling stops the run
|
|
21
|
-
|
|
22
|
-
If the manifest is present but the harness is not, **stop here**. Emit one finding per
|
|
23
|
-
selected obligation and write no files (FR-038-AC-4).
|
|
24
|
-
|
|
25
|
-
Do not:
|
|
26
|
-
|
|
27
|
-
- run `cargo install cargo-fuzz`
|
|
28
|
-
- add `atheris` or `fast-check` to a dependency list
|
|
29
|
-
- create `fuzz/Cargo.toml`, a `[[bin]]` block, or a nightly toolchain file
|
|
30
|
-
|
|
31
|
-
A fuzz workspace is not a generated artifact. It is a dev-dependency, a nightly toolchain
|
|
32
|
-
requirement and a CI job, and adding all three to somebody's repository because their spec
|
|
33
|
-
mentioned a parser is a decision that belongs to them (ADR-0011: generated artifacts are
|
|
34
|
-
consumer-owned).
|
|
35
|
-
|
|
36
|
-
The finding is the deliverable in this case, and it is a good one — it says *"your spec
|
|
37
|
-
declares N fuzzable surfaces and this repository cannot fuzz"*, which is a fact nobody had
|
|
38
|
-
written down.
|
|
39
|
-
|
|
40
|
-
## Record what you detected
|
|
41
|
-
|
|
42
|
-
The provenance line carries it, so a re-run and a reviewer can both see which harness was
|
|
43
|
-
chosen and why:
|
|
44
|
-
|
|
45
|
-
```
|
|
46
|
-
spec-fuzz: obligation=NFR-012-M-2 harness=cargo-fuzz entry=quire_rs::parse_document origin=advised
|
|
47
|
-
```
|
|
48
|
-
|
|
49
|
-
`origin ∈ {advised, authored}` — whether the method came from `quoin advise`'s
|
|
50
|
-
recommendation or from the requirement's own `Verification` cell. They are different claims
|
|
51
|
-
and the distinction survives into the report.
|
|
@@ -1,47 +0,0 @@
|
|
|
1
|
-
# Step 1: Select the obligations
|
|
2
|
-
|
|
3
|
-
**Goal**: the set of obligations that want a fuzz target, decided by module data.
|
|
4
|
-
|
|
5
|
-
## The selector
|
|
6
|
-
|
|
7
|
-
An obligation is in scope when its verification method carries **`evidence_kind: Fuzz`** in
|
|
8
|
-
the active `verification_catalog`.
|
|
9
|
-
|
|
10
|
-
```
|
|
11
|
-
quoin advise --repo <repo> --json
|
|
12
|
-
quoin catalog methods --json # the catalog, with each method's evidence_kind
|
|
13
|
-
```
|
|
14
|
-
|
|
15
|
-
Take the method from the obligation's authored `Verification` cell if it has one, and from
|
|
16
|
-
the top recommendation otherwise. Record which in `origin=` (step 0).
|
|
17
|
-
|
|
18
|
-
## Do not carry a list of fuzz methods here
|
|
19
|
-
|
|
20
|
-
Today the catalog declares two — `fuzzing` and `grammar-based-fuzzing`. **Do not hardcode
|
|
21
|
-
those two names.** A module adding a third, or renaming one, must change this skill's
|
|
22
|
-
behaviour without changing this skill (FR-038-CON-1).
|
|
23
|
-
|
|
24
|
-
The test for "is this a fuzz method" is `evidence_kind === "Fuzz"`, every time.
|
|
25
|
-
|
|
26
|
-
## Two facts about today's catalog worth knowing
|
|
27
|
-
|
|
28
|
-
Neither changes the selector; both change what you should expect to see.
|
|
29
|
-
|
|
30
|
-
**`grammar-based-fuzzing` is never advised.** It is keyed on `structured-input` and
|
|
31
|
-
`grammar-declared`, and `characteristicsOf` mints neither, so no statement can reach it
|
|
32
|
-
(`agent-ix/quoin#128`). It arrives only as an authored method. If you were expecting the
|
|
33
|
-
advisor to suggest it for a grammar, that is why it did not.
|
|
34
|
-
|
|
35
|
-
**`fuzzing` is advised from two of its three keys.** `untrusted-input` and `parser` are
|
|
36
|
-
mintable; `deserializer` is not. An obligation about deserialization that says neither
|
|
37
|
-
"untrusted" nor "pars…" will not be advised, and is a legitimate authored-method case.
|
|
38
|
-
|
|
39
|
-
## What a good selection looks like
|
|
40
|
-
|
|
41
|
-
Obligations that survive this step describe an **input surface**: something that consumes
|
|
42
|
-
bytes or text from outside and must not crash. If a selected obligation is about a return
|
|
43
|
-
value, a threshold or an ordering, the method is wrong — say so in the report rather than
|
|
44
|
-
generating a target that fuzzes the wrong thing.
|
|
45
|
-
|
|
46
|
-
That is a finding about the method, not about the requirement. Do not reword the
|
|
47
|
-
requirement, and do not silently drop it (FR-038-AC-9).
|
|
@@ -1,55 +0,0 @@
|
|
|
1
|
-
# Step 2: Ground the entry point
|
|
2
|
-
|
|
3
|
-
**Goal**: the symbol the target will call. It must exist.
|
|
4
|
-
|
|
5
|
-
## Why this step cannot be skipped
|
|
6
|
-
|
|
7
|
-
A property test that grounds nothing is a weak test. **A fuzz target that calls nothing is a
|
|
8
|
-
build error in somebody's CI**, and it arrives in a harness most reviewers do not run
|
|
9
|
-
locally, so it fails in the one place nobody is watching.
|
|
10
|
-
|
|
11
|
-
The entry point is therefore *found in the source*, never inferred from the requirement's
|
|
12
|
-
wording (FR-038-AC-2).
|
|
13
|
-
|
|
14
|
-
## How to find it
|
|
15
|
-
|
|
16
|
-
In order, stopping at the first that resolves:
|
|
17
|
-
|
|
18
|
-
1. **The requirement's `## Inputs` section**, if it names a symbol or a module path. This is
|
|
19
|
-
the author telling you directly.
|
|
20
|
-
2. **An existing target in the same suite** covering a neighbouring surface — its imports
|
|
21
|
-
show the shape of a callable entry point in this repository.
|
|
22
|
-
3. **The public surface**: a function taking `&[u8]`, `&str`, `bytes` or `string` and
|
|
23
|
-
returning a `Result`/`Option`, exported from the module the requirement names.
|
|
24
|
-
|
|
25
|
-
Read the function. Confirm it takes the input the requirement describes and that calling it
|
|
26
|
-
has no side effect outside the process — a fuzz target that writes files or opens sockets
|
|
27
|
-
will be killed by the fuzzer's own sanitizers and produce nothing but noise.
|
|
28
|
-
|
|
29
|
-
## Ungrounded is a finding, not a guess
|
|
30
|
-
|
|
31
|
-
If none of the three resolves, **write no file for that obligation** and record a finding
|
|
32
|
-
naming it and what you looked for (FR-038-AC-3).
|
|
33
|
-
|
|
34
|
-
This is the honest outcome and it is often the useful one. *"NFR-003 declares the config
|
|
35
|
-
loader must not panic on arbitrary input, and there is no function in `src/` that takes
|
|
36
|
-
arbitrary bytes"* means either the surface does not exist yet or the requirement is about
|
|
37
|
-
something else. Both are worth a reviewer's attention; a generated target guessing at
|
|
38
|
-
`load_config()` is not.
|
|
39
|
-
|
|
40
|
-
## Do not fuzz through a wrapper
|
|
41
|
-
|
|
42
|
-
Where the requirement names a surface and the obvious public function wraps it in file I/O,
|
|
43
|
-
ground on the **inner** function that takes the bytes. Fuzzing the wrapper spends the whole
|
|
44
|
-
run on the filesystem and reaches the parser a few thousand times instead of a few hundred
|
|
45
|
-
million.
|
|
46
|
-
|
|
47
|
-
Record the choice in the provenance line, because it is a judgement:
|
|
48
|
-
|
|
49
|
-
```
|
|
50
|
-
spec-fuzz: obligation=NFR-003-M-1 harness=cargo-fuzz entry=loader::manifest::parse_manifest origin=advised
|
|
51
|
-
```
|
|
52
|
-
|
|
53
|
-
If you grounded on an inner function while the requirement named the outer one, say so in
|
|
54
|
-
the report. It is the kind of thing that is obviously right when explained and looks like an
|
|
55
|
-
error when not.
|
|
@@ -1,65 +0,0 @@
|
|
|
1
|
-
# Step 3: Emit the targets
|
|
2
|
-
|
|
3
|
-
**Goal**: a target that compiles, runs, and reconciles.
|
|
4
|
-
|
|
5
|
-
Templates: [cargo-fuzz](../assets/templates/cargo-fuzz.rs.md) ·
|
|
6
|
-
[atheris](../assets/templates/atheris.py.md) ·
|
|
7
|
-
[fast-check](../assets/templates/fast-check.ts.md)
|
|
8
|
-
|
|
9
|
-
## The tag contract
|
|
10
|
-
|
|
11
|
-
Inherited from `spec-correctness` step 4, unchanged, because `gap-analysis` reconciles by the
|
|
12
|
-
same grep. **Two independent carriers**, so one formatting change cannot break reconciliation:
|
|
13
|
-
|
|
14
|
-
1. `Trace: NFR-003-M-1` on its own line in the doc comment or docstring.
|
|
15
|
-
2. The target's own name containing the id — `fuzz_nfr_003_m_1_parse_manifest`.
|
|
16
|
-
|
|
17
|
-
### Placement, which is where this bites
|
|
18
|
-
|
|
19
|
-
A carrier binds to the **symbol whose source span encloses it**. For a libfuzzer target that
|
|
20
|
-
span is the `fuzz_target!` block — so the doc comment goes immediately above `fuzz_target!`,
|
|
21
|
-
not at the top of the file.
|
|
22
|
-
|
|
23
|
-
A file-header comment reads correctly, passes review, matches a grep, and **binds to
|
|
24
|
-
nothing**. Six generated files shipped that way in `@agent-ix/quoin@0.12.x` and every
|
|
25
|
-
criterion in them scored zero (`agent-ix/quoin#61`). Do not verify placement with grep — grep
|
|
26
|
-
does not care where a comment sits, which is exactly why that shipped.
|
|
27
|
-
|
|
28
|
-
## The provenance line
|
|
29
|
-
|
|
30
|
-
One per target, ignored by the reconciliation grep, read by this skill on re-runs:
|
|
31
|
-
|
|
32
|
-
```
|
|
33
|
-
spec-fuzz: obligation=<id> harness=<harness> entry=<symbol> origin=<advised|authored>
|
|
34
|
-
```
|
|
35
|
-
|
|
36
|
-
Add `wrapped=<outer-symbol>` when step 2 grounded on an inner function.
|
|
37
|
-
|
|
38
|
-
## Idempotent re-runs
|
|
39
|
-
|
|
40
|
-
Same obligation, same harness, same entry → **leave the file alone** (FR-038-AC-6).
|
|
41
|
-
|
|
42
|
-
A changed entry point is a real change: rewrite the target and say so in the report. A
|
|
43
|
-
changed requirement *statement* is not — the target calls a symbol, not a sentence, so a
|
|
44
|
-
reworded requirement with the same surface needs no new file.
|
|
45
|
-
|
|
46
|
-
## What the target must not do
|
|
47
|
-
|
|
48
|
-
- **No assertions about correctness.** Fuzzing looks for crashes, hangs and assertion
|
|
49
|
-
failures inside the code under test — not for wrong answers. An `assert_eq!` on the result
|
|
50
|
-
turns every interesting input into a false positive.
|
|
51
|
-
- **No `unwrap()` on the result.** The function returning `Err` on garbage is the requirement
|
|
52
|
-
being *met*. Unwrapping turns success into a crash and the fuzzer will find it in seconds.
|
|
53
|
-
- **No file, network or process access.** Sanitizers will kill it and the run produces noise.
|
|
54
|
-
- **No `panic!` as a way of reporting.** The fuzzer's crash is the report.
|
|
55
|
-
|
|
56
|
-
The body is therefore usually three lines: take the bytes, make the input the function
|
|
57
|
-
expects, call it and drop the result.
|
|
58
|
-
|
|
59
|
-
## Corpus and seeds
|
|
60
|
-
|
|
61
|
-
Out of scope. A seed corpus makes a fuzzer dramatically more effective and building one from
|
|
62
|
-
the repository's own fixtures is real work with its own decisions.
|
|
63
|
-
|
|
64
|
-
Say so in the report rather than shipping an empty `corpus/` directory that looks like it was
|
|
65
|
-
considered.
|
|
@@ -1,56 +0,0 @@
|
|
|
1
|
-
# Step 4: Report
|
|
2
|
-
|
|
3
|
-
**Goal**: a validated artifact saying what was generated, what was not, and what none of it
|
|
4
|
-
proves yet.
|
|
5
|
-
|
|
6
|
-
## The handoff sentence that must appear
|
|
7
|
-
|
|
8
|
-
> These targets are **undischarged**. A fuzz target that has never run is a search never
|
|
9
|
-
> started, and the evidence store will report it as such until a run is recorded.
|
|
10
|
-
|
|
11
|
-
Say it plainly and do not soften it. The temptation at the end of a generation run is to
|
|
12
|
-
report N targets as N obligations covered, and that is the exact claim this skill exists not
|
|
13
|
-
to make (FR-038-CON-3).
|
|
14
|
-
|
|
15
|
-
What the consumer does next is theirs: run the fuzzer in their CI, then
|
|
16
|
-
`quoin evidence record` the result into a suite with `Evidence Kind: Fuzz`. quoin does not
|
|
17
|
-
run it — the invariant that makes a run record mean *"this ran in your CI"* is that quoin was
|
|
18
|
-
not the thing running it.
|
|
19
|
-
|
|
20
|
-
## The artifact
|
|
21
|
-
|
|
22
|
-
A `SpecReview` with `analysis: evidence`, at `reviews/YY-MM-DD-<slug>.md`. One findings row
|
|
23
|
-
per obligation **not served**, and none for the ones that were — a review listing every
|
|
24
|
-
success is a review nobody reads to the end.
|
|
25
|
-
|
|
26
|
-
```markdown
|
|
27
|
-
| ID | Severity | Summary | Refs |
|
|
28
|
-
|----|----------|---------|------|
|
|
29
|
-
| FND-001 | high | This repository has no fuzz harness; 6 Fuzz-kind obligations cannot be materialized. Nothing was installed. | Cargo.toml |
|
|
30
|
-
| FND-002 | medium | NFR-003-M-1 names no groundable entry point: no function in `src/` takes arbitrary bytes. | NFR-003-M-1 |
|
|
31
|
-
| FND-003 | low | FR-012-AC-2 is authored `fuzzing` but describes an ordering, not an input surface. The method looks wrong. | FR-012-AC-2 |
|
|
32
|
-
```
|
|
33
|
-
|
|
34
|
-
Severities, and why:
|
|
35
|
-
|
|
36
|
-
- **high** — no harness. Every Fuzz-kind obligation in the repository is unmaterializable, and
|
|
37
|
-
the decision to change that is the owner's.
|
|
38
|
-
- **medium** — ungrounded entry point. A gap in the spec or the code, one obligation each.
|
|
39
|
-
- **low** — a method that looks wrong for its obligation. Advisory; the author decides.
|
|
40
|
-
|
|
41
|
-
## Report counts, not a grade
|
|
42
|
-
|
|
43
|
-
*"6 of 9 obligations produced targets"* is data. **"67% fuzz coverage" is a verdict**, and
|
|
44
|
-
this skill emits none — no threshold, no grade, no pass/fail (FR-038-AC-9).
|
|
45
|
-
|
|
46
|
-
The same rule bars rewording. Where a requirement is genuinely unfuzzable as stated, that is
|
|
47
|
-
a finding for a human, not an edit for this skill to make.
|
|
48
|
-
|
|
49
|
-
## Validate before finishing
|
|
50
|
-
|
|
51
|
-
```
|
|
52
|
-
quire validate --scope <repo> "reviews/**/*.md"
|
|
53
|
-
```
|
|
54
|
-
|
|
55
|
-
Fix any frontmatter, `analysis` enum or findings-table error before reporting the run
|
|
56
|
-
complete. A review that does not validate is not an artifact; it is a file.
|
|
@@ -1,46 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: spec-ideation
|
|
3
|
-
description: Use for loose, exploratory specification drafting before formal authoring, review, matrix, or planning work.
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# Spec Ideation
|
|
7
|
-
|
|
8
|
-
## Mode
|
|
9
|
-
|
|
10
|
-
This is a config-only skill. Do not create workflow state, call workflow
|
|
11
|
-
commands, or enforce phase gates while using it.
|
|
12
|
-
|
|
13
|
-
## Framing Moves
|
|
14
|
-
|
|
15
|
-
- State the problem in concrete user-facing terms.
|
|
16
|
-
- Separate users, operators, and system actors.
|
|
17
|
-
- Draft candidate features as options, not commitments.
|
|
18
|
-
- Name non-goals early when they protect scope.
|
|
19
|
-
- Convert uncertainty into open questions instead of blocking progress.
|
|
20
|
-
- Define success criteria that can later become evidence targets.
|
|
21
|
-
|
|
22
|
-
## Draft Outline
|
|
23
|
-
|
|
24
|
-
```markdown
|
|
25
|
-
# Draft Spec
|
|
26
|
-
|
|
27
|
-
## Problem
|
|
28
|
-
|
|
29
|
-
## Users And Actors
|
|
30
|
-
|
|
31
|
-
## Goals
|
|
32
|
-
|
|
33
|
-
## Non-Goals
|
|
34
|
-
|
|
35
|
-
## Candidate Features
|
|
36
|
-
|
|
37
|
-
## Open Questions
|
|
38
|
-
|
|
39
|
-
## Success Criteria
|
|
40
|
-
```
|
|
41
|
-
|
|
42
|
-
## Promotion Signal
|
|
43
|
-
|
|
44
|
-
Recommend promotion to `specify` when the draft has a clear problem, named
|
|
45
|
-
users or actors, scoped goals and non-goals, and at least one success criterion
|
|
46
|
-
that can be verified.
|
|
@@ -1,62 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: spec-integrity-analysis
|
|
3
|
-
description: Perform quality gate analysis on ISO-style specifications to ensure completeness, consistency, and atomicity.
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# Specification Integrity Analysis
|
|
7
|
-
|
|
8
|
-
This skill performs a quality gate analysis on specifications (User Stories, FR/SR, StR, NFR) before task generation.
|
|
9
|
-
|
|
10
|
-
## Process
|
|
11
|
-
|
|
12
|
-
1. **Completeness Analysis**:
|
|
13
|
-
- Verify every User Story (US) maps to >= 1 Functional/System Requirement (FR/SR).
|
|
14
|
-
- Verify every FR/SR maps to >= 1 Stakeholder Requirement (StR).
|
|
15
|
-
- Verify every FR/SR maps to >= 1 verification method.
|
|
16
|
-
- Verify every NFR is explicitly scoped and referenced by affected FR/SR.
|
|
17
|
-
- **Deliverable**: Traceability matrix (US -> FR/SR -> StR -> Verification).
|
|
18
|
-
|
|
19
|
-
2. **Consistency & Conflict Analysis**:
|
|
20
|
-
- Identify contradictory constraints (e.g., latency vs security).
|
|
21
|
-
- Identify duplicated requirements with different wording.
|
|
22
|
-
- Identify hidden assumptions embedded in prose.
|
|
23
|
-
- **Rule**: No requirement may have more than one valid interpretation.
|
|
24
|
-
|
|
25
|
-
### Hidden Assumption Probes
|
|
26
|
-
|
|
27
|
-
For every FR, explicitly check for these patterns:
|
|
28
|
-
|
|
29
|
-
| Pattern | Probe Question |
|
|
30
|
-
|---------|---------------|
|
|
31
|
-
| FR delegates to an external CLI (git, gh, cookiecutter, etc.) | Is there an NFR declaring the tool's minimum version, detection method, and user-facing error when absent? |
|
|
32
|
-
| FR performs a lookup over multiple sources (registries, plugins, taps) | Is there an explicit tie-breaking policy when two sources return the same key? (first-wins, last-wins, error, merge — must be a stated decision) |
|
|
33
|
-
| FR calls an external API that returns paginated results | Does an NFR state whether full enumeration is required? If a cap is acceptable, is it documented as a known limitation? |
|
|
34
|
-
| FR calls an external API in a loop or concurrently | Does an NFR declare max concurrency, rate limit awareness, retry policy, and that errors must surface (not be silently swallowed)? |
|
|
35
|
-
| FR involves a scaffolding or generation command | Are both an interactive mode (human at terminal) and a scripted/CI mode explicitly specified with their flags? |
|
|
36
|
-
| FR calls an authenticated external API | Does an NFR declare the required auth scopes and mandate a clear user-facing error when scope is insufficient (not silent empty results)? |
|
|
37
|
-
| FR depends on a package or service not yet implemented | Is the interim fallback and eventual resolution chain documented? Is the hardcoded default traceable to a known stub? |
|
|
38
|
-
|
|
39
|
-
3. **Atomicity & Testability Analysis**:
|
|
40
|
-
- Ensure each FR/SR/StR defines a *single* behavior/obligation.
|
|
41
|
-
- Ensure behavior is externally observable.
|
|
42
|
-
- Ensure behavior is verifiable by test, inspection, analysis, or demonstration.
|
|
43
|
-
- **Action**: Flag non-testable requirements for rewriting or splitting.
|
|
44
|
-
|
|
45
|
-
## Failure Domain Check
|
|
46
|
-
Before finalizing, verify against `spec-failure-domain-analysis`:
|
|
47
|
-
- Extension failures, Identity keys, Evaluation purity, Topological robustness.
|
|
48
|
-
|
|
49
|
-
## Output contract
|
|
50
|
-
|
|
51
|
-
This skill emits one **`SpecReview`** under `reviews/YY-MM-DD-<slug>.md` with
|
|
52
|
-
`analysis: integrity` in its frontmatter.
|
|
53
|
-
|
|
54
|
-
Stated here because nothing checked it. The module declares an `analysis`
|
|
55
|
-
vocabulary of eleven values; five of them named a skill that never said it
|
|
56
|
-
emitted under them, so a skill and its declared output were unlinked and drift
|
|
57
|
-
between the two was invisible. `tests/skill-contracts.test.ts` now asserts the
|
|
58
|
-
pairing in both directions.
|
|
59
|
-
|
|
60
|
-
The document must carry a `## Summary` and a `## Findings` table — the two
|
|
61
|
-
sections `SpecReview`'s `body_extraction` requires — and must pass
|
|
62
|
-
`quire validate`.
|