@agent-ix/quoin 0.21.9 → 0.23.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/plugin.json +1 -1
- package/.codex-plugin/plugin.json +1 -1
- package/default-modules.yaml +18 -2
- package/dist/{advisor-BiKhR9Yp.js → advisor-B0rESCx1.js} +1 -1
- package/dist/auditor/audit.d.ts +23 -18
- package/dist/auditor/audit.d.ts.map +1 -1
- package/dist/auditor/index.d.ts +2 -1
- package/dist/auditor/index.d.ts.map +1 -1
- package/dist/{auditor-ww0MC62a.js → auditor-Dd3i9Aqx.js} +82 -65
- package/dist/{base-W7vrLi5E.js → base-gAClyCNd.js} +1 -1
- package/dist/change-assurance/attestations.d.ts +7 -0
- package/dist/change-assurance/attestations.d.ts.map +1 -0
- package/dist/change-assurance/index.d.ts +14 -0
- package/dist/change-assurance/index.d.ts.map +1 -0
- package/dist/change-assurance/integrity.d.ts +11 -0
- package/dist/change-assurance/integrity.d.ts.map +1 -0
- package/dist/change-assurance/records.d.ts +22 -0
- package/dist/change-assurance/records.d.ts.map +1 -0
- package/dist/change-assurance/schema-assets.d.ts +8 -0
- package/dist/change-assurance/schema-assets.d.ts.map +1 -0
- package/dist/change-assurance/store.d.ts +18 -0
- package/dist/change-assurance/store.d.ts.map +1 -0
- package/dist/change-assurance/types.d.ts +180 -0
- package/dist/change-assurance/types.d.ts.map +1 -0
- package/dist/change-assurance/verify.d.ts +4 -0
- package/dist/change-assurance/verify.d.ts.map +1 -0
- package/dist/change-assurance-CyKLPeKa.js +1236 -0
- package/dist/cli.js +1 -1
- package/dist/commands/advise.js +27 -26
- package/dist/commands/assurance.d.ts.map +1 -1
- package/dist/commands/assurance.js +84 -61
- package/dist/commands/catalog/list.js +2 -2
- package/dist/commands/catalog/methods.js +3 -3
- package/dist/commands/catalog/show.js +2 -2
- package/dist/commands/catalog/validate.js +2 -2
- package/dist/commands/change-assurance/common.d.ts +37 -0
- package/dist/commands/change-assurance/common.d.ts.map +1 -0
- package/dist/commands/change-assurance/index.d.ts +8 -0
- package/dist/commands/change-assurance/index.d.ts.map +1 -0
- package/dist/commands/change-assurance/index.js +12 -0
- package/dist/commands/change-assurance/intake.d.ts +15 -0
- package/dist/commands/change-assurance/intake.d.ts.map +1 -0
- package/dist/commands/change-assurance/intake.js +53 -0
- package/dist/commands/change-assurance/receipt.d.ts +21 -0
- package/dist/commands/change-assurance/receipt.d.ts.map +1 -0
- package/dist/commands/change-assurance/receipt.js +99 -0
- package/dist/commands/change-assurance/recover.d.ts +13 -0
- package/dist/commands/change-assurance/recover.d.ts.map +1 -0
- package/dist/commands/change-assurance/recover.js +29 -0
- package/dist/commands/change-assurance/schema.d.ts +13 -0
- package/dist/commands/change-assurance/schema.d.ts.map +1 -0
- package/dist/commands/change-assurance/schema.js +40 -0
- package/dist/commands/change-assurance/seal-attestation.d.ts +15 -0
- package/dist/commands/change-assurance/seal-attestation.d.ts.map +1 -0
- package/dist/commands/change-assurance/seal-attestation.js +58 -0
- package/dist/commands/change-assurance/seal-record.d.ts +14 -0
- package/dist/commands/change-assurance/seal-record.d.ts.map +1 -0
- package/dist/commands/change-assurance/seal-record.js +53 -0
- package/dist/commands/change-assurance/verify-receipt.d.ts +13 -0
- package/dist/commands/change-assurance/verify-receipt.d.ts.map +1 -0
- package/dist/commands/change-assurance/verify-receipt.js +41 -0
- package/dist/commands/completeness.js +2 -2
- package/dist/commands/config/doctor.d.ts.map +1 -1
- package/dist/commands/config/doctor.js +3 -3
- package/dist/commands/config/edit.d.ts.map +1 -1
- package/dist/commands/config/edit.js +3 -3
- package/dist/commands/config/get.js +1 -1
- package/dist/commands/config/set.js +1 -1
- package/dist/commands/evidence/affirm.js +17 -16
- package/dist/commands/evidence/audit.d.ts.map +1 -1
- package/dist/commands/evidence/audit.js +55 -43
- package/dist/commands/evidence/baseline.d.ts.map +1 -1
- package/dist/commands/evidence/baseline.js +50 -40
- package/dist/commands/evidence/gc.js +3 -2
- package/dist/commands/evidence/index.js +1 -1
- package/dist/commands/evidence/inspect-mocks.d.ts +16 -0
- package/dist/commands/evidence/inspect-mocks.d.ts.map +1 -0
- package/dist/commands/evidence/inspect-mocks.js +49 -0
- package/dist/commands/evidence/record.d.ts +1 -0
- package/dist/commands/evidence/record.d.ts.map +1 -1
- package/dist/commands/evidence/record.js +48 -33
- package/dist/commands/graph/change-impact.d.ts +16 -0
- package/dist/commands/graph/change-impact.d.ts.map +1 -0
- package/dist/commands/graph/change-impact.js +29 -0
- package/dist/commands/graph/churn.d.ts +14 -0
- package/dist/commands/graph/churn.d.ts.map +1 -0
- package/dist/commands/graph/churn.js +15 -0
- package/dist/commands/graph/common.d.ts +16 -0
- package/dist/commands/graph/common.d.ts.map +1 -0
- package/dist/commands/graph/fan-out.d.ts +14 -0
- package/dist/commands/graph/fan-out.d.ts.map +1 -0
- package/dist/commands/graph/fan-out.js +15 -0
- package/dist/commands/graph/index.d.ts +8 -0
- package/dist/commands/graph/index.d.ts.map +1 -0
- package/dist/commands/graph/index.js +12 -0
- package/dist/commands/matrix.js +1 -1
- package/dist/commands/measurement/index.d.ts +7 -0
- package/dist/commands/measurement/index.d.ts.map +1 -0
- package/dist/commands/measurement/index.js +11 -0
- package/dist/commands/measurement/intervention.d.ts +11 -0
- package/dist/commands/measurement/intervention.d.ts.map +1 -0
- package/dist/commands/measurement/intervention.js +31 -0
- package/dist/commands/measurement/operational-release.d.ts +11 -0
- package/dist/commands/measurement/operational-release.d.ts.map +1 -0
- package/dist/commands/measurement/operational-release.js +31 -0
- package/dist/commands/measurement/record.d.ts +10 -0
- package/dist/commands/measurement/record.d.ts.map +1 -0
- package/dist/commands/measurement/record.js +36 -0
- package/dist/commands/module/ensure-defaults.js +3 -3
- package/dist/commands/module/install.js +2 -2
- package/dist/commands/module/list.js +2 -2
- package/dist/commands/module/remove.js +2 -2
- package/dist/commands/report.d.ts +19 -0
- package/dist/commands/report.d.ts.map +1 -0
- package/dist/commands/report.js +96 -0
- package/dist/commands/review.js +1 -1
- package/dist/commands/to-plan.js +1 -1
- package/dist/commands/update.js +2 -2
- package/dist/commands/validate.d.ts +13 -0
- package/dist/commands/validate.d.ts.map +1 -0
- package/dist/commands/validate.js +123 -0
- package/dist/commands/write.js +3 -3
- package/dist/common-B1ZJ8CSO.js +36 -0
- package/dist/common-DTrmnvL-.js +35 -0
- package/dist/{completeness-BQDxME0a.js → completeness-BzBuNq6w.js} +1 -1
- package/dist/evidence/adapters/contract-conformance.d.ts +16 -0
- package/dist/evidence/adapters/contract-conformance.d.ts.map +1 -0
- package/dist/evidence/adapters/differential-report.d.ts +18 -0
- package/dist/evidence/adapters/differential-report.d.ts.map +1 -0
- package/dist/evidence/adapters/registry.d.ts.map +1 -1
- package/dist/evidence/adapters/types.d.ts +31 -0
- package/dist/evidence/adapters/types.d.ts.map +1 -1
- package/dist/evidence/index.d.ts +7 -3
- package/dist/evidence/index.d.ts.map +1 -1
- package/dist/evidence/mock-inspection.d.ts +16 -0
- package/dist/evidence/mock-inspection.d.ts.map +1 -0
- package/dist/evidence/store.d.ts +11 -1
- package/dist/evidence/store.d.ts.map +1 -1
- package/dist/evidence/types.d.ts +31 -0
- package/dist/evidence/types.d.ts.map +1 -1
- package/dist/evidence-OyqpqHLS.js +614 -0
- package/dist/{flow-command-C_dUJNm-.js → flow-command-CCRTE5Oe.js} +7 -7
- package/dist/graph-analysis/analysis.d.ts +106 -0
- package/dist/graph-analysis/analysis.d.ts.map +1 -0
- package/dist/graph-analysis/index.d.ts +6 -0
- package/dist/graph-analysis/index.d.ts.map +1 -0
- package/dist/graph-analysis/input.d.ts +33 -0
- package/dist/graph-analysis/input.d.ts.map +1 -0
- package/dist/graph-analysis/load.d.ts +21 -0
- package/dist/graph-analysis/load.d.ts.map +1 -0
- package/dist/graph-analysis/render.d.ts +4 -0
- package/dist/graph-analysis/render.d.ts.map +1 -0
- package/dist/graph-analysis-IWaoJJSN.js +657 -0
- package/dist/index.d.ts +2 -0
- package/dist/index.d.ts.map +1 -1
- package/dist/index.js +11 -8
- package/dist/measurement/agent-eval-intervention.d.ts +6 -0
- package/dist/measurement/agent-eval-intervention.d.ts.map +1 -0
- package/dist/measurement/atomic-file.d.ts +5 -0
- package/dist/measurement/atomic-file.d.ts.map +1 -0
- package/dist/measurement/compare.d.ts +4 -0
- package/dist/measurement/compare.d.ts.map +1 -0
- package/dist/measurement/date-time.d.ts +3 -0
- package/dist/measurement/date-time.d.ts.map +1 -0
- package/dist/measurement/github-release-operational.d.ts +7 -0
- package/dist/measurement/github-release-operational.d.ts.map +1 -0
- package/dist/measurement/graph-adapters.d.ts +304 -0
- package/dist/measurement/graph-adapters.d.ts.map +1 -0
- package/dist/measurement/graph-portfolio-load.d.ts +3 -0
- package/dist/measurement/graph-portfolio-load.d.ts.map +1 -0
- package/dist/measurement/graph-portfolio.d.ts +158 -0
- package/dist/measurement/graph-portfolio.d.ts.map +1 -0
- package/dist/measurement/index.d.ts +22 -0
- package/dist/measurement/index.d.ts.map +1 -0
- package/dist/measurement/intervention-report.d.ts +24 -0
- package/dist/measurement/intervention-report.d.ts.map +1 -0
- package/dist/measurement/intervention-schema.d.ts +144 -0
- package/dist/measurement/intervention-schema.d.ts.map +1 -0
- package/dist/measurement/intervention-types.d.ts +105 -0
- package/dist/measurement/intervention-types.d.ts.map +1 -0
- package/dist/measurement/intervention.d.ts +16 -0
- package/dist/measurement/intervention.d.ts.map +1 -0
- package/dist/measurement/operational-report.d.ts +17 -0
- package/dist/measurement/operational-report.d.ts.map +1 -0
- package/dist/measurement/operational-schema.d.ts +461 -0
- package/dist/measurement/operational-schema.d.ts.map +1 -0
- package/dist/measurement/operational-types.d.ts +121 -0
- package/dist/measurement/operational-types.d.ts.map +1 -0
- package/dist/measurement/operational.d.ts +13 -0
- package/dist/measurement/operational.d.ts.map +1 -0
- package/dist/measurement/plans.d.ts +6 -0
- package/dist/measurement/plans.d.ts.map +1 -0
- package/dist/measurement/portfolio.d.ts +54 -0
- package/dist/measurement/portfolio.d.ts.map +1 -0
- package/dist/measurement/profiles.d.ts +9 -0
- package/dist/measurement/profiles.d.ts.map +1 -0
- package/dist/measurement/report.d.ts +48 -0
- package/dist/measurement/report.d.ts.map +1 -0
- package/dist/measurement/schemas/operational-evidence-v1.schema.json.d.ts +384 -0
- package/dist/measurement/store.d.ts +14 -0
- package/dist/measurement/store.d.ts.map +1 -0
- package/dist/measurement/types.d.ts +85 -0
- package/dist/measurement/types.d.ts.map +1 -0
- package/dist/measurement/validate.d.ts +9 -0
- package/dist/measurement/validate.d.ts.map +1 -0
- package/dist/measurement-j8sDSqx5.js +2980 -0
- package/dist/{modules-Cn9Htfp0.js → modules-DDQkKC4l.js} +2 -2
- package/dist/{plugins-Byi1bWLD.js → plugins-CHpYhpEI.js} +1 -1
- package/dist/quire/assurance.d.ts +109 -0
- package/dist/quire/assurance.d.ts.map +1 -0
- package/dist/quire/contract.d.ts +12 -12
- package/dist/quire/contract.d.ts.map +1 -1
- package/dist/quire/exec.d.ts +10 -0
- package/dist/quire/exec.d.ts.map +1 -1
- package/dist/quire/index.d.ts +4 -3
- package/dist/quire/index.d.ts.map +1 -1
- package/dist/quire/types.d.ts +119 -1
- package/dist/quire/types.d.ts.map +1 -1
- package/dist/quire/validate.d.ts +5 -0
- package/dist/quire/validate.d.ts.map +1 -1
- package/dist/{quire-UzoK3Azf.js → quire-BsVj1xIR.js} +533 -499
- package/dist/schema-assets-HZWo_iFN.js +233 -0
- package/dist/schemas/assurance-v1.schema.json +225 -0
- package/dist/schemas/change-assurance-record-v1.schema.json +234 -0
- package/dist/schemas/coverage-v1.schema.json +919 -105
- package/dist/schemas/operational-evidence-v1.schema.json +381 -0
- package/dist/schemas/proof-attestation-v1.schema.json +96 -0
- package/dist/schemas/properties-v1.schema.json +25 -0
- package/dist/schemas/verification-receipt-v1.schema.json +208 -0
- package/dist/validators/gates.d.ts +18 -0
- package/dist/validators/gates.d.ts.map +1 -0
- package/dist/validators/index.d.ts +2 -0
- package/dist/validators/index.d.ts.map +1 -0
- package/dist/{version-BMXhyIie.js → version-CMxMIh5g.js} +1 -1
- package/dist/{write-BDxILTLC.js → write-CGTI0dRO.js} +1 -1
- package/package.json +26 -16
- package/skills/assurance-status-report/SKILL.md +135 -0
- package/skills/assurance-status-report/references/report-contract.md +110 -0
- package/skills/gap-analysis/references/step-4-underspecified-code.md +36 -7
- package/skills/gap-analysis/references/step-5-semantic-review.md +2 -2
- package/skills/gap-analysis/references/step-6-specreview-artifact.md +6 -5
- package/skills/spec-architecture-evaluation/SKILL.md +30 -0
- package/skills/spec-fuzz/SKILL.md +7 -6
- package/dist/evidence-BA5vyZJk.js +0 -603
|
@@ -0,0 +1,208 @@
|
|
|
1
|
+
{
|
|
2
|
+
"$schema": "https://json-schema.org/draft/2020-12/schema",
|
|
3
|
+
"$id": "https://agent-ix.github.io/quoin/schemas/verification-receipt-v1.schema.json",
|
|
4
|
+
"title": "VerificationReceiptV1",
|
|
5
|
+
"type": "object",
|
|
6
|
+
"required": [
|
|
7
|
+
"schema_version",
|
|
8
|
+
"record_type",
|
|
9
|
+
"digest",
|
|
10
|
+
"record_digest",
|
|
11
|
+
"candidate_revision",
|
|
12
|
+
"decision_event",
|
|
13
|
+
"parent_digests",
|
|
14
|
+
"checks",
|
|
15
|
+
"proofs",
|
|
16
|
+
"unknowns",
|
|
17
|
+
"outcome",
|
|
18
|
+
"reasons"
|
|
19
|
+
],
|
|
20
|
+
"properties": {
|
|
21
|
+
"schema_version": { "const": 1 },
|
|
22
|
+
"record_type": { "const": "verification_receipt" },
|
|
23
|
+
"digest": { "$ref": "#/$defs/digest" },
|
|
24
|
+
"record_digest": { "$ref": "#/$defs/digest" },
|
|
25
|
+
"candidate_revision": { "type": "string", "minLength": 1 },
|
|
26
|
+
"decision_event": {
|
|
27
|
+
"anyOf": [{ "$ref": "#/$defs/decision_event" }, { "type": "null" }]
|
|
28
|
+
},
|
|
29
|
+
"parent_digests": {
|
|
30
|
+
"type": "array",
|
|
31
|
+
"items": { "$ref": "#/$defs/digest" }
|
|
32
|
+
},
|
|
33
|
+
"checks": {
|
|
34
|
+
"type": "object",
|
|
35
|
+
"required": ["record", "lineage", "review", "impact"],
|
|
36
|
+
"properties": {
|
|
37
|
+
"record": { "$ref": "#/$defs/check" },
|
|
38
|
+
"lineage": { "$ref": "#/$defs/check" },
|
|
39
|
+
"review": { "$ref": "#/$defs/check" },
|
|
40
|
+
"impact": { "$ref": "#/$defs/check" }
|
|
41
|
+
},
|
|
42
|
+
"additionalProperties": false
|
|
43
|
+
},
|
|
44
|
+
"proofs": {
|
|
45
|
+
"type": "array",
|
|
46
|
+
"items": { "$ref": "#/$defs/proof_receipt" }
|
|
47
|
+
},
|
|
48
|
+
"unknowns": {
|
|
49
|
+
"type": "array",
|
|
50
|
+
"items": {
|
|
51
|
+
"type": "object",
|
|
52
|
+
"required": ["id", "disposition"],
|
|
53
|
+
"properties": {
|
|
54
|
+
"id": { "$ref": "#/$defs/identity" },
|
|
55
|
+
"disposition": {
|
|
56
|
+
"type": "string",
|
|
57
|
+
"enum": ["open", "accepted", "deferred", "resolved"]
|
|
58
|
+
}
|
|
59
|
+
},
|
|
60
|
+
"additionalProperties": false
|
|
61
|
+
}
|
|
62
|
+
},
|
|
63
|
+
"outcome": { "$ref": "#/$defs/outcome" },
|
|
64
|
+
"reasons": {
|
|
65
|
+
"type": "array",
|
|
66
|
+
"items": { "$ref": "#/$defs/reason" }
|
|
67
|
+
}
|
|
68
|
+
},
|
|
69
|
+
"$defs": {
|
|
70
|
+
"identity": {
|
|
71
|
+
"type": "string",
|
|
72
|
+
"pattern": "^[A-Za-z0-9][A-Za-z0-9._:/-]{0,255}$"
|
|
73
|
+
},
|
|
74
|
+
"digest": {
|
|
75
|
+
"type": "string",
|
|
76
|
+
"pattern": "^[a-f0-9]{64}$"
|
|
77
|
+
},
|
|
78
|
+
"outcome": {
|
|
79
|
+
"type": "string",
|
|
80
|
+
"enum": ["valid", "invalid", "incomplete"]
|
|
81
|
+
},
|
|
82
|
+
"reason": {
|
|
83
|
+
"type": "string",
|
|
84
|
+
"enum": [
|
|
85
|
+
"schema_invalid",
|
|
86
|
+
"record_digest_mismatch",
|
|
87
|
+
"parent_missing",
|
|
88
|
+
"parent_invalid",
|
|
89
|
+
"parent_mismatch",
|
|
90
|
+
"revision_gap",
|
|
91
|
+
"impact_incomplete",
|
|
92
|
+
"impact_truncated",
|
|
93
|
+
"unresolved_unknown",
|
|
94
|
+
"decision_missing",
|
|
95
|
+
"event_chain_missing",
|
|
96
|
+
"event_chain_invalid",
|
|
97
|
+
"decision_mismatch",
|
|
98
|
+
"review_rejected",
|
|
99
|
+
"review_revision_requested",
|
|
100
|
+
"attestation_missing",
|
|
101
|
+
"attestation_schema_invalid",
|
|
102
|
+
"attestation_digest_mismatch",
|
|
103
|
+
"output_missing",
|
|
104
|
+
"output_digest_mismatch",
|
|
105
|
+
"record_binding_mismatch",
|
|
106
|
+
"candidate_revision_mismatch",
|
|
107
|
+
"proof_id_mismatch",
|
|
108
|
+
"command_mismatch",
|
|
109
|
+
"tool_identity_mismatch",
|
|
110
|
+
"configuration_mismatch",
|
|
111
|
+
"result_failed",
|
|
112
|
+
"result_unavailable",
|
|
113
|
+
"result_not_computed",
|
|
114
|
+
"evidence_stale",
|
|
115
|
+
"evidence_suspect",
|
|
116
|
+
"evidence_vacuous",
|
|
117
|
+
"evidence_unrelated",
|
|
118
|
+
"audit_finding",
|
|
119
|
+
"audit_not_evaluated"
|
|
120
|
+
]
|
|
121
|
+
},
|
|
122
|
+
"check": {
|
|
123
|
+
"type": "object",
|
|
124
|
+
"required": ["outcome", "reasons"],
|
|
125
|
+
"properties": {
|
|
126
|
+
"outcome": { "$ref": "#/$defs/outcome" },
|
|
127
|
+
"reasons": {
|
|
128
|
+
"type": "array",
|
|
129
|
+
"items": { "$ref": "#/$defs/reason" }
|
|
130
|
+
}
|
|
131
|
+
},
|
|
132
|
+
"additionalProperties": false
|
|
133
|
+
},
|
|
134
|
+
"decision_event": {
|
|
135
|
+
"type": "object",
|
|
136
|
+
"required": [
|
|
137
|
+
"run_id",
|
|
138
|
+
"event_id",
|
|
139
|
+
"event_hash",
|
|
140
|
+
"chain_tail_hash",
|
|
141
|
+
"recorded_actor",
|
|
142
|
+
"decision"
|
|
143
|
+
],
|
|
144
|
+
"properties": {
|
|
145
|
+
"run_id": { "$ref": "#/$defs/identity" },
|
|
146
|
+
"event_id": { "$ref": "#/$defs/identity" },
|
|
147
|
+
"event_hash": { "$ref": "#/$defs/digest" },
|
|
148
|
+
"chain_tail_hash": { "$ref": "#/$defs/digest" },
|
|
149
|
+
"recorded_actor": { "type": "string", "minLength": 1 },
|
|
150
|
+
"decision": {
|
|
151
|
+
"type": "string",
|
|
152
|
+
"enum": ["approved", "rejected", "revise"]
|
|
153
|
+
}
|
|
154
|
+
},
|
|
155
|
+
"additionalProperties": false
|
|
156
|
+
},
|
|
157
|
+
"audit_finding": {
|
|
158
|
+
"type": "object",
|
|
159
|
+
"required": ["obligation_id", "kind"],
|
|
160
|
+
"properties": {
|
|
161
|
+
"obligation_id": { "$ref": "#/$defs/identity" },
|
|
162
|
+
"kind": { "type": "string", "minLength": 1 }
|
|
163
|
+
},
|
|
164
|
+
"additionalProperties": false
|
|
165
|
+
},
|
|
166
|
+
"proof_receipt": {
|
|
167
|
+
"type": "object",
|
|
168
|
+
"required": [
|
|
169
|
+
"proof_id",
|
|
170
|
+
"obligation_ids",
|
|
171
|
+
"attestation_digest",
|
|
172
|
+
"retained_output_digest",
|
|
173
|
+
"audit_report_digest",
|
|
174
|
+
"audit_findings",
|
|
175
|
+
"outcome",
|
|
176
|
+
"reasons"
|
|
177
|
+
],
|
|
178
|
+
"properties": {
|
|
179
|
+
"proof_id": { "$ref": "#/$defs/identity" },
|
|
180
|
+
"obligation_ids": {
|
|
181
|
+
"type": "array",
|
|
182
|
+
"minItems": 1,
|
|
183
|
+
"items": { "$ref": "#/$defs/identity" }
|
|
184
|
+
},
|
|
185
|
+
"attestation_digest": {
|
|
186
|
+
"anyOf": [{ "$ref": "#/$defs/digest" }, { "type": "null" }]
|
|
187
|
+
},
|
|
188
|
+
"retained_output_digest": {
|
|
189
|
+
"anyOf": [{ "$ref": "#/$defs/digest" }, { "type": "null" }]
|
|
190
|
+
},
|
|
191
|
+
"audit_report_digest": {
|
|
192
|
+
"anyOf": [{ "$ref": "#/$defs/digest" }, { "type": "null" }]
|
|
193
|
+
},
|
|
194
|
+
"audit_findings": {
|
|
195
|
+
"type": "array",
|
|
196
|
+
"items": { "$ref": "#/$defs/audit_finding" }
|
|
197
|
+
},
|
|
198
|
+
"outcome": { "$ref": "#/$defs/outcome" },
|
|
199
|
+
"reasons": {
|
|
200
|
+
"type": "array",
|
|
201
|
+
"items": { "$ref": "#/$defs/reason" }
|
|
202
|
+
}
|
|
203
|
+
},
|
|
204
|
+
"additionalProperties": false
|
|
205
|
+
}
|
|
206
|
+
},
|
|
207
|
+
"additionalProperties": false
|
|
208
|
+
}
|
|
@@ -0,0 +1,18 @@
|
|
|
1
|
+
export interface EmptyGateFinding {
|
|
2
|
+
kind: "gate-that-gates-nothing";
|
|
3
|
+
obligation: string;
|
|
4
|
+
path: string;
|
|
5
|
+
line: number;
|
|
6
|
+
wiredBy: string;
|
|
7
|
+
summary: string;
|
|
8
|
+
subject: string;
|
|
9
|
+
changeTarget: string;
|
|
10
|
+
remedy: string;
|
|
11
|
+
}
|
|
12
|
+
/**
|
|
13
|
+
* Find a declared, wired shell gate that counts forbidden matches but never
|
|
14
|
+
* asserts the count. The three-way join is deliberate: script text alone
|
|
15
|
+
* cannot distinguish a gate from a report (agent-ix/quoin#224).
|
|
16
|
+
*/
|
|
17
|
+
export declare function inspectEmptyGates(repo: string): EmptyGateFinding[];
|
|
18
|
+
//# sourceMappingURL=gates.d.ts.map
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"version":3,"file":"gates.d.ts","sourceRoot":"","sources":["../../src/validators/gates.ts"],"names":[],"mappings":"AAYA,MAAM,WAAW,gBAAgB;IAC/B,IAAI,EAAE,yBAAyB,CAAC;IAChC,UAAU,EAAE,MAAM,CAAC;IACnB,IAAI,EAAE,MAAM,CAAC;IACb,IAAI,EAAE,MAAM,CAAC;IACb,OAAO,EAAE,MAAM,CAAC;IAChB,OAAO,EAAE,MAAM,CAAC;IAChB,OAAO,EAAE,MAAM,CAAC;IAChB,YAAY,EAAE,MAAM,CAAC;IACrB,MAAM,EAAE,MAAM,CAAC;CAChB;AAED;;;;GAIG;AACH,wBAAgB,iBAAiB,CAAC,IAAI,EAAE,MAAM,GAAG,gBAAgB,EAAE,CA4ClE"}
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/validators/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,iBAAiB,EAAE,KAAK,gBAAgB,EAAE,MAAM,YAAY,CAAC"}
|
|
@@ -1,4 +1,4 @@
|
|
|
1
|
-
import { i as e } from "./base-
|
|
1
|
+
import { i as e } from "./base-gAClyCNd.js";
|
|
2
2
|
import { n as t, r as n, t as r } from "./config-schema-Dp-vlxuR.js";
|
|
3
3
|
import { ConfigService as i } from "@agent-ix/ix-cli-core";
|
|
4
4
|
import { existsSync as a, readFileSync as o, statSync as s } from "node:fs";
|
package/package.json
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@agent-ix/quoin",
|
|
3
3
|
"description": "Spec-driven development for Claude Code — author validated, ISO/IEC/IEEE 29148-aligned specs, then plan and build against them.",
|
|
4
|
-
"version": "0.
|
|
4
|
+
"version": "0.23.1",
|
|
5
5
|
"license": "AGPL-3.0-or-later",
|
|
6
6
|
"type": "module",
|
|
7
7
|
"files": [
|
|
@@ -36,6 +36,12 @@
|
|
|
36
36
|
"evidence": {
|
|
37
37
|
"description": "The evidence store — what actually ran, and against which statement (record, affirm, gc)."
|
|
38
38
|
},
|
|
39
|
+
"graph": {
|
|
40
|
+
"description": "Read-only evidence-graph analysis views."
|
|
41
|
+
},
|
|
42
|
+
"measurement": {
|
|
43
|
+
"description": "Record plan-validated QA measurements as atomic producer collections."
|
|
44
|
+
},
|
|
39
45
|
"module": {
|
|
40
46
|
"description": "Install and manage user/community spec modules (list, install, remove, ensure-defaults)."
|
|
41
47
|
},
|
|
@@ -76,10 +82,13 @@
|
|
|
76
82
|
"pkg:add": "pnpm add",
|
|
77
83
|
"pkg:add-dev": "pnpm add -D",
|
|
78
84
|
"pkg:update": "pnpm update",
|
|
79
|
-
"pkg:update-latest": "pnpm update --latest",
|
|
80
|
-
"pkg:use-local": "pnpm dlx @agent-ix/js-deps use-local",
|
|
81
|
-
"pkg:use-upstream": "pnpm dlx @agent-ix/js-deps use-upstream",
|
|
82
|
-
"pkg:refresh-local": "pnpm dlx @agent-ix/js-deps refresh-local",
|
|
85
|
+
"experimental:pkg:update-latest": "pnpm update --latest",
|
|
86
|
+
"pkg:use-local": "pnpm dlx @agent-ix/js-deps@0.2.4 use-local",
|
|
87
|
+
"pkg:use-upstream": "pnpm dlx @agent-ix/js-deps@0.2.4 use-upstream",
|
|
88
|
+
"pkg:refresh-local": "pnpm dlx @agent-ix/js-deps@0.2.4 refresh-local",
|
|
89
|
+
"audit:tool-drift": "node scripts/check-tool-drift.mjs",
|
|
90
|
+
"test:tool-drift": "node scripts/check-tool-drift-selftest.mjs",
|
|
91
|
+
"test:verification-stack": "node scripts/verification-stack-selftest.mjs",
|
|
83
92
|
"test-results:summary": "./node_modules/.bin/jest-results summary",
|
|
84
93
|
"test-results:groups": "./node_modules/.bin/jest-results groups",
|
|
85
94
|
"test-results:detail": "./node_modules/.bin/jest-results detail",
|
|
@@ -90,27 +99,28 @@
|
|
|
90
99
|
"typecheck": "tsc --noEmit -p tsconfig.json"
|
|
91
100
|
},
|
|
92
101
|
"dependencies": {
|
|
93
|
-
"@agent-ix/filament-plan-sync": "
|
|
94
|
-
"@agent-ix/ix-cli-core": "
|
|
95
|
-
"@agent-ix/ts-plugin-kit": "
|
|
96
|
-
"@
|
|
97
|
-
"
|
|
98
|
-
"
|
|
99
|
-
"
|
|
102
|
+
"@agent-ix/filament-plan-sync": "0.1.0",
|
|
103
|
+
"@agent-ix/ix-cli-core": "0.12.0",
|
|
104
|
+
"@agent-ix/ts-plugin-kit": "0.2.0",
|
|
105
|
+
"@noble/hashes": "2.2.0",
|
|
106
|
+
"@oclif/core": "4.13.3",
|
|
107
|
+
"ajv": "8.20.0",
|
|
108
|
+
"yaml": "2.9.0",
|
|
109
|
+
"zod": "4.4.3"
|
|
100
110
|
},
|
|
101
111
|
"devDependencies": {
|
|
102
|
-
"@agent-ix/quire-cli": "
|
|
112
|
+
"@agent-ix/quire-cli": "0.30.2",
|
|
103
113
|
"@types/node": "26.1.2",
|
|
104
114
|
"@typescript-eslint/eslint-plugin": "8.66.0",
|
|
105
115
|
"@typescript-eslint/parser": "8.66.0",
|
|
106
116
|
"@vitest/coverage-v8": "4.1.10",
|
|
107
|
-
"add": "
|
|
117
|
+
"add": "2.0.9",
|
|
108
118
|
"eslint": "10.8.0",
|
|
109
119
|
"eslint-plugin-prettier": "5.5.6",
|
|
110
|
-
"fast-check": "
|
|
120
|
+
"fast-check": "4.9.0",
|
|
111
121
|
"pnpm": "11.20.0",
|
|
112
122
|
"prettier": "3.9.6",
|
|
113
|
-
"ts-node": "
|
|
123
|
+
"ts-node": "10.9.2",
|
|
114
124
|
"typescript": "6.0.3",
|
|
115
125
|
"vite": "8.2.0",
|
|
116
126
|
"vite-plugin-dts": "5.0.3",
|
|
@@ -0,0 +1,135 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: assurance-status-report
|
|
3
|
+
description: Produce an evidence-backed status report for a Quoin/Quire epic, phase, or assurance campaign. Use when asked for progress, percent complete, before/after metrics, completed-ticket inventory, open-work classification, or readiness for the next phase. The workflow is read-only and does not comment on, close, or modify tickets or repositories.
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Assurance Status Report
|
|
7
|
+
|
|
8
|
+
Report what the retained evidence proves about a named goal. Use Quoin for
|
|
9
|
+
measurement meaning and history, Quire for producer provenance, git for local
|
|
10
|
+
state, and GitHub for current ticket and promotion state. Do not recreate their
|
|
11
|
+
analysis in the skill.
|
|
12
|
+
|
|
13
|
+
Read [references/report-contract.md](references/report-contract.md) before
|
|
14
|
+
assembling the report.
|
|
15
|
+
|
|
16
|
+
## Boundary
|
|
17
|
+
|
|
18
|
+
This workflow is read-only. It may inspect repositories, retained evidence, and
|
|
19
|
+
remote ticket state. It must not run measurement producers, update baselines,
|
|
20
|
+
modify evidence, push branches, or create/comment/close/reopen issues or pull
|
|
21
|
+
requests unless the user separately authorizes that mutation.
|
|
22
|
+
|
|
23
|
+
A closed ticket is workflow state, not proof of completion. Match each claimed
|
|
24
|
+
result to its acceptance evidence, promoted commit, and relevant current-state
|
|
25
|
+
check.
|
|
26
|
+
|
|
27
|
+
## Inputs
|
|
28
|
+
|
|
29
|
+
Establish these before collecting evidence:
|
|
30
|
+
|
|
31
|
+
- the goal, epic, phase, or campaign being reported;
|
|
32
|
+
- repositories and tickets in scope;
|
|
33
|
+
- work the user explicitly excluded;
|
|
34
|
+
- the baseline and current endpoint; and
|
|
35
|
+
- whether the user also wants an intermediate phase boundary.
|
|
36
|
+
|
|
37
|
+
If no baseline is named, use the earliest retained collection explicitly linked
|
|
38
|
+
by the target epic. Use the latest compatible retained collection as current.
|
|
39
|
+
State that selection instead of silently choosing favorable snapshots.
|
|
40
|
+
|
|
41
|
+
## Collect exact evidence
|
|
42
|
+
|
|
43
|
+
### Repository state
|
|
44
|
+
|
|
45
|
+
For every participating repository, record:
|
|
46
|
+
|
|
47
|
+
```bash
|
|
48
|
+
git rev-parse HEAD
|
|
49
|
+
git status --porcelain
|
|
50
|
+
git remote get-url origin
|
|
51
|
+
```
|
|
52
|
+
|
|
53
|
+
Resolve revisions to full 40-character SHAs. Use the canonical remote and a
|
|
54
|
+
versioned, read-only GitHub query to confirm current default-branch and commit
|
|
55
|
+
reachability, for example:
|
|
56
|
+
|
|
57
|
+
```bash
|
|
58
|
+
gh api --header 'X-GitHub-Api-Version: 2022-11-28' \
|
|
59
|
+
repos/OWNER/REPO/commits/FULL_SHA
|
|
60
|
+
```
|
|
61
|
+
|
|
62
|
+
Validate required response fields rather than assuming a successful command
|
|
63
|
+
returned the requested object. Record dirty, unreachable, ambiguous, or
|
|
64
|
+
wrong-origin state as a limitation; never normalize it to clean.
|
|
65
|
+
|
|
66
|
+
### Tool and measurement state
|
|
67
|
+
|
|
68
|
+
Use existing machine-readable interfaces:
|
|
69
|
+
|
|
70
|
+
```bash
|
|
71
|
+
quoin report --format json
|
|
72
|
+
quoin report --series METRIC --format json
|
|
73
|
+
quoin report --since FULL_BASELINE_REVISION --format json
|
|
74
|
+
quire provenance --json
|
|
75
|
+
```
|
|
76
|
+
|
|
77
|
+
Use `quoin report` to discover active MeasurementPlans and retained values. Use
|
|
78
|
+
the series or comparison view for historical values; do not scrape rendered
|
|
79
|
+
human output when JSON exists. Confirm Quire's provenance schema, full CLI and
|
|
80
|
+
engine revisions, clean state, and required capabilities before attributing a
|
|
81
|
+
measurement to it.
|
|
82
|
+
|
|
83
|
+
Record the exact collection id, timestamp, source revision, corpus revision,
|
|
84
|
+
tool identity/version, configuration digest, definition version, and population
|
|
85
|
+
identity supporting each reported value. If the repository has a verification
|
|
86
|
+
stack attestation, report its lock and executable digests.
|
|
87
|
+
|
|
88
|
+
Do not regenerate evidence merely to answer a status question. A new run changes
|
|
89
|
+
the evidence state and requires separate authorization.
|
|
90
|
+
|
|
91
|
+
### Ticket and promotion state
|
|
92
|
+
|
|
93
|
+
Use versioned read-only GitHub REST or GraphQL queries. For each issue capture at
|
|
94
|
+
least number, title, state, URL, and closed time. For each delivery pull request
|
|
95
|
+
capture state, base/head branches, merge time, merge commit, and URL. Confirm the
|
|
96
|
+
current default-branch SHA separately.
|
|
97
|
+
|
|
98
|
+
Follow relationships from the target epic and its retained implementation
|
|
99
|
+
comments. Do not equate “mentioned nearby” with “child.” Classify every remaining
|
|
100
|
+
item as blocking, non-blocking, downstream, excluded, or unknown and state the
|
|
101
|
+
evidence for that disposition.
|
|
102
|
+
|
|
103
|
+
## Interpret without hiding drift
|
|
104
|
+
|
|
105
|
+
Define every project-specific term before its first use in the metrics section.
|
|
106
|
+
Derive definitions from the active MeasurementPlan or other versioned contract.
|
|
107
|
+
At minimum define any use of finding, controlled case, differential pair,
|
|
108
|
+
localization, L1/L2/L3, actionability, span grounding, safe refusal, Tier 1,
|
|
109
|
+
Tier 2, ratchet, drift mutation, comparability, or fail closed.
|
|
110
|
+
|
|
111
|
+
For every percentage, report its numerator and denominator. Express rate changes
|
|
112
|
+
as percentage points. Compare baseline and current numerically only when their
|
|
113
|
+
definition versions and population identities are compatible. If either moved,
|
|
114
|
+
show both values and explain the change, but mark the delta incomparable.
|
|
115
|
+
|
|
116
|
+
Keep historical metrics visible when a stronger successor exists. Explain why
|
|
117
|
+
the successor is more decision-relevant; do not relabel old evidence under the
|
|
118
|
+
new definition.
|
|
119
|
+
|
|
120
|
+
If the user asks for percent complete, use authored task weights when present.
|
|
121
|
+
Otherwise report the unweighted count of proven-complete in-scope tasks and say
|
|
122
|
+
that this is the method. Present verification and promotion gates separately so
|
|
123
|
+
a high task percentage cannot conceal an unverified result.
|
|
124
|
+
|
|
125
|
+
## Report and stop
|
|
126
|
+
|
|
127
|
+
Follow the ordering in the report contract: status, definitions, metrics,
|
|
128
|
+
completed work, open work, drift controls, limitations, and progress judgment.
|
|
129
|
+
Lead with whether the named goal is complete, progressing, at risk, blocked, or
|
|
130
|
+
not started, but put the glossary before the first detailed metric use.
|
|
131
|
+
|
|
132
|
+
Link to the exact retained collections, issues, pull requests, and promoted
|
|
133
|
+
commits. Distinguish evidence observed now from historical evidence retained by
|
|
134
|
+
the campaign. If required evidence is missing or incompatible, say
|
|
135
|
+
`unknown` or `not_computed` and identify what would resolve it.
|
|
@@ -0,0 +1,110 @@
|
|
|
1
|
+
# Assurance status report contract
|
|
2
|
+
|
|
3
|
+
Use this contract for a detailed report. Short status requests may compress
|
|
4
|
+
sections, but they retain the same evidence and comparison rules.
|
|
5
|
+
|
|
6
|
+
## Evidence states
|
|
7
|
+
|
|
8
|
+
- **Proven:** Direct current or retained evidence satisfies the requirement.
|
|
9
|
+
- **Contradicted:** Direct evidence shows the requirement is not satisfied.
|
|
10
|
+
- **Incomplete:** Some required evidence exists, but the full requirement is not
|
|
11
|
+
demonstrated.
|
|
12
|
+
- **Missing:** No authoritative evidence was found.
|
|
13
|
+
- **Incomparable:** Values exist, but their definitions or populations do not
|
|
14
|
+
permit a numeric delta.
|
|
15
|
+
|
|
16
|
+
Never turn incomplete, missing, or incomparable evidence into zero, green, or
|
|
17
|
+
complete.
|
|
18
|
+
|
|
19
|
+
## Required order
|
|
20
|
+
|
|
21
|
+
### 1. Executive status
|
|
22
|
+
|
|
23
|
+
Name the goal, current disposition, as-of time and timezone, current promoted
|
|
24
|
+
revision, scope boundary, and progress method. Distinguish completion of the
|
|
25
|
+
named phase from progress of the larger program.
|
|
26
|
+
|
|
27
|
+
### 2. Definitions
|
|
28
|
+
|
|
29
|
+
Define each project-specific term before the metrics table. Definitions cite the
|
|
30
|
+
active versioned contract. Prefer plain language, then state the exact counting
|
|
31
|
+
rule where it matters.
|
|
32
|
+
|
|
33
|
+
Examples of distinctions that must remain visible:
|
|
34
|
+
|
|
35
|
+
- localization identifies the correct place; it does not prove the explanation
|
|
36
|
+
or remedy is correct;
|
|
37
|
+
- actionability-field presence does not prove guidance correctness;
|
|
38
|
+
- safe refusal preserves uncertainty and does not count as an exact span;
|
|
39
|
+
- a controlled-corpus result does not estimate ecosystem-wide precision; and
|
|
40
|
+
- a closed ticket does not by itself prove its acceptance criteria.
|
|
41
|
+
|
|
42
|
+
### 3. Metric progression
|
|
43
|
+
|
|
44
|
+
Use a table with these conceptual columns:
|
|
45
|
+
|
|
46
|
+
| Metric | Baseline | Intermediate | Current | Delta | Comparability | Evidence |
|
|
47
|
+
| --- | --- | --- | --- | --- | --- | --- |
|
|
48
|
+
|
|
49
|
+
Every ratio displays `matched/examined` beside the percentage. Each row retains
|
|
50
|
+
the metric definition version and population identity, either inline or in its
|
|
51
|
+
evidence link. Use `—` for a deliberately absent intermediate snapshot and
|
|
52
|
+
`not_computed: REASON` for an unavailable value.
|
|
53
|
+
|
|
54
|
+
Do not calculate a delta when:
|
|
55
|
+
|
|
56
|
+
- the definition version changed;
|
|
57
|
+
- the applicable population was redefined;
|
|
58
|
+
- the source or corpus identity cannot be proved;
|
|
59
|
+
- either value is not computed; or
|
|
60
|
+
- a producer or required capability changed without an accepted comparison.
|
|
61
|
+
|
|
62
|
+
When the population merely grows under the same contract, report both the count
|
|
63
|
+
change and the rate change. A rate decline with a larger numerator can be scope
|
|
64
|
+
growth rather than a product regression; explain which occurred.
|
|
65
|
+
|
|
66
|
+
### 4. Completed work
|
|
67
|
+
|
|
68
|
+
Enumerate every in-scope ticket/task with title, repository, final state, delivery
|
|
69
|
+
PR or commit, and the evidence that proves acceptance. Group by workstream when
|
|
70
|
+
the list is long. Separately enumerate promotion PRs and exact merge commits.
|
|
71
|
+
|
|
72
|
+
### 5. Open work
|
|
73
|
+
|
|
74
|
+
Enumerate unresolved items and assign exactly one disposition:
|
|
75
|
+
|
|
76
|
+
- **blocking:** prevents the named goal;
|
|
77
|
+
- **non-blocking:** retained limitation that does not prevent this goal;
|
|
78
|
+
- **downstream:** belongs to a later goal or phase;
|
|
79
|
+
- **excluded:** explicitly outside the user's scope; or
|
|
80
|
+
- **unknown:** relationship or impact is not proven.
|
|
81
|
+
|
|
82
|
+
Do not omit open work merely because the named phase is complete.
|
|
83
|
+
|
|
84
|
+
### 6. Drift controls
|
|
85
|
+
|
|
86
|
+
Report the guard and its proof for each relevant drift class: repository,
|
|
87
|
+
submodule, tool/engine, executable bytes, package resolution, toolchain, workflow
|
|
88
|
+
action, container, schema, configuration, corpus, metric definition, evidence
|
|
89
|
+
overlay, and promotion topology. Distinguish a guard observed in code from a
|
|
90
|
+
mutation test proving it fails before governed execution.
|
|
91
|
+
|
|
92
|
+
### 7. Limitations and judgment
|
|
93
|
+
|
|
94
|
+
State remaining evidence limitations, then answer whether the effort is moving
|
|
95
|
+
toward the goal and why. Use one of:
|
|
96
|
+
|
|
97
|
+
- **complete** — every requirement is proven and no in-scope work remains;
|
|
98
|
+
- **on track** — incomplete, with no current blocking contradiction;
|
|
99
|
+
- **at risk** — progress exists, but a named unresolved risk threatens the goal;
|
|
100
|
+
- **blocked** — a named blocker prevents meaningful progress; or
|
|
101
|
+
- **not started** — no implementation evidence exists.
|
|
102
|
+
|
|
103
|
+
Close with the next decision or evidence-gathering point. Do not suggest starting
|
|
104
|
+
explicitly excluded work.
|
|
105
|
+
|
|
106
|
+
## Read-only rule
|
|
107
|
+
|
|
108
|
+
Producing the report does not authorize ticket comments, issue state changes,
|
|
109
|
+
branch updates, evidence regeneration, baseline updates, or new external
|
|
110
|
+
messages. Ask separately before any such mutation.
|
|
@@ -5,8 +5,9 @@ requirement**, plus stubs that masquerade as complete. Steps 2–3 verify spec
|
|
|
5
5
|
coverage; this step verifies code→spec, catching scope that was implemented but never
|
|
6
6
|
specified.
|
|
7
7
|
|
|
8
|
-
|
|
9
|
-
|
|
8
|
+
This reference is the authoritative, self-contained reverse-gap procedure. Do not
|
|
9
|
+
consult a private repository, user-home path, or separately installed skill for the
|
|
10
|
+
detection heuristics below.
|
|
10
11
|
|
|
11
12
|
## A. Untraced behavior (code with no requirement)
|
|
12
13
|
|
|
@@ -24,8 +25,7 @@ Reuse the detection heuristics in
|
|
|
24
25
|
|
|
25
26
|
## B. Implied requirements from code patterns
|
|
26
27
|
|
|
27
|
-
Map suspicious patterns to the requirement that *should* exist
|
|
28
|
-
implementation-gap-analysis table):
|
|
28
|
+
Map suspicious patterns to the requirement that *should* exist using the table below:
|
|
29
29
|
|
|
30
30
|
| Code pattern | Missing requirement type |
|
|
31
31
|
| --- | --- |
|
|
@@ -45,17 +45,46 @@ done:
|
|
|
45
45
|
| Stub | Detect | Severity |
|
|
46
46
|
| --- | --- | --- |
|
|
47
47
|
| Tiny file (≤5 lines, excl. `__init__`) | line count | high |
|
|
48
|
-
| `pass` / placeholder return (`{}
|
|
48
|
+
| `pass` / placeholder return (`{}`, `[]`, `""`, `None`, `"not implemented"`) body | grep/AST | high |
|
|
49
49
|
| Protocol/ABC-only with no concrete impl | structure | high |
|
|
50
50
|
| Re-export-only module | structure | medium (may be intentional) |
|
|
51
51
|
| Trivially-covered stub (≤5 lines @ 100% cov) | coverage + size | medium |
|
|
52
52
|
|
|
53
53
|
A stub behind a `done` task or a ✅ matrix row is a `high` finding (false completion).
|
|
54
54
|
|
|
55
|
+
Inspect test files as well as source. A passing test can still be a stub:
|
|
56
|
+
|
|
57
|
+
| Test stub | Detect | Severity |
|
|
58
|
+
| --- | --- | --- |
|
|
59
|
+
| Empty body or unconditional skip | `pass`, empty callback, or skip without a tracked reason | high |
|
|
60
|
+
| No behavioral assertion | no assertion, rejection, snapshot, or observable-effect check | high |
|
|
61
|
+
| Weak-only assertion | only existence/type checks for behavior with a stronger contract | high |
|
|
62
|
+
| Mock-everything | all meaningful collaborators replaced so production behavior is never exercised | high |
|
|
63
|
+
| Import-only smoke test | verifies only that a module imports | medium |
|
|
64
|
+
|
|
65
|
+
Do not flag an abstract declaration, generated file, intentional compatibility re-export,
|
|
66
|
+
or a test whose assertion is expressed through the repository's harness merely because it
|
|
67
|
+
matches a textual pattern. Confirm the behavior is hollow before recording a finding.
|
|
68
|
+
|
|
69
|
+
## D. Coverage inflation
|
|
70
|
+
|
|
71
|
+
Treat coverage as evidence only after checking what the covered lines do:
|
|
72
|
+
|
|
73
|
+
- A source file with five or fewer substantive lines and 100% coverage can still be a
|
|
74
|
+
trivially covered stub.
|
|
75
|
+
- A test that mocks a source module which is itself hollow is circular evidence, not
|
|
76
|
+
implementation coverage.
|
|
77
|
+
- A threshold dominated by imports, declarations, or re-exports does not establish that
|
|
78
|
+
the promised behavior exists.
|
|
79
|
+
|
|
80
|
+
Record these as `high` when they support a `done` task or ✅ matrix claim, otherwise
|
|
81
|
+
`medium`. Cite both the hollow source and the test or coverage artifact.
|
|
82
|
+
|
|
55
83
|
## Output of this step
|
|
56
84
|
|
|
57
|
-
Findings for untraced behavior, implied-but-missing requirements,
|
|
58
|
-
`Refs` = code location
|
|
85
|
+
Findings for untraced behavior, implied-but-missing requirements, source/test stubs, and
|
|
86
|
+
coverage inflation, each with `Refs` = concrete code/test location. Include counts of
|
|
87
|
+
inventoried behaviors, untraced behaviors, source stubs, and test stubs in `## Coverage`.
|
|
59
88
|
|
|
60
89
|
## Notes
|
|
61
90
|
|
|
@@ -21,8 +21,8 @@ code it governs (from Step 4), assess three axes:
|
|
|
21
21
|
requirement describes*, including its acceptance criteria, or only an incidental/trivial
|
|
22
22
|
aspect? A test tagged `FR-007-AC-1` that asserts something unrelated to AC-1 fails here.
|
|
23
23
|
2. **(b) Test exercises the code** — does the test run the real implementation, or is it
|
|
24
|
-
hollow? Reuse
|
|
25
|
-
|
|
24
|
+
hollow? Reuse Step 4's **test-stub / coverage-inflation** heuristics: no assertions,
|
|
25
|
+
weak-only assertions (`is not None`, `isinstance`),
|
|
26
26
|
mock-everything (no real code path), import-only, circular-mock-of-a-stub.
|
|
27
27
|
3. **(c) Code matches intent** — does the implementation actually do what the requirement
|
|
28
28
|
says (semantics, edge cases, error behavior), or has it drifted?
|