bigpowers 2.73.8 → 2.74.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.continue/rules/context7-mcp.md +0 -0
- package/.continue/rules/diagnose-stall.md +0 -0
- package/.kilocode/rules/context7-mcp.md +0 -0
- package/.kilocode/rules/diagnose-stall.md +0 -0
- package/.pi/package.json +2 -2
- package/.pi/prompts/audit-code.md +17 -13
- package/.pi/prompts/change-request.md +3 -1
- package/.pi/prompts/compose-workflow.md +15 -0
- package/.pi/prompts/context7-mcp.md +54 -0
- package/.pi/prompts/craft-skill.md +28 -0
- package/.pi/prompts/deepen-architecture.md +20 -0
- package/.pi/prompts/delegate-task.md +14 -0
- package/.pi/prompts/deploy.md +8 -0
- package/.pi/prompts/develop-tdd.md +15 -4
- package/.pi/prompts/diagnose-stall.md +53 -0
- package/.pi/prompts/dispatch-agents.md +49 -19
- package/.pi/prompts/gate-trace.md +9 -1
- package/.pi/prompts/guard-git.md +14 -0
- package/.pi/prompts/migrate-spec.md +12 -0
- package/.pi/prompts/plan-work.md +62 -2
- package/.pi/prompts/publish-package.md +11 -0
- package/.pi/prompts/release-branch.md +39 -43
- package/.pi/prompts/request-review.md +57 -17
- package/.pi/prompts/run-benchmark.md +3 -3
- package/.pi/prompts/run-evals.md +26 -6
- package/.pi/prompts/security-review.md +56 -8
- package/.pi/prompts/seed-conventions.md +61 -0
- package/.pi/prompts/session-state.md +5 -10
- package/.pi/prompts/slice-tasks.md +3 -0
- package/.pi/prompts/smoke-test.md +11 -0
- package/.pi/prompts/stocktake-skills.md +2 -1
- package/.pi/prompts/validate-contracts.md +12 -0
- package/.pi/prompts/validate-fix.md +2 -0
- package/.pi/prompts/verify-work.md +31 -20
- package/.pi/prompts/wire-ci.md +11 -0
- package/.pi/prompts/write-document.md +10 -0
- package/.pi/skills/audit-code/SKILL.md +17 -13
- package/.pi/skills/change-request/SKILL.md +3 -1
- package/.pi/skills/compose-workflow/SKILL.md +15 -0
- package/.pi/skills/context7-mcp/SKILL.md +56 -0
- package/.pi/skills/craft-skill/SKILL.md +28 -0
- package/.pi/skills/deepen-architecture/SKILL.md +20 -0
- package/.pi/skills/delegate-task/SKILL.md +14 -0
- package/.pi/skills/deploy/SKILL.md +8 -0
- package/.pi/skills/develop-tdd/SKILL.md +15 -4
- package/.pi/skills/diagnose-stall/SKILL.md +55 -0
- package/.pi/skills/dispatch-agents/SKILL.md +49 -19
- package/.pi/skills/gate-trace/SKILL.md +9 -1
- package/.pi/skills/guard-git/SKILL.md +14 -0
- package/.pi/skills/migrate-spec/SKILL.md +12 -0
- package/.pi/skills/plan-work/SKILL.md +62 -2
- package/.pi/skills/publish-package/SKILL.md +11 -0
- package/.pi/skills/release-branch/SKILL.md +39 -43
- package/.pi/skills/request-review/SKILL.md +57 -17
- package/.pi/skills/run-benchmark/SKILL.md +3 -3
- package/.pi/skills/run-evals/SKILL.md +26 -6
- package/.pi/skills/security-review/SKILL.md +56 -8
- package/.pi/skills/seed-conventions/SKILL.md +61 -0
- package/.pi/skills/session-state/SKILL.md +5 -10
- package/.pi/skills/slice-tasks/SKILL.md +3 -0
- package/.pi/skills/smoke-test/SKILL.md +11 -0
- package/.pi/skills/stocktake-skills/SKILL.md +2 -1
- package/.pi/skills/validate-contracts/SKILL.md +12 -0
- package/.pi/skills/validate-fix/SKILL.md +2 -0
- package/.pi/skills/verify-work/SKILL.md +31 -20
- package/.pi/skills/wire-ci/SKILL.md +11 -0
- package/.pi/skills/write-document/SKILL.md +10 -0
- package/CHANGELOG.md +14 -0
- package/CLAUDE.md +59 -1
- package/CONVENTIONS.md +80 -5
- package/README.md +1 -1
- package/SKILL-INDEX.md +1 -1
- package/package.json +1 -1
- package/scripts/bp-churn-rank.sh +49 -0
- package/scripts/check-import-boundaries.sh +64 -0
- package/scripts/compile-rule-matrix.sh +114 -0
- package/scripts/hooks/rtk-rewrite.sh +11 -0
- package/scripts/hooks/token-mgmt-pre-tool-use.sh +53 -0
- package/scripts/install.sh +6 -0
- package/scripts/lib/completeness-critic.sh +62 -0
- package/scripts/lib/doc-fetch-cache.sh +71 -0
- package/scripts/lib/golden-suite-gates.sh +3 -1
- package/scripts/lib/parallel-review-worktrees.sh +34 -0
- package/scripts/lib/plan-consistency-check.sh +88 -0
- package/scripts/lib/run-benchmark.py +210 -0
- package/scripts/lib/simple_yaml.py +130 -0
- package/scripts/lib/sync-context-engineering-ref.sh +19 -0
- package/scripts/lib/trace-matrix.py +10 -281
- package/scripts/lib/trace_renderer.py +147 -0
- package/scripts/references-manifest.yaml +19 -0
- package/scripts/run-benchmark.sh +6 -0
- package/scripts/sync-references.sh +25 -0
- package/scripts/test-trace-matrix-size.sh +46 -0
- package/scripts/validate-skill-catalog.sh +147 -0
- package/scripts/validate-skill-description.sh +70 -0
- package/skills/audit-code/SKILL.md +19 -13
- package/skills/change-request/SKILL.md +3 -1
- package/skills/compose-workflow/SKILL.md +15 -0
- package/skills/context7-mcp/SKILL.md +57 -0
- package/skills/craft-skill/SKILL.md +29 -0
- package/skills/deepen-architecture/SKILL.md +22 -0
- package/skills/delegate-task/SKILL.md +14 -0
- package/skills/deploy/SKILL.md +9 -0
- package/skills/develop-tdd/SKILL.md +18 -4
- package/skills/diagnose-stall/SKILL.md +56 -0
- package/skills/dispatch-agents/SKILL.md +51 -19
- package/skills/gate-trace/SKILL.md +11 -1
- package/skills/guard-git/REFERENCE.md +14 -0
- package/skills/migrate-spec/REFERENCE.md +12 -0
- package/skills/plan-work/REFERENCE.md +29 -2
- package/skills/plan-work/SKILL.md +38 -0
- package/skills/publish-package/REFERENCE.md +11 -0
- package/skills/release-branch/REFERENCE.md +14 -0
- package/skills/release-branch/SKILL.md +28 -43
- package/skills/request-review/SKILL.md +59 -17
- package/skills/run-benchmark/SKILL.md +4 -4
- package/skills/run-evals/REFERENCE.md +14 -4
- package/skills/run-evals/SKILL.md +13 -2
- package/skills/security-review/REFERENCE-false-positives.md +9 -8
- package/skills/security-review/REFERENCE-vuln-categories.md +4 -0
- package/skills/security-review/SKILL.md +45 -0
- package/skills/security-review/fixtures/CWE-79-xss-negative.js +6 -0
- package/skills/security-review/fixtures/CWE-79-xss-positive.js +6 -0
- package/skills/security-review/fixtures/CWE-89-sqli-negative.py +8 -0
- package/skills/security-review/fixtures/CWE-89-sqli-positive.py +9 -0
- package/skills/seed-conventions/REFERENCE.md +40 -0
- package/skills/seed-conventions/SKILL.md +22 -0
- package/skills/session-state/SKILL.md +5 -10
- package/skills/slice-tasks/SKILL.md +3 -0
- package/skills/smoke-test/REFERENCE.md +11 -0
- package/skills/stocktake-skills/SKILL.md +3 -1
- package/skills/validate-contracts/REFERENCE.md +12 -0
- package/skills/validate-fix/SKILL.md +3 -0
- package/skills/verify-work/REFERENCE.md +17 -0
- package/skills/verify-work/SKILL.md +18 -20
- package/skills/wire-ci/REFERENCE.md +11 -0
- package/skills/write-document/REFERENCE.md +10 -0
- package/skills-lock.json +32 -22
|
@@ -1,4 +1,7 @@
|
|
|
1
1
|
<!-- story: e38s07 -->
|
|
2
|
+
<!-- story: e45s15 -->
|
|
3
|
+
<!-- story: e45s32 -->
|
|
4
|
+
<!-- story: e45s39 -->
|
|
2
5
|
---
|
|
3
6
|
name: release-branch
|
|
4
7
|
model: haiku
|
|
@@ -55,6 +58,8 @@ If REVIEW.md is missing or stale → run `security-review` inline. Findings bloc
|
|
|
55
58
|
|
|
56
59
|
Run `gate-trace` before merge. FAIL blocks merge; CONCERNS requires explicit override in `specs/state.yaml` (`traceability_override: CONCERNS accepted, reason: <explanation>`). WAIVED if no matrix available.
|
|
57
60
|
|
|
61
|
+
> **Adversarial refute framing (e45s32):** The final pre-merge check is **refute, not rubber-stamp**. Before declaring ready, actively try to disprove traceability completeness — missing story tags, absent verify evidence, stale security review. Only proceed when refutation fails.
|
|
62
|
+
|
|
58
63
|
### 3. Diff review
|
|
59
64
|
|
|
60
65
|
- [ ] All commits intentional, no secrets, CONVENTIONS.md compliance
|
|
@@ -75,9 +80,26 @@ bash scripts/land-branch.sh <task-slug> "feat(scope): description"
|
|
|
75
80
|
|
|
76
81
|
### 6. Create PR (team-pr only)
|
|
77
82
|
|
|
78
|
-
Create the pull request
|
|
83
|
+
Create the pull request with a **literal provenance marker** in the body so agent-generated PRs are identifiable and do not rot silently:
|
|
84
|
+
|
|
85
|
+
```markdown
|
|
86
|
+
<!-- bigpowers-provenance: agent-generated -->
|
|
87
|
+
```
|
|
88
|
+
|
|
89
|
+
Place the marker on its own line immediately after the `## Summary` heading. Then merge via `gh`:
|
|
79
90
|
|
|
80
91
|
```bash
|
|
92
|
+
gh pr create --title "..." --body "$(cat <<'EOF'
|
|
93
|
+
## Summary
|
|
94
|
+
<!-- bigpowers-provenance: agent-generated -->
|
|
95
|
+
|
|
96
|
+
- ...
|
|
97
|
+
|
|
98
|
+
## Test plan
|
|
99
|
+
- [ ] ...
|
|
100
|
+
|
|
101
|
+
EOF
|
|
102
|
+
)"
|
|
81
103
|
gh pr merge --squash --delete-branch
|
|
82
104
|
```
|
|
83
105
|
|
|
@@ -93,55 +115,18 @@ mv specs/epics/eNN-slug specs/epics/archive/
|
|
|
93
115
|
|
|
94
116
|
### 7b. CI verification & agent lock release (e39s02)
|
|
95
117
|
|
|
96
|
-
> **HARD GATE** — Do NOT declare success until CI completes.
|
|
97
|
-
|
|
98
|
-
After push, run CI polling:
|
|
118
|
+
> **HARD GATE** — Do NOT declare success until CI completes. **Three-independent-facts** (e45s15): commit landed, workflow green, registry visible — see [REFERENCE.md](REFERENCE.md#three-independent-facts-release).
|
|
99
119
|
|
|
100
120
|
```bash
|
|
101
121
|
bash scripts/wait-for-ci.sh --timeout 600 --interval 30
|
|
102
122
|
```
|
|
103
123
|
|
|
104
|
-
|
|
105
|
-
|
|
106
|
-
```bash
|
|
107
|
-
LOCK="specs/agent-locks.yaml"; STORY="<story-id>"
|
|
108
|
-
[ -f "$LOCK" ] && python3 -c "
|
|
109
|
-
import yaml
|
|
110
|
-
d=yaml.safe_load(open('$LOCK'))
|
|
111
|
-
if d:d['locks']=[l for l in d['locks'] if l.get('story_id')!='$STORY']
|
|
112
|
-
yaml.dump(d,open('$LOCK','w'),default_flow_style=False)
|
|
113
|
-
print(f'LOCK RELEASED: $STORY')
|
|
114
|
-
"||echo "No lock for $STORY — idempotent"
|
|
115
|
-
```
|
|
116
|
-
|
|
117
|
-
- [ ] CI workflow passes after push (wait-for-ci.sh exit 0)
|
|
118
|
-
- [ ] `release.ci_verified: true` documented in state.yaml
|
|
119
|
-
- On failure: `handoff.next_skill = fix-bug` with CI failure URL
|
|
124
|
+
- [ ] CI passes; `release.ci_verified: true` in state.yaml
|
|
125
|
+
- On failure: `handoff.next_skill = fix-bug`
|
|
120
126
|
|
|
121
|
-
### 8. Clean up
|
|
127
|
+
### 8. Clean up & return
|
|
122
128
|
|
|
123
|
-
|
|
124
|
-
git worktree prune
|
|
125
|
-
git worktree remove ../<branch-name> 2>/dev/null || true
|
|
126
|
-
git branch -d <branch-name>
|
|
127
|
-
```
|
|
128
|
-
|
|
129
|
-
### 8a. Cycle-time recording
|
|
130
|
-
|
|
131
|
-
After landing, record delivery metrics with the git-derived, additive script:
|
|
132
|
-
|
|
133
|
-
```bash
|
|
134
|
-
bash scripts/record-cycle-time.sh append \
|
|
135
|
-
--story <story_id> --bcps <bcps> \
|
|
136
|
-
--range "$(git merge-base main HEAD)..HEAD" \
|
|
137
|
-
--file specs/metrics/cycle-times.yaml
|
|
138
|
-
```
|
|
139
|
-
|
|
140
|
-
### 9. Return to main
|
|
141
|
-
|
|
142
|
-
```bash
|
|
143
|
-
git checkout main && git status && pwd
|
|
144
|
-
```
|
|
129
|
+
Worktree prune, branch delete, `git checkout main`. Cycle-time: see [REFERENCE.md](REFERENCE.md#cycle-time).
|
|
145
130
|
|
|
146
131
|
Report: "Branch released."
|
|
147
132
|
|
|
@@ -1,3 +1,6 @@
|
|
|
1
|
+
# story: e45s07
|
|
2
|
+
<!-- story: e45s07 -->
|
|
3
|
+
<!-- story: e45s17 -->
|
|
1
4
|
---
|
|
2
5
|
name: request-review
|
|
3
6
|
model: opus
|
|
@@ -5,21 +8,44 @@ effort: standard
|
|
|
5
8
|
description: Dispatch a fresh reviewer agent with a clean context to critique the code after audit-code passes. The reviewer has no shared state with the coding agent and gives a genuine second opinion. Use after audit-code passes, before committing, or when user wants an independent code review.
|
|
6
9
|
---
|
|
7
10
|
|
|
11
|
+
# story: e45s28
|
|
12
|
+
|
|
8
13
|
# Request Review
|
|
9
14
|
|
|
10
|
-
Dispatch
|
|
15
|
+
Dispatch fresh reviewer agents with clean contexts. Reviewers have no shared state — they find what the coding agent missed.
|
|
16
|
+
|
|
17
|
+
**Distinct from `audit-code`:** `audit-code` is self-review (internal). This skill dispatches external agents.
|
|
18
|
+
|
|
19
|
+
**Solo developer note:** Reviewer agents replace the human reviewer.
|
|
20
|
+
|
|
21
|
+
**Run `audit-code` first.** Don't waste reviewer attention on hygiene issues you could have caught yourself.
|
|
22
|
+
|
|
23
|
+
## Santa Method — Dual-Blind AND Gate (e45s07)
|
|
24
|
+
|
|
25
|
+
Use **two independent reviewers** (Reviewer A and Reviewer B) with **no shared context** between them or the coding agent.
|
|
11
26
|
|
|
12
|
-
|
|
27
|
+
| Parameter | Value |
|
|
28
|
+
|-----------|-------|
|
|
29
|
+
| Reviewers | 2 (mandatory) |
|
|
30
|
+
| `MAX_REVIEW_ITERATIONS` | **5** (hard cap — e45s28; iteration 6 forbidden) |
|
|
31
|
+
| Pass rule | **AND-gate** — both reviewers must pass independently |
|
|
32
|
+
| Blindness | Neither reviewer sees the other's report until both complete |
|
|
13
33
|
|
|
14
|
-
**
|
|
34
|
+
**Iteration loop (max `MAX_REVIEW_ITERATIONS`):**
|
|
15
35
|
|
|
16
|
-
|
|
36
|
+
1. Dispatch Reviewer A and Reviewer B in parallel with identical briefs but separate contexts.
|
|
37
|
+
2. Collect both reports. Each categorizes findings: must-fix / should-fix / consider.
|
|
38
|
+
3. **AND-gate:** If **either** reviewer has must-fix findings → FAIL round. Run `respond-review`, fix, re-dispatch both reviewers.
|
|
39
|
+
4. If both pass (zero must-fix, score ≥ 94% each) → review complete.
|
|
40
|
+
5. After **5** iterations without dual pass → **stop**; report "Review cap exhausted (5/5). Human decision required." Do not merge.
|
|
41
|
+
|
|
42
|
+
> **HARD GATE** — Single-reviewer pass is insufficient. Partial agreement does not satisfy the AND-gate.
|
|
17
43
|
|
|
18
44
|
## Process
|
|
19
45
|
|
|
20
46
|
### 1. Prepare the review brief
|
|
21
47
|
|
|
22
|
-
Write a self-contained brief for
|
|
48
|
+
Write a self-contained brief for each reviewer. Include:
|
|
23
49
|
|
|
24
50
|
- What was built (feature description, not implementation)
|
|
25
51
|
- Which files changed (the diff context)
|
|
@@ -29,12 +55,25 @@ Write a self-contained brief for the reviewer agent. Include:
|
|
|
29
55
|
- What you're most uncertain about (where you want fresh eyes)
|
|
30
56
|
- **Security focus** — If the epic has a `specs/security/epics/<id>/THREAT_MODEL.md`, include the relevant vulnerability categories as reviewer focal points. Also include the false-positive exclusion rules so the reviewer avoids known-safe patterns. Tag the review as `security-sensitive: true` if THREAT_MODEL risk is HIGH+.
|
|
31
57
|
|
|
32
|
-
### 2.
|
|
58
|
+
### 2. Fan-out parallel reviewers (e45s17)
|
|
59
|
+
|
|
60
|
+
Beyond the mandatory dual-blind pair (e45s07), optionally dispatch **N dimension-specific subagents in one message** — one check per agent for broader coverage (OpenAI Codex `code-review-*` pattern):
|
|
61
|
+
|
|
62
|
+
| Agent | Focus |
|
|
63
|
+
|-------|-------|
|
|
64
|
+
| R-correctness | Logic, edge cases, verify command result |
|
|
65
|
+
| R-conventions | CONVENTIONS.md, test quality (F.I.R.S.T) |
|
|
66
|
+
| R-security | Injection, auth, secrets (when `security-sensitive`) |
|
|
67
|
+
| R-design | Simpler alternatives, API shape |
|
|
33
68
|
|
|
34
|
-
|
|
69
|
+
Santa Method still applies: each agent is blind; AND-gate uses Reviewer A + B scores. Fan-out agents feed findings into `respond-review` but do not replace the dual-blind pair.
|
|
70
|
+
|
|
71
|
+
### 2b. Dispatch both reviewer agents (parallel)
|
|
72
|
+
|
|
73
|
+
Use the Agent tool twice with completely fresh contexts. Each prompt must be self-contained — no references to "our conversation" or "what we discussed."
|
|
35
74
|
|
|
36
75
|
```
|
|
37
|
-
You are
|
|
76
|
+
You are code reviewer [A|B]. Review the following code changes independently.
|
|
38
77
|
|
|
39
78
|
Context: [feature description]
|
|
40
79
|
CONVENTIONS.md rules: [paste relevant sections]
|
|
@@ -56,19 +95,22 @@ For each finding, categorize as: must-fix / should-fix / consider.
|
|
|
56
95
|
Run the verify command and report the result.
|
|
57
96
|
```
|
|
58
97
|
|
|
59
|
-
### 3. Collect
|
|
98
|
+
### 3. Collect both reports
|
|
60
99
|
|
|
61
|
-
When
|
|
62
|
-
- Read every finding before acting on any
|
|
63
|
-
- Note
|
|
64
|
-
- Compute
|
|
65
|
-
-
|
|
100
|
+
When reviewers return:
|
|
101
|
+
- Read every finding from **both** reports before acting on any
|
|
102
|
+
- Note each verify command result
|
|
103
|
+
- Compute quality score per reviewer: `100 × (total_items − must_fix − should_fix) / total_items`
|
|
104
|
+
- **AND-gate check:** both scores ≥ 94% and zero must-fix from **both**?
|
|
66
105
|
|
|
67
|
-
> **HARD GATE** — If score < 94
|
|
106
|
+
> **HARD GATE** — If either score < 94% or either has must-fix → FAIL round. Run `respond-review` first. The 94% threshold also applies to `npm run compliance` (scripts/audit-compliance.sh).
|
|
68
107
|
|
|
69
108
|
### 4. Hand off to respond-review
|
|
70
109
|
|
|
71
|
-
Pass
|
|
110
|
+
Pass combined findings to `respond-review` to categorize and apply fixes. Increment iteration counter. Re-dispatch both reviewers until AND-gate passes or iteration 3 exhausted.
|
|
111
|
+
|
|
112
|
+
Report to user: "Review round [N/3]. Reviewer A: [score], Reviewer B: [score]. AND-gate: [PASS|FAIL]."
|
|
72
113
|
|
|
73
|
-
|
|
114
|
+
## Verify
|
|
74
115
|
|
|
116
|
+
→ verify: `grep -q 'AND-gate' skills/request-review/SKILL.md && grep -q 'max 3' skills/request-review/SKILL.md && echo OK`
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: run-benchmark
|
|
3
|
-
# story:
|
|
3
|
+
# story: e45s01
|
|
4
4
|
model: haiku
|
|
5
5
|
effort: standard
|
|
6
6
|
description: Run skill quality benchmarks from specs/benchmarks/ definitions — N-run with/without-skill delta grading, train/validation split, pass@k + benchmark.json reports. Use before and after evolve-skill to prove quality changes are improvements, not regressions.
|
|
@@ -30,9 +30,9 @@ Benchmark definitions partition scenarios into two sets:
|
|
|
30
30
|
## Usage
|
|
31
31
|
|
|
32
32
|
```bash
|
|
33
|
-
run-benchmark <skill-name> # benchmark single skill
|
|
34
|
-
run-benchmark --all # benchmark all with definitions
|
|
35
|
-
run-benchmark <skill-name> --baseline # pin results as baseline
|
|
33
|
+
bash scripts/run-benchmark.sh <skill-name> # benchmark single skill
|
|
34
|
+
bash scripts/run-benchmark.sh --all # benchmark all with definitions
|
|
35
|
+
bash scripts/run-benchmark.sh <skill-name> --baseline # pin results as baseline
|
|
36
36
|
```
|
|
37
37
|
|
|
38
38
|
## Process
|
|
@@ -1,15 +1,25 @@
|
|
|
1
1
|
# Run Evals — Reference
|
|
2
2
|
|
|
3
|
+
## Strictness tiers (e45s37)
|
|
4
|
+
|
|
5
|
+
Add a `tier:` column to each eval row:
|
|
6
|
+
|
|
7
|
+
| Tier | Gate behaviour |
|
|
8
|
+
|------|----------------|
|
|
9
|
+
| `EXPERIMENTAL` | Log only — does not block |
|
|
10
|
+
| `USUALLY_PASSES` | Warn on failure; blocks only when paired with failing `ALWAYS_PASSES` |
|
|
11
|
+
| `ALWAYS_PASSES` | Hard block on any failure |
|
|
12
|
+
|
|
3
13
|
## EVALS template
|
|
4
14
|
|
|
5
15
|
```markdown
|
|
6
16
|
# EVALS: <feature>
|
|
7
17
|
|
|
8
18
|
## Capability
|
|
9
|
-
| ID | Eval | Grader | verify / rubric |
|
|
10
|
-
|
|
11
|
-
| C1 | ... | code | `verify: npm test -- <file>` |
|
|
12
|
-
| C2 | ... | model | Rubric: [ ] criterion A [ ] criterion B |
|
|
19
|
+
| ID | Eval | Grader | Tier | verify / rubric |
|
|
20
|
+
|----|------|--------|------|-----------------|
|
|
21
|
+
| C1 | ... | code | ALWAYS_PASSES | `verify: npm test -- <file>` |
|
|
22
|
+
| C2 | ... | model | USUALLY_PASSES | Rubric: [ ] criterion A [ ] criterion B |
|
|
13
23
|
|
|
14
24
|
## Regression
|
|
15
25
|
| ID | Eval | Grader | verify / rubric |
|
|
@@ -1,3 +1,4 @@
|
|
|
1
|
+
# story: e45s37
|
|
1
2
|
---
|
|
2
3
|
name: run-evals
|
|
3
4
|
description: Eval-Driven Development — define capability and regression evals before building; code graders use verify commands, model graders use explicit rubrics; log pass@k. Use before develop-tdd on new features, or when measuring agent capability over runs.
|
|
@@ -16,8 +17,18 @@ effort: standard
|
|
|
16
17
|
- **Capability evals** (does it do the job?)
|
|
17
18
|
- **Regression evals** (did we break anything?)
|
|
18
19
|
3. Assign grader type per eval: `code` (shell verify) or `model` (rubric).
|
|
19
|
-
4.
|
|
20
|
-
|
|
20
|
+
4. Assign **strictness tier** per eval (graduated promotion — e45s37):
|
|
21
|
+
|
|
22
|
+
| Tier | Meaning | Promotion rule |
|
|
23
|
+
|------|---------|------------------|
|
|
24
|
+
| `EXPERIMENTAL` | New eval, may flake | Not gating |
|
|
25
|
+
| `USUALLY_PASSES` | Stable in dev; ≥2/3 recent runs pass | Blocks BUILD only when combined with ALWAYS_PASSES suite |
|
|
26
|
+
| `ALWAYS_PASSES` | Zero tolerance; required for release | Any single failure blocks BUILD and merge |
|
|
27
|
+
|
|
28
|
+
Promote: `EXPERIMENTAL → USUALLY_PASSES` after 3 consecutive passes; `USUALLY_PASSES → ALWAYS_PASSES` after 5 consecutive passes with zero flakes documented in `specs/state.yaml`.
|
|
29
|
+
|
|
30
|
+
5. Run evals; log results table with pass@k (e.g. 3/3 runs) and tier per eval.
|
|
31
|
+
6. Block BUILD phase until all `ALWAYS_PASSES` evals pass at agreed k. `USUALLY_PASSES` failures warn; `EXPERIMENTAL` failures log only.
|
|
21
32
|
|
|
22
33
|
## Artefact
|
|
23
34
|
|
|
@@ -19,14 +19,15 @@ Automatically exclude findings matching these patterns:
|
|
|
19
19
|
| 8 | **Race conditions / timing attacks** that are theoretical | Only report if concretely problematic |
|
|
20
20
|
| 9 | **Outdated third-party libraries** | Managed separately by dependency scanners |
|
|
21
21
|
| 10 | **Memory safety** in Rust or other memory-safe languages | Impossible by language guarantees |
|
|
22
|
-
| 11 | **
|
|
23
|
-
| 12 | **
|
|
24
|
-
| 13 | **
|
|
25
|
-
| 14 | **
|
|
26
|
-
| 15 | **
|
|
27
|
-
| 16 | **Regex
|
|
28
|
-
| 17 | **
|
|
29
|
-
| 18 | **
|
|
22
|
+
| 11 | **Hardcoded SQL with proven authorship** — migrations, seeds, static admin queries with no user interpolation | Developer-authored SQL is safe per SQL-safety doctrine (e45s41) |
|
|
23
|
+
| 12 | **Unit test files only** | Not production risk |
|
|
24
|
+
| 13 | **Log spoofing** | Outputting unsanitized input to logs is not a vuln |
|
|
25
|
+
| 14 | **SSRF that only controls path** | Only host/protocol control is exploitable |
|
|
26
|
+
| 15 | **User-controlled content in AI system prompts** | Not a security vulnerability |
|
|
27
|
+
| 16 | **Regex injection** | Injecting untrusted content into regex is not a vuln |
|
|
28
|
+
| 17 | **Regex DOS** | Excluded alongside general DOS |
|
|
29
|
+
| 18 | **Documentation files** (.md, .txt) | Insecure docs are not code vulnerabilities |
|
|
30
|
+
| 19 | **Lack of audit logs** | Not a vulnerability |
|
|
30
31
|
|
|
31
32
|
## Precedent Rules
|
|
32
33
|
|
|
@@ -7,6 +7,8 @@ Each category: vulnerable pattern → safe pattern → code example.
|
|
|
7
7
|
| Aspect | Detail |
|
|
8
8
|
|--------|--------|
|
|
9
9
|
| **Vulnerable** | String interpolation in SQL queries: `f"SELECT * FROM users WHERE id = {uid}"` |
|
|
10
|
+
| **CWE** | CWE-89 (SQL Injection) |
|
|
11
|
+
| **Fixtures** | `fixtures/CWE-89-sqli-positive.py` (flag) · `fixtures/CWE-89-sqli-negative.py` (pass) |
|
|
10
12
|
| **Safe** | Parameterized queries / ORM: `cursor.execute("SELECT * FROM users WHERE id = %s", (uid,))` |
|
|
11
13
|
| **Look for** | f-strings, `+` concatenation, `format()` in query builders; raw SQL in ORM `.raw()` / `.execute()` |
|
|
12
14
|
| **False-positive guard** | Not a FP if the input is user-controlled (HTTP param, file, env var, CLI arg). Env vars are trusted (see exclusion rules). |
|
|
@@ -16,6 +18,8 @@ Each category: vulnerable pattern → safe pattern → code example.
|
|
|
16
18
|
| Aspect | Detail |
|
|
17
19
|
|--------|--------|
|
|
18
20
|
| **Vulnerable** | `element.innerHTML = userInput`, `dangerouslySetInnerHTML={{__html: userInput}}` |
|
|
21
|
+
| **CWE** | CWE-79 (Cross-site Scripting) |
|
|
22
|
+
| **Fixtures** | `fixtures/CWE-79-xss-positive.js` (flag) · `fixtures/CWE-79-xss-negative.js` (pass) |
|
|
19
23
|
| **Safe** | `element.textContent = userInput`, React JSX (auto-escaped), template engines with auto-escaping |
|
|
20
24
|
| **Look for** | `.innerHTML`, `document.write()`, `dangerouslySetInnerHTML`, `v-html` (Vue), `bypassSecurityTrustHtml` (Angular) |
|
|
21
25
|
| **False-positive guard** | React/Angular components without unsafe methods are NOT vulnerable (see exclusion rules). |
|
|
@@ -1,3 +1,5 @@
|
|
|
1
|
+
# story: e45s41
|
|
2
|
+
<!-- story: e45s18 -->
|
|
1
3
|
---
|
|
2
4
|
name: security-review
|
|
3
5
|
model: sonnet
|
|
@@ -10,12 +12,24 @@ description: >
|
|
|
10
12
|
the user says "security review" or "scan for vulns".
|
|
11
13
|
---
|
|
12
14
|
|
|
15
|
+
# story: e45s26
|
|
16
|
+
|
|
13
17
|
# Security Review
|
|
14
18
|
|
|
15
19
|
> **HARD GATE** — Requires git context (branch with merge-base or diff). Never
|
|
16
20
|
> writes files outside `specs/security/`. Findings below confidence 8/10 are
|
|
17
21
|
> suppressed. **→ verify:** `git rev-parse HEAD >/dev/null 2>&1 && echo "ok" || echo "BLOCKED"`
|
|
18
22
|
|
|
23
|
+
## Parallel worktree mode (e45s18)
|
|
24
|
+
|
|
25
|
+
When running alongside `audit-code`, use isolated worktrees so scans do not race on the same index:
|
|
26
|
+
|
|
27
|
+
```bash
|
|
28
|
+
bash scripts/lib/parallel-review-worktrees.sh security-review
|
|
29
|
+
```
|
|
30
|
+
|
|
31
|
+
Each check gets a detached worktree at `.bigpowers/worktrees/review-<name>/`; reports still write only under `specs/security/`.
|
|
32
|
+
|
|
19
33
|
## 5-phase scan
|
|
20
34
|
|
|
21
35
|
| # | Phase | What |
|
|
@@ -30,6 +44,37 @@ description: >
|
|
|
30
44
|
|
|
31
45
|
Covered: SQLi, XSS, SSRF, command injection, auth bypass, unsafe deserialization, path traversal, IDOR, crypto flaws, secrets exposure, template injection, NoSQLi
|
|
32
46
|
|
|
47
|
+
## CWE mapping mandate (e45s26)
|
|
48
|
+
|
|
49
|
+
Every **new detection rule** added to this skill MUST:
|
|
50
|
+
|
|
51
|
+
1. Map to a [CWE](https://cwe.mitre.org/) ID in `REFERENCE-vuln-categories.md` (e.g. SQLi → CWE-89, XSS → CWE-79).
|
|
52
|
+
2. Ship **two fixture pairs** under `skills/security-review/fixtures/`:
|
|
53
|
+
- **Positive** — minimal code the rule MUST flag (vulnerable pattern present).
|
|
54
|
+
- **Negative** — structurally similar code the rule MUST NOT flag (safe pattern / false-positive guard).
|
|
55
|
+
|
|
56
|
+
| Rule | CWE | Positive fixture | Negative fixture |
|
|
57
|
+
|------|-----|------------------|------------------|
|
|
58
|
+
| SQL injection | CWE-89 | `fixtures/CWE-89-sqli-positive.py` | `fixtures/CWE-89-sqli-negative.py` |
|
|
59
|
+
| XSS (DOM) | CWE-79 | `fixtures/CWE-79-xss-positive.js` | `fixtures/CWE-79-xss-negative.js` |
|
|
60
|
+
|
|
61
|
+
Before merging a new category, run both fixtures through the detection guidance and confirm positive flags / negative passes.
|
|
62
|
+
|
|
63
|
+
## SQL-safety doctrine (e45s41 — proven authorship)
|
|
64
|
+
|
|
65
|
+
Formal rule for SQL injection classification:
|
|
66
|
+
|
|
67
|
+
| SQL source | Attacker-reachable input? | Verdict |
|
|
68
|
+
|------------|---------------------------|---------|
|
|
69
|
+
| Hardcoded / compile-time constant string | N/A | **Safe** — proven authorship |
|
|
70
|
+
| Developer-authored query with bound parameters only | No dynamic fragments from user input | **Safe** |
|
|
71
|
+
| String concatenation / template with user-controlled values | Yes | **Unsafe** — report as SQLi |
|
|
72
|
+
| ORM query builder with user input in WHERE/JOIN | Yes | **Unsafe** unless parameterized |
|
|
73
|
+
| Stored procedure call with bound args | Args from trusted constants only | **Safe** |
|
|
74
|
+
| Stored procedure with dynamic SQL inside | User input reaches EXEC | **Unsafe** |
|
|
75
|
+
|
|
76
|
+
**Provenance test:** If the agent cannot prove the query string was authored entirely by the developer (no attacker-reachable interpolation), treat as vulnerable. Hardcoded SQL in migrations, seeds, and admin scripts is safe; anything reachable from HTTP/CLI/user input is not.
|
|
77
|
+
|
|
33
78
|
## BCP Plus Integration
|
|
34
79
|
|
|
35
80
|
This skill maps to **BCP Plus dimension 12 (Security & Compliance)**. When BCP Plus sizing is active, the threat model categories above correspond to sub-elements within dimension 12. The NFR Gate rule applies: standard-expectation items (e.g., "use HTTPS", "hash passwords") score 0 with a one-line rationale; only above-standard security requirements contribute to the dimension 12 count. See `docs/references/bcp-plus.md` for the full 13-dimension framework and NFR Gate pattern.
|
|
@@ -0,0 +1,8 @@
|
|
|
1
|
+
# story: e45s26
|
|
2
|
+
# fixture: CWE-89 negative — MUST NOT be flagged (parameterized query)
|
|
3
|
+
import sqlite3
|
|
4
|
+
|
|
5
|
+
def get_user(user_id: str) -> dict:
|
|
6
|
+
conn = sqlite3.connect("app.db")
|
|
7
|
+
# SAFE: bound parameter — proven authorship, no attacker-reachable interpolation
|
|
8
|
+
return conn.execute("SELECT * FROM users WHERE id = ?", (user_id,)).fetchone()
|
|
@@ -0,0 +1,9 @@
|
|
|
1
|
+
# story: e45s26
|
|
2
|
+
# fixture: CWE-89 positive — MUST be flagged as SQL injection
|
|
3
|
+
import sqlite3
|
|
4
|
+
|
|
5
|
+
def get_user(user_id: str) -> dict:
|
|
6
|
+
conn = sqlite3.connect("app.db")
|
|
7
|
+
# VULNERABLE: user-controlled string interpolated into SQL
|
|
8
|
+
query = f"SELECT * FROM users WHERE id = {user_id}"
|
|
9
|
+
return conn.execute(query).fetchone()
|
|
@@ -1,6 +1,46 @@
|
|
|
1
1
|
# story: e51s02 e37s01 e37s03 e37s14
|
|
2
|
+
# story: e45s21
|
|
2
3
|
# Seed Conventions — Reference Templates
|
|
3
4
|
|
|
5
|
+
## Navigation
|
|
6
|
+
|
|
7
|
+
| Lines | Section |
|
|
8
|
+
|-------|---------|
|
|
9
|
+
| 1–4 | Title + story tags |
|
|
10
|
+
| 6–22 | Navigation (this table) |
|
|
11
|
+
| 24–35 | AGENTS.md spine |
|
|
12
|
+
| 37–76 | Agent config template |
|
|
13
|
+
| 78–85 | opencode.json template |
|
|
14
|
+
| 87–96 | Aider bridge |
|
|
15
|
+
| 98–108 | Codex CLI wiring |
|
|
16
|
+
| 110–118 | CONVENTIONS.md |
|
|
17
|
+
| 120–122 | Stack profile fragments |
|
|
18
|
+
| 124–153 | Local tool wiring |
|
|
19
|
+
|
|
20
|
+
## Fenced markers (e45s21)
|
|
21
|
+
|
|
22
|
+
Self-installing blocks prevent skills from overwriting user-authored prose. Pattern:
|
|
23
|
+
|
|
24
|
+
```markdown
|
|
25
|
+
<!-- BEGIN bigpowers:section-id -->
|
|
26
|
+
…managed content…
|
|
27
|
+
<!-- END bigpowers:section-id -->
|
|
28
|
+
```
|
|
29
|
+
|
|
30
|
+
**Merge algorithm:**
|
|
31
|
+
|
|
32
|
+
1. If `BEGIN bigpowers:<id>` exists → replace inner content only.
|
|
33
|
+
2. If missing → append new fenced block at EOF.
|
|
34
|
+
3. Never delete content outside fences.
|
|
35
|
+
|
|
36
|
+
Seed these marker IDs in generated `AGENTS.md`:
|
|
37
|
+
|
|
38
|
+
| ID | Initial content |
|
|
39
|
+
|----|-----------------|
|
|
40
|
+
| `project` | Project, Commands, Architecture, Conventions, Never, Agent Rules |
|
|
41
|
+
| `context-routing` | Glob → sub-AGENTS.md table (see CLAUDE.md e45s22) |
|
|
42
|
+
| `learned-preferences` | Empty Learned User Preferences + Workspace Facts lists |
|
|
43
|
+
|
|
4
44
|
## AGENTS.md spine (Reach Template — e37s01)
|
|
5
45
|
|
|
6
46
|
Canonical source: copy from `docs/templates/AGENTS.md` in the bigpowers repo (Reach Template).
|
|
@@ -1,4 +1,5 @@
|
|
|
1
1
|
# story: e51s02
|
|
2
|
+
# story: e45s21
|
|
2
3
|
---
|
|
3
4
|
name: seed-conventions
|
|
4
5
|
model: sonnet
|
|
@@ -64,7 +65,28 @@ echo "# Specs\n\nAll planning documents for this project." > specs/README.md
|
|
|
64
65
|
|
|
65
66
|
When generating `CLAUDE.md`, if the user did not name a Preflight command, chain the Test + Lint + Build interview answers into one **Preflight** row (e.g. `npm test && npm run lint && npm run build`).
|
|
66
67
|
|
|
68
|
+
### Self-installing fenced markers (e45s21)
|
|
67
69
|
|
|
70
|
+
Skills that write into `CLAUDE.md` or `AGENTS.md` MUST use **fenced HTML comment markers** so handwritten content outside the fence is never clobbered:
|
|
71
|
+
|
|
72
|
+
```markdown
|
|
73
|
+
<!-- BEGIN bigpowers:section-id -->
|
|
74
|
+
…agent-managed content only…
|
|
75
|
+
<!-- END bigpowers:section-id -->
|
|
76
|
+
```
|
|
77
|
+
|
|
78
|
+
**Merge rule:** On update, replace only the content *between* matching `BEGIN`/`END` pairs. If a marker pair is missing, append a new fenced block at the end of the file — never rewrite the whole file.
|
|
79
|
+
|
|
80
|
+
**Standard marker IDs** for seeded projects (see [REFERENCE.md](REFERENCE.md) § Fenced markers):
|
|
81
|
+
|
|
82
|
+
| Marker ID | Owner skill | Purpose |
|
|
83
|
+
|-----------|-------------|---------|
|
|
84
|
+
| `project` | seed-conventions | Project, Commands, Architecture |
|
|
85
|
+
| `context-routing` | seed-conventions | Glob → sub-AGENTS.md routing table |
|
|
86
|
+
| `learned-preferences` | session-state | Learned User Preferences + Workspace Facts |
|
|
87
|
+
| `tooling` | setup-environment, guard-git | sqz/rtk/hook blocks installed by tooling skills |
|
|
88
|
+
|
|
89
|
+
Emit these fences in `AGENTS.md` (and therefore `CLAUDE.md` symlink) from `docs/templates/AGENTS.md`. User prose outside fences is sacred.
|
|
68
90
|
|
|
69
91
|
- [ ] CLAUDE.md exists and is populated
|
|
70
92
|
- [ ] CONVENTIONS.md exists and includes specs/ output convention
|
|
@@ -5,6 +5,8 @@ effort: standard
|
|
|
5
5
|
description: Track implementation decisions and progress in specs/state.yaml to prevent context rot. Use at the start of a session to load context, and whenever a significant decision is made or a milestone is reached.
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
+
# story: e45s23
|
|
9
|
+
|
|
8
10
|
# Session State
|
|
9
11
|
> **HARD GATE** — **HARD GATE** — Session state must be synchronized with git state. If state.yaml conflicts with the working tree, halt and ask for clarification. Do NOT assume state is correct.
|
|
10
12
|
|
|
@@ -19,6 +21,8 @@ Maintain a single source of truth for the *current* session in `specs/state.yaml
|
|
|
19
21
|
|
|
20
22
|
Legacy markdown (`specs/archive/STATE.md`, `RELEASE-PLAN.md`) is **not** SoT when YAML exists — use `specs/state.yaml` only.
|
|
21
23
|
|
|
24
|
+
When a story modifies existing behavior, patch only between matching marker pairs in `CLAUDE.md` / `AGENTS.md` `learned-preferences` fence — see e45s21.
|
|
25
|
+
|
|
22
26
|
## Handoff block (cold start)
|
|
23
27
|
|
|
24
28
|
When ending a session or before a context-heavy spawn, update `handoff` in `state.yaml`:
|
|
@@ -65,6 +69,7 @@ When starting a new session or after a significant context flush:
|
|
|
65
69
|
Whenever a significant decision is made or a milestone is reached:
|
|
66
70
|
|
|
67
71
|
- [ ] Patch via `bash scripts/bp-yaml-set.sh specs/state.yaml git.hash <hash>` (or edit directly).
|
|
72
|
+
- [ ] Patch `handoff` and `learned_preferences` / `workspace_facts` in `CLAUDE.md` fenced block when durable user preferences or repo facts crystallize (e45s23).
|
|
68
73
|
- [ ] Update `handoff.open_decisions` with rationale.
|
|
69
74
|
- [ ] Update `epic_cycle` when advancing `ship-epic` steps.
|
|
70
75
|
- [ ] Record open questions under `handoff.open_decisions` or an ADR.
|
|
@@ -131,16 +136,6 @@ handoff:
|
|
|
131
136
|
next_skill: survey-context
|
|
132
137
|
```
|
|
133
138
|
|
|
134
|
-
## Tracking commit ratio
|
|
135
|
-
|
|
136
|
-
After `release-branch` lands, compute fix-to-feature ratio via:
|
|
137
|
-
```bash
|
|
138
|
-
FEAT_COUNT=$(git log main --oneline --grep="^feat" | wc -l | tr -d ' ')
|
|
139
|
-
FIX_COUNT=$(git log main --oneline --grep="^fix" | wc -l | tr -d ' ')
|
|
140
|
-
FIX_PCT=$((FIX_COUNT * 100 / (FEAT_COUNT + FIX_COUNT)))
|
|
141
|
-
```
|
|
142
|
-
Update `specs/state.yaml` `metrics.commit_ratio` with counts. If `fix_pct > 30%`, emit: `"High fix rate (N%) — deploy + smoke-test recommended"`.
|
|
143
|
-
|
|
144
139
|
## Anti-Patterns
|
|
145
140
|
|
|
146
141
|
- **Duplicate Plan**: Don't copy `release-plan.yaml` or epic shards into `state.yaml`.
|
|
@@ -5,6 +5,8 @@ model: sonnet
|
|
|
5
5
|
effort: standard
|
|
6
6
|
---
|
|
7
7
|
|
|
8
|
+
# story: e45s29
|
|
9
|
+
|
|
8
10
|
# Slice Tasks
|
|
9
11
|
|
|
10
12
|
> **Spine position:** Step 2 — scope-work → slice-tasks → plan-work.
|
|
@@ -37,6 +39,7 @@ Produce **epic capsule story tasks** in `specs/epics/eNN-slug/` — vertical sli
|
|
|
37
39
|
- `eNNsYY-tasks.yaml` with `story_id`, `title`, `status`, `bcps`, `tasks[]` (each with `id`, `description`, `verify`, `status`)
|
|
38
40
|
- Story spec `.md` files are written by `plan-work` and follow countable-story-format.md
|
|
39
41
|
- The epic capsule manifest (`epic.yaml`) is updated to list the story ID and BCPs
|
|
42
|
+
- **Requirement deltas (e45s29):** Stories that alter existing behavior MUST carry `delta:` in `epic.yaml` (`ADDED` | `MODIFIED` | `REMOVED` | `RENAMED`). `plan-work` expands deltas into full before/after requirement text.
|
|
40
43
|
|
|
41
44
|
5. **Order by WSJF** in `release-plan.yaml` epic list — highest WSJF first. Weight-shortest-job-first ensures the highest value arrives earliest.
|
|
42
45
|
|
|
@@ -1,5 +1,16 @@
|
|
|
1
1
|
# Smoke Test — Reference
|
|
2
2
|
|
|
3
|
+
## Navigation
|
|
4
|
+
|
|
5
|
+
| Lines | Section |
|
|
6
|
+
|-------|---------|
|
|
7
|
+
| 1 | Title |
|
|
8
|
+
| 3–12 | Navigation |
|
|
9
|
+
| 14–31 | Runner script |
|
|
10
|
+
| 33–42 | Configuration reference |
|
|
11
|
+
| 44–53 | Verification |
|
|
12
|
+
| 55–160 | Reference blocks 1–5 |
|
|
13
|
+
|
|
3
14
|
## Runner script
|
|
4
15
|
|
|
5
16
|
A ready-to-use runner is provided for standalone operation:
|
|
@@ -1,3 +1,4 @@
|
|
|
1
|
+
<!-- story: e45s12 -->
|
|
1
2
|
---
|
|
2
3
|
name: stocktake-skills
|
|
3
4
|
description: Sequential subagent batch audit of the bigpowers skill catalog — Quick Scan (changed only) or Full (all skills). Use during sustain phase, before a major release, or when catalog drift is suspected.
|
|
@@ -21,6 +22,7 @@ Audit SKILL.md catalog for drift, stale triggers, missing HARD GATEs, and INDEX
|
|
|
21
22
|
|
|
22
23
|
## Process
|
|
23
24
|
|
|
25
|
+
0. **Catalog validator (code-enforced)** — run `bash scripts/validate-skill-catalog.sh`. Any FAIL is a critical finding before manual review. Add `--archive` to list zero-usage skills from `metrics.skill_timings` for auto-archiving candidates (move to `specs/epics/archive/` or delete after user confirms).
|
|
24
26
|
1. Run `bash scripts/audit-catalog.sh` to verify pi/skills ↔ source SKILL.md sync. Mismatch is a critical finding.
|
|
25
27
|
2. Run mode; for each skill check: exists, verb-noun, <300 lines total, HARD GATE present, INDEX row matches.
|
|
26
28
|
3. Write `specs/STOCKTAKE-<date>.md` with findings table (skill, issue, severity).
|
|
@@ -52,6 +54,6 @@ Timing data is populated by `scripts/bp-timing.sh start|end <skill>` calls withi
|
|
|
52
54
|
|
|
53
55
|
## Verify
|
|
54
56
|
|
|
55
|
-
→ verify: `test -f specs/STOCKTAKE-*.md && echo OK || echo MISSING`
|
|
57
|
+
→ verify: `test -f specs/STOCKTAKE-*.md && bash scripts/validate-skill-catalog.sh && echo OK || echo MISSING`
|
|
56
58
|
|
|
57
59
|
See [REFERENCE.md](REFERENCE.md) for checklist.
|
|
@@ -1,5 +1,17 @@
|
|
|
1
1
|
# Validate Contracts — Reference
|
|
2
2
|
|
|
3
|
+
## Navigation
|
|
4
|
+
|
|
5
|
+
| Lines | Section |
|
|
6
|
+
|-------|---------|
|
|
7
|
+
| 1 | Title |
|
|
8
|
+
| 3–14 | Navigation |
|
|
9
|
+
| 16–24 | Integration |
|
|
10
|
+
| 26–35 | Configuration |
|
|
11
|
+
| 37–46 | Verification |
|
|
12
|
+
| 48–170 | Reference blocks + Examples 1–6 |
|
|
13
|
+
| 172–190 | Integration (duplicate) + Configuration + Verification |
|
|
14
|
+
|
|
3
15
|
## Integration
|
|
4
16
|
|
|
5
17
|
- **Pre-deploy gate:** The `deploy` skill runs `validate-contracts` before smoke-test.
|