@lifeaitools/rdc-skills 0.25.0 → 0.25.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/plugin.json +1560 -1518
- package/.github/workflows/self-test.yml +34 -34
- package/CHANGELOG.md +322 -310
- package/MANIFEST.md +224 -221
- package/README.md +379 -377
- package/commands/build.md +181 -181
- package/commands/collab.md +180 -180
- package/commands/deploy.md +148 -148
- package/commands/fixit.md +150 -150
- package/commands/handoff.md +173 -173
- package/commands/overnight.md +220 -220
- package/commands/plan.md +158 -158
- package/commands/preplan.md +131 -131
- package/commands/prototype.md +145 -145
- package/commands/report.md +99 -99
- package/commands/review.md +120 -120
- package/commands/status.md +86 -86
- package/commands/workitems.md +127 -127
- package/git-sha.json +1 -1
- package/guides/agent-bootstrap.md +195 -195
- package/guides/agents/backend.md +102 -102
- package/guides/agents/content.md +94 -94
- package/guides/agents/cs2.md +56 -56
- package/guides/agents/data.md +86 -86
- package/guides/agents/design.md +77 -77
- package/guides/agents/frontend.md +91 -91
- package/guides/agents/infrastructure.md +81 -81
- package/guides/agents/setup.md +272 -272
- package/guides/agents/verify.md +119 -119
- package/guides/agents/viz.md +106 -106
- package/package.json +57 -57
- package/scripts/install-rdc-skills.js +1401 -1289
- package/scripts/self-test.mjs +1460 -1460
- package/scripts/validate-publish-manifests.js +502 -502
- package/skills/build/SKILL.md +574 -559
- package/skills/channel-formatter/SKILL.md +538 -538
- package/skills/collab/SKILL.md +239 -239
- package/skills/convert/SKILL.md +167 -167
- package/skills/deploy/SKILL.md +541 -541
- package/skills/design/SKILL.md +205 -205
- package/skills/env/SKILL.md +141 -0
- package/skills/fixit/SKILL.md +203 -203
- package/skills/fs-mcp/SKILL.md +37 -2
- package/skills/handoff/SKILL.md +236 -236
- package/skills/new-model/SKILL.md +49 -0
- package/skills/onramp/SKILL.md +1459 -248
- package/skills/overnight/SKILL.md +251 -251
- package/skills/plan/SKILL.md +345 -345
- package/skills/preplan/SKILL.md +90 -90
- package/skills/prototype/SKILL.md +150 -150
- package/skills/regen-media/SKILL.md +94 -0
- package/skills/release/SKILL.md +140 -140
- package/skills/report/SKILL.md +100 -100
- package/skills/review/SKILL.md +159 -151
- package/skills/self-test/SKILL.md +108 -108
- package/skills/status/SKILL.md +99 -99
- package/skills/tests/MATRIX.md +55 -54
- package/skills/tests/onramp.test.json +87 -87
- package/skills/tests/rdc-regen-media.test.json +29 -0
- package/skills/watch/SKILL.md +84 -84
- package/skills/workitems/SKILL.md +151 -151
package/skills/review/SKILL.md
CHANGED
|
@@ -1,152 +1,160 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: rdc:review
|
|
3
|
-
description: "Usage `rdc:review [--unattended]` — Post-build quality gate: tsc, tests, stale docs, export conflicts, and a mandatory pr-review-toolkit:code-reviewer pass across modified packages. Fixes what it can automatically, escalates the rest. Call after rdc:build and before merging to main."
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
> **⚠️ OUTPUT CONTRACT (READ FIRST):** `guides/output-contract.md`
|
|
7
|
-
> Checklist-only output. No tool-call narration. No raw MCP/JSON/log dumps.
|
|
8
|
-
> One checklist upfront, updated in place, shown again at end with a 1-line verdict.
|
|
9
|
-
|
|
10
|
-
> If dispatching subagents or running as a subagent: read `{PROJECT_ROOT}/.rdc/guides/agent-bootstrap.md` first (fallback: `{PROJECT_ROOT}/.rdc/guides/agent-bootstrap.md`), then `{PROJECT_ROOT}/.rdc/guides/engineering-behavior.md` (fallback: `{PROJECT_ROOT}/.rdc/guides/engineering-behavior.md`).
|
|
11
|
-
|
|
12
|
-
> **Sandbox contract:** This skill honors `RDC_TEST=1` per `guides/agent-bootstrap.md` § RDC_TEST Sandbox Contract. Destructive external calls short-circuit under the flag.
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
# rdc:review — Quality Gate
|
|
16
|
-
|
|
17
|
-
## When to Use
|
|
18
|
-
- After a build session (especially overnight builds)
|
|
19
|
-
- Before merging development → main/production
|
|
20
|
-
- Project lead asks "review the work", "is everything clean"
|
|
21
|
-
- Before any production deployment
|
|
22
|
-
- Called by `rdc:overnight` after each epic build completes
|
|
23
|
-
|
|
24
|
-
## Arguments
|
|
25
|
-
- `rdc:review` — interactive review, pauses on issues needing judgment
|
|
26
|
-
- `rdc:review --unattended` — silent mode, auto-fixes everything fixable
|
|
27
|
-
|
|
28
|
-
## Procedure
|
|
29
|
-
|
|
30
|
-
1. **Identify modified packages:**
|
|
31
|
-
```bash
|
|
32
|
-
git diff --name-only origin/main...HEAD | grep "^packages/" | cut -d/ -f2 | sort -u
|
|
33
|
-
```
|
|
34
|
-
|
|
35
|
-
2. **Run tests for each modified package:**
|
|
36
|
-
```bash
|
|
37
|
-
cd packages/<name> && npx vitest run 2>&1 | tail -10
|
|
38
|
-
```
|
|
39
|
-
Report: package → test count → pass/fail → new tests added
|
|
40
|
-
|
|
41
|
-
**IMPORTANT:** `pnpm build` must NEVER be run (crashes system). Use `npx tsc --noEmit --project <path>/tsconfig.json` for typecheck instead. For packages without tests, typecheck is the verification method. Do NOT run vitest across the entire monorepo — check only modified packages individually.
|
|
42
|
-
|
|
43
|
-
3. **Check test coverage delta:**
|
|
44
|
-
```bash
|
|
45
|
-
git diff origin/main...HEAD -- packages/*/src/ | grep -c "^+" | head -5
|
|
46
|
-
git diff origin/main...HEAD -- packages/*/test* packages/*/src/**/*.test.* packages/*/src/**/*.spec.* 2>/dev/null | grep -c "^+" || echo 0
|
|
47
|
-
```
|
|
48
|
-
Flag any package where implementation lines added > 50 but test lines added = 0.
|
|
49
|
-
|
|
50
|
-
4. **Check for export conflicts:**
|
|
51
|
-
- Read `packages/*/src/index.ts` for any package with new exports
|
|
52
|
-
- Look for duplicate export names across the barrel
|
|
53
|
-
- Verify aliased exports don't shadow each other
|
|
54
|
-
|
|
55
|
-
5. **Check for TODO/FIXME/HACK:**
|
|
56
|
-
```bash
|
|
57
|
-
grep -rn "TODO\|FIXME\|HACK\|XXX" packages/*/src/ --include="*.ts" --include="*.tsx"
|
|
58
|
-
```
|
|
59
|
-
|
|
60
|
-
6. **Check package versions:**
|
|
61
|
-
- Any package with significant new code should have a version bump
|
|
62
|
-
- Compare package.json versions to what's in `docs/SYSTEM-STATE.md`
|
|
63
|
-
|
|
64
|
-
7. **Check for stale CLAUDE.md:**
|
|
65
|
-
- If new modules were added to a package, does its CLAUDE.md mention them?
|
|
66
|
-
- Flag any package where exports grew by >10 lines but CLAUDE.md wasn't updated
|
|
67
|
-
|
|
68
|
-
8. **Orphan work item audit:**
|
|
69
|
-
```sql
|
|
70
|
-
SELECT id, title, item_type, status, source, created_at::date
|
|
71
|
-
FROM work_items
|
|
72
|
-
WHERE parent_id IS NULL
|
|
73
|
-
AND item_type NOT IN ('epic', 'bug')
|
|
74
|
-
AND status NOT IN ('done', 'archived')
|
|
75
|
-
ORDER BY created_at DESC;
|
|
76
|
-
```
|
|
77
|
-
For each orphaned task found:
|
|
78
|
-
- If it clearly belongs to an open epic → **do not run raw SQL**. No RPC exists for re-parenting. Create a work item: `SELECT insert_work_item(p_title := 'Re-parent orphaned task <task-id> to epic <epic-id>', p_priority := 'normal', p_source := 'agent')` and flag for supervisor to re-parent manually.
|
|
79
|
-
- If unclear → report (interactive) or flag in REVIEW_STATUS (unattended)
|
|
80
|
-
- Never silently leave orphaned tasks
|
|
81
|
-
- **⛔ Raw `UPDATE work_items SET parent_id = ...` is forbidden** — bypasses RLS and all constraint checks
|
|
82
|
-
|
|
83
|
-
8b. **Mandatory code-review gate — dispatch pr-review-toolkit:code-reviewer:**
|
|
84
|
-
|
|
85
|
-
⛔ **No CLEAN verdict without a code-review pass.** This is the second half of the quality gate; tsc/vitest catch type and behavior errors, code-reviewer catches logic, security, and convention drift.
|
|
86
|
-
|
|
87
|
-
Dispatch ONE `pr-review-toolkit:code-reviewer` agent on the full diff under review:
|
|
88
|
-
|
|
89
|
-
```
|
|
90
|
-
Agent({
|
|
91
|
-
subagent_type: "pr-review-toolkit:code-reviewer",
|
|
92
|
-
description: "rdc:review code-review pass",
|
|
93
|
-
prompt: "Review `git diff origin/main...HEAD` on the development branch.
|
|
94
|
-
Focus on: bugs, logic errors, security vulnerabilities, project-convention
|
|
95
|
-
adherence (.claude/rules/*, CLAUDE.md, engineering-behavior.md).
|
|
96
|
-
Confidence-based filtering — high-confidence findings only.
|
|
97
|
-
Return CODE_REVIEW_COMPLETE with: { critical_count, high_count, medium_count,
|
|
98
|
-
low_count, findings: [{severity, file:line, issue, suggested_fix}] }."
|
|
99
|
-
})
|
|
100
|
-
```
|
|
101
|
-
|
|
102
|
-
**Severity gate:**
|
|
103
|
-
- `critical` or `high` → verdict cannot be CLEAN. Interactive: report and pause. Unattended: auto-fix if mechanical (rename, missing await, obvious null check), otherwise escalate via advisor and mark HAS_ISSUES.
|
|
104
|
-
- `medium` or `low` → record in the review report's "Issues" section; verdict can still be CLEAN.
|
|
105
|
-
- Zero findings → log `CODE_REVIEW: CLEAN` and continue.
|
|
106
|
-
|
|
107
|
-
Under `RDC_TEST=1`: echo `[RDC_TEST] skipping code-review dispatch` and continue.
|
|
108
|
-
|
|
109
|
-
9. **Verification gate — dispatch the verify agent:**
|
|
110
|
-
After any fixes land, run the verify gate on every touched package. See `guides/agents/verify.md`.
|
|
111
|
-
Apply `guides/engineering-behavior.md` while reviewing: flag unnecessary abstraction, drive-by refactors, missing assumptions, hidden uncertainty, out-of-scope edits, and prose-only verification.
|
|
112
|
-
**Iron Law: no CLEAN verdict without fresh evidence.** Quote the checklist decomposition verdict, vitest output, and tsc output in the report.
|
|
1
|
+
---
|
|
2
|
+
name: rdc:review
|
|
3
|
+
description: "Usage `rdc:review [--unattended]` — Post-build quality gate: tsc, tests, stale docs, export conflicts, and a mandatory pr-review-toolkit:code-reviewer pass across modified packages. Fixes what it can automatically, escalates the rest. Call after rdc:build and before merging to main."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
> **⚠️ OUTPUT CONTRACT (READ FIRST):** `guides/output-contract.md`
|
|
7
|
+
> Checklist-only output. No tool-call narration. No raw MCP/JSON/log dumps.
|
|
8
|
+
> One checklist upfront, updated in place, shown again at end with a 1-line verdict.
|
|
9
|
+
|
|
10
|
+
> If dispatching subagents or running as a subagent: read `{PROJECT_ROOT}/.rdc/guides/agent-bootstrap.md` first (fallback: `{PROJECT_ROOT}/.rdc/guides/agent-bootstrap.md`), then `{PROJECT_ROOT}/.rdc/guides/engineering-behavior.md` (fallback: `{PROJECT_ROOT}/.rdc/guides/engineering-behavior.md`).
|
|
11
|
+
|
|
12
|
+
> **Sandbox contract:** This skill honors `RDC_TEST=1` per `guides/agent-bootstrap.md` § RDC_TEST Sandbox Contract. Destructive external calls short-circuit under the flag.
|
|
13
|
+
|
|
14
|
+
|
|
15
|
+
# rdc:review — Quality Gate
|
|
16
|
+
|
|
17
|
+
## When to Use
|
|
18
|
+
- After a build session (especially overnight builds)
|
|
19
|
+
- Before merging development → main/production
|
|
20
|
+
- Project lead asks "review the work", "is everything clean"
|
|
21
|
+
- Before any production deployment
|
|
22
|
+
- Called by `rdc:overnight` after each epic build completes
|
|
23
|
+
|
|
24
|
+
## Arguments
|
|
25
|
+
- `rdc:review` — interactive review, pauses on issues needing judgment
|
|
26
|
+
- `rdc:review --unattended` — silent mode, auto-fixes everything fixable
|
|
27
|
+
|
|
28
|
+
## Procedure
|
|
29
|
+
|
|
30
|
+
1. **Identify modified packages:**
|
|
31
|
+
```bash
|
|
32
|
+
git diff --name-only origin/main...HEAD | grep "^packages/" | cut -d/ -f2 | sort -u
|
|
33
|
+
```
|
|
34
|
+
|
|
35
|
+
2. **Run tests for each modified package:**
|
|
36
|
+
```bash
|
|
37
|
+
cd packages/<name> && npx vitest run 2>&1 | tail -10
|
|
38
|
+
```
|
|
39
|
+
Report: package → test count → pass/fail → new tests added
|
|
40
|
+
|
|
41
|
+
**IMPORTANT:** `pnpm build` must NEVER be run (crashes system). Use `npx tsc --noEmit --project <path>/tsconfig.json` for typecheck instead. For packages without tests, typecheck is the verification method. Do NOT run vitest across the entire monorepo — check only modified packages individually.
|
|
42
|
+
|
|
43
|
+
3. **Check test coverage delta:**
|
|
44
|
+
```bash
|
|
45
|
+
git diff origin/main...HEAD -- packages/*/src/ | grep -c "^+" | head -5
|
|
46
|
+
git diff origin/main...HEAD -- packages/*/test* packages/*/src/**/*.test.* packages/*/src/**/*.spec.* 2>/dev/null | grep -c "^+" || echo 0
|
|
47
|
+
```
|
|
48
|
+
Flag any package where implementation lines added > 50 but test lines added = 0.
|
|
49
|
+
|
|
50
|
+
4. **Check for export conflicts:**
|
|
51
|
+
- Read `packages/*/src/index.ts` for any package with new exports
|
|
52
|
+
- Look for duplicate export names across the barrel
|
|
53
|
+
- Verify aliased exports don't shadow each other
|
|
54
|
+
|
|
55
|
+
5. **Check for TODO/FIXME/HACK:**
|
|
56
|
+
```bash
|
|
57
|
+
grep -rn "TODO\|FIXME\|HACK\|XXX" packages/*/src/ --include="*.ts" --include="*.tsx"
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
6. **Check package versions:**
|
|
61
|
+
- Any package with significant new code should have a version bump
|
|
62
|
+
- Compare package.json versions to what's in `docs/SYSTEM-STATE.md`
|
|
63
|
+
|
|
64
|
+
7. **Check for stale CLAUDE.md:**
|
|
65
|
+
- If new modules were added to a package, does its CLAUDE.md mention them?
|
|
66
|
+
- Flag any package where exports grew by >10 lines but CLAUDE.md wasn't updated
|
|
67
|
+
|
|
68
|
+
8. **Orphan work item audit:**
|
|
69
|
+
```sql
|
|
70
|
+
SELECT id, title, item_type, status, source, created_at::date
|
|
71
|
+
FROM work_items
|
|
72
|
+
WHERE parent_id IS NULL
|
|
73
|
+
AND item_type NOT IN ('epic', 'bug')
|
|
74
|
+
AND status NOT IN ('done', 'archived')
|
|
75
|
+
ORDER BY created_at DESC;
|
|
76
|
+
```
|
|
77
|
+
For each orphaned task found:
|
|
78
|
+
- If it clearly belongs to an open epic → **do not run raw SQL**. No RPC exists for re-parenting. Create a work item: `SELECT insert_work_item(p_title := 'Re-parent orphaned task <task-id> to epic <epic-id>', p_priority := 'normal', p_source := 'agent')` and flag for supervisor to re-parent manually.
|
|
79
|
+
- If unclear → report (interactive) or flag in REVIEW_STATUS (unattended)
|
|
80
|
+
- Never silently leave orphaned tasks
|
|
81
|
+
- **⛔ Raw `UPDATE work_items SET parent_id = ...` is forbidden** — bypasses RLS and all constraint checks
|
|
82
|
+
|
|
83
|
+
8b. **Mandatory code-review gate — dispatch pr-review-toolkit:code-reviewer:**
|
|
84
|
+
|
|
85
|
+
⛔ **No CLEAN verdict without a code-review pass.** This is the second half of the quality gate; tsc/vitest catch type and behavior errors, code-reviewer catches logic, security, and convention drift.
|
|
86
|
+
|
|
87
|
+
Dispatch ONE `pr-review-toolkit:code-reviewer` agent on the full diff under review:
|
|
88
|
+
|
|
89
|
+
```
|
|
90
|
+
Agent({
|
|
91
|
+
subagent_type: "pr-review-toolkit:code-reviewer",
|
|
92
|
+
description: "rdc:review code-review pass",
|
|
93
|
+
prompt: "Review `git diff origin/main...HEAD` on the development branch.
|
|
94
|
+
Focus on: bugs, logic errors, security vulnerabilities, project-convention
|
|
95
|
+
adherence (.claude/rules/*, CLAUDE.md, engineering-behavior.md).
|
|
96
|
+
Confidence-based filtering — high-confidence findings only.
|
|
97
|
+
Return CODE_REVIEW_COMPLETE with: { critical_count, high_count, medium_count,
|
|
98
|
+
low_count, findings: [{severity, file:line, issue, suggested_fix}] }."
|
|
99
|
+
})
|
|
100
|
+
```
|
|
101
|
+
|
|
102
|
+
**Severity gate:**
|
|
103
|
+
- `critical` or `high` → verdict cannot be CLEAN. Interactive: report and pause. Unattended: auto-fix if mechanical (rename, missing await, obvious null check), otherwise escalate via advisor and mark HAS_ISSUES.
|
|
104
|
+
- `medium` or `low` → record in the review report's "Issues" section; verdict can still be CLEAN.
|
|
105
|
+
- Zero findings → log `CODE_REVIEW: CLEAN` and continue.
|
|
106
|
+
|
|
107
|
+
Under `RDC_TEST=1`: echo `[RDC_TEST] skipping code-review dispatch` and continue.
|
|
108
|
+
|
|
109
|
+
9. **Verification gate — dispatch the verify agent:**
|
|
110
|
+
After any fixes land, run the verify gate on every touched package. See `guides/agents/verify.md`.
|
|
111
|
+
Apply `guides/engineering-behavior.md` while reviewing: flag unnecessary abstraction, drive-by refactors, missing assumptions, hidden uncertainty, out-of-scope edits, and prose-only verification.
|
|
112
|
+
**Iron Law: no CLEAN verdict without fresh evidence.** Quote the checklist decomposition verdict, vitest output, and tsc output in the report.
|
|
113
113
|
The verify agent must reject any work item that lacks passed `decomp-*` checklist rows, whose rows are too coarse to prove one observable behavior at a time, OR whose checklist falls below the per-surface completeness floor (a feature WP with 5-6 rows where its surfaces demand 12-20 attested rows is a REJECT).
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
|
|
117
|
-
-
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
|
|
121
|
-
|
|
122
|
-
|
|
123
|
-
|
|
124
|
-
|
|
125
|
-
|
|
126
|
-
|
|
127
|
-
|
|
128
|
-
|
|
129
|
-
|
|
130
|
-
|
|
131
|
-
|
|
132
|
-
|
|
133
|
-
|
|
134
|
-
|
|
135
|
-
|
|
136
|
-
|
|
137
|
-
-
|
|
138
|
-
```
|
|
139
|
-
|
|
140
|
-
|
|
141
|
-
|
|
142
|
-
##
|
|
143
|
-
|
|
144
|
-
|
|
145
|
-
- Unattended:
|
|
146
|
-
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
##
|
|
151
|
-
|
|
152
|
-
|
|
114
|
+
**Durable workflow hard gate:** If the diff adds or changes a queue/job,
|
|
115
|
+
background worker, storage hand-off, retry/lease, webhook, or async
|
|
116
|
+
cross-process path, require a committed E2E harness and a fresh receipt from
|
|
117
|
+
a deploy-equivalent container plus real disposable dependencies (or isolated
|
|
118
|
+
mirror). It must invoke public ingress, prove the complete state transition,
|
|
119
|
+
verify every persisted output, and prove `finally` cleanup. Unit tests,
|
|
120
|
+
mocks, migrations, Docker construction, and route-health probes are not
|
|
121
|
+
substitutes; missing evidence means `HAS_ISSUES`, never `CLEAN`.
|
|
122
|
+
If verify fails → do NOT emit CLEAN. Loop back, fix, re-run verify.
|
|
123
|
+
|
|
124
|
+
10. **Fix issues found:**
|
|
125
|
+
- Failing tests → fix and commit
|
|
126
|
+
- Export conflicts → resolve and commit
|
|
127
|
+
- Missing version bumps → bump and commit
|
|
128
|
+
- All fixes as separate commits with descriptive messages
|
|
129
|
+
|
|
130
|
+
**Judgment calls:**
|
|
131
|
+
- Interactive: report — don't guess
|
|
132
|
+
- Unattended: escalate via advisor tool with: error message, surrounding context,
|
|
133
|
+
two most likely fix paths. Resume with advisor's recommendation.
|
|
134
|
+
If advisor unavailable: take the most conservative path, flag in status block.
|
|
135
|
+
|
|
136
|
+
11. **Report:**
|
|
137
|
+
- Interactive:
|
|
138
|
+
```
|
|
139
|
+
## Review Results
|
|
140
|
+
| Package | Tests | Pass/Fail | New Tests | Issues |
|
|
141
|
+
## Fixed
|
|
142
|
+
## Remaining Issues
|
|
143
|
+
## Verdict: CLEAN / HAS ISSUES
|
|
144
|
+
```
|
|
145
|
+
- Unattended: emit status block only:
|
|
146
|
+
```
|
|
147
|
+
REVIEW_STATUS: { verdict: "CLEAN|HAS_ISSUES", packages_checked, tests_passed, tests_failed, new_tests_added, fixes_applied, escalations }
|
|
148
|
+
```
|
|
149
|
+
|
|
150
|
+
## Rules
|
|
151
|
+
- Do NOT run `pnpm build` (crashes system) — vitest only
|
|
152
|
+
- Interactive: fix what you can, flag what needs decision
|
|
153
|
+
- Unattended: fix everything fixable; escalate judgment calls to advisor
|
|
154
|
+
- Each fix is a separate commit (not batched)
|
|
155
|
+
- Always push fixes to origin after committing *(skip if `$RDC_TEST=1` — echo `[RDC_TEST] skipping git push` instead)*
|
|
156
|
+
- Unattended: NEVER pause for input
|
|
157
|
+
|
|
158
|
+
## Capture lessons (exit step)
|
|
159
|
+
|
|
160
|
+
Before the final verdict line, follow `.rdc/guides/lessons-learned-spec.md` § Capture procedure. If this run taught something non-obvious — a first root-cause theory that turned out wrong, the documented/standard path not working, a missing gate or check that cost a round, or a surprising tool/infra behavior — write one `.rdc/lessons/<YYYY-MM-DD>-review-<short-slug>.md` per lesson using the schema in that spec. Set `scope` (`simple` | `architectural`) and `status` (`open`, or `applied` if you shipped the fix in this same run, with the commit linked). Commit the lesson file(s) on `develop` alongside the run's other commits, and note "N lessons captured" in your verdict/summary. A run that taught nothing writes nothing — absence is the default.
|
|
@@ -1,100 +1,100 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: rdc:self-test
|
|
3
|
-
description: "Usage `rdc:self-test [--strict]` — Validate all rdc:* skills, plugin manifest, and tooling consistency. Use after editing skills, upgrading the plugin, or when a skill behaves unexpectedly."
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
> **⚠️ OUTPUT CONTRACT (READ FIRST):** `guides/output-contract.md`
|
|
7
|
-
> Checklist-only output. No tool-call narration. No raw runner dumps — summarize.
|
|
8
|
-
> One checklist upfront, updated in place, shown again at end with a 1-line verdict.
|
|
9
|
-
|
|
10
|
-
> **Sandbox contract:** This skill honors `RDC_TEST=1` per `guides/agent-bootstrap.md` § RDC_TEST Sandbox Contract. Tier 2 behavioral runs and any git push are skipped under `RDC_TEST=1`; Tier 1 static lint runs normally.
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
# rdc:self-test — Skill Library Self-Test (Tier 1)
|
|
14
|
-
|
|
15
|
-
## When to Use
|
|
16
|
-
- Before every `rdc:release rdc-skills` tag push
|
|
17
|
-
- After editing any skill description or frontmatter
|
|
18
|
-
- When a skill mysteriously disappears from the menu (backtick bug repro)
|
|
19
|
-
- In CI on every rdc-skills PR (once wired)
|
|
20
|
-
|
|
21
|
-
## Tiers
|
|
22
|
-
|
|
23
|
-
| Tier | What it checks | Status |
|
|
24
|
-
|------|----------------|--------|
|
|
25
|
-
| Tier 1 | Static lint — frontmatter, Usage line, referenced files, name match | ✅ live |
|
|
1
|
+
---
|
|
2
|
+
name: rdc:self-test
|
|
3
|
+
description: "Usage `rdc:self-test [--strict]` — Validate all rdc:* skills, plugin manifest, and tooling consistency. Use after editing skills, upgrading the plugin, or when a skill behaves unexpectedly."
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
> **⚠️ OUTPUT CONTRACT (READ FIRST):** `guides/output-contract.md`
|
|
7
|
+
> Checklist-only output. No tool-call narration. No raw runner dumps — summarize.
|
|
8
|
+
> One checklist upfront, updated in place, shown again at end with a 1-line verdict.
|
|
9
|
+
|
|
10
|
+
> **Sandbox contract:** This skill honors `RDC_TEST=1` per `guides/agent-bootstrap.md` § RDC_TEST Sandbox Contract. Tier 2 behavioral runs and any git push are skipped under `RDC_TEST=1`; Tier 1 static lint runs normally.
|
|
11
|
+
|
|
12
|
+
|
|
13
|
+
# rdc:self-test — Skill Library Self-Test (Tier 1)
|
|
14
|
+
|
|
15
|
+
## When to Use
|
|
16
|
+
- Before every `rdc:release rdc-skills` tag push
|
|
17
|
+
- After editing any skill description or frontmatter
|
|
18
|
+
- When a skill mysteriously disappears from the menu (backtick bug repro)
|
|
19
|
+
- In CI on every rdc-skills PR (once wired)
|
|
20
|
+
|
|
21
|
+
## Tiers
|
|
22
|
+
|
|
23
|
+
| Tier | What it checks | Status |
|
|
24
|
+
|------|----------------|--------|
|
|
25
|
+
| Tier 1 | Static lint — frontmatter, Usage line, referenced files, name match | ✅ live |
|
|
26
26
|
| Tier 2 | Behavioral — headless Claude or Codex runs each skill in sandbox, asserts artifacts | ✅ live — 30 manifests; acceptance harness records transcripts, tool calls, artifacts, and lessons learned |
|
|
27
|
-
| Tier 3 | Golden checklists — snapshot output format, regress on drift | 🔒 future |
|
|
28
|
-
|
|
29
|
-
## Interactive UI
|
|
30
|
-
|
|
31
|
-
Launch the interactive menu — pick tier, pick skill, see live output:
|
|
32
|
-
|
|
33
|
-
```bash
|
|
27
|
+
| Tier 3 | Golden checklists — snapshot output format, regress on drift | 🔒 future |
|
|
28
|
+
|
|
29
|
+
## Interactive UI
|
|
30
|
+
|
|
31
|
+
Launch the interactive menu — pick tier, pick skill, see live output:
|
|
32
|
+
|
|
33
|
+
```bash
|
|
34
34
|
node {RDC_SKILLS_ROOT}/scripts/self-test-ui.mjs
|
|
35
|
-
```
|
|
36
|
-
|
|
37
|
-
Menu options:
|
|
38
|
-
- **1** — Full Tier 1 test (all skills)
|
|
39
|
-
- **2** — Pick a specific skill from a numbered list
|
|
40
|
-
- **3** — Choose tier (Tier 1 static lint | Tier 2 behavioral | Tier 3 🔒 future)
|
|
41
|
-
|
|
42
|
-
Test output streams live to the terminal. No server, no extra processes.
|
|
43
|
-
|
|
44
|
-
## Procedure (Tier 1)
|
|
45
|
-
|
|
46
|
-
1. **Run the linter (direct or via UI):**
|
|
47
|
-
```bash
|
|
35
|
+
```
|
|
36
|
+
|
|
37
|
+
Menu options:
|
|
38
|
+
- **1** — Full Tier 1 test (all skills)
|
|
39
|
+
- **2** — Pick a specific skill from a numbered list
|
|
40
|
+
- **3** — Choose tier (Tier 1 static lint | Tier 2 behavioral | Tier 3 🔒 future)
|
|
41
|
+
|
|
42
|
+
Test output streams live to the terminal. No server, no extra processes.
|
|
43
|
+
|
|
44
|
+
## Procedure (Tier 1)
|
|
45
|
+
|
|
46
|
+
1. **Run the linter (direct or via UI):**
|
|
47
|
+
```bash
|
|
48
48
|
node {RDC_SKILLS_ROOT}/scripts/self-test.mjs
|
|
49
|
-
# or interactively:
|
|
49
|
+
# or interactively:
|
|
50
50
|
node {RDC_SKILLS_ROOT}/scripts/self-test-ui.mjs
|
|
51
|
-
```
|
|
52
|
-
|
|
53
|
-
2. **Interpret exit codes:**
|
|
54
|
-
- `0` = all skills pass
|
|
55
|
-
- `1` = at least one FAIL or (in `--strict` mode) at least one WARN
|
|
56
|
-
- `2` = runner itself crashed (e.g., skills dir unreadable)
|
|
57
|
-
- `3` = `.claude-plugin/plugin.json` missing entirely (distinct from skill failures)
|
|
58
|
-
|
|
59
|
-
3. **Common findings and fixes:**
|
|
60
|
-
|
|
61
|
-
| Finding code | Cause | Fix |
|
|
62
|
-
|---|---|---|
|
|
63
|
-
| `description-backtick-leading` | Folded YAML starts with `` ` `` — parser drops skill | Rewrite description to start with a word |
|
|
64
|
-
| `usage-marker-missing` | No `` Usage `rdc:name <args>` `` in description | Front-load arg contract |
|
|
65
|
-
| `usage-marker-mismatch` | `Usage` line references a different skill's name (copy-paste drift) | Fix the skill name in the Usage marker |
|
|
66
|
-
| `name-filename-mismatch` | frontmatter `name:` ≠ filename | `--fix` auto-renames; or rewrite name |
|
|
67
|
-
| `guide-not-found` / `rule-not-found` / `hook-not-found` | Dead reference in skill body | Create file or fix link |
|
|
68
|
-
| `banner-missing` | Skill missing OUTPUT CONTRACT banner | `--fix` auto-inserts |
|
|
69
|
-
| `manifest-missing` / `manifest-version-mismatch` | `.claude-plugin/plugin.json` missing or out-of-sync with `package.json` | Create/update manifest |
|
|
70
|
-
| `duplicate-skill-name` / `skill-guide-filename-collision` | Two skills claim same name, or skill collides with agent guide | Rename one |
|
|
71
|
-
| `orphan-hook` | File under `hooks/` isn't referenced by any skill, settings.json, or plugin.json | Wire it up or delete |
|
|
72
|
-
|
|
73
|
-
4. **Flags:**
|
|
74
|
-
- `--strict` — promotes warnings to failures (use in CI and before release)
|
|
75
|
-
- `--skill <name>` — run against a single skill (e.g. `--skill rdc:build`)
|
|
76
|
-
- `--json` — machine-readable schema v2 (per-skill `findings[]` with `code` + `level`, plugin_manifest block, global_findings, summary.exit_code). Consumed by Tier 2 runner as pre-gate.
|
|
77
|
-
- `--fix` — auto-repair fixable findings: insert missing OUTPUT CONTRACT banner, rename files to match frontmatter name. Prints `FIXED:` lines + touched file list so you can git diff + commit. Backtick-leading descriptions are NOT auto-fixed (need human rewrite).
|
|
78
|
-
|
|
79
|
-
5. **Report to the project lead:**
|
|
80
|
-
```
|
|
81
|
-
Self-test: X/Y pass, Z warnings, W failures
|
|
82
|
-
Failures: <list>
|
|
83
|
-
Verdict: PASS | FAIL
|
|
84
|
-
```
|
|
85
|
-
|
|
86
|
-
## Procedure (Tier 2)
|
|
87
|
-
|
|
51
|
+
```
|
|
52
|
+
|
|
53
|
+
2. **Interpret exit codes:**
|
|
54
|
+
- `0` = all skills pass
|
|
55
|
+
- `1` = at least one FAIL or (in `--strict` mode) at least one WARN
|
|
56
|
+
- `2` = runner itself crashed (e.g., skills dir unreadable)
|
|
57
|
+
- `3` = `.claude-plugin/plugin.json` missing entirely (distinct from skill failures)
|
|
58
|
+
|
|
59
|
+
3. **Common findings and fixes:**
|
|
60
|
+
|
|
61
|
+
| Finding code | Cause | Fix |
|
|
62
|
+
|---|---|---|
|
|
63
|
+
| `description-backtick-leading` | Folded YAML starts with `` ` `` — parser drops skill | Rewrite description to start with a word |
|
|
64
|
+
| `usage-marker-missing` | No `` Usage `rdc:name <args>` `` in description | Front-load arg contract |
|
|
65
|
+
| `usage-marker-mismatch` | `Usage` line references a different skill's name (copy-paste drift) | Fix the skill name in the Usage marker |
|
|
66
|
+
| `name-filename-mismatch` | frontmatter `name:` ≠ filename | `--fix` auto-renames; or rewrite name |
|
|
67
|
+
| `guide-not-found` / `rule-not-found` / `hook-not-found` | Dead reference in skill body | Create file or fix link |
|
|
68
|
+
| `banner-missing` | Skill missing OUTPUT CONTRACT banner | `--fix` auto-inserts |
|
|
69
|
+
| `manifest-missing` / `manifest-version-mismatch` | `.claude-plugin/plugin.json` missing or out-of-sync with `package.json` | Create/update manifest |
|
|
70
|
+
| `duplicate-skill-name` / `skill-guide-filename-collision` | Two skills claim same name, or skill collides with agent guide | Rename one |
|
|
71
|
+
| `orphan-hook` | File under `hooks/` isn't referenced by any skill, settings.json, or plugin.json | Wire it up or delete |
|
|
72
|
+
|
|
73
|
+
4. **Flags:**
|
|
74
|
+
- `--strict` — promotes warnings to failures (use in CI and before release)
|
|
75
|
+
- `--skill <name>` — run against a single skill (e.g. `--skill rdc:build`)
|
|
76
|
+
- `--json` — machine-readable schema v2 (per-skill `findings[]` with `code` + `level`, plugin_manifest block, global_findings, summary.exit_code). Consumed by Tier 2 runner as pre-gate.
|
|
77
|
+
- `--fix` — auto-repair fixable findings: insert missing OUTPUT CONTRACT banner, rename files to match frontmatter name. Prints `FIXED:` lines + touched file list so you can git diff + commit. Backtick-leading descriptions are NOT auto-fixed (need human rewrite).
|
|
78
|
+
|
|
79
|
+
5. **Report to the project lead:**
|
|
80
|
+
```
|
|
81
|
+
Self-test: X/Y pass, Z warnings, W failures
|
|
82
|
+
Failures: <list>
|
|
83
|
+
Verdict: PASS | FAIL
|
|
84
|
+
```
|
|
85
|
+
|
|
86
|
+
## Procedure (Tier 2)
|
|
87
|
+
|
|
88
88
|
Tier 2 runs each skill end-to-end in an isolated sandbox and asserts on observed state (files touched, commits made, work items, exit code). Build acceptance additionally records all observable engine events/tool calls, assistant output, stdout/stderr artifacts, lessons learned, and next build optimizations. It supports `--engine claude` and `--engine codex`; both engines use the same manifests, worktree sandbox, JSONL evidence, and Markdown report. Use it before shipping behavioral changes — Tier 1 alone can't catch runtime drift.
|
|
89
|
-
|
|
90
|
-
1. **Prerequisites:**
|
|
89
|
+
|
|
90
|
+
1. **Prerequisites:**
|
|
91
91
|
- `claude` CLI on PATH for Claude runs (headless mode: `claude --print`)
|
|
92
92
|
- `codex` CLI on PATH for Codex runs (headless mode: `codex exec --json`)
|
|
93
|
-
- clauth daemon unlocked (`curl -s http://127.0.0.1:52437/ping`)
|
|
94
|
-
- Supabase MCP reachable (runner creates a throwaway test branch)
|
|
95
|
-
- Clean git tree in `rdc-skills` (worktrees are added under `.rdc/sandbox/<run-id>/`)
|
|
96
|
-
|
|
97
|
-
2. **Run:**
|
|
93
|
+
- clauth daemon unlocked (`curl -s http://127.0.0.1:52437/ping`)
|
|
94
|
+
- Supabase MCP reachable (runner creates a throwaway test branch)
|
|
95
|
+
- Clean git tree in `rdc-skills` (worktrees are added under `.rdc/sandbox/<run-id>/`)
|
|
96
|
+
|
|
97
|
+
2. **Run:**
|
|
98
98
|
```bash
|
|
99
99
|
node scripts/self-test.mjs --tier2 # all skills with manifests
|
|
100
100
|
node scripts/self-test.mjs --tier2 --skill rdc:build # single skill
|
|
@@ -103,30 +103,30 @@ Tier 2 runs each skill end-to-end in an isolated sandbox and asserts on observed
|
|
|
103
103
|
node scripts/acceptance.mjs --skill rdc:build # build acceptance with JSONL/tool-call evidence
|
|
104
104
|
node scripts/acceptance.mjs --engine codex --skill rdc:build
|
|
105
105
|
```
|
|
106
|
-
|
|
107
|
-
3. **What it does:**
|
|
108
|
-
- Runs Tier 1 as a pre-gate (fails fast if static lint fails)
|
|
109
|
-
- Creates one Supabase test branch for the run
|
|
106
|
+
|
|
107
|
+
3. **What it does:**
|
|
108
|
+
- Runs Tier 1 as a pre-gate (fails fast if static lint fails)
|
|
109
|
+
- Creates one Supabase test branch for the run
|
|
110
110
|
- For each skill: `git worktree add` into `.rdc/sandbox/<run-id>/<skill>/`, sets `RDC_TEST=1`, invokes the selected headless engine with the skill prompt, waits for exit
|
|
111
111
|
- Asserts per the skill's manifest: exit code, files touched, commits made, stdout patterns
|
|
112
112
|
- Build acceptance writes JSONL evidence and extracts tool calls from the engine stream
|
|
113
113
|
- Cleans up worktrees + deletes the Supabase branch at the end (even on failure)
|
|
114
|
-
|
|
115
|
-
4. **Reports:**
|
|
114
|
+
|
|
115
|
+
4. **Reports:**
|
|
116
116
|
- `.rdc/reports/self-test-tier2-<iso>.json` — full per-skill result, findings, timings
|
|
117
117
|
- `.rdc/reports/acceptance-*.jsonl` and `.rdc/reports/acceptance-*.md` — build acceptance evidence, transcript artifact pointers, lessons learned, and next build optimizations
|
|
118
118
|
- Exit codes: `0` pass, `1` fail (one or more skills failed assertions), `2` runner error (couldn't set up sandbox / branch)
|
|
119
|
-
|
|
120
|
-
5. **Adding a new manifest:**
|
|
121
|
-
- Create `skills/tests/<skill>.test.json` (one per skill, colocated)
|
|
122
|
-
- Validate the shape against the schema at `scripts/lib/manifest-schema.mjs`
|
|
123
|
-
- Test it in isolation: `node scripts/self-test.mjs --tier2 --skill rdc:name`
|
|
124
|
-
- Commit the manifest alongside any skill body changes
|
|
125
|
-
|
|
126
|
-
## Rules
|
|
127
|
-
- Run Tier 1 **before every `rdc:release rdc-skills`** — it catches the backtick-drift class of bugs that break the skill menu silently.
|
|
128
|
-
- Use `--strict` in CI. Warnings matter in the release path.
|
|
129
|
-
- Do NOT skip findings by relaxing the linter. Fix the skill.
|
|
130
|
-
- Run Tier 2 before tagging a release. Gate the tag if any manifested skill fails.
|
|
119
|
+
|
|
120
|
+
5. **Adding a new manifest:**
|
|
121
|
+
- Create `skills/tests/<skill>.test.json` (one per skill, colocated)
|
|
122
|
+
- Validate the shape against the schema at `scripts/lib/manifest-schema.mjs`
|
|
123
|
+
- Test it in isolation: `node scripts/self-test.mjs --tier2 --skill rdc:name`
|
|
124
|
+
- Commit the manifest alongside any skill body changes
|
|
125
|
+
|
|
126
|
+
## Rules
|
|
127
|
+
- Run Tier 1 **before every `rdc:release rdc-skills`** — it catches the backtick-drift class of bugs that break the skill menu silently.
|
|
128
|
+
- Use `--strict` in CI. Warnings matter in the release path.
|
|
129
|
+
- Do NOT skip findings by relaxing the linter. Fix the skill.
|
|
130
|
+
- Run Tier 2 before tagging a release. Gate the tag if any manifested skill fails.
|
|
131
131
|
- Headless sessions must not steal focus. The runner uses hidden process launch options where supported; if windows flash or focus is grabbed, inspect `scripts/lib/runner.mjs` before changing skill behavior.
|
|
132
132
|
- If Tier 2 tests fail with `exit_code: -1`, verify the runner still passes `--dangerously-skip-permissions` and sets `RDC_TEST=1`.
|