@softspark/ai-toolkit 1.3.14 → 1.3.15
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +12 -0
- package/README.md +37 -0
- package/app/agents/backend-specialist.md +8 -0
- package/app/agents/code-reviewer.md +9 -0
- package/app/agents/database-architect.md +8 -0
- package/app/agents/debugger.md +8 -0
- package/app/agents/devops-implementer.md +8 -0
- package/app/agents/documenter.md +8 -0
- package/app/agents/frontend-specialist.md +8 -0
- package/app/agents/performance-optimizer.md +8 -0
- package/app/agents/security-auditor.md +9 -0
- package/app/agents/test-engineer.md +9 -0
- package/app/skills/analyze/SKILL.md +15 -0
- package/app/skills/api-patterns/SKILL.md +10 -0
- package/app/skills/ci-cd-patterns/SKILL.md +10 -0
- package/app/skills/clean-code/SKILL.md +10 -0
- package/app/skills/database-patterns/SKILL.md +10 -0
- package/app/skills/debug/SKILL.md +16 -0
- package/app/skills/docs/SKILL.md +16 -0
- package/app/skills/git-mastery/SKILL.md +10 -0
- package/app/skills/onboard/SKILL.md +15 -0
- package/app/skills/performance-profiling/SKILL.md +10 -0
- package/app/skills/plan/SKILL.md +16 -0
- package/app/skills/refactor/SKILL.md +16 -0
- package/app/skills/review/SKILL.md +58 -3
- package/app/skills/security-patterns/SKILL.md +10 -0
- package/app/skills/tdd/SKILL.md +6 -0
- package/app/skills/testing-patterns/SKILL.md +10 -0
- package/kb/reference/architecture-overview.md +18 -1
- package/kb/reference/skills-catalog.md +57 -1
- package/llms-full.txt +75 -2
- package/manifest.json +1 -1
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
|
@@ -7,6 +7,18 @@ Versioning follows [Semantic Versioning](https://semver.org/).
|
|
|
7
7
|
|
|
8
8
|
---
|
|
9
9
|
|
|
10
|
+
## v1.3.15 — Quality Guardrails: Anti-Rationalization, Confidence Scoring, Verification Checklists (2026-04-08)
|
|
11
|
+
|
|
12
|
+
### Added
|
|
13
|
+
- **Anti-rationalization tables** — 15 core skills now include `## Common Rationalizations` sections with domain-specific excuse/rebuttal tables that prevent agent drift and shortcut-taking. Inspired by [addyosmani/agent-skills](https://github.com/addyosmani/agent-skills).
|
|
14
|
+
- **Confidence scoring** (`/review`) — review findings now include per-issue confidence scores (1-10) and severity classification (critical/major/minor/nit) with a calibration guide.
|
|
15
|
+
- **LLM-as-Judge self-evaluation** (`/review`) — structured self-check after review: blind spot detection, anchoring bias check, and confidence calibration.
|
|
16
|
+
- **Agent verification checklists** — 10 key agents (`code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`) now include `## Verification Checklist` exit criteria.
|
|
17
|
+
- **Skill reference routing** — 7 core skills (`/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`) include `## Related Skills` sections for follow-up discoverability.
|
|
18
|
+
- **Intent Capture Interview** (`/onboard`) — Step 0 interview phase with 5 targeted questions to capture undocumented project intent before setup.
|
|
19
|
+
|
|
20
|
+
---
|
|
21
|
+
|
|
10
22
|
## v1.3.14 — CVE Scanner + Open Contributions (2026-04-08)
|
|
11
23
|
|
|
12
24
|
### Added
|
package/README.md
CHANGED
|
@@ -385,6 +385,43 @@ Three skills enforce non-negotiable quality gates with anti-rationalization tabl
|
|
|
385
385
|
| `debugging-tactics` | `NO FIXES WITHOUT ROOT CAUSE INVESTIGATION FIRST` | 4-phase debugging: root cause → pattern → hypothesis → fix. 3+ failed fixes → question architecture. |
|
|
386
386
|
| `verification-before-completion` | `NO COMPLETION CLAIMS WITHOUT FRESH VERIFICATION EVIDENCE` | Gate function: IDENTIFY → RUN → READ → VERIFY → CLAIM. "Should work now" is not evidence. |
|
|
387
387
|
|
|
388
|
+
Additionally, **15 core skills** include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift and shortcut-taking. Skills with rationalization tables: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
|
|
389
|
+
|
|
390
|
+
### Confidence Scoring & Self-Evaluation (`/review`)
|
|
391
|
+
|
|
392
|
+
The `/review` skill outputs findings with per-issue confidence scores (1-10) and severity classification (critical/major/minor/nit). After completing a review, an LLM-as-Judge self-evaluation pass checks for blind spots: anchoring bias, assumption vs verification, missing unhappy paths, and calibrates confidence scores.
|
|
393
|
+
|
|
394
|
+
### Agent Verification Checklists
|
|
395
|
+
|
|
396
|
+
10 key agents include `## Verification Checklist` — exit criteria that MUST be met before presenting results. Each checklist is domain-specific:
|
|
397
|
+
|
|
398
|
+
| Agent | Key exit criteria |
|
|
399
|
+
|-------|------------------|
|
|
400
|
+
| `code-reviewer` | Every finding has file:line + evidence, not just opinion |
|
|
401
|
+
| `security-auditor` | Each finding includes proof-of-concept or exploit path |
|
|
402
|
+
| `test-engineer` | No empty/placeholder tests, mocks only at boundaries |
|
|
403
|
+
| `debugger` | Root cause identified, regression test added |
|
|
404
|
+
| `backend-specialist` | Input validation, error format, query optimization |
|
|
405
|
+
| `frontend-specialist` | Empty/loading/error states, accessibility, responsive |
|
|
406
|
+
| `database-architect` | Migration tested on prod-like volume, rollback tested |
|
|
407
|
+
| `performance-optimizer` | Baseline measured, profiler evidence attached |
|
|
408
|
+
| `devops-implementer` | Dry run passed, rollback documented, no hardcoded secrets |
|
|
409
|
+
| `documenter` | Code examples runnable, no placeholders, valid links |
|
|
410
|
+
|
|
411
|
+
### Skill Reference Routing
|
|
412
|
+
|
|
413
|
+
7 core skills include `## Related Skills` sections that suggest logical follow-up skills, improving discoverability:
|
|
414
|
+
|
|
415
|
+
```
|
|
416
|
+
/review → found issues? → /debug, /tdd, /cve-scan, /analyze
|
|
417
|
+
/debug → bug fixed? → /review, /tdd, /workflow incident-response
|
|
418
|
+
/plan → approved? → /orchestrate, /write-a-prd, /grill-me
|
|
419
|
+
```
|
|
420
|
+
|
|
421
|
+
### Intent Capture Interview (`/onboard`)
|
|
422
|
+
|
|
423
|
+
The `/onboard` skill now includes a Step 0 interview phase before setup — asking 5 targeted questions to capture undocumented project intent (common contributor mistakes, protected files, deployment model, non-obvious constraints, review culture). Answers customize the generated `CLAUDE.md`.
|
|
424
|
+
|
|
388
425
|
### 7. Two-Stage Review (`/subagent-development`)
|
|
389
426
|
|
|
390
427
|
Per-task review pipeline inspired by [obra/superpowers](https://github.com/obra/superpowers):
|
|
@@ -184,6 +184,14 @@ After implementing significant changes, update documentation:
|
|
|
184
184
|
### Delegation
|
|
185
185
|
For large documentation tasks, hand off to `documenter` agent.
|
|
186
186
|
|
|
187
|
+
## Verification Checklist
|
|
188
|
+
Before presenting implementation:
|
|
189
|
+
- [ ] All new endpoints have input validation
|
|
190
|
+
- [ ] Error responses follow the project's error format
|
|
191
|
+
- [ ] Database queries are optimized (checked with EXPLAIN if applicable)
|
|
192
|
+
- [ ] New dependencies are justified and audited
|
|
193
|
+
- [ ] Migration is reversible
|
|
194
|
+
|
|
187
195
|
## KB Integration
|
|
188
196
|
|
|
189
197
|
Before coding, search knowledge base:
|
|
@@ -177,6 +177,15 @@ After significant reviews, update documentation:
|
|
|
177
177
|
### Delegation
|
|
178
178
|
For large documentation tasks, hand off to `documenter` agent.
|
|
179
179
|
|
|
180
|
+
## Verification Checklist
|
|
181
|
+
Before presenting review results:
|
|
182
|
+
- [ ] Every finding includes file:line reference
|
|
183
|
+
- [ ] Each finding has evidence (code snippet or reasoning), not just opinion
|
|
184
|
+
- [ ] Severity rating reflects actual impact, not gut feeling
|
|
185
|
+
- [ ] "No findings" includes list of specific checks performed
|
|
186
|
+
- [ ] Security-sensitive files received deeper scrutiny
|
|
187
|
+
- [ ] Test coverage gaps are flagged, not assumed covered
|
|
188
|
+
|
|
180
189
|
## Limitations
|
|
181
190
|
|
|
182
191
|
- **Security penetration testing** → Use `security-auditor`
|
|
@@ -308,6 +308,14 @@ After schema/database changes, update documentation:
|
|
|
308
308
|
### Delegation
|
|
309
309
|
For large documentation tasks, hand off to `documenter` agent.
|
|
310
310
|
|
|
311
|
+
## Verification Checklist
|
|
312
|
+
Before presenting schema changes:
|
|
313
|
+
- [ ] Migration tested on production-like data volume
|
|
314
|
+
- [ ] Rollback script exists and was tested
|
|
315
|
+
- [ ] Indexes cover the expected query patterns
|
|
316
|
+
- [ ] No long-running locks on large tables
|
|
317
|
+
- [ ] Application handles both old and new schema during migration
|
|
318
|
+
|
|
311
319
|
## KB Integration
|
|
312
320
|
|
|
313
321
|
Before designing, search knowledge base:
|
package/app/agents/debugger.md
CHANGED
|
@@ -231,6 +231,14 @@ After fixing significant bugs, update documentation:
|
|
|
231
231
|
### Delegation
|
|
232
232
|
For large documentation tasks, hand off to `documenter` agent.
|
|
233
233
|
|
|
234
|
+
## Verification Checklist
|
|
235
|
+
Before claiming a bug is fixed:
|
|
236
|
+
- [ ] Root cause identified, not just symptoms addressed
|
|
237
|
+
- [ ] Fix was verified by reproducing the original failure first
|
|
238
|
+
- [ ] Regression test added to prevent recurrence
|
|
239
|
+
- [ ] Related code paths checked for similar issues
|
|
240
|
+
- [ ] Fix doesn't introduce new side effects
|
|
241
|
+
|
|
234
242
|
## Limitations
|
|
235
243
|
|
|
236
244
|
- **Performance profiling** → Use `performance-optimizer`
|
|
@@ -187,6 +187,14 @@ instructions: |
|
|
|
187
187
|
---
|
|
188
188
|
```
|
|
189
189
|
|
|
190
|
+
## Verification Checklist
|
|
191
|
+
Before presenting infrastructure changes:
|
|
192
|
+
- [ ] Dry run completed successfully
|
|
193
|
+
- [ ] Rollback procedure documented and tested
|
|
194
|
+
- [ ] Secrets are not hardcoded or logged
|
|
195
|
+
- [ ] Health checks configured for new services
|
|
196
|
+
- [ ] Resource limits set to prevent runaway costs
|
|
197
|
+
|
|
190
198
|
## Limitations
|
|
191
199
|
|
|
192
200
|
- **Architectural decisions** → Use `infrastructure-architect`
|
package/app/agents/documenter.md
CHANGED
|
@@ -357,6 +357,14 @@ last_updated: "YYYY-MM-DD"
|
|
|
357
357
|
- Add diagrams where helpful
|
|
358
358
|
- Version documentation with code
|
|
359
359
|
|
|
360
|
+
## Verification Checklist
|
|
361
|
+
Before presenting documentation:
|
|
362
|
+
- [ ] Code examples are tested and runnable
|
|
363
|
+
- [ ] No placeholder text or TODO markers remain
|
|
364
|
+
- [ ] Links and references are valid
|
|
365
|
+
- [ ] Architecture decisions include rationale (not just "what")
|
|
366
|
+
- [ ] KB documents have complete YAML frontmatter
|
|
367
|
+
|
|
360
368
|
## Limitations
|
|
361
369
|
|
|
362
370
|
- **Code implementation** → Use `devops-implementer`
|
|
@@ -200,6 +200,14 @@ After implementing significant changes, update documentation:
|
|
|
200
200
|
### Delegation
|
|
201
201
|
For large documentation tasks, hand off to `documenter` agent.
|
|
202
202
|
|
|
203
|
+
## Verification Checklist
|
|
204
|
+
Before presenting implementation:
|
|
205
|
+
- [ ] Components render correctly with empty/loading/error states
|
|
206
|
+
- [ ] Accessibility basics checked (keyboard nav, aria labels, contrast)
|
|
207
|
+
- [ ] No console errors or warnings in dev tools
|
|
208
|
+
- [ ] Responsive behavior verified at mobile/tablet/desktop breakpoints
|
|
209
|
+
- [ ] Bundle size impact assessed for new dependencies
|
|
210
|
+
|
|
203
211
|
## KB Integration
|
|
204
212
|
|
|
205
213
|
Before coding, search knowledge base:
|
|
@@ -247,6 +247,14 @@ After performance optimizations, update documentation:
|
|
|
247
247
|
### Delegation
|
|
248
248
|
For large documentation tasks, hand off to `documenter` agent.
|
|
249
249
|
|
|
250
|
+
## Verification Checklist
|
|
251
|
+
Before presenting optimization:
|
|
252
|
+
- [ ] Baseline measurement taken before changes
|
|
253
|
+
- [ ] Improvement measured with realistic data, not synthetic benchmarks
|
|
254
|
+
- [ ] No regressions in other metrics (memory, latency, correctness)
|
|
255
|
+
- [ ] Optimization targets the actual bottleneck (profiler evidence attached)
|
|
256
|
+
- [ ] Cache invalidation strategy documented if caching was added
|
|
257
|
+
|
|
250
258
|
## Limitations
|
|
251
259
|
|
|
252
260
|
- **Production incidents** → Use `incident-responder`
|
|
@@ -301,6 +301,15 @@ For large documentation tasks, hand off to `documenter` agent.
|
|
|
301
301
|
- No destructive testing without explicit approval
|
|
302
302
|
- Report findings responsibly
|
|
303
303
|
|
|
304
|
+
## Verification Checklist
|
|
305
|
+
Before presenting security findings:
|
|
306
|
+
- [ ] Each finding includes proof-of-concept or exploit path
|
|
307
|
+
- [ ] Severity ratings reference actual impact, not theoretical risk
|
|
308
|
+
- [ ] "No findings" includes the specific checks performed
|
|
309
|
+
- [ ] Dependencies were scanned, not just application code
|
|
310
|
+
- [ ] Secrets scan covered all file types (not just source code)
|
|
311
|
+
- [ ] Auth flows were traced end-to-end, not spot-checked
|
|
312
|
+
|
|
304
313
|
## Limitations
|
|
305
314
|
|
|
306
315
|
- **Code implementation** → Use `devops-implementer`
|
|
@@ -257,6 +257,15 @@ After writing significant tests, update documentation:
|
|
|
257
257
|
### Delegation
|
|
258
258
|
For large documentation tasks, hand off to `documenter` agent.
|
|
259
259
|
|
|
260
|
+
## Verification Checklist
|
|
261
|
+
Before presenting test results:
|
|
262
|
+
- [ ] Every test has a clear assertion (no empty or placeholder tests)
|
|
263
|
+
- [ ] Edge cases are explicitly tested, not assumed
|
|
264
|
+
- [ ] Mocks are only at system boundaries, not internal collaborators
|
|
265
|
+
- [ ] Test names describe behavior, not implementation
|
|
266
|
+
- [ ] Flaky test patterns (time, network, order-dependent) are flagged
|
|
267
|
+
- [ ] Coverage gaps are reported with specific uncovered paths
|
|
268
|
+
|
|
260
269
|
## Limitations
|
|
261
270
|
|
|
262
271
|
- **Code implementation** → Use `devops-implementer`
|
|
@@ -82,6 +82,15 @@ python3 ${CLAUDE_SKILL_DIR}/scripts/complexity.py .
|
|
|
82
82
|
|
|
83
83
|
Reports file counts by type, largest files, TODO/FIXME counts, and total code lines.
|
|
84
84
|
|
|
85
|
+
## Common Rationalizations
|
|
86
|
+
|
|
87
|
+
| Excuse | Why It's Wrong |
|
|
88
|
+
|--------|----------------|
|
|
89
|
+
| "The linter is green, the code is fine" | Linters catch syntax, not design flaws — analysis covers architecture and patterns |
|
|
90
|
+
| "We know where the problems are" | Intuition misses systemic issues — data-driven analysis reveals hidden hotspots |
|
|
91
|
+
| "Analysis takes too long" | A 5-minute scan prevents weeks of debugging — front-load the investment |
|
|
92
|
+
| "It's legacy code, analysis won't help" | Legacy code benefits most — find the critical paths before they break |
|
|
93
|
+
|
|
85
94
|
## Tools Used
|
|
86
95
|
|
|
87
96
|
| Language | Tools |
|
|
@@ -90,3 +99,9 @@ Reports file counts by type, largest files, TODO/FIXME counts, and total code li
|
|
|
90
99
|
| JavaScript | eslint, tsc |
|
|
91
100
|
| Go | golangci-lint |
|
|
92
101
|
| Rust | clippy |
|
|
102
|
+
|
|
103
|
+
## Related Skills
|
|
104
|
+
- Found quality issues? → `/refactor` to fix them systematically
|
|
105
|
+
- Security issues detected? → `/cve-scan` for dependency audit
|
|
106
|
+
- Want deeper architecture review? → `/architecture-audit` for friction discovery
|
|
107
|
+
- Performance hotspots found? → `/workflow performance-optimization`
|
|
@@ -292,6 +292,16 @@ Accept: application/vnd.myapi.v1+json
|
|
|
292
292
|
|
|
293
293
|
---
|
|
294
294
|
|
|
295
|
+
## Common Rationalizations
|
|
296
|
+
|
|
297
|
+
| Excuse | Why It's Wrong |
|
|
298
|
+
|--------|----------------|
|
|
299
|
+
| "We'll version the API later" | Unversioned APIs break clients on every change — version from day one |
|
|
300
|
+
| "Retries are the client's problem" | Server-side idempotency prevents data corruption — design for at-least-once delivery |
|
|
301
|
+
| "We'll add rate limiting later" | Unprotected endpoints get abused within hours of deployment |
|
|
302
|
+
| "Error messages are just for debugging" | Error responses are your API's UX — clients depend on consistent, parseable errors |
|
|
303
|
+
| "PATCH and PUT are the same thing" | PUT replaces the resource, PATCH modifies it — wrong semantics cause data loss |
|
|
304
|
+
|
|
295
305
|
## Best Practices
|
|
296
306
|
|
|
297
307
|
- [ ] Use HTTPS only
|
|
@@ -291,6 +291,16 @@ env:
|
|
|
291
291
|
| `feat:` | Minor (0.x.0) | `feat: add user search endpoint` |
|
|
292
292
|
| `feat!:` / `BREAKING CHANGE:` | Major (x.0.0) | `feat!: change API response format` |
|
|
293
293
|
|
|
294
|
+
## Common Rationalizations
|
|
295
|
+
|
|
296
|
+
| Excuse | Why It's Wrong |
|
|
297
|
+
|--------|----------------|
|
|
298
|
+
| "CI is green, ship it" | CI tests the happy path — verify edge cases, security, and performance separately |
|
|
299
|
+
| "Manual deploys give us more control" | Manual deploys give you more human error — automate the repeatable parts |
|
|
300
|
+
| "We'll set up CI when the project is bigger" | Small projects grow fast — CI debt compounds and retrofitting is painful |
|
|
301
|
+
| "Caching isn't worth the complexity" | Uncached builds waste developer time daily — caching pays for itself in a week |
|
|
302
|
+
| "Feature flags are over-engineering" | Feature flags decouple deploy from release — they're the cheapest safety net |
|
|
303
|
+
|
|
294
304
|
## Anti-Patterns
|
|
295
305
|
- Secrets in pipeline logs or environment dumps
|
|
296
306
|
- No caching (slow builds)
|
|
@@ -100,6 +100,16 @@ Keep modules focused. Order contents consistently: imports (stdlib, third-party,
|
|
|
100
100
|
|
|
101
101
|
---
|
|
102
102
|
|
|
103
|
+
## Common Rationalizations
|
|
104
|
+
|
|
105
|
+
| Excuse | Why It's Wrong |
|
|
106
|
+
|--------|----------------|
|
|
107
|
+
| "It's readable enough" | "Enough" means someone will misread it eventually — clarity prevents incidents |
|
|
108
|
+
| "Refactoring for readability is gold-plating" | Readability is maintainability — future you will thank present you |
|
|
109
|
+
| "Short variable names are faster to type" | You type it once, readers parse it hundreds of times — optimize for reading |
|
|
110
|
+
| "DRY means never repeat anything" | Wrong DRY creates coupling — duplicate until you see the real abstraction |
|
|
111
|
+
| "More abstractions = cleaner code" | Premature abstraction is worse than duplication — wait for the third use |
|
|
112
|
+
|
|
103
113
|
## Language-Specific References
|
|
104
114
|
|
|
105
115
|
For detailed patterns, type hints, linting configuration, and idiomatic code per language:
|
|
@@ -296,3 +296,13 @@ client.create_payload_index(
|
|
|
296
296
|
| COSINE | Text embeddings | Yes |
|
|
297
297
|
| EUCLID | Image embeddings | No |
|
|
298
298
|
| DOT | When vectors pre-normalized | Yes |
|
|
299
|
+
|
|
300
|
+
## Common Rationalizations
|
|
301
|
+
|
|
302
|
+
| Excuse | Why It's Wrong |
|
|
303
|
+
|--------|----------------|
|
|
304
|
+
| "We'll add indexes later when it's slow" | Missing indexes on production tables cause outages, not slowdowns — index from design |
|
|
305
|
+
| "The ORM handles performance" | ORMs generate queries, they don't optimize them — always check the query plan |
|
|
306
|
+
| "NoSQL is faster" | NoSQL trades consistency for speed — if you need joins, use a relational DB |
|
|
307
|
+
| "We don't need migrations, we'll update the schema directly" | Direct schema changes are irreversible and untestable — migrations are the safety net |
|
|
308
|
+
| "One big table is simpler" | Denormalization without measurement creates update anomalies — normalize first, denormalize with data |
|
|
@@ -144,6 +144,16 @@ Have them talk to each other to challenge each other's theories.
|
|
|
144
144
|
Report consensus when done.
|
|
145
145
|
```
|
|
146
146
|
|
|
147
|
+
## Common Rationalizations
|
|
148
|
+
|
|
149
|
+
| Excuse | Why It's Wrong |
|
|
150
|
+
|--------|----------------|
|
|
151
|
+
| "It works on my machine" | Environment differences are the #1 cause of production bugs — reproduce in prod-like env |
|
|
152
|
+
| "It must be a library bug" | 95% of the time it's your code — exhaust local hypotheses first |
|
|
153
|
+
| "I'll just add more logging and wait" | Passive debugging wastes hours — form a hypothesis and test it actively |
|
|
154
|
+
| "The error message says X, so it must be X" | Error messages often describe symptoms, not root causes — trace the full chain |
|
|
155
|
+
| "It only happens sometimes, probably a fluke" | Intermittent bugs are race conditions or state leaks — they get worse, not better |
|
|
156
|
+
|
|
147
157
|
## Debug Checklist
|
|
148
158
|
|
|
149
159
|
- [ ] Identified error/symptom
|
|
@@ -152,3 +162,9 @@ Report consensus when done.
|
|
|
152
162
|
- [ ] Reproduced issue
|
|
153
163
|
- [ ] Formed hypothesis
|
|
154
164
|
- [ ] Tested fix
|
|
165
|
+
|
|
166
|
+
## Related Skills
|
|
167
|
+
- Bug fixed? → `/review` to verify the fix quality
|
|
168
|
+
- Need a regression test? → `/tdd` to write it test-first
|
|
169
|
+
- Performance issue? → `/analyze --type=complexity` for hotspot analysis
|
|
170
|
+
- Incident in production? → `/workflow incident-response` for full response
|
package/app/skills/docs/SKILL.md
CHANGED
|
@@ -113,6 +113,16 @@ Proposed
|
|
|
113
113
|
- [ ] Commit changes
|
|
114
114
|
```
|
|
115
115
|
|
|
116
|
+
## Common Rationalizations
|
|
117
|
+
|
|
118
|
+
| Excuse | Why It's Wrong |
|
|
119
|
+
|--------|----------------|
|
|
120
|
+
| "The code is self-documenting" | Code shows how, not why — decisions, constraints, and context need prose |
|
|
121
|
+
| "Nobody reads docs anyway" | People don't read bad docs — good docs are the first thing consulted |
|
|
122
|
+
| "I'll document it when it's stable" | Unstable code needs docs most — document intent so others can contribute |
|
|
123
|
+
| "Comments get stale" | That's an argument for maintaining docs, not skipping them |
|
|
124
|
+
| "The tests are the documentation" | Tests verify behavior but don't explain architecture, trade-offs, or setup |
|
|
125
|
+
|
|
116
126
|
## Configuration
|
|
117
127
|
|
|
118
128
|
Documentation settings in:
|
|
@@ -143,3 +153,9 @@ Create an agent team for documentation:
|
|
|
143
153
|
- Teammate 3 (documenter): "Generate README sections: installation, usage, API reference." Use Opus.
|
|
144
154
|
Teammates should NOT overlap — each owns their assigned scope.
|
|
145
155
|
```
|
|
156
|
+
|
|
157
|
+
## Related Skills
|
|
158
|
+
- Documenting an architecture decision? → `/council` for multi-perspective analysis first
|
|
159
|
+
- Need to explore the codebase? → `/explore` to understand structure before documenting
|
|
160
|
+
- Writing a PRD? → `/write-a-prd` for structured product requirements
|
|
161
|
+
- Auditing existing docs? → `/analyze` for coverage gaps
|
|
@@ -68,3 +68,13 @@ git cherry-pick --continue
|
|
|
68
68
|
- `perf:` Performance improvement
|
|
69
69
|
- `test:` Adding missing tests
|
|
70
70
|
- `chore:` Build process/auxiliary tools
|
|
71
|
+
|
|
72
|
+
## Common Rationalizations
|
|
73
|
+
|
|
74
|
+
| Excuse | Why It's Wrong |
|
|
75
|
+
|--------|----------------|
|
|
76
|
+
| "I'll clean up commits later" | Later means never — write clean commits as you go |
|
|
77
|
+
| "Force push is fine on my branch" | Others may have fetched your branch — use --force-with-lease |
|
|
78
|
+
| "One big commit is simpler" | Big commits are impossible to review, bisect, or revert — keep them atomic |
|
|
79
|
+
| "Merge conflicts mean someone else's problem" | Conflicts mean you diverged too long — rebase frequently to stay aligned |
|
|
80
|
+
| "Commit messages don't matter" | Messages are documentation — future you needs to understand why, not just what |
|
|
@@ -17,6 +17,21 @@ Guide the user through setting up the ai-toolkit in their project, including con
|
|
|
17
17
|
|
|
18
18
|
## Setup Steps
|
|
19
19
|
|
|
20
|
+
### Step 0: Intent Capture Interview
|
|
21
|
+
|
|
22
|
+
Before setting up tooling, understand the project's undocumented context. Ask the developer these questions (adapt based on what the codebase scan reveals):
|
|
23
|
+
|
|
24
|
+
1. **What's the one thing a new contributor always gets wrong?** — This reveals the biggest documentation gap
|
|
25
|
+
2. **Are there files or directories that should NOT be modified?** — Identifies protected areas (legacy, generated, vendor)
|
|
26
|
+
3. **What's the deployment model?** — Monolith, microservices, serverless, edge — shapes which agents and skills are most relevant
|
|
27
|
+
4. **Are there non-obvious constraints?** — Compliance requirements, performance budgets, browser support matrix
|
|
28
|
+
5. **What's the team's review culture?** — Strict PR reviews, trunk-based, pair programming — configures `/review` behavior
|
|
29
|
+
|
|
30
|
+
Use answers to:
|
|
31
|
+
- Customize the generated `CLAUDE.md` with project-specific warnings and conventions
|
|
32
|
+
- Select the right `--profile` (minimal/standard/strict) automatically
|
|
33
|
+
- Pre-configure relevant language rules
|
|
34
|
+
|
|
20
35
|
### Step 1: Prerequisites Check
|
|
21
36
|
- [ ] Claude Code CLI installed
|
|
22
37
|
- [ ] ai-toolkit repository cloned
|
|
@@ -57,3 +57,13 @@ Always measure -> change -> measure.
|
|
|
57
57
|
2. **Algorithm**: (O(n²) -> O(n log n))
|
|
58
58
|
3. **Memory**: (Allocation churn, GC pressure)
|
|
59
59
|
4. **Micro-optimization**: (Loop unrolling, etc.) - *Smallest Gains*
|
|
60
|
+
|
|
61
|
+
## Common Rationalizations
|
|
62
|
+
|
|
63
|
+
| Excuse | Why It's Wrong |
|
|
64
|
+
|--------|----------------|
|
|
65
|
+
| "It feels slow, let me optimize this function" | Feelings aren't data — profile first, then optimize the actual bottleneck |
|
|
66
|
+
| "We should optimize everything" | Premature optimization is the root of all evil — focus on the critical path |
|
|
67
|
+
| "Caching will fix it" | Caching masks problems and adds complexity — fix the root cause first |
|
|
68
|
+
| "It's fast enough in dev" | Dev has 1 user — production has thousands and cold caches |
|
|
69
|
+
| "We'll optimize later" | Performance debt compounds — a 100ms regression per sprint = 5s in a year |
|
package/app/skills/plan/SKILL.md
CHANGED
|
@@ -95,6 +95,16 @@ During planning:
|
|
|
95
95
|
- NO code writing
|
|
96
96
|
- NO file creation (except plan)
|
|
97
97
|
|
|
98
|
+
## Common Rationalizations
|
|
99
|
+
|
|
100
|
+
| Excuse | Why It's Wrong |
|
|
101
|
+
|--------|----------------|
|
|
102
|
+
| "We already know what to build" | Assumed requirements lead to rework — validate assumptions explicitly |
|
|
103
|
+
| "Planning is wasted time, just start coding" | Unplanned work has 3-5x more rework — 30 min planning saves days |
|
|
104
|
+
| "The requirements will change anyway" | Plans adapt — without one, you can't assess impact of changes |
|
|
105
|
+
| "It's a small feature, no plan needed" | Small features in complex systems have hidden dependencies — map them |
|
|
106
|
+
| "We'll figure it out as we go" | Discovery without structure leads to scope creep and missed edge cases |
|
|
107
|
+
|
|
98
108
|
## Next Steps
|
|
99
109
|
|
|
100
110
|
After plan approval:
|
|
@@ -108,3 +118,9 @@ Before planning:
|
|
|
108
118
|
smart_query("project template: {type}")
|
|
109
119
|
hybrid_search_kb("architecture {pattern}")
|
|
110
120
|
```
|
|
121
|
+
|
|
122
|
+
## Related Skills
|
|
123
|
+
- Plan approved? → `/orchestrate` or `/workflow` to execute with agents
|
|
124
|
+
- Need requirements first? → `/write-a-prd` for structured product requirements
|
|
125
|
+
- Want to stress-test the plan? → `/grill-me` for Socratic questioning
|
|
126
|
+
- Ready to break into issues? → `/prd-to-plan` → `/triage-issue`
|
|
@@ -81,6 +81,16 @@ Before executing:
|
|
|
81
81
|
- [ ] Tests passing
|
|
82
82
|
- [ ] Backup created
|
|
83
83
|
|
|
84
|
+
## Common Rationalizations
|
|
85
|
+
|
|
86
|
+
| Excuse | Why It's Wrong |
|
|
87
|
+
|--------|----------------|
|
|
88
|
+
| "It works, don't touch it" | Working code that's hard to maintain slows every future change |
|
|
89
|
+
| "We'll refactor it later" | Later never comes — refactor when the pain is fresh and context is loaded |
|
|
90
|
+
| "It's too risky to change" | That's exactly why it needs refactoring — risk compounds with complexity |
|
|
91
|
+
| "Just one more hack won't hurt" | Each hack makes the next one easier to justify — break the cycle now |
|
|
92
|
+
| "We need to rewrite from scratch" | Incremental refactoring is safer and delivers value continuously |
|
|
93
|
+
|
|
84
94
|
## READ BEFORE WRITE
|
|
85
95
|
|
|
86
96
|
This command analyzes and plans first.
|
|
@@ -122,3 +132,9 @@ Create an agent team for refactoring:
|
|
|
122
132
|
- Teammate 2 (backend-specialist): "Implement the refactoring changes identified by the reviewer." Use Opus.
|
|
123
133
|
Teammate 1 completes first, then Teammate 2 acts on the plan.
|
|
124
134
|
```
|
|
135
|
+
|
|
136
|
+
## Related Skills
|
|
137
|
+
- Need a safe refactor plan? → `/refactor-plan` for incremental steps as GitHub RFC
|
|
138
|
+
- Want to validate architecture? → `/analyze` for code quality metrics
|
|
139
|
+
- Need tests before refactoring? → `/tdd` to build safety net first
|
|
140
|
+
- Architecture decision needed? → `/council` for multi-perspective evaluation
|
|
@@ -117,17 +117,40 @@ After all reviewers complete:
|
|
|
117
117
|
- **Lines Added**: [+count]
|
|
118
118
|
- **Lines Removed**: [-count]
|
|
119
119
|
- **Issues Found**: [count]
|
|
120
|
+
- **Overall Confidence**: [1-10] — how confident the reviewer is in the assessment
|
|
120
121
|
|
|
121
122
|
### Findings
|
|
122
123
|
|
|
123
124
|
#### Critical
|
|
124
125
|
- **[file:line]**: [issue]
|
|
125
|
-
- [
|
|
126
|
+
- Severity: critical | Confidence: [1-10]
|
|
127
|
+
- Evidence: [specific code reference and reasoning]
|
|
126
128
|
- Suggested fix: [code]
|
|
127
129
|
|
|
128
|
-
####
|
|
130
|
+
#### Major
|
|
131
|
+
- **[file:line]**: [issue]
|
|
132
|
+
- Severity: major | Confidence: [1-10]
|
|
133
|
+
- Evidence: [specific code reference and reasoning]
|
|
134
|
+
- Suggested fix: [code]
|
|
135
|
+
|
|
136
|
+
#### Minor
|
|
137
|
+
- **[file:line]**: [issue]
|
|
138
|
+
- Severity: minor | Confidence: [1-10]
|
|
139
|
+
- Evidence: [line number + reasoning]
|
|
140
|
+
|
|
141
|
+
#### Nit
|
|
129
142
|
- **[file:line]**: [suggestion]
|
|
130
|
-
- [
|
|
143
|
+
- Severity: nit | Confidence: [1-10]
|
|
144
|
+
|
|
145
|
+
### Confidence Guide
|
|
146
|
+
|
|
147
|
+
| Score | Meaning |
|
|
148
|
+
|-------|---------|
|
|
149
|
+
| 9-10 | Certain — verified via code, tests, or documentation |
|
|
150
|
+
| 7-8 | High — strong evidence, minor assumptions |
|
|
151
|
+
| 5-6 | Medium — plausible issue, needs author confirmation |
|
|
152
|
+
| 3-4 | Low — speculative, based on patterns not proof |
|
|
153
|
+
| 1-2 | Guess — flag for discussion, don't block on this |
|
|
131
154
|
|
|
132
155
|
### Positive Notes
|
|
133
156
|
- [What's good about the code]
|
|
@@ -136,6 +159,38 @@ After all reviewers complete:
|
|
|
136
159
|
[APPROVE / REQUEST_CHANGES / NEEDS_DISCUSSION]
|
|
137
160
|
```
|
|
138
161
|
|
|
162
|
+
## Common Rationalizations
|
|
163
|
+
|
|
164
|
+
| Excuse | Why It's Wrong |
|
|
165
|
+
|--------|----------------|
|
|
166
|
+
| "Small change, quick scan is enough" | Small changes introduce subtle bugs — apply consistent review regardless of size |
|
|
167
|
+
| "Tests pass, so the code is correct" | Tests validate specific scenarios, not all behaviors — verify missing coverage |
|
|
168
|
+
| "It's just a refactor, no need for deep review" | Refactors change invariants — verify behavior preservation, not just compilation |
|
|
169
|
+
| "The author is senior, they know what they're doing" | Seniority doesn't prevent mistakes — review the code, not the person |
|
|
170
|
+
| "We're in a hurry, ship it" | Rushed reviews create tech debt that costs 10x more to fix later |
|
|
171
|
+
|
|
172
|
+
## Self-Evaluation (LLM-as-Judge)
|
|
173
|
+
|
|
174
|
+
After completing the review, perform a self-evaluation pass:
|
|
175
|
+
|
|
176
|
+
### Check for Blind Spots
|
|
177
|
+
1. **Did I verify, or assume?** — For each finding, confirm you read the actual code (not inferred from context)
|
|
178
|
+
2. **Did I miss the inverse?** — If you flagged X as a problem, did you check if NOT doing X is also a problem elsewhere?
|
|
179
|
+
3. **Did I anchor on the first issue?** — Review whether early findings biased you toward similar patterns, missing different issue classes
|
|
180
|
+
4. **Did I check the unhappy path?** — Error handling, edge cases, failure modes — not just the golden path
|
|
181
|
+
5. **Did I flag uncertainty?** — Findings with confidence < 6 should be clearly marked as "needs author input"
|
|
182
|
+
|
|
183
|
+
### Calibrate Confidence
|
|
184
|
+
- If all findings are confidence 7+, you may be overconfident — re-examine the weakest finding
|
|
185
|
+
- If any finding lacks a file:line reference, downgrade it or remove it
|
|
186
|
+
- If you found zero issues, state what you specifically checked (not "looks good")
|
|
187
|
+
|
|
139
188
|
## READ-ONLY
|
|
140
189
|
|
|
141
190
|
This skill only analyzes. It does NOT modify any files.
|
|
191
|
+
|
|
192
|
+
## Related Skills
|
|
193
|
+
- Issues found? → `/debug` to trace root causes
|
|
194
|
+
- Missing tests? → `/tdd` to add test-first coverage
|
|
195
|
+
- Security findings? → `/cve-scan` for dependency vulnerabilities
|
|
196
|
+
- Architecture concerns? → `/analyze` for deeper code quality metrics
|
|
@@ -81,6 +81,16 @@ async def resource():
|
|
|
81
81
|
|
|
82
82
|
---
|
|
83
83
|
|
|
84
|
+
## Common Rationalizations
|
|
85
|
+
|
|
86
|
+
| Excuse | Why It's Wrong |
|
|
87
|
+
|--------|----------------|
|
|
88
|
+
| "It's an internal API, security doesn't matter" | Internal APIs get exposed — lateral movement is attackers' primary technique |
|
|
89
|
+
| "The framework handles security" | Frameworks provide tools, not guarantees — misconfiguration is OWASP #5 |
|
|
90
|
+
| "We'll add auth later" | Unauthenticated endpoints in production get discovered within hours |
|
|
91
|
+
| "Nobody would exploit this" | Automated scanners don't care about your threat model — they scan everything |
|
|
92
|
+
| "It's behind a VPN" | VPNs are perimeter defense — zero trust assumes breach already happened |
|
|
93
|
+
|
|
84
94
|
## Reference Guides
|
|
85
95
|
|
|
86
96
|
For authentication patterns (JWT, passwords, token strategy), see [reference/authentication.md](reference/authentication.md).
|
package/app/skills/tdd/SKILL.md
CHANGED
|
@@ -172,3 +172,9 @@ Before marking work complete:
|
|
|
172
172
|
- [ ] Edge cases and errors covered
|
|
173
173
|
|
|
174
174
|
Can't check all boxes? You skipped TDD. Start over.
|
|
175
|
+
|
|
176
|
+
## Related Skills
|
|
177
|
+
- Feature complete? → `/review` to get a code review
|
|
178
|
+
- Need to plan the feature first? → `/plan` for task breakdown
|
|
179
|
+
- Want a full test coverage sweep? → `/workflow test-coverage`
|
|
180
|
+
- Debugging a test failure? → `/debug` for systematic root cause analysis
|
|
@@ -72,3 +72,13 @@ For PHP PHPUnit patterns, see [reference/php-phpunit.md](reference/php-phpunit.m
|
|
|
72
72
|
For Go testing patterns, see [reference/go-testing.md](reference/go-testing.md).
|
|
73
73
|
|
|
74
74
|
For Flutter/Dart testing patterns, see [reference/flutter-testing.md](reference/flutter-testing.md).
|
|
75
|
+
|
|
76
|
+
## Common Rationalizations
|
|
77
|
+
|
|
78
|
+
| Excuse | Why It's Wrong |
|
|
79
|
+
|--------|----------------|
|
|
80
|
+
| "It's too simple to test" | Simple code breaks in integration — test the contract, not the complexity |
|
|
81
|
+
| "Tests slow down development" | Tests slow down bugs reaching production — that's the point |
|
|
82
|
+
| "We'll add tests later" | Untested code accumulates — later means never, and coverage gaps compound |
|
|
83
|
+
| "Mocking everything is fine" | Over-mocking tests the mocks, not the code — mock at boundaries only |
|
|
84
|
+
| "100% coverage means no bugs" | Coverage measures execution, not correctness — focus on behavior assertions |
|
|
@@ -3,7 +3,7 @@ title: "AI Toolkit - Architecture Overview"
|
|
|
3
3
|
category: reference
|
|
4
4
|
service: ai-toolkit
|
|
5
5
|
tags: [architecture, overview, design, structure]
|
|
6
|
-
version: "1.3.
|
|
6
|
+
version: "1.3.15"
|
|
7
7
|
created: "2026-03-23"
|
|
8
8
|
last_updated: "2026-04-08"
|
|
9
9
|
description: "Architecture of ai-toolkit: directory layout, global install model, skill tiers, and integration with projects."
|
|
@@ -178,6 +178,23 @@ Skills that spawn real parallel agents use:
|
|
|
178
178
|
|
|
179
179
|
`CLAUDE_CODE_EXPERIMENTAL_AGENT_TEAMS=1` must be set for Agent Teams (tmux-based) support.
|
|
180
180
|
|
|
181
|
+
## Quality Guardrails
|
|
182
|
+
|
|
183
|
+
### Anti-Rationalization Tables
|
|
184
|
+
15 core skills include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift. Skills: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
|
|
185
|
+
|
|
186
|
+
### Confidence Scoring & LLM-as-Judge (`/review`)
|
|
187
|
+
Review findings include per-issue confidence scores (1-10) and severity tiers (critical/major/minor/nit). A self-evaluation pass after review checks for anchoring bias, assumption vs verification, and calibrates confidence.
|
|
188
|
+
|
|
189
|
+
### Agent Verification Checklists
|
|
190
|
+
10 agents have `## Verification Checklist` — domain-specific exit criteria: `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
|
|
191
|
+
|
|
192
|
+
### Skill Reference Routing
|
|
193
|
+
7 core skills include `## Related Skills` suggesting follow-up skills: `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
|
|
194
|
+
|
|
195
|
+
### Intent Capture Interview (`/onboard`)
|
|
196
|
+
Step 0 interview — 5 questions to capture undocumented project intent before setup.
|
|
197
|
+
|
|
181
198
|
## Component Relationships
|
|
182
199
|
|
|
183
200
|
```
|
|
@@ -3,7 +3,7 @@ title: "AI Toolkit - Skills Catalog"
|
|
|
3
3
|
category: reference
|
|
4
4
|
service: ai-toolkit
|
|
5
5
|
tags: [skills, domain-knowledge, catalog, task-skills, hybrid-skills]
|
|
6
|
-
version: "1.3.
|
|
6
|
+
version: "1.3.15"
|
|
7
7
|
created: "2026-03-23"
|
|
8
8
|
last_updated: "2026-04-08"
|
|
9
9
|
description: "Complete skills catalog with task, hybrid, and knowledge skills. Includes effort levels, skill-scoped hooks, executable scripts, security auditor, and persona presets."
|
|
@@ -171,6 +171,62 @@ Hybrid skills combine slash-command invocation with domain knowledge that agents
|
|
|
171
171
|
|-------|-----------|--------|
|
|
172
172
|
| **hive-mind** | `skills/hive-mind/` | Multi-agent aggregation, consensus, swarm patterns |
|
|
173
173
|
|
|
174
|
+
## Quality Guardrails
|
|
175
|
+
|
|
176
|
+
### Anti-Rationalization Tables
|
|
177
|
+
|
|
178
|
+
15 core skills include `## Common Rationalizations` — domain-specific tables of excuses and rebuttals that prevent agent drift and shortcut-taking:
|
|
179
|
+
|
|
180
|
+
| Skill | Example rationalization blocked |
|
|
181
|
+
|-------|---------------------------------|
|
|
182
|
+
| `/review` | "Small change, quick scan is enough" |
|
|
183
|
+
| `/debug` | "It must be a library bug" |
|
|
184
|
+
| `/refactor` | "It works, don't touch it" |
|
|
185
|
+
| `/tdd` | "Too simple to test" |
|
|
186
|
+
| `/plan` | "Planning is wasted time, just start coding" |
|
|
187
|
+
| `/docs` | "The code is self-documenting" |
|
|
188
|
+
| `/analyze` | "The linter is green, the code is fine" |
|
|
189
|
+
| `security-patterns` | "It's an internal API, security doesn't matter" |
|
|
190
|
+
| `testing-patterns` | "Tests slow down development" |
|
|
191
|
+
| `api-patterns` | "We'll version the API later" |
|
|
192
|
+
| `ci-cd-patterns` | "Manual deploys give us more control" |
|
|
193
|
+
| `clean-code` | "It's readable enough" |
|
|
194
|
+
| `performance-profiling` | "It feels slow, let me optimize this function" |
|
|
195
|
+
| `git-mastery` | "One big commit is simpler" |
|
|
196
|
+
| `database-patterns` | "We'll add indexes later when it's slow" |
|
|
197
|
+
|
|
198
|
+
### Confidence Scoring (`/review`)
|
|
199
|
+
|
|
200
|
+
The `/review` skill outputs structured findings with:
|
|
201
|
+
- **Severity**: critical / major / minor / nit
|
|
202
|
+
- **Confidence score**: 1-10 per finding with calibration guide
|
|
203
|
+
- **Evidence requirement**: each finding must include file:line + reasoning
|
|
204
|
+
|
|
205
|
+
### Self-Evaluation — LLM-as-Judge (`/review`)
|
|
206
|
+
|
|
207
|
+
After completing a review, the agent performs a self-evaluation pass:
|
|
208
|
+
1. Verify vs assume — did I read actual code for each finding?
|
|
209
|
+
2. Check the inverse — if X is a problem, is NOT-X also a problem elsewhere?
|
|
210
|
+
3. Detect anchoring bias — did early findings bias toward similar patterns?
|
|
211
|
+
4. Check unhappy paths — error handling, edge cases, failure modes
|
|
212
|
+
5. Calibrate confidence — overconfident? re-examine weakest finding
|
|
213
|
+
|
|
214
|
+
### Agent Verification Checklists
|
|
215
|
+
|
|
216
|
+
10 key agents include `## Verification Checklist` — exit criteria before presenting results:
|
|
217
|
+
`code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
|
|
218
|
+
|
|
219
|
+
### Skill Reference Routing
|
|
220
|
+
|
|
221
|
+
7 core skills include `## Related Skills` sections suggesting logical follow-up skills:
|
|
222
|
+
`/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
|
|
223
|
+
|
|
224
|
+
### Intent Capture Interview (`/onboard`)
|
|
225
|
+
|
|
226
|
+
Step 0 interview before setup — 5 targeted questions to capture undocumented project intent, customizing the generated `CLAUDE.md`.
|
|
227
|
+
|
|
228
|
+
---
|
|
229
|
+
|
|
174
230
|
## Advanced Features
|
|
175
231
|
|
|
176
232
|
### Effort Levels
|
package/llms-full.txt
CHANGED
|
@@ -934,7 +934,7 @@ title: "AI Toolkit - Architecture Overview"
|
|
|
934
934
|
category: reference
|
|
935
935
|
service: ai-toolkit
|
|
936
936
|
tags: [architecture, overview, design, structure]
|
|
937
|
-
version: "1.3.
|
|
937
|
+
version: "1.3.15"
|
|
938
938
|
created: "2026-03-23"
|
|
939
939
|
last_updated: "2026-04-08"
|
|
940
940
|
description: "Architecture of ai-toolkit: directory layout, global install model, skill tiers, and integration with projects."
|
|
@@ -1109,6 +1109,23 @@ Skills that spawn real parallel agents use:
|
|
|
1109
1109
|
|
|
1110
1110
|
`CLAUDE_CODE_EXPERIMENTAL_AGENT_TEAMS=1` must be set for Agent Teams (tmux-based) support.
|
|
1111
1111
|
|
|
1112
|
+
## Quality Guardrails
|
|
1113
|
+
|
|
1114
|
+
### Anti-Rationalization Tables
|
|
1115
|
+
15 core skills include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift. Skills: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
|
|
1116
|
+
|
|
1117
|
+
### Confidence Scoring & LLM-as-Judge (`/review`)
|
|
1118
|
+
Review findings include per-issue confidence scores (1-10) and severity tiers (critical/major/minor/nit). A self-evaluation pass after review checks for anchoring bias, assumption vs verification, and calibrates confidence.
|
|
1119
|
+
|
|
1120
|
+
### Agent Verification Checklists
|
|
1121
|
+
10 agents have `## Verification Checklist` — domain-specific exit criteria: `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
|
|
1122
|
+
|
|
1123
|
+
### Skill Reference Routing
|
|
1124
|
+
7 core skills include `## Related Skills` suggesting follow-up skills: `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
|
|
1125
|
+
|
|
1126
|
+
### Intent Capture Interview (`/onboard`)
|
|
1127
|
+
Step 0 interview — 5 questions to capture undocumented project intent before setup.
|
|
1128
|
+
|
|
1112
1129
|
## Component Relationships
|
|
1113
1130
|
|
|
1114
1131
|
```
|
|
@@ -4095,7 +4112,7 @@ title: "AI Toolkit - Skills Catalog"
|
|
|
4095
4112
|
category: reference
|
|
4096
4113
|
service: ai-toolkit
|
|
4097
4114
|
tags: [skills, domain-knowledge, catalog, task-skills, hybrid-skills]
|
|
4098
|
-
version: "1.3.
|
|
4115
|
+
version: "1.3.15"
|
|
4099
4116
|
created: "2026-03-23"
|
|
4100
4117
|
last_updated: "2026-04-08"
|
|
4101
4118
|
description: "Complete skills catalog with task, hybrid, and knowledge skills. Includes effort levels, skill-scoped hooks, executable scripts, security auditor, and persona presets."
|
|
@@ -4263,6 +4280,62 @@ Hybrid skills combine slash-command invocation with domain knowledge that agents
|
|
|
4263
4280
|
|-------|-----------|--------|
|
|
4264
4281
|
| **hive-mind** | `skills/hive-mind/` | Multi-agent aggregation, consensus, swarm patterns |
|
|
4265
4282
|
|
|
4283
|
+
## Quality Guardrails
|
|
4284
|
+
|
|
4285
|
+
### Anti-Rationalization Tables
|
|
4286
|
+
|
|
4287
|
+
15 core skills include `## Common Rationalizations` — domain-specific tables of excuses and rebuttals that prevent agent drift and shortcut-taking:
|
|
4288
|
+
|
|
4289
|
+
| Skill | Example rationalization blocked |
|
|
4290
|
+
|-------|---------------------------------|
|
|
4291
|
+
| `/review` | "Small change, quick scan is enough" |
|
|
4292
|
+
| `/debug` | "It must be a library bug" |
|
|
4293
|
+
| `/refactor` | "It works, don't touch it" |
|
|
4294
|
+
| `/tdd` | "Too simple to test" |
|
|
4295
|
+
| `/plan` | "Planning is wasted time, just start coding" |
|
|
4296
|
+
| `/docs` | "The code is self-documenting" |
|
|
4297
|
+
| `/analyze` | "The linter is green, the code is fine" |
|
|
4298
|
+
| `security-patterns` | "It's an internal API, security doesn't matter" |
|
|
4299
|
+
| `testing-patterns` | "Tests slow down development" |
|
|
4300
|
+
| `api-patterns` | "We'll version the API later" |
|
|
4301
|
+
| `ci-cd-patterns` | "Manual deploys give us more control" |
|
|
4302
|
+
| `clean-code` | "It's readable enough" |
|
|
4303
|
+
| `performance-profiling` | "It feels slow, let me optimize this function" |
|
|
4304
|
+
| `git-mastery` | "One big commit is simpler" |
|
|
4305
|
+
| `database-patterns` | "We'll add indexes later when it's slow" |
|
|
4306
|
+
|
|
4307
|
+
### Confidence Scoring (`/review`)
|
|
4308
|
+
|
|
4309
|
+
The `/review` skill outputs structured findings with:
|
|
4310
|
+
- **Severity**: critical / major / minor / nit
|
|
4311
|
+
- **Confidence score**: 1-10 per finding with calibration guide
|
|
4312
|
+
- **Evidence requirement**: each finding must include file:line + reasoning
|
|
4313
|
+
|
|
4314
|
+
### Self-Evaluation — LLM-as-Judge (`/review`)
|
|
4315
|
+
|
|
4316
|
+
After completing a review, the agent performs a self-evaluation pass:
|
|
4317
|
+
1. Verify vs assume — did I read actual code for each finding?
|
|
4318
|
+
2. Check the inverse — if X is a problem, is NOT-X also a problem elsewhere?
|
|
4319
|
+
3. Detect anchoring bias — did early findings bias toward similar patterns?
|
|
4320
|
+
4. Check unhappy paths — error handling, edge cases, failure modes
|
|
4321
|
+
5. Calibrate confidence — overconfident? re-examine weakest finding
|
|
4322
|
+
|
|
4323
|
+
### Agent Verification Checklists
|
|
4324
|
+
|
|
4325
|
+
10 key agents include `## Verification Checklist` — exit criteria before presenting results:
|
|
4326
|
+
`code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
|
|
4327
|
+
|
|
4328
|
+
### Skill Reference Routing
|
|
4329
|
+
|
|
4330
|
+
7 core skills include `## Related Skills` sections suggesting logical follow-up skills:
|
|
4331
|
+
`/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
|
|
4332
|
+
|
|
4333
|
+
### Intent Capture Interview (`/onboard`)
|
|
4334
|
+
|
|
4335
|
+
Step 0 interview before setup — 5 targeted questions to capture undocumented project intent, customizing the generated `CLAUDE.md`.
|
|
4336
|
+
|
|
4337
|
+
---
|
|
4338
|
+
|
|
4266
4339
|
## Advanced Features
|
|
4267
4340
|
|
|
4268
4341
|
### Effort Levels
|
package/manifest.json
CHANGED
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@softspark/ai-toolkit",
|
|
3
|
-
"version": "1.3.
|
|
3
|
+
"version": "1.3.15",
|
|
4
4
|
"description": "Professional-grade AI coding toolkit: 91 skills, 44 agents, multi-platform support (Claude, Cursor, Windsurf, Copilot, Gemini, Cline, Roo Code, Aider, Augment), machine-enforced safety constitution, persona presets, skill security auditor, expanded lifecycle hooks, 11 plugin packs, and benchmark tooling.",
|
|
5
5
|
"keywords": [
|
|
6
6
|
"claude",
|