@softspark/ai-toolkit 1.3.14 → 1.3.15

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CHANGELOG.md CHANGED
@@ -7,6 +7,18 @@ Versioning follows [Semantic Versioning](https://semver.org/).
7
7
 
8
8
  ---
9
9
 
10
+ ## v1.3.15 — Quality Guardrails: Anti-Rationalization, Confidence Scoring, Verification Checklists (2026-04-08)
11
+
12
+ ### Added
13
+ - **Anti-rationalization tables** — 15 core skills now include `## Common Rationalizations` sections with domain-specific excuse/rebuttal tables that prevent agent drift and shortcut-taking. Inspired by [addyosmani/agent-skills](https://github.com/addyosmani/agent-skills).
14
+ - **Confidence scoring** (`/review`) — review findings now include per-issue confidence scores (1-10) and severity classification (critical/major/minor/nit) with a calibration guide.
15
+ - **LLM-as-Judge self-evaluation** (`/review`) — structured self-check after review: blind spot detection, anchoring bias check, and confidence calibration.
16
+ - **Agent verification checklists** — 10 key agents (`code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`) now include `## Verification Checklist` exit criteria.
17
+ - **Skill reference routing** — 7 core skills (`/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`) include `## Related Skills` sections for follow-up discoverability.
18
+ - **Intent Capture Interview** (`/onboard`) — Step 0 interview phase with 5 targeted questions to capture undocumented project intent before setup.
19
+
20
+ ---
21
+
10
22
  ## v1.3.14 — CVE Scanner + Open Contributions (2026-04-08)
11
23
 
12
24
  ### Added
package/README.md CHANGED
@@ -385,6 +385,43 @@ Three skills enforce non-negotiable quality gates with anti-rationalization tabl
385
385
  | `debugging-tactics` | `NO FIXES WITHOUT ROOT CAUSE INVESTIGATION FIRST` | 4-phase debugging: root cause → pattern → hypothesis → fix. 3+ failed fixes → question architecture. |
386
386
  | `verification-before-completion` | `NO COMPLETION CLAIMS WITHOUT FRESH VERIFICATION EVIDENCE` | Gate function: IDENTIFY → RUN → READ → VERIFY → CLAIM. "Should work now" is not evidence. |
387
387
 
388
+ Additionally, **15 core skills** include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift and shortcut-taking. Skills with rationalization tables: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
389
+
390
+ ### Confidence Scoring & Self-Evaluation (`/review`)
391
+
392
+ The `/review` skill outputs findings with per-issue confidence scores (1-10) and severity classification (critical/major/minor/nit). After completing a review, an LLM-as-Judge self-evaluation pass checks for blind spots: anchoring bias, assumption vs verification, missing unhappy paths, and calibrates confidence scores.
393
+
394
+ ### Agent Verification Checklists
395
+
396
+ 10 key agents include `## Verification Checklist` — exit criteria that MUST be met before presenting results. Each checklist is domain-specific:
397
+
398
+ | Agent | Key exit criteria |
399
+ |-------|------------------|
400
+ | `code-reviewer` | Every finding has file:line + evidence, not just opinion |
401
+ | `security-auditor` | Each finding includes proof-of-concept or exploit path |
402
+ | `test-engineer` | No empty/placeholder tests, mocks only at boundaries |
403
+ | `debugger` | Root cause identified, regression test added |
404
+ | `backend-specialist` | Input validation, error format, query optimization |
405
+ | `frontend-specialist` | Empty/loading/error states, accessibility, responsive |
406
+ | `database-architect` | Migration tested on prod-like volume, rollback tested |
407
+ | `performance-optimizer` | Baseline measured, profiler evidence attached |
408
+ | `devops-implementer` | Dry run passed, rollback documented, no hardcoded secrets |
409
+ | `documenter` | Code examples runnable, no placeholders, valid links |
410
+
411
+ ### Skill Reference Routing
412
+
413
+ 7 core skills include `## Related Skills` sections that suggest logical follow-up skills, improving discoverability:
414
+
415
+ ```
416
+ /review → found issues? → /debug, /tdd, /cve-scan, /analyze
417
+ /debug → bug fixed? → /review, /tdd, /workflow incident-response
418
+ /plan → approved? → /orchestrate, /write-a-prd, /grill-me
419
+ ```
420
+
421
+ ### Intent Capture Interview (`/onboard`)
422
+
423
+ The `/onboard` skill now includes a Step 0 interview phase before setup — asking 5 targeted questions to capture undocumented project intent (common contributor mistakes, protected files, deployment model, non-obvious constraints, review culture). Answers customize the generated `CLAUDE.md`.
424
+
388
425
  ### 7. Two-Stage Review (`/subagent-development`)
389
426
 
390
427
  Per-task review pipeline inspired by [obra/superpowers](https://github.com/obra/superpowers):
@@ -184,6 +184,14 @@ After implementing significant changes, update documentation:
184
184
  ### Delegation
185
185
  For large documentation tasks, hand off to `documenter` agent.
186
186
 
187
+ ## Verification Checklist
188
+ Before presenting implementation:
189
+ - [ ] All new endpoints have input validation
190
+ - [ ] Error responses follow the project's error format
191
+ - [ ] Database queries are optimized (checked with EXPLAIN if applicable)
192
+ - [ ] New dependencies are justified and audited
193
+ - [ ] Migration is reversible
194
+
187
195
  ## KB Integration
188
196
 
189
197
  Before coding, search knowledge base:
@@ -177,6 +177,15 @@ After significant reviews, update documentation:
177
177
  ### Delegation
178
178
  For large documentation tasks, hand off to `documenter` agent.
179
179
 
180
+ ## Verification Checklist
181
+ Before presenting review results:
182
+ - [ ] Every finding includes file:line reference
183
+ - [ ] Each finding has evidence (code snippet or reasoning), not just opinion
184
+ - [ ] Severity rating reflects actual impact, not gut feeling
185
+ - [ ] "No findings" includes list of specific checks performed
186
+ - [ ] Security-sensitive files received deeper scrutiny
187
+ - [ ] Test coverage gaps are flagged, not assumed covered
188
+
180
189
  ## Limitations
181
190
 
182
191
  - **Security penetration testing** → Use `security-auditor`
@@ -308,6 +308,14 @@ After schema/database changes, update documentation:
308
308
  ### Delegation
309
309
  For large documentation tasks, hand off to `documenter` agent.
310
310
 
311
+ ## Verification Checklist
312
+ Before presenting schema changes:
313
+ - [ ] Migration tested on production-like data volume
314
+ - [ ] Rollback script exists and was tested
315
+ - [ ] Indexes cover the expected query patterns
316
+ - [ ] No long-running locks on large tables
317
+ - [ ] Application handles both old and new schema during migration
318
+
311
319
  ## KB Integration
312
320
 
313
321
  Before designing, search knowledge base:
@@ -231,6 +231,14 @@ After fixing significant bugs, update documentation:
231
231
  ### Delegation
232
232
  For large documentation tasks, hand off to `documenter` agent.
233
233
 
234
+ ## Verification Checklist
235
+ Before claiming a bug is fixed:
236
+ - [ ] Root cause identified, not just symptoms addressed
237
+ - [ ] Fix was verified by reproducing the original failure first
238
+ - [ ] Regression test added to prevent recurrence
239
+ - [ ] Related code paths checked for similar issues
240
+ - [ ] Fix doesn't introduce new side effects
241
+
234
242
  ## Limitations
235
243
 
236
244
  - **Performance profiling** → Use `performance-optimizer`
@@ -187,6 +187,14 @@ instructions: |
187
187
  ---
188
188
  ```
189
189
 
190
+ ## Verification Checklist
191
+ Before presenting infrastructure changes:
192
+ - [ ] Dry run completed successfully
193
+ - [ ] Rollback procedure documented and tested
194
+ - [ ] Secrets are not hardcoded or logged
195
+ - [ ] Health checks configured for new services
196
+ - [ ] Resource limits set to prevent runaway costs
197
+
190
198
  ## Limitations
191
199
 
192
200
  - **Architectural decisions** → Use `infrastructure-architect`
@@ -357,6 +357,14 @@ last_updated: "YYYY-MM-DD"
357
357
  - Add diagrams where helpful
358
358
  - Version documentation with code
359
359
 
360
+ ## Verification Checklist
361
+ Before presenting documentation:
362
+ - [ ] Code examples are tested and runnable
363
+ - [ ] No placeholder text or TODO markers remain
364
+ - [ ] Links and references are valid
365
+ - [ ] Architecture decisions include rationale (not just "what")
366
+ - [ ] KB documents have complete YAML frontmatter
367
+
360
368
  ## Limitations
361
369
 
362
370
  - **Code implementation** → Use `devops-implementer`
@@ -200,6 +200,14 @@ After implementing significant changes, update documentation:
200
200
  ### Delegation
201
201
  For large documentation tasks, hand off to `documenter` agent.
202
202
 
203
+ ## Verification Checklist
204
+ Before presenting implementation:
205
+ - [ ] Components render correctly with empty/loading/error states
206
+ - [ ] Accessibility basics checked (keyboard nav, aria labels, contrast)
207
+ - [ ] No console errors or warnings in dev tools
208
+ - [ ] Responsive behavior verified at mobile/tablet/desktop breakpoints
209
+ - [ ] Bundle size impact assessed for new dependencies
210
+
203
211
  ## KB Integration
204
212
 
205
213
  Before coding, search knowledge base:
@@ -247,6 +247,14 @@ After performance optimizations, update documentation:
247
247
  ### Delegation
248
248
  For large documentation tasks, hand off to `documenter` agent.
249
249
 
250
+ ## Verification Checklist
251
+ Before presenting optimization:
252
+ - [ ] Baseline measurement taken before changes
253
+ - [ ] Improvement measured with realistic data, not synthetic benchmarks
254
+ - [ ] No regressions in other metrics (memory, latency, correctness)
255
+ - [ ] Optimization targets the actual bottleneck (profiler evidence attached)
256
+ - [ ] Cache invalidation strategy documented if caching was added
257
+
250
258
  ## Limitations
251
259
 
252
260
  - **Production incidents** → Use `incident-responder`
@@ -301,6 +301,15 @@ For large documentation tasks, hand off to `documenter` agent.
301
301
  - No destructive testing without explicit approval
302
302
  - Report findings responsibly
303
303
 
304
+ ## Verification Checklist
305
+ Before presenting security findings:
306
+ - [ ] Each finding includes proof-of-concept or exploit path
307
+ - [ ] Severity ratings reference actual impact, not theoretical risk
308
+ - [ ] "No findings" includes the specific checks performed
309
+ - [ ] Dependencies were scanned, not just application code
310
+ - [ ] Secrets scan covered all file types (not just source code)
311
+ - [ ] Auth flows were traced end-to-end, not spot-checked
312
+
304
313
  ## Limitations
305
314
 
306
315
  - **Code implementation** → Use `devops-implementer`
@@ -257,6 +257,15 @@ After writing significant tests, update documentation:
257
257
  ### Delegation
258
258
  For large documentation tasks, hand off to `documenter` agent.
259
259
 
260
+ ## Verification Checklist
261
+ Before presenting test results:
262
+ - [ ] Every test has a clear assertion (no empty or placeholder tests)
263
+ - [ ] Edge cases are explicitly tested, not assumed
264
+ - [ ] Mocks are only at system boundaries, not internal collaborators
265
+ - [ ] Test names describe behavior, not implementation
266
+ - [ ] Flaky test patterns (time, network, order-dependent) are flagged
267
+ - [ ] Coverage gaps are reported with specific uncovered paths
268
+
260
269
  ## Limitations
261
270
 
262
271
  - **Code implementation** → Use `devops-implementer`
@@ -82,6 +82,15 @@ python3 ${CLAUDE_SKILL_DIR}/scripts/complexity.py .
82
82
 
83
83
  Reports file counts by type, largest files, TODO/FIXME counts, and total code lines.
84
84
 
85
+ ## Common Rationalizations
86
+
87
+ | Excuse | Why It's Wrong |
88
+ |--------|----------------|
89
+ | "The linter is green, the code is fine" | Linters catch syntax, not design flaws — analysis covers architecture and patterns |
90
+ | "We know where the problems are" | Intuition misses systemic issues — data-driven analysis reveals hidden hotspots |
91
+ | "Analysis takes too long" | A 5-minute scan prevents weeks of debugging — front-load the investment |
92
+ | "It's legacy code, analysis won't help" | Legacy code benefits most — find the critical paths before they break |
93
+
85
94
  ## Tools Used
86
95
 
87
96
  | Language | Tools |
@@ -90,3 +99,9 @@ Reports file counts by type, largest files, TODO/FIXME counts, and total code li
90
99
  | JavaScript | eslint, tsc |
91
100
  | Go | golangci-lint |
92
101
  | Rust | clippy |
102
+
103
+ ## Related Skills
104
+ - Found quality issues? → `/refactor` to fix them systematically
105
+ - Security issues detected? → `/cve-scan` for dependency audit
106
+ - Want deeper architecture review? → `/architecture-audit` for friction discovery
107
+ - Performance hotspots found? → `/workflow performance-optimization`
@@ -292,6 +292,16 @@ Accept: application/vnd.myapi.v1+json
292
292
 
293
293
  ---
294
294
 
295
+ ## Common Rationalizations
296
+
297
+ | Excuse | Why It's Wrong |
298
+ |--------|----------------|
299
+ | "We'll version the API later" | Unversioned APIs break clients on every change — version from day one |
300
+ | "Retries are the client's problem" | Server-side idempotency prevents data corruption — design for at-least-once delivery |
301
+ | "We'll add rate limiting later" | Unprotected endpoints get abused within hours of deployment |
302
+ | "Error messages are just for debugging" | Error responses are your API's UX — clients depend on consistent, parseable errors |
303
+ | "PATCH and PUT are the same thing" | PUT replaces the resource, PATCH modifies it — wrong semantics cause data loss |
304
+
295
305
  ## Best Practices
296
306
 
297
307
  - [ ] Use HTTPS only
@@ -291,6 +291,16 @@ env:
291
291
  | `feat:` | Minor (0.x.0) | `feat: add user search endpoint` |
292
292
  | `feat!:` / `BREAKING CHANGE:` | Major (x.0.0) | `feat!: change API response format` |
293
293
 
294
+ ## Common Rationalizations
295
+
296
+ | Excuse | Why It's Wrong |
297
+ |--------|----------------|
298
+ | "CI is green, ship it" | CI tests the happy path — verify edge cases, security, and performance separately |
299
+ | "Manual deploys give us more control" | Manual deploys give you more human error — automate the repeatable parts |
300
+ | "We'll set up CI when the project is bigger" | Small projects grow fast — CI debt compounds and retrofitting is painful |
301
+ | "Caching isn't worth the complexity" | Uncached builds waste developer time daily — caching pays for itself in a week |
302
+ | "Feature flags are over-engineering" | Feature flags decouple deploy from release — they're the cheapest safety net |
303
+
294
304
  ## Anti-Patterns
295
305
  - Secrets in pipeline logs or environment dumps
296
306
  - No caching (slow builds)
@@ -100,6 +100,16 @@ Keep modules focused. Order contents consistently: imports (stdlib, third-party,
100
100
 
101
101
  ---
102
102
 
103
+ ## Common Rationalizations
104
+
105
+ | Excuse | Why It's Wrong |
106
+ |--------|----------------|
107
+ | "It's readable enough" | "Enough" means someone will misread it eventually — clarity prevents incidents |
108
+ | "Refactoring for readability is gold-plating" | Readability is maintainability — future you will thank present you |
109
+ | "Short variable names are faster to type" | You type it once, readers parse it hundreds of times — optimize for reading |
110
+ | "DRY means never repeat anything" | Wrong DRY creates coupling — duplicate until you see the real abstraction |
111
+ | "More abstractions = cleaner code" | Premature abstraction is worse than duplication — wait for the third use |
112
+
103
113
  ## Language-Specific References
104
114
 
105
115
  For detailed patterns, type hints, linting configuration, and idiomatic code per language:
@@ -296,3 +296,13 @@ client.create_payload_index(
296
296
  | COSINE | Text embeddings | Yes |
297
297
  | EUCLID | Image embeddings | No |
298
298
  | DOT | When vectors pre-normalized | Yes |
299
+
300
+ ## Common Rationalizations
301
+
302
+ | Excuse | Why It's Wrong |
303
+ |--------|----------------|
304
+ | "We'll add indexes later when it's slow" | Missing indexes on production tables cause outages, not slowdowns — index from design |
305
+ | "The ORM handles performance" | ORMs generate queries, they don't optimize them — always check the query plan |
306
+ | "NoSQL is faster" | NoSQL trades consistency for speed — if you need joins, use a relational DB |
307
+ | "We don't need migrations, we'll update the schema directly" | Direct schema changes are irreversible and untestable — migrations are the safety net |
308
+ | "One big table is simpler" | Denormalization without measurement creates update anomalies — normalize first, denormalize with data |
@@ -144,6 +144,16 @@ Have them talk to each other to challenge each other's theories.
144
144
  Report consensus when done.
145
145
  ```
146
146
 
147
+ ## Common Rationalizations
148
+
149
+ | Excuse | Why It's Wrong |
150
+ |--------|----------------|
151
+ | "It works on my machine" | Environment differences are the #1 cause of production bugs — reproduce in prod-like env |
152
+ | "It must be a library bug" | 95% of the time it's your code — exhaust local hypotheses first |
153
+ | "I'll just add more logging and wait" | Passive debugging wastes hours — form a hypothesis and test it actively |
154
+ | "The error message says X, so it must be X" | Error messages often describe symptoms, not root causes — trace the full chain |
155
+ | "It only happens sometimes, probably a fluke" | Intermittent bugs are race conditions or state leaks — they get worse, not better |
156
+
147
157
  ## Debug Checklist
148
158
 
149
159
  - [ ] Identified error/symptom
@@ -152,3 +162,9 @@ Report consensus when done.
152
162
  - [ ] Reproduced issue
153
163
  - [ ] Formed hypothesis
154
164
  - [ ] Tested fix
165
+
166
+ ## Related Skills
167
+ - Bug fixed? → `/review` to verify the fix quality
168
+ - Need a regression test? → `/tdd` to write it test-first
169
+ - Performance issue? → `/analyze --type=complexity` for hotspot analysis
170
+ - Incident in production? → `/workflow incident-response` for full response
@@ -113,6 +113,16 @@ Proposed
113
113
  - [ ] Commit changes
114
114
  ```
115
115
 
116
+ ## Common Rationalizations
117
+
118
+ | Excuse | Why It's Wrong |
119
+ |--------|----------------|
120
+ | "The code is self-documenting" | Code shows how, not why — decisions, constraints, and context need prose |
121
+ | "Nobody reads docs anyway" | People don't read bad docs — good docs are the first thing consulted |
122
+ | "I'll document it when it's stable" | Unstable code needs docs most — document intent so others can contribute |
123
+ | "Comments get stale" | That's an argument for maintaining docs, not skipping them |
124
+ | "The tests are the documentation" | Tests verify behavior but don't explain architecture, trade-offs, or setup |
125
+
116
126
  ## Configuration
117
127
 
118
128
  Documentation settings in:
@@ -143,3 +153,9 @@ Create an agent team for documentation:
143
153
  - Teammate 3 (documenter): "Generate README sections: installation, usage, API reference." Use Opus.
144
154
  Teammates should NOT overlap — each owns their assigned scope.
145
155
  ```
156
+
157
+ ## Related Skills
158
+ - Documenting an architecture decision? → `/council` for multi-perspective analysis first
159
+ - Need to explore the codebase? → `/explore` to understand structure before documenting
160
+ - Writing a PRD? → `/write-a-prd` for structured product requirements
161
+ - Auditing existing docs? → `/analyze` for coverage gaps
@@ -68,3 +68,13 @@ git cherry-pick --continue
68
68
  - `perf:` Performance improvement
69
69
  - `test:` Adding missing tests
70
70
  - `chore:` Build process/auxiliary tools
71
+
72
+ ## Common Rationalizations
73
+
74
+ | Excuse | Why It's Wrong |
75
+ |--------|----------------|
76
+ | "I'll clean up commits later" | Later means never — write clean commits as you go |
77
+ | "Force push is fine on my branch" | Others may have fetched your branch — use --force-with-lease |
78
+ | "One big commit is simpler" | Big commits are impossible to review, bisect, or revert — keep them atomic |
79
+ | "Merge conflicts mean someone else's problem" | Conflicts mean you diverged too long — rebase frequently to stay aligned |
80
+ | "Commit messages don't matter" | Messages are documentation — future you needs to understand why, not just what |
@@ -17,6 +17,21 @@ Guide the user through setting up the ai-toolkit in their project, including con
17
17
 
18
18
  ## Setup Steps
19
19
 
20
+ ### Step 0: Intent Capture Interview
21
+
22
+ Before setting up tooling, understand the project's undocumented context. Ask the developer these questions (adapt based on what the codebase scan reveals):
23
+
24
+ 1. **What's the one thing a new contributor always gets wrong?** — This reveals the biggest documentation gap
25
+ 2. **Are there files or directories that should NOT be modified?** — Identifies protected areas (legacy, generated, vendor)
26
+ 3. **What's the deployment model?** — Monolith, microservices, serverless, edge — shapes which agents and skills are most relevant
27
+ 4. **Are there non-obvious constraints?** — Compliance requirements, performance budgets, browser support matrix
28
+ 5. **What's the team's review culture?** — Strict PR reviews, trunk-based, pair programming — configures `/review` behavior
29
+
30
+ Use answers to:
31
+ - Customize the generated `CLAUDE.md` with project-specific warnings and conventions
32
+ - Select the right `--profile` (minimal/standard/strict) automatically
33
+ - Pre-configure relevant language rules
34
+
20
35
  ### Step 1: Prerequisites Check
21
36
  - [ ] Claude Code CLI installed
22
37
  - [ ] ai-toolkit repository cloned
@@ -57,3 +57,13 @@ Always measure -> change -> measure.
57
57
  2. **Algorithm**: (O(n²) -> O(n log n))
58
58
  3. **Memory**: (Allocation churn, GC pressure)
59
59
  4. **Micro-optimization**: (Loop unrolling, etc.) - *Smallest Gains*
60
+
61
+ ## Common Rationalizations
62
+
63
+ | Excuse | Why It's Wrong |
64
+ |--------|----------------|
65
+ | "It feels slow, let me optimize this function" | Feelings aren't data — profile first, then optimize the actual bottleneck |
66
+ | "We should optimize everything" | Premature optimization is the root of all evil — focus on the critical path |
67
+ | "Caching will fix it" | Caching masks problems and adds complexity — fix the root cause first |
68
+ | "It's fast enough in dev" | Dev has 1 user — production has thousands and cold caches |
69
+ | "We'll optimize later" | Performance debt compounds — a 100ms regression per sprint = 5s in a year |
@@ -95,6 +95,16 @@ During planning:
95
95
  - NO code writing
96
96
  - NO file creation (except plan)
97
97
 
98
+ ## Common Rationalizations
99
+
100
+ | Excuse | Why It's Wrong |
101
+ |--------|----------------|
102
+ | "We already know what to build" | Assumed requirements lead to rework — validate assumptions explicitly |
103
+ | "Planning is wasted time, just start coding" | Unplanned work has 3-5x more rework — 30 min planning saves days |
104
+ | "The requirements will change anyway" | Plans adapt — without one, you can't assess impact of changes |
105
+ | "It's a small feature, no plan needed" | Small features in complex systems have hidden dependencies — map them |
106
+ | "We'll figure it out as we go" | Discovery without structure leads to scope creep and missed edge cases |
107
+
98
108
  ## Next Steps
99
109
 
100
110
  After plan approval:
@@ -108,3 +118,9 @@ Before planning:
108
118
  smart_query("project template: {type}")
109
119
  hybrid_search_kb("architecture {pattern}")
110
120
  ```
121
+
122
+ ## Related Skills
123
+ - Plan approved? → `/orchestrate` or `/workflow` to execute with agents
124
+ - Need requirements first? → `/write-a-prd` for structured product requirements
125
+ - Want to stress-test the plan? → `/grill-me` for Socratic questioning
126
+ - Ready to break into issues? → `/prd-to-plan` → `/triage-issue`
@@ -81,6 +81,16 @@ Before executing:
81
81
  - [ ] Tests passing
82
82
  - [ ] Backup created
83
83
 
84
+ ## Common Rationalizations
85
+
86
+ | Excuse | Why It's Wrong |
87
+ |--------|----------------|
88
+ | "It works, don't touch it" | Working code that's hard to maintain slows every future change |
89
+ | "We'll refactor it later" | Later never comes — refactor when the pain is fresh and context is loaded |
90
+ | "It's too risky to change" | That's exactly why it needs refactoring — risk compounds with complexity |
91
+ | "Just one more hack won't hurt" | Each hack makes the next one easier to justify — break the cycle now |
92
+ | "We need to rewrite from scratch" | Incremental refactoring is safer and delivers value continuously |
93
+
84
94
  ## READ BEFORE WRITE
85
95
 
86
96
  This command analyzes and plans first.
@@ -122,3 +132,9 @@ Create an agent team for refactoring:
122
132
  - Teammate 2 (backend-specialist): "Implement the refactoring changes identified by the reviewer." Use Opus.
123
133
  Teammate 1 completes first, then Teammate 2 acts on the plan.
124
134
  ```
135
+
136
+ ## Related Skills
137
+ - Need a safe refactor plan? → `/refactor-plan` for incremental steps as GitHub RFC
138
+ - Want to validate architecture? → `/analyze` for code quality metrics
139
+ - Need tests before refactoring? → `/tdd` to build safety net first
140
+ - Architecture decision needed? → `/council` for multi-perspective evaluation
@@ -117,17 +117,40 @@ After all reviewers complete:
117
117
  - **Lines Added**: [+count]
118
118
  - **Lines Removed**: [-count]
119
119
  - **Issues Found**: [count]
120
+ - **Overall Confidence**: [1-10] — how confident the reviewer is in the assessment
120
121
 
121
122
  ### Findings
122
123
 
123
124
  #### Critical
124
125
  - **[file:line]**: [issue]
125
- - [explanation]
126
+ - Severity: critical | Confidence: [1-10]
127
+ - Evidence: [specific code reference and reasoning]
126
128
  - Suggested fix: [code]
127
129
 
128
- #### Suggestions
130
+ #### Major
131
+ - **[file:line]**: [issue]
132
+ - Severity: major | Confidence: [1-10]
133
+ - Evidence: [specific code reference and reasoning]
134
+ - Suggested fix: [code]
135
+
136
+ #### Minor
137
+ - **[file:line]**: [issue]
138
+ - Severity: minor | Confidence: [1-10]
139
+ - Evidence: [line number + reasoning]
140
+
141
+ #### Nit
129
142
  - **[file:line]**: [suggestion]
130
- - [explanation]
143
+ - Severity: nit | Confidence: [1-10]
144
+
145
+ ### Confidence Guide
146
+
147
+ | Score | Meaning |
148
+ |-------|---------|
149
+ | 9-10 | Certain — verified via code, tests, or documentation |
150
+ | 7-8 | High — strong evidence, minor assumptions |
151
+ | 5-6 | Medium — plausible issue, needs author confirmation |
152
+ | 3-4 | Low — speculative, based on patterns not proof |
153
+ | 1-2 | Guess — flag for discussion, don't block on this |
131
154
 
132
155
  ### Positive Notes
133
156
  - [What's good about the code]
@@ -136,6 +159,38 @@ After all reviewers complete:
136
159
  [APPROVE / REQUEST_CHANGES / NEEDS_DISCUSSION]
137
160
  ```
138
161
 
162
+ ## Common Rationalizations
163
+
164
+ | Excuse | Why It's Wrong |
165
+ |--------|----------------|
166
+ | "Small change, quick scan is enough" | Small changes introduce subtle bugs — apply consistent review regardless of size |
167
+ | "Tests pass, so the code is correct" | Tests validate specific scenarios, not all behaviors — verify missing coverage |
168
+ | "It's just a refactor, no need for deep review" | Refactors change invariants — verify behavior preservation, not just compilation |
169
+ | "The author is senior, they know what they're doing" | Seniority doesn't prevent mistakes — review the code, not the person |
170
+ | "We're in a hurry, ship it" | Rushed reviews create tech debt that costs 10x more to fix later |
171
+
172
+ ## Self-Evaluation (LLM-as-Judge)
173
+
174
+ After completing the review, perform a self-evaluation pass:
175
+
176
+ ### Check for Blind Spots
177
+ 1. **Did I verify, or assume?** — For each finding, confirm you read the actual code (not inferred from context)
178
+ 2. **Did I miss the inverse?** — If you flagged X as a problem, did you check if NOT doing X is also a problem elsewhere?
179
+ 3. **Did I anchor on the first issue?** — Review whether early findings biased you toward similar patterns, missing different issue classes
180
+ 4. **Did I check the unhappy path?** — Error handling, edge cases, failure modes — not just the golden path
181
+ 5. **Did I flag uncertainty?** — Findings with confidence < 6 should be clearly marked as "needs author input"
182
+
183
+ ### Calibrate Confidence
184
+ - If all findings are confidence 7+, you may be overconfident — re-examine the weakest finding
185
+ - If any finding lacks a file:line reference, downgrade it or remove it
186
+ - If you found zero issues, state what you specifically checked (not "looks good")
187
+
139
188
  ## READ-ONLY
140
189
 
141
190
  This skill only analyzes. It does NOT modify any files.
191
+
192
+ ## Related Skills
193
+ - Issues found? → `/debug` to trace root causes
194
+ - Missing tests? → `/tdd` to add test-first coverage
195
+ - Security findings? → `/cve-scan` for dependency vulnerabilities
196
+ - Architecture concerns? → `/analyze` for deeper code quality metrics
@@ -81,6 +81,16 @@ async def resource():
81
81
 
82
82
  ---
83
83
 
84
+ ## Common Rationalizations
85
+
86
+ | Excuse | Why It's Wrong |
87
+ |--------|----------------|
88
+ | "It's an internal API, security doesn't matter" | Internal APIs get exposed — lateral movement is attackers' primary technique |
89
+ | "The framework handles security" | Frameworks provide tools, not guarantees — misconfiguration is OWASP #5 |
90
+ | "We'll add auth later" | Unauthenticated endpoints in production get discovered within hours |
91
+ | "Nobody would exploit this" | Automated scanners don't care about your threat model — they scan everything |
92
+ | "It's behind a VPN" | VPNs are perimeter defense — zero trust assumes breach already happened |
93
+
84
94
  ## Reference Guides
85
95
 
86
96
  For authentication patterns (JWT, passwords, token strategy), see [reference/authentication.md](reference/authentication.md).
@@ -172,3 +172,9 @@ Before marking work complete:
172
172
  - [ ] Edge cases and errors covered
173
173
 
174
174
  Can't check all boxes? You skipped TDD. Start over.
175
+
176
+ ## Related Skills
177
+ - Feature complete? → `/review` to get a code review
178
+ - Need to plan the feature first? → `/plan` for task breakdown
179
+ - Want a full test coverage sweep? → `/workflow test-coverage`
180
+ - Debugging a test failure? → `/debug` for systematic root cause analysis
@@ -72,3 +72,13 @@ For PHP PHPUnit patterns, see [reference/php-phpunit.md](reference/php-phpunit.m
72
72
  For Go testing patterns, see [reference/go-testing.md](reference/go-testing.md).
73
73
 
74
74
  For Flutter/Dart testing patterns, see [reference/flutter-testing.md](reference/flutter-testing.md).
75
+
76
+ ## Common Rationalizations
77
+
78
+ | Excuse | Why It's Wrong |
79
+ |--------|----------------|
80
+ | "It's too simple to test" | Simple code breaks in integration — test the contract, not the complexity |
81
+ | "Tests slow down development" | Tests slow down bugs reaching production — that's the point |
82
+ | "We'll add tests later" | Untested code accumulates — later means never, and coverage gaps compound |
83
+ | "Mocking everything is fine" | Over-mocking tests the mocks, not the code — mock at boundaries only |
84
+ | "100% coverage means no bugs" | Coverage measures execution, not correctness — focus on behavior assertions |
@@ -3,7 +3,7 @@ title: "AI Toolkit - Architecture Overview"
3
3
  category: reference
4
4
  service: ai-toolkit
5
5
  tags: [architecture, overview, design, structure]
6
- version: "1.3.14"
6
+ version: "1.3.15"
7
7
  created: "2026-03-23"
8
8
  last_updated: "2026-04-08"
9
9
  description: "Architecture of ai-toolkit: directory layout, global install model, skill tiers, and integration with projects."
@@ -178,6 +178,23 @@ Skills that spawn real parallel agents use:
178
178
 
179
179
  `CLAUDE_CODE_EXPERIMENTAL_AGENT_TEAMS=1` must be set for Agent Teams (tmux-based) support.
180
180
 
181
+ ## Quality Guardrails
182
+
183
+ ### Anti-Rationalization Tables
184
+ 15 core skills include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift. Skills: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
185
+
186
+ ### Confidence Scoring & LLM-as-Judge (`/review`)
187
+ Review findings include per-issue confidence scores (1-10) and severity tiers (critical/major/minor/nit). A self-evaluation pass after review checks for anchoring bias, assumption vs verification, and calibrates confidence.
188
+
189
+ ### Agent Verification Checklists
190
+ 10 agents have `## Verification Checklist` — domain-specific exit criteria: `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
191
+
192
+ ### Skill Reference Routing
193
+ 7 core skills include `## Related Skills` suggesting follow-up skills: `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
194
+
195
+ ### Intent Capture Interview (`/onboard`)
196
+ Step 0 interview — 5 questions to capture undocumented project intent before setup.
197
+
181
198
  ## Component Relationships
182
199
 
183
200
  ```
@@ -3,7 +3,7 @@ title: "AI Toolkit - Skills Catalog"
3
3
  category: reference
4
4
  service: ai-toolkit
5
5
  tags: [skills, domain-knowledge, catalog, task-skills, hybrid-skills]
6
- version: "1.3.14"
6
+ version: "1.3.15"
7
7
  created: "2026-03-23"
8
8
  last_updated: "2026-04-08"
9
9
  description: "Complete skills catalog with task, hybrid, and knowledge skills. Includes effort levels, skill-scoped hooks, executable scripts, security auditor, and persona presets."
@@ -171,6 +171,62 @@ Hybrid skills combine slash-command invocation with domain knowledge that agents
171
171
  |-------|-----------|--------|
172
172
  | **hive-mind** | `skills/hive-mind/` | Multi-agent aggregation, consensus, swarm patterns |
173
173
 
174
+ ## Quality Guardrails
175
+
176
+ ### Anti-Rationalization Tables
177
+
178
+ 15 core skills include `## Common Rationalizations` — domain-specific tables of excuses and rebuttals that prevent agent drift and shortcut-taking:
179
+
180
+ | Skill | Example rationalization blocked |
181
+ |-------|---------------------------------|
182
+ | `/review` | "Small change, quick scan is enough" |
183
+ | `/debug` | "It must be a library bug" |
184
+ | `/refactor` | "It works, don't touch it" |
185
+ | `/tdd` | "Too simple to test" |
186
+ | `/plan` | "Planning is wasted time, just start coding" |
187
+ | `/docs` | "The code is self-documenting" |
188
+ | `/analyze` | "The linter is green, the code is fine" |
189
+ | `security-patterns` | "It's an internal API, security doesn't matter" |
190
+ | `testing-patterns` | "Tests slow down development" |
191
+ | `api-patterns` | "We'll version the API later" |
192
+ | `ci-cd-patterns` | "Manual deploys give us more control" |
193
+ | `clean-code` | "It's readable enough" |
194
+ | `performance-profiling` | "It feels slow, let me optimize this function" |
195
+ | `git-mastery` | "One big commit is simpler" |
196
+ | `database-patterns` | "We'll add indexes later when it's slow" |
197
+
198
+ ### Confidence Scoring (`/review`)
199
+
200
+ The `/review` skill outputs structured findings with:
201
+ - **Severity**: critical / major / minor / nit
202
+ - **Confidence score**: 1-10 per finding with calibration guide
203
+ - **Evidence requirement**: each finding must include file:line + reasoning
204
+
205
+ ### Self-Evaluation — LLM-as-Judge (`/review`)
206
+
207
+ After completing a review, the agent performs a self-evaluation pass:
208
+ 1. Verify vs assume — did I read actual code for each finding?
209
+ 2. Check the inverse — if X is a problem, is NOT-X also a problem elsewhere?
210
+ 3. Detect anchoring bias — did early findings bias toward similar patterns?
211
+ 4. Check unhappy paths — error handling, edge cases, failure modes
212
+ 5. Calibrate confidence — overconfident? re-examine weakest finding
213
+
214
+ ### Agent Verification Checklists
215
+
216
+ 10 key agents include `## Verification Checklist` — exit criteria before presenting results:
217
+ `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
218
+
219
+ ### Skill Reference Routing
220
+
221
+ 7 core skills include `## Related Skills` sections suggesting logical follow-up skills:
222
+ `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
223
+
224
+ ### Intent Capture Interview (`/onboard`)
225
+
226
+ Step 0 interview before setup — 5 targeted questions to capture undocumented project intent, customizing the generated `CLAUDE.md`.
227
+
228
+ ---
229
+
174
230
  ## Advanced Features
175
231
 
176
232
  ### Effort Levels
package/llms-full.txt CHANGED
@@ -934,7 +934,7 @@ title: "AI Toolkit - Architecture Overview"
934
934
  category: reference
935
935
  service: ai-toolkit
936
936
  tags: [architecture, overview, design, structure]
937
- version: "1.3.14"
937
+ version: "1.3.15"
938
938
  created: "2026-03-23"
939
939
  last_updated: "2026-04-08"
940
940
  description: "Architecture of ai-toolkit: directory layout, global install model, skill tiers, and integration with projects."
@@ -1109,6 +1109,23 @@ Skills that spawn real parallel agents use:
1109
1109
 
1110
1110
  `CLAUDE_CODE_EXPERIMENTAL_AGENT_TEAMS=1` must be set for Agent Teams (tmux-based) support.
1111
1111
 
1112
+ ## Quality Guardrails
1113
+
1114
+ ### Anti-Rationalization Tables
1115
+ 15 core skills include `## Common Rationalizations` tables — domain-specific excuses with rebuttals that prevent agent drift. Skills: `/review`, `/debug`, `/refactor`, `/tdd`, `/plan`, `/docs`, `/analyze`, `security-patterns`, `testing-patterns`, `api-patterns`, `ci-cd-patterns`, `clean-code`, `performance-profiling`, `git-mastery`, `database-patterns`.
1116
+
1117
+ ### Confidence Scoring & LLM-as-Judge (`/review`)
1118
+ Review findings include per-issue confidence scores (1-10) and severity tiers (critical/major/minor/nit). A self-evaluation pass after review checks for anchoring bias, assumption vs verification, and calibrates confidence.
1119
+
1120
+ ### Agent Verification Checklists
1121
+ 10 agents have `## Verification Checklist` — domain-specific exit criteria: `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
1122
+
1123
+ ### Skill Reference Routing
1124
+ 7 core skills include `## Related Skills` suggesting follow-up skills: `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
1125
+
1126
+ ### Intent Capture Interview (`/onboard`)
1127
+ Step 0 interview — 5 questions to capture undocumented project intent before setup.
1128
+
1112
1129
  ## Component Relationships
1113
1130
 
1114
1131
  ```
@@ -4095,7 +4112,7 @@ title: "AI Toolkit - Skills Catalog"
4095
4112
  category: reference
4096
4113
  service: ai-toolkit
4097
4114
  tags: [skills, domain-knowledge, catalog, task-skills, hybrid-skills]
4098
- version: "1.3.14"
4115
+ version: "1.3.15"
4099
4116
  created: "2026-03-23"
4100
4117
  last_updated: "2026-04-08"
4101
4118
  description: "Complete skills catalog with task, hybrid, and knowledge skills. Includes effort levels, skill-scoped hooks, executable scripts, security auditor, and persona presets."
@@ -4263,6 +4280,62 @@ Hybrid skills combine slash-command invocation with domain knowledge that agents
4263
4280
  |-------|-----------|--------|
4264
4281
  | **hive-mind** | `skills/hive-mind/` | Multi-agent aggregation, consensus, swarm patterns |
4265
4282
 
4283
+ ## Quality Guardrails
4284
+
4285
+ ### Anti-Rationalization Tables
4286
+
4287
+ 15 core skills include `## Common Rationalizations` — domain-specific tables of excuses and rebuttals that prevent agent drift and shortcut-taking:
4288
+
4289
+ | Skill | Example rationalization blocked |
4290
+ |-------|---------------------------------|
4291
+ | `/review` | "Small change, quick scan is enough" |
4292
+ | `/debug` | "It must be a library bug" |
4293
+ | `/refactor` | "It works, don't touch it" |
4294
+ | `/tdd` | "Too simple to test" |
4295
+ | `/plan` | "Planning is wasted time, just start coding" |
4296
+ | `/docs` | "The code is self-documenting" |
4297
+ | `/analyze` | "The linter is green, the code is fine" |
4298
+ | `security-patterns` | "It's an internal API, security doesn't matter" |
4299
+ | `testing-patterns` | "Tests slow down development" |
4300
+ | `api-patterns` | "We'll version the API later" |
4301
+ | `ci-cd-patterns` | "Manual deploys give us more control" |
4302
+ | `clean-code` | "It's readable enough" |
4303
+ | `performance-profiling` | "It feels slow, let me optimize this function" |
4304
+ | `git-mastery` | "One big commit is simpler" |
4305
+ | `database-patterns` | "We'll add indexes later when it's slow" |
4306
+
4307
+ ### Confidence Scoring (`/review`)
4308
+
4309
+ The `/review` skill outputs structured findings with:
4310
+ - **Severity**: critical / major / minor / nit
4311
+ - **Confidence score**: 1-10 per finding with calibration guide
4312
+ - **Evidence requirement**: each finding must include file:line + reasoning
4313
+
4314
+ ### Self-Evaluation — LLM-as-Judge (`/review`)
4315
+
4316
+ After completing a review, the agent performs a self-evaluation pass:
4317
+ 1. Verify vs assume — did I read actual code for each finding?
4318
+ 2. Check the inverse — if X is a problem, is NOT-X also a problem elsewhere?
4319
+ 3. Detect anchoring bias — did early findings bias toward similar patterns?
4320
+ 4. Check unhappy paths — error handling, edge cases, failure modes
4321
+ 5. Calibrate confidence — overconfident? re-examine weakest finding
4322
+
4323
+ ### Agent Verification Checklists
4324
+
4325
+ 10 key agents include `## Verification Checklist` — exit criteria before presenting results:
4326
+ `code-reviewer`, `test-engineer`, `security-auditor`, `debugger`, `backend-specialist`, `frontend-specialist`, `database-architect`, `performance-optimizer`, `devops-implementer`, `documenter`.
4327
+
4328
+ ### Skill Reference Routing
4329
+
4330
+ 7 core skills include `## Related Skills` sections suggesting logical follow-up skills:
4331
+ `/review`, `/debug`, `/plan`, `/refactor`, `/tdd`, `/docs`, `/analyze`.
4332
+
4333
+ ### Intent Capture Interview (`/onboard`)
4334
+
4335
+ Step 0 interview before setup — 5 targeted questions to capture undocumented project intent, customizing the generated `CLAUDE.md`.
4336
+
4337
+ ---
4338
+
4266
4339
  ## Advanced Features
4267
4340
 
4268
4341
  ### Effort Levels
package/manifest.json CHANGED
@@ -1,5 +1,5 @@
1
1
  {
2
- "version": "1.3.14",
2
+ "version": "1.3.15",
3
3
  "components": {
4
4
  "agents": {
5
5
  "description": "44 specialized agents (orchestrator, backend, frontend, security, devops, etc.)",
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@softspark/ai-toolkit",
3
- "version": "1.3.14",
3
+ "version": "1.3.15",
4
4
  "description": "Professional-grade AI coding toolkit: 91 skills, 44 agents, multi-platform support (Claude, Cursor, Windsurf, Copilot, Gemini, Cline, Roo Code, Aider, Augment), machine-enforced safety constitution, persona presets, skill security auditor, expanded lifecycle hooks, 11 plugin packs, and benchmark tooling.",
5
5
  "keywords": [
6
6
  "claude",