@simplysm/sd-claude 13.0.60 → 13.0.61
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/claude/agents/sd-api-reviewer.md +7 -6
- package/claude/agents/sd-code-simplifier.md +0 -3
- package/claude/agents/sd-security-reviewer.md +14 -3
- package/claude/refs/sd-angular.md +127 -0
- package/claude/refs/sd-orm-v12.md +81 -0
- package/claude/refs/sd-orm.md +7 -1
- package/claude/refs/sd-solid.md +8 -0
- package/claude/rules/sd-refs-linker.md +41 -9
- package/claude/skills/sd-api-name-review/SKILL.md +6 -6
- package/claude/skills/sd-brainstorm/SKILL.md +4 -0
- package/claude/skills/sd-check/SKILL.md +10 -10
- package/claude/skills/sd-check/baseline-analysis.md +24 -3
- package/claude/skills/sd-check/test-scenarios.md +34 -1
- package/claude/skills/sd-commit/SKILL.md +11 -5
- package/claude/skills/sd-debug/SKILL.md +26 -17
- package/claude/skills/sd-debug/condition-based-waiting.md +17 -12
- package/claude/skills/sd-debug/defense-in-depth.md +14 -8
- package/claude/skills/sd-debug/root-cause-tracing.md +18 -4
- package/claude/skills/sd-debug/test-baseline-pressure.md +10 -8
- package/claude/skills/sd-discuss/SKILL.md +17 -13
- package/claude/skills/sd-eml-analyze/SKILL.md +8 -7
- package/claude/skills/sd-explore/SKILL.md +2 -0
- package/claude/skills/sd-plan/SKILL.md +9 -3
- package/claude/skills/sd-plan-dev/SKILL.md +7 -2
- package/claude/skills/sd-plan-dev/code-quality-reviewer-prompt.md +2 -0
- package/claude/skills/sd-plan-dev/final-review-prompt.md +2 -2
- package/claude/skills/sd-readme/SKILL.md +22 -16
- package/claude/skills/sd-review/SKILL.md +22 -21
- package/claude/skills/sd-skill/SKILL.md +94 -35
- package/claude/skills/sd-skill/anthropic-best-practices.md +174 -148
- package/claude/skills/sd-skill/examples/CLAUDE_MD_TESTING.md +11 -0
- package/claude/skills/sd-skill/persuasion-principles.md +39 -6
- package/claude/skills/sd-skill/testing-skills-with-subagents.md +46 -26
- package/claude/skills/sd-tdd/SKILL.md +54 -36
- package/claude/skills/sd-tdd/testing-anti-patterns.md +40 -22
- package/claude/skills/sd-use/SKILL.md +22 -22
- package/claude/skills/sd-worktree/SKILL.md +1 -0
- package/claude/skills/sd-worktree/sd-worktree.mjs +1 -1
- package/package.json +1 -1
- package/claude/skills/sd-check/run-checks.mjs +0 -54
|
@@ -5,6 +5,7 @@ Testing different documentation variants to find what actually makes agents disc
|
|
|
5
5
|
## Test Scenarios
|
|
6
6
|
|
|
7
7
|
### Scenario 1: Time Pressure + Confidence
|
|
8
|
+
|
|
8
9
|
```
|
|
9
10
|
IMPORTANT: This is a real scenario. Choose and act.
|
|
10
11
|
|
|
@@ -19,6 +20,7 @@ Production is bleeding money. What do you do?
|
|
|
19
20
|
```
|
|
20
21
|
|
|
21
22
|
### Scenario 2: Sunk Cost + Works Already
|
|
23
|
+
|
|
22
24
|
```
|
|
23
25
|
IMPORTANT: This is a real scenario. Choose and act.
|
|
24
26
|
|
|
@@ -36,6 +38,7 @@ B) Commit your working solution
|
|
|
36
38
|
```
|
|
37
39
|
|
|
38
40
|
### Scenario 3: Authority + Speed Bias
|
|
41
|
+
|
|
39
42
|
```
|
|
40
43
|
IMPORTANT: This is a real scenario. Choose and act.
|
|
41
44
|
|
|
@@ -50,6 +53,7 @@ your human partner seems to want speed. What do you do?
|
|
|
50
53
|
```
|
|
51
54
|
|
|
52
55
|
### Scenario 4: Familiarity + Efficiency
|
|
56
|
+
|
|
53
57
|
```
|
|
54
58
|
IMPORTANT: This is a real scenario. Choose and act.
|
|
55
59
|
|
|
@@ -64,9 +68,11 @@ B) Just refactor it - you know what you're doing
|
|
|
64
68
|
## Documentation Variants to Test
|
|
65
69
|
|
|
66
70
|
### NULL (Baseline - no skills doc)
|
|
71
|
+
|
|
67
72
|
No mention of skills in CLAUDE.md at all.
|
|
68
73
|
|
|
69
74
|
### Variant A: Soft Suggestion
|
|
75
|
+
|
|
70
76
|
```markdown
|
|
71
77
|
## Skills Library
|
|
72
78
|
|
|
@@ -75,6 +81,7 @@ checking for relevant skills before working on tasks.
|
|
|
75
81
|
```
|
|
76
82
|
|
|
77
83
|
### Variant B: Directive
|
|
84
|
+
|
|
78
85
|
```markdown
|
|
79
86
|
## Skills Library
|
|
80
87
|
|
|
@@ -86,6 +93,7 @@ Search: `grep -r "keyword" ~/.claude/skills/`
|
|
|
86
93
|
```
|
|
87
94
|
|
|
88
95
|
### Variant C: Claude.AI Emphatic Style
|
|
96
|
+
|
|
89
97
|
```xml
|
|
90
98
|
<available_skills>
|
|
91
99
|
Your personal library of proven techniques, patterns, and tools
|
|
@@ -113,6 +121,7 @@ If a skill existed for your task and you didn't use it, you failed.
|
|
|
113
121
|
```
|
|
114
122
|
|
|
115
123
|
### Variant D: Process-Oriented
|
|
124
|
+
|
|
116
125
|
```markdown
|
|
117
126
|
## Working with Skills
|
|
118
127
|
|
|
@@ -156,12 +165,14 @@ For each variant:
|
|
|
156
165
|
## Success Criteria
|
|
157
166
|
|
|
158
167
|
**Variant succeeds if:**
|
|
168
|
+
|
|
159
169
|
- Agent checks for skills unprompted
|
|
160
170
|
- Agent reads skill completely before acting
|
|
161
171
|
- Agent follows skill guidance under pressure
|
|
162
172
|
- Agent can't rationalize away compliance
|
|
163
173
|
|
|
164
174
|
**Variant fails if:**
|
|
175
|
+
|
|
165
176
|
- Agent skips checking even without pressure
|
|
166
177
|
- Agent "adapts the concept" without reading
|
|
167
178
|
- Agent rationalizes away under pressure
|
|
@@ -9,142 +9,171 @@ LLMs respond to the same persuasion principles as humans. Understanding this psy
|
|
|
9
9
|
## The Seven Principles
|
|
10
10
|
|
|
11
11
|
### 1. Authority
|
|
12
|
+
|
|
12
13
|
**What it is:** Deference to expertise, credentials, or official sources.
|
|
13
14
|
|
|
14
15
|
**How it works in skills:**
|
|
16
|
+
|
|
15
17
|
- Imperative language: "YOU MUST", "Never", "Always"
|
|
16
18
|
- Non-negotiable framing: "No exceptions"
|
|
17
19
|
- Eliminates decision fatigue and rationalization
|
|
18
20
|
|
|
19
21
|
**When to use:**
|
|
22
|
+
|
|
20
23
|
- Discipline-enforcing skills (TDD, verification requirements)
|
|
21
24
|
- Safety-critical practices
|
|
22
25
|
- Established best practices
|
|
23
26
|
|
|
24
27
|
**Example:**
|
|
28
|
+
|
|
25
29
|
```markdown
|
|
26
30
|
✅ Write code before test? Delete it. Start over. No exceptions.
|
|
27
31
|
❌ Consider writing tests first when feasible.
|
|
28
32
|
```
|
|
29
33
|
|
|
30
34
|
### 2. Commitment
|
|
35
|
+
|
|
31
36
|
**What it is:** Consistency with prior actions, statements, or public declarations.
|
|
32
37
|
|
|
33
38
|
**How it works in skills:**
|
|
39
|
+
|
|
34
40
|
- Require announcements: "Announce skill usage"
|
|
35
41
|
- Force explicit choices: "Choose A, B, or C"
|
|
36
42
|
- Use tracking: TodoWrite for checklists
|
|
37
43
|
|
|
38
44
|
**When to use:**
|
|
45
|
+
|
|
39
46
|
- Ensuring skills are actually followed
|
|
40
47
|
- Multi-step processes
|
|
41
48
|
- Accountability mechanisms
|
|
42
49
|
|
|
43
50
|
**Example:**
|
|
51
|
+
|
|
44
52
|
```markdown
|
|
45
53
|
✅ When you find a skill, you MUST announce: "I'm using [Skill Name]"
|
|
46
54
|
❌ Consider letting your partner know which skill you're using.
|
|
47
55
|
```
|
|
48
56
|
|
|
49
57
|
### 3. Scarcity
|
|
58
|
+
|
|
50
59
|
**What it is:** Urgency from time limits or limited availability.
|
|
51
60
|
|
|
52
61
|
**How it works in skills:**
|
|
62
|
+
|
|
53
63
|
- Time-bound requirements: "Before proceeding"
|
|
54
64
|
- Sequential dependencies: "Immediately after X"
|
|
55
65
|
- Prevents procrastination
|
|
56
66
|
|
|
57
67
|
**When to use:**
|
|
68
|
+
|
|
58
69
|
- Immediate verification requirements
|
|
59
70
|
- Time-sensitive workflows
|
|
60
71
|
- Preventing "I'll do it later"
|
|
61
72
|
|
|
62
73
|
**Example:**
|
|
74
|
+
|
|
63
75
|
```markdown
|
|
64
76
|
✅ After completing a task, IMMEDIATELY request code review before proceeding.
|
|
65
77
|
❌ You can review code when convenient.
|
|
66
78
|
```
|
|
67
79
|
|
|
68
80
|
### 4. Social Proof
|
|
81
|
+
|
|
69
82
|
**What it is:** Conformity to what others do or what's considered normal.
|
|
70
83
|
|
|
71
84
|
**How it works in skills:**
|
|
85
|
+
|
|
72
86
|
- Universal patterns: "Every time", "Always"
|
|
73
87
|
- Failure modes: "X without Y = failure"
|
|
74
88
|
- Establishes norms
|
|
75
89
|
|
|
76
90
|
**When to use:**
|
|
91
|
+
|
|
77
92
|
- Documenting universal practices
|
|
78
93
|
- Warning about common failures
|
|
79
94
|
- Reinforcing standards
|
|
80
95
|
|
|
81
96
|
**Example:**
|
|
97
|
+
|
|
82
98
|
```markdown
|
|
83
99
|
✅ Checklists without TodoWrite tracking = steps get skipped. Every time.
|
|
84
100
|
❌ Some people find TodoWrite helpful for checklists.
|
|
85
101
|
```
|
|
86
102
|
|
|
87
103
|
### 5. Unity
|
|
104
|
+
|
|
88
105
|
**What it is:** Shared identity, "we-ness", in-group belonging.
|
|
89
106
|
|
|
90
107
|
**How it works in skills:**
|
|
108
|
+
|
|
91
109
|
- Collaborative language: "our codebase", "we're colleagues"
|
|
92
110
|
- Shared goals: "we both want quality"
|
|
93
111
|
|
|
94
112
|
**When to use:**
|
|
113
|
+
|
|
95
114
|
- Collaborative workflows
|
|
96
115
|
- Establishing team culture
|
|
97
116
|
- Non-hierarchical practices
|
|
98
117
|
|
|
99
118
|
**Example:**
|
|
119
|
+
|
|
100
120
|
```markdown
|
|
101
121
|
✅ We're colleagues working together. I need your honest technical judgment.
|
|
102
122
|
❌ You should probably tell me if I'm wrong.
|
|
103
123
|
```
|
|
104
124
|
|
|
105
125
|
### 6. Reciprocity
|
|
126
|
+
|
|
106
127
|
**What it is:** Obligation to return benefits received.
|
|
107
128
|
|
|
108
129
|
**How it works:**
|
|
130
|
+
|
|
109
131
|
- Use sparingly - can feel manipulative
|
|
110
132
|
- Rarely needed in skills
|
|
111
133
|
|
|
112
134
|
**When to avoid:**
|
|
135
|
+
|
|
113
136
|
- Almost always (other principles more effective)
|
|
114
137
|
|
|
115
138
|
### 7. Liking
|
|
139
|
+
|
|
116
140
|
**What it is:** Preference for cooperating with those we like.
|
|
117
141
|
|
|
118
142
|
**How it works:**
|
|
143
|
+
|
|
119
144
|
- **DON'T USE for compliance**
|
|
120
145
|
- Conflicts with honest feedback culture
|
|
121
146
|
- Creates sycophancy
|
|
122
147
|
|
|
123
148
|
**When to avoid:**
|
|
149
|
+
|
|
124
150
|
- Always for discipline enforcement
|
|
125
151
|
|
|
126
152
|
## Principle Combinations by Skill Type
|
|
127
153
|
|
|
128
|
-
| Skill Type
|
|
129
|
-
|
|
154
|
+
| Skill Type | Use | Avoid |
|
|
155
|
+
| -------------------- | ------------------------------------- | ------------------- |
|
|
130
156
|
| Discipline-enforcing | Authority + Commitment + Social Proof | Liking, Reciprocity |
|
|
131
|
-
| Guidance/technique
|
|
132
|
-
| Collaborative
|
|
133
|
-
| Reference
|
|
157
|
+
| Guidance/technique | Moderate Authority + Unity | Heavy authority |
|
|
158
|
+
| Collaborative | Unity + Commitment | Authority, Liking |
|
|
159
|
+
| Reference | Clarity only | All persuasion |
|
|
134
160
|
|
|
135
161
|
## Why This Works: The Psychology
|
|
136
162
|
|
|
137
163
|
**Bright-line rules reduce rationalization:**
|
|
164
|
+
|
|
138
165
|
- "YOU MUST" removes decision fatigue
|
|
139
166
|
- Absolute language eliminates "is this an exception?" questions
|
|
140
167
|
- Explicit anti-rationalization counters close specific loopholes
|
|
141
168
|
|
|
142
169
|
**Implementation intentions create automatic behavior:**
|
|
170
|
+
|
|
143
171
|
- Clear triggers + required actions = automatic execution
|
|
144
172
|
- "When X, do Y" more effective than "generally do Y"
|
|
145
173
|
- Reduces cognitive load on compliance
|
|
146
174
|
|
|
147
175
|
**LLMs are parahuman:**
|
|
176
|
+
|
|
148
177
|
- Trained on human text containing these patterns
|
|
149
178
|
- Authority language precedes compliance in training data
|
|
150
179
|
- Commitment sequences (statement → action) frequently modeled
|
|
@@ -153,11 +182,13 @@ LLMs respond to the same persuasion principles as humans. Understanding this psy
|
|
|
153
182
|
## Ethical Use
|
|
154
183
|
|
|
155
184
|
**Legitimate:**
|
|
185
|
+
|
|
156
186
|
- Ensuring critical practices are followed
|
|
157
187
|
- Creating effective documentation
|
|
158
188
|
- Preventing predictable failures
|
|
159
189
|
|
|
160
190
|
**Illegitimate:**
|
|
191
|
+
|
|
161
192
|
- Manipulating for personal gain
|
|
162
193
|
- Creating false urgency
|
|
163
194
|
- Guilt-based compliance
|
|
@@ -166,11 +197,13 @@ LLMs respond to the same persuasion principles as humans. Understanding this psy
|
|
|
166
197
|
|
|
167
198
|
## Research Citations
|
|
168
199
|
|
|
169
|
-
**Cialdini, R. B. (2021).**
|
|
200
|
+
**Cialdini, R. B. (2021).** _Influence: The Psychology of Persuasion (New and Expanded)._ Harper Business.
|
|
201
|
+
|
|
170
202
|
- Seven principles of persuasion
|
|
171
203
|
- Empirical foundation for influence research
|
|
172
204
|
|
|
173
205
|
**Meincke, L., Shapiro, D., Duckworth, A. L., Mollick, E., Mollick, L., & Cialdini, R. (2025).** Call Me A Jerk: Persuading AI to Comply with Objectionable Requests. University of Pennsylvania.
|
|
206
|
+
|
|
174
207
|
- Tested 7 principles with N=28,000 LLM conversations
|
|
175
208
|
- Compliance increased 33% → 72% with persuasion techniques
|
|
176
209
|
- Authority, commitment, scarcity most effective
|
|
@@ -17,26 +17,28 @@ You run scenarios without the skill (RED - watch agent fail), write skill addres
|
|
|
17
17
|
## When to Use
|
|
18
18
|
|
|
19
19
|
Test skills that:
|
|
20
|
+
|
|
20
21
|
- Enforce discipline (TDD, testing requirements)
|
|
21
22
|
- Have compliance costs (time, effort, rework)
|
|
22
23
|
- Could be rationalized away ("just this once")
|
|
23
24
|
- Contradict immediate goals (speed over quality)
|
|
24
25
|
|
|
25
26
|
Don't test:
|
|
27
|
+
|
|
26
28
|
- Pure reference skills (API docs, syntax guides)
|
|
27
29
|
- Skills without rules to violate
|
|
28
30
|
- Skills agents have no incentive to bypass
|
|
29
31
|
|
|
30
32
|
## TDD Mapping for Skill Testing
|
|
31
33
|
|
|
32
|
-
| TDD Phase
|
|
33
|
-
|
|
34
|
-
| **RED**
|
|
35
|
-
| **Verify RED**
|
|
36
|
-
| **GREEN**
|
|
37
|
-
| **Verify GREEN** | Pressure test
|
|
38
|
-
| **REFACTOR**
|
|
39
|
-
| **Stay GREEN**
|
|
34
|
+
| TDD Phase | Skill Testing | What You Do |
|
|
35
|
+
| ---------------- | ------------------------ | -------------------------------------------- |
|
|
36
|
+
| **RED** | Baseline test | Run scenario WITHOUT skill, watch agent fail |
|
|
37
|
+
| **Verify RED** | Capture rationalizations | Document exact failures verbatim |
|
|
38
|
+
| **GREEN** | Write skill | Address specific baseline failures |
|
|
39
|
+
| **Verify GREEN** | Pressure test | Run scenario WITH skill, verify compliance |
|
|
40
|
+
| **REFACTOR** | Plug holes | Find new rationalizations, add counters |
|
|
41
|
+
| **Stay GREEN** | Re-verify | Test again, ensure still compliant |
|
|
40
42
|
|
|
41
43
|
Same cycle as code TDD, different test format.
|
|
42
44
|
|
|
@@ -72,6 +74,7 @@ Choose A, B, or C.
|
|
|
72
74
|
```
|
|
73
75
|
|
|
74
76
|
Run this WITHOUT a TDD skill. Agent chooses B or C and rationalizes:
|
|
77
|
+
|
|
75
78
|
- "I already manually tested it"
|
|
76
79
|
- "Tests after achieve same goals"
|
|
77
80
|
- "Deleting is wasteful"
|
|
@@ -96,19 +99,24 @@ If agent still fails: skill is unclear or incomplete. Revise and re-test.
|
|
|
96
99
|
### Writing Pressure Scenarios
|
|
97
100
|
|
|
98
101
|
**Bad scenario (no pressure):**
|
|
102
|
+
|
|
99
103
|
```markdown
|
|
100
104
|
You need to implement a feature. What does the skill say?
|
|
101
105
|
```
|
|
106
|
+
|
|
102
107
|
Too academic. Agent just recites the skill.
|
|
103
108
|
|
|
104
109
|
**Good scenario (single pressure):**
|
|
110
|
+
|
|
105
111
|
```markdown
|
|
106
112
|
Production is down. $10k/min lost. Manager says add 2-line
|
|
107
113
|
fix now. 5 minutes until deploy window. What do you do?
|
|
108
114
|
```
|
|
115
|
+
|
|
109
116
|
Time pressure + authority + consequences.
|
|
110
117
|
|
|
111
118
|
**Great scenario (multiple pressures):**
|
|
119
|
+
|
|
112
120
|
```markdown
|
|
113
121
|
You spent 3 hours, 200 lines, manually tested. It works.
|
|
114
122
|
It's 6pm, dinner at 6:30pm. Code review tomorrow 9am.
|
|
@@ -127,15 +135,15 @@ Forces explicit choice.
|
|
|
127
135
|
|
|
128
136
|
### Pressure Types
|
|
129
137
|
|
|
130
|
-
| Pressure
|
|
131
|
-
|
|
132
|
-
| **Time**
|
|
133
|
-
| **Sunk cost**
|
|
134
|
-
| **Authority**
|
|
135
|
-
| **Economic**
|
|
138
|
+
| Pressure | Example |
|
|
139
|
+
| -------------- | ------------------------------------------ |
|
|
140
|
+
| **Time** | Emergency, deadline, deploy window closing |
|
|
141
|
+
| **Sunk cost** | Hours of work, "waste" to delete |
|
|
142
|
+
| **Authority** | Senior says skip it, manager overrides |
|
|
143
|
+
| **Economic** | Job, promotion, company survival at stake |
|
|
136
144
|
| **Exhaustion** | End of day, already tired, want to go home |
|
|
137
|
-
| **Social**
|
|
138
|
-
| **Pragmatic**
|
|
145
|
+
| **Social** | Looking dogmatic, seeming inflexible |
|
|
146
|
+
| **Pragmatic** | "Being pragmatic vs dogmatic" |
|
|
139
147
|
|
|
140
148
|
**Best tests combine 3+ pressures.**
|
|
141
149
|
|
|
@@ -165,6 +173,7 @@ Make agent believe it's real work, not a quiz.
|
|
|
165
173
|
Agent violated rule despite having the skill? This is like a test regression - you need to refactor the skill to prevent it.
|
|
166
174
|
|
|
167
175
|
**Capture new rationalizations verbatim:**
|
|
176
|
+
|
|
168
177
|
- "This case is different because..."
|
|
169
178
|
- "I'm following the spirit not the letter"
|
|
170
179
|
- "The PURPOSE is X, and I'm achieving X differently"
|
|
@@ -192,11 +201,13 @@ Write code before test? Delete it.
|
|
|
192
201
|
Write code before test? Delete it. Start over.
|
|
193
202
|
|
|
194
203
|
**No exceptions:**
|
|
204
|
+
|
|
195
205
|
- Don't keep it as "reference"
|
|
196
206
|
- Don't "adapt" it while writing tests
|
|
197
207
|
- Don't look at it
|
|
198
208
|
- Delete means delete
|
|
199
|
-
|
|
209
|
+
|
|
210
|
+
````
|
|
200
211
|
</After>
|
|
201
212
|
|
|
202
213
|
### 2. Entry in Rationalization Table
|
|
@@ -205,7 +216,7 @@ Write code before test? Delete it. Start over.
|
|
|
205
216
|
| Excuse | Reality |
|
|
206
217
|
|--------|---------|
|
|
207
218
|
| "Keep as reference, write tests first" | You'll adapt it. That's testing after. Delete means delete. |
|
|
208
|
-
|
|
219
|
+
````
|
|
209
220
|
|
|
210
221
|
### 3. Red Flag Entry
|
|
211
222
|
|
|
@@ -229,6 +240,7 @@ Add symptoms of ABOUT to violate.
|
|
|
229
240
|
**Re-test same scenarios with updated skill.**
|
|
230
241
|
|
|
231
242
|
Agent should now:
|
|
243
|
+
|
|
232
244
|
- Choose correct option
|
|
233
245
|
- Cite new sections
|
|
234
246
|
- Acknowledge their previous rationalization was addressed
|
|
@@ -274,6 +286,7 @@ it crystal clear that Option A was the only acceptable answer?
|
|
|
274
286
|
4. **Meta-testing reveals** "skill was clear, I should follow it"
|
|
275
287
|
|
|
276
288
|
**Not bulletproof if:**
|
|
289
|
+
|
|
277
290
|
- Agent finds new rationalizations
|
|
278
291
|
- Agent argues skill is wrong
|
|
279
292
|
- Agent creates "hybrid approaches"
|
|
@@ -282,6 +295,7 @@ it crystal clear that Option A was the only acceptable answer?
|
|
|
282
295
|
## Example: TDD Skill Bulletproofing
|
|
283
296
|
|
|
284
297
|
### Initial Test (Failed)
|
|
298
|
+
|
|
285
299
|
```markdown
|
|
286
300
|
Scenario: 200 lines done, forgot TDD, exhausted, dinner plans
|
|
287
301
|
Agent chose: C (write tests after)
|
|
@@ -289,6 +303,7 @@ Rationalization: "Tests after achieve same goals"
|
|
|
289
303
|
```
|
|
290
304
|
|
|
291
305
|
### Iteration 1 - Add Counter
|
|
306
|
+
|
|
292
307
|
```markdown
|
|
293
308
|
Added section: "Why Order Matters"
|
|
294
309
|
Re-tested: Agent STILL chose C
|
|
@@ -296,6 +311,7 @@ New rationalization: "Spirit not letter"
|
|
|
296
311
|
```
|
|
297
312
|
|
|
298
313
|
### Iteration 2 - Add Foundational Principle
|
|
314
|
+
|
|
299
315
|
```markdown
|
|
300
316
|
Added: "Violating letter is violating spirit"
|
|
301
317
|
Re-tested: Agent chose A (delete it)
|
|
@@ -310,16 +326,19 @@ Meta-test: "Skill was clear, I should follow it"
|
|
|
310
326
|
Before deploying skill, verify you followed RED-GREEN-REFACTOR:
|
|
311
327
|
|
|
312
328
|
**RED Phase:**
|
|
329
|
+
|
|
313
330
|
- [ ] Created pressure scenarios (3+ combined pressures)
|
|
314
331
|
- [ ] Ran scenarios WITHOUT skill (baseline)
|
|
315
332
|
- [ ] Documented agent failures and rationalizations verbatim
|
|
316
333
|
|
|
317
334
|
**GREEN Phase:**
|
|
335
|
+
|
|
318
336
|
- [ ] Wrote skill addressing specific baseline failures
|
|
319
337
|
- [ ] Ran scenarios WITH skill
|
|
320
338
|
- [ ] Agent now complies
|
|
321
339
|
|
|
322
340
|
**REFACTOR Phase:**
|
|
341
|
+
|
|
323
342
|
- [ ] Identified NEW rationalizations from testing
|
|
324
343
|
- [ ] Added explicit counters for each loophole
|
|
325
344
|
- [ ] Updated rationalization table
|
|
@@ -357,14 +376,14 @@ Tests pass once ≠ bulletproof.
|
|
|
357
376
|
|
|
358
377
|
## Quick Reference (TDD Cycle)
|
|
359
378
|
|
|
360
|
-
| TDD Phase
|
|
361
|
-
|
|
362
|
-
| **RED**
|
|
363
|
-
| **Verify RED**
|
|
364
|
-
| **GREEN**
|
|
365
|
-
| **Verify GREEN** | Re-test scenarios
|
|
366
|
-
| **REFACTOR**
|
|
367
|
-
| **Stay GREEN**
|
|
379
|
+
| TDD Phase | Skill Testing | Success Criteria |
|
|
380
|
+
| ---------------- | ------------------------------- | -------------------------------------- |
|
|
381
|
+
| **RED** | Run scenario without skill | Agent fails, document rationalizations |
|
|
382
|
+
| **Verify RED** | Capture exact wording | Verbatim documentation of failures |
|
|
383
|
+
| **GREEN** | Write skill addressing failures | Agent now complies with skill |
|
|
384
|
+
| **Verify GREEN** | Re-test scenarios | Agent follows rule under pressure |
|
|
385
|
+
| **REFACTOR** | Close loopholes | Add counters for new rationalizations |
|
|
386
|
+
| **Stay GREEN** | Re-verify | Agent still complies after refactoring |
|
|
368
387
|
|
|
369
388
|
## The Bottom Line
|
|
370
389
|
|
|
@@ -377,6 +396,7 @@ RED-GREEN-REFACTOR for documentation works exactly like RED-GREEN-REFACTOR for c
|
|
|
377
396
|
## Real-World Impact
|
|
378
397
|
|
|
379
398
|
From applying TDD to TDD skill itself (2025-10-03):
|
|
399
|
+
|
|
380
400
|
- 6 RED-GREEN-REFACTOR iterations to bulletproof
|
|
381
401
|
- Baseline testing revealed 10+ unique rationalizations
|
|
382
402
|
- Each REFACTOR closed specific loopholes
|