devlyn-cli 1.0.1 → 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CLAUDE.md
CHANGED
|
@@ -63,6 +63,7 @@ Optional flags:
|
|
|
63
63
|
- `--skip-review` — skip team-review phase
|
|
64
64
|
- `--skip-clean` — skip clean phase
|
|
65
65
|
- `--skip-docs` — skip update-docs phase
|
|
66
|
+
- `--with-codex [evaluate|review|both]` — use OpenAI Codex as cross-model evaluator/reviewer (requires codex-mcp-server)
|
|
66
67
|
|
|
67
68
|
## Manual Pipeline (Step-by-Step Control)
|
|
68
69
|
|
package/README.md
CHANGED
|
@@ -76,7 +76,7 @@ Slash commands are invoked directly in Claude Code conversations (e.g., type `/d
|
|
|
76
76
|
|---|---|
|
|
77
77
|
| `/devlyn:resolve` | Systematic bug fixing with root-cause analysis and test-driven validation |
|
|
78
78
|
| `/devlyn:team-resolve` | Spawns a full agent team — root cause analyst, test engineer, security auditor — to investigate complex issues |
|
|
79
|
-
| `/devlyn:auto-resolve` | Fully automated pipeline for any task — bugs, features, refactors, chores. Build → evaluate → fix loop → simplify → review → clean → docs. One command, zero human intervention |
|
|
79
|
+
| `/devlyn:auto-resolve` | Fully automated pipeline for any task — bugs, features, refactors, chores. Build → evaluate → fix loop → simplify → review → clean → docs. One command, zero human intervention. Supports `--with-codex` for cross-model evaluation via OpenAI Codex |
|
|
80
80
|
|
|
81
81
|
### Code Review & Quality
|
|
82
82
|
|
|
@@ -146,7 +146,7 @@ One command runs the full cycle — no human intervention needed:
|
|
|
146
146
|
| **Clean** | Remove dead code and unused dependencies |
|
|
147
147
|
| **Docs** | Sync documentation with changes |
|
|
148
148
|
|
|
149
|
-
Each phase runs as a separate subagent (fresh context), communicates via files, and commits a git checkpoint for rollback safety. Skip phases with flags: `--skip-review`, `--skip-clean`, `--skip-docs`, `--max-rounds 3
|
|
149
|
+
Each phase runs as a separate subagent (fresh context), communicates via files, and commits a git checkpoint for rollback safety. Skip phases with flags: `--skip-review`, `--skip-clean`, `--skip-docs`, `--max-rounds 3`, `--with-codex` (cross-model evaluation via OpenAI Codex).
|
|
150
150
|
|
|
151
151
|
### Manual Workflow
|
|
152
152
|
|
|
@@ -208,6 +208,9 @@ Copied directly into your `.claude/skills/` directory.
|
|
|
208
208
|
| `prompt-engineering` | Claude 4 prompt optimization using official Anthropic best practices |
|
|
209
209
|
| `better-auth-setup` | Production-ready Better Auth + Hono + Drizzle + PostgreSQL auth setup |
|
|
210
210
|
| `pyx-scan` | Check whether an AI agent skill is safe before installing |
|
|
211
|
+
| `dokkit` | Document template filling for DOCX/HWPX — ingest, fill, review, export |
|
|
212
|
+
| `devlyn:pencil-pull` | Pull Pencil designs into code with exact visual fidelity |
|
|
213
|
+
| `devlyn:pencil-push` | Push codebase UI to Pencil canvas for design sync |
|
|
211
214
|
|
|
212
215
|
### Community Packs
|
|
213
216
|
|
|
@@ -219,6 +222,7 @@ Installed via the [skills CLI](https://github.com/anthropics/skills) (`npx skill
|
|
|
219
222
|
| `supabase/agent-skills` | Supabase integration patterns |
|
|
220
223
|
| `coreyhaines31/marketingskills` | Marketing automation and content skills |
|
|
221
224
|
| `anthropics/skills` | Official Anthropic skill-creator with eval framework and description optimizer |
|
|
225
|
+
| `Leonxlnx/taste-skill` | Premium frontend design skills — modern layouts, animations, and visual refinement |
|
|
222
226
|
|
|
223
227
|
> **Want to add a pack?** Open a PR adding your pack to the `OPTIONAL_ADDONS` array in [`bin/devlyn.js`](bin/devlyn.js).
|
|
224
228
|
|
|
@@ -20,8 +20,10 @@ $ARGUMENTS
|
|
|
20
20
|
- `--security-review` (auto) — run dedicated security audit. Auto-detects: runs when changes touch auth, secrets, user data, API endpoints, env/config, or crypto. Force with `--security-review always` or skip with `--security-review skip`
|
|
21
21
|
- `--skip-clean` (false) — skip clean phase
|
|
22
22
|
- `--skip-docs` (false) — skip update-docs phase
|
|
23
|
+
- `--with-codex` (false) — use OpenAI Codex as a cross-model evaluator/reviewer via `mcp__codex-cli__*` MCP tools. Accepts: `evaluate`, `review`, or `both` (default when flag is present without value). When enabled, Codex provides an independent second opinion from a different model family, creating a GAN-like dynamic where Claude builds and Codex critiques.
|
|
23
24
|
|
|
24
25
|
Flags can be passed naturally: `/devlyn:auto-resolve fix the auth bug --max-rounds 3 --skip-docs`
|
|
26
|
+
Codex examples: `--with-codex` (both), `--with-codex evaluate`, `--with-codex review`
|
|
25
27
|
If no flags are present, use defaults.
|
|
26
28
|
|
|
27
29
|
3. Announce the pipeline plan:
|
|
@@ -30,11 +32,12 @@ Auto-resolve pipeline starting
|
|
|
30
32
|
Task: [extracted task description]
|
|
31
33
|
Phases: Build → Evaluate → [Fix loop if needed] → Simplify → [Review] → [Security] → [Clean] → [Docs]
|
|
32
34
|
Max evaluation rounds: [N]
|
|
35
|
+
Cross-model evaluation (Codex): [evaluate / review / both / disabled]
|
|
33
36
|
```
|
|
34
37
|
|
|
35
38
|
## PHASE 1: BUILD
|
|
36
39
|
|
|
37
|
-
Spawn a subagent using the Agent tool to investigate and implement the fix. The subagent does NOT have access to skills, so include all necessary instructions inline.
|
|
40
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` to investigate and implement the fix. The subagent does NOT have access to skills, so include all necessary instructions inline.
|
|
38
41
|
|
|
39
42
|
Agent prompt — pass this to the Agent tool:
|
|
40
43
|
|
|
@@ -72,7 +75,7 @@ The task is: [paste the task description here]
|
|
|
72
75
|
|
|
73
76
|
## PHASE 2: EVALUATE
|
|
74
77
|
|
|
75
|
-
Spawn a subagent using the Agent tool to evaluate the work. Include all evaluation instructions inline.
|
|
78
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` to evaluate the work. Include all evaluation instructions inline.
|
|
76
79
|
|
|
77
80
|
Agent prompt — pass this to the Agent tool:
|
|
78
81
|
|
|
@@ -120,18 +123,19 @@ Do NOT delete `.claude/done-criteria.md` or `.claude/EVAL-FINDINGS.md` — the o
|
|
|
120
123
|
**After the agent completes**:
|
|
121
124
|
1. Read `.claude/EVAL-FINDINGS.md`
|
|
122
125
|
2. Extract the verdict
|
|
123
|
-
3.
|
|
126
|
+
3. **If `--with-codex` includes `evaluate` or `both`**: Read `references/codex-integration.md` and follow the "PHASE 2-CODEX: CROSS-MODEL EVALUATE" section. This runs Codex as a second evaluator and merges findings into `EVAL-FINDINGS.md`.
|
|
127
|
+
4. Branch on verdict (from the merged findings if Codex was used):
|
|
124
128
|
- `PASS` → skip to PHASE 3
|
|
125
129
|
- `PASS WITH ISSUES` → skip to PHASE 3 (issues are shippable)
|
|
126
130
|
- `NEEDS WORK` → go to PHASE 2.5 (fix loop)
|
|
127
131
|
- `BLOCKED` → go to PHASE 2.5 (fix loop)
|
|
128
|
-
|
|
132
|
+
5. If `.claude/EVAL-FINDINGS.md` was not created, treat as PASS WITH ISSUES and log a warning
|
|
129
133
|
|
|
130
134
|
## PHASE 2.5: FIX LOOP (conditional)
|
|
131
135
|
|
|
132
136
|
Track the current round number. If `round >= max-rounds`, stop the loop and proceed to PHASE 3 with a warning that unresolved findings remain.
|
|
133
137
|
|
|
134
|
-
Spawn a subagent using the Agent tool to fix the evaluation findings.
|
|
138
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` to fix the evaluation findings.
|
|
135
139
|
|
|
136
140
|
Agent prompt — pass this to the Agent tool:
|
|
137
141
|
|
|
@@ -148,7 +152,7 @@ For each finding: read the referenced file:line, understand the issue, implement
|
|
|
148
152
|
|
|
149
153
|
## PHASE 3: SIMPLIFY
|
|
150
154
|
|
|
151
|
-
Spawn a subagent using the Agent tool for a quick cleanup pass.
|
|
155
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` for a quick cleanup pass.
|
|
152
156
|
|
|
153
157
|
Agent prompt — pass this to the Agent tool:
|
|
154
158
|
|
|
@@ -161,7 +165,7 @@ Review the recently changed files (use `git diff HEAD~1` to see what changed). L
|
|
|
161
165
|
|
|
162
166
|
Skip if `--skip-review` was set.
|
|
163
167
|
|
|
164
|
-
Spawn a subagent using the Agent tool for a multi-perspective review.
|
|
168
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` for a multi-perspective review.
|
|
165
169
|
|
|
166
170
|
Agent prompt — pass this to the Agent tool:
|
|
167
171
|
|
|
@@ -171,7 +175,9 @@ Each reviewer evaluates from their perspective, sends findings with file:line ev
|
|
|
171
175
|
|
|
172
176
|
Clean up the team after completion.
|
|
173
177
|
|
|
174
|
-
**
|
|
178
|
+
**If `--with-codex` includes `review` or `both`**: Read `references/codex-integration.md` and follow the "PHASE 4B: CODEX REVIEW" section. This runs Codex's independent code review and reconciles findings with the Claude team review.
|
|
179
|
+
|
|
180
|
+
**After the review phase completes**:
|
|
175
181
|
1. If CRITICAL issues remain unfixed, log a warning in the final report
|
|
176
182
|
2. **Checkpoint**: Run `git add -A && git commit -m "chore(pipeline): review fixes complete"` if there are changes
|
|
177
183
|
|
|
@@ -185,7 +191,7 @@ Determine whether to run this phase:
|
|
|
185
191
|
- Also run `git diff main` and scan for patterns: `API_KEY`, `SECRET`, `TOKEN`, `PASSWORD`, `PRIVATE_KEY`, `Bearer`, `jwt`, `bcrypt`, `crypto`, `env.`, `process.env`
|
|
186
192
|
- If any match → run. If no matches → skip and note "Security review skipped — no security-sensitive changes detected."
|
|
187
193
|
|
|
188
|
-
Spawn a subagent using the Agent tool for a dedicated security audit.
|
|
194
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` for a dedicated security audit.
|
|
189
195
|
|
|
190
196
|
Agent prompt — pass this to the Agent tool:
|
|
191
197
|
|
|
@@ -213,7 +219,7 @@ Fix any CRITICAL findings directly. For HIGH findings, fix if straightforward, o
|
|
|
213
219
|
|
|
214
220
|
Skip if `--skip-clean` was set.
|
|
215
221
|
|
|
216
|
-
Spawn a subagent using the Agent tool
|
|
222
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"`.
|
|
217
223
|
|
|
218
224
|
Agent prompt — pass this to the Agent tool:
|
|
219
225
|
|
|
@@ -226,7 +232,7 @@ Scan the codebase for dead code, unused dependencies, and code hygiene issues in
|
|
|
226
232
|
|
|
227
233
|
Skip if `--skip-docs` was set.
|
|
228
234
|
|
|
229
|
-
Spawn a subagent using the Agent tool
|
|
235
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"`.
|
|
230
236
|
|
|
231
237
|
Agent prompt — pass this to the Agent tool:
|
|
232
238
|
|
|
@@ -256,10 +262,12 @@ After all phases complete:
|
|
|
256
262
|
| Phase | Status | Notes |
|
|
257
263
|
|-------|--------|-------|
|
|
258
264
|
| Build (team-resolve) | [completed] | [brief summary] |
|
|
259
|
-
| Evaluate | [PASS/NEEDS WORK after N rounds] | [verdict + key findings] |
|
|
265
|
+
| Evaluate (Claude) | [PASS/NEEDS WORK after N rounds] | [verdict + key findings] |
|
|
266
|
+
| Evaluate (Codex) | [completed / skipped] | [Codex-only findings count, merged verdict] |
|
|
260
267
|
| Fix rounds | [N rounds / skipped] | [what was fixed] |
|
|
261
268
|
| Simplify | [completed / skipped] | [changes made] |
|
|
262
|
-
| Review (team
|
|
269
|
+
| Review (Claude team) | [completed / skipped] | [findings summary] |
|
|
270
|
+
| Review (Codex) | [completed / skipped] | [Codex-only findings, agreed findings] |
|
|
263
271
|
| Security review | [completed / skipped / auto-skipped] | [findings or "no security-sensitive changes"] |
|
|
264
272
|
| Clean | [completed / skipped] | [items cleaned] |
|
|
265
273
|
| Docs (update-docs) | [completed / skipped] | [docs updated] |
|
|
@@ -0,0 +1,82 @@
|
|
|
1
|
+
# Codex Cross-Model Integration
|
|
2
|
+
|
|
3
|
+
Instructions for using OpenAI Codex as an independent evaluator/reviewer in the auto-resolve pipeline. Only read this file when `--with-codex` is enabled.
|
|
4
|
+
|
|
5
|
+
Codex is accessed via `mcp__codex-cli__*` MCP tools (provided by codex-mcp-server). This creates a GAN-like adversarial dynamic — Claude builds and Codex critiques, reducing shared blind spots between model families.
|
|
6
|
+
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
## PHASE 2-CODEX: CROSS-MODEL EVALUATE
|
|
10
|
+
|
|
11
|
+
Run after the Claude evaluator (Phase 2) completes, only if `--with-codex` includes `evaluate` or `both`.
|
|
12
|
+
|
|
13
|
+
### Step 1 — Get Codex's evaluation
|
|
14
|
+
|
|
15
|
+
Call `mcp__codex-cli__codex` with:
|
|
16
|
+
- `prompt`: Include the full content of `.claude/done-criteria.md` and the output of `git diff HEAD~1`. Ask Codex to evaluate the changes against the done criteria and report issues by severity (CRITICAL, HIGH, MEDIUM, LOW) with file:line references.
|
|
17
|
+
- `workingDirectory`: the project root
|
|
18
|
+
- `sandbox`: `"read-only"` (Codex should only read, not modify files)
|
|
19
|
+
- `reasoningEffort`: `"high"`
|
|
20
|
+
|
|
21
|
+
Example prompt to pass:
|
|
22
|
+
```
|
|
23
|
+
You are an independent code evaluator. Grade the following code changes against the done criteria below. Be strict — when in doubt, flag it.
|
|
24
|
+
|
|
25
|
+
## Done Criteria
|
|
26
|
+
[paste contents of .claude/done-criteria.md]
|
|
27
|
+
|
|
28
|
+
## Code Changes
|
|
29
|
+
[paste output of git diff HEAD~1]
|
|
30
|
+
|
|
31
|
+
For each criterion, mark VERIFIED (with evidence) or FAILED (with file:line and what's wrong).
|
|
32
|
+
Then list all issues found grouped by severity: CRITICAL, HIGH, MEDIUM, LOW.
|
|
33
|
+
For each issue provide: file:line, description, and suggested fix.
|
|
34
|
+
End with a verdict: PASS, PASS WITH ISSUES, NEEDS WORK, or BLOCKED.
|
|
35
|
+
```
|
|
36
|
+
|
|
37
|
+
### Step 2 — Merge findings
|
|
38
|
+
|
|
39
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` to merge Claude's and Codex's evaluations.
|
|
40
|
+
|
|
41
|
+
Agent prompt:
|
|
42
|
+
|
|
43
|
+
Read `.claude/EVAL-FINDINGS.md` (Claude's evaluation) and the Codex evaluation output below. Merge them into a single unified `.claude/EVAL-FINDINGS.md` following the existing format. Rules:
|
|
44
|
+
- Take the MORE SEVERE verdict between the two evaluators
|
|
45
|
+
- Deduplicate findings that reference the same file:line or describe the same issue
|
|
46
|
+
- When both evaluators flag the same issue, keep the more detailed description
|
|
47
|
+
- Prefix Codex-only findings with `[codex]` so the fix loop knows the source
|
|
48
|
+
- Preserve the exact structure: Verdict, Done Criteria Results, Findings Requiring Action (CRITICAL/HIGH), Cross-Cutting Patterns
|
|
49
|
+
|
|
50
|
+
Codex evaluation:
|
|
51
|
+
[paste Codex's response here]
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## PHASE 4B: CODEX REVIEW
|
|
56
|
+
|
|
57
|
+
Run after the Claude team review (Phase 4A) completes, only if `--with-codex` includes `review` or `both`.
|
|
58
|
+
|
|
59
|
+
### Step 1 — Run Codex review
|
|
60
|
+
|
|
61
|
+
Call `mcp__codex-cli__review` with:
|
|
62
|
+
- `base`: `"main"` — review all changes since main
|
|
63
|
+
- `workingDirectory`: the project root
|
|
64
|
+
- `title`: `"Cross-model review (Codex)"`
|
|
65
|
+
|
|
66
|
+
This runs OpenAI Codex's built-in code review against the diff. The review tool returns structured findings automatically — no custom prompt needed.
|
|
67
|
+
|
|
68
|
+
### Step 2 — Reconcile both reviews
|
|
69
|
+
|
|
70
|
+
Spawn a subagent using the Agent tool with `mode: "bypassPermissions"` to reconcile both reviews.
|
|
71
|
+
|
|
72
|
+
Agent prompt:
|
|
73
|
+
|
|
74
|
+
Two independent reviews have been conducted on recent changes — one by a Claude team review and one by OpenAI Codex. Reconcile them:
|
|
75
|
+
|
|
76
|
+
Claude team review findings: [paste Phase 4A agent's output summary]
|
|
77
|
+
Codex review findings: [paste mcp__codex-cli__review output]
|
|
78
|
+
|
|
79
|
+
1. Deduplicate findings that describe the same issue
|
|
80
|
+
2. For unique Codex findings not caught by Claude's team, prefix with `[codex]` and assess severity
|
|
81
|
+
3. Fix any CRITICAL issues directly. For HIGH issues, fix if straightforward.
|
|
82
|
+
4. Write a brief reconciliation summary to stdout listing: findings from both (agreed), Claude-only, Codex-only, and what was fixed
|