@ai-dev-methodologies/rlp-desk 0.15.0 → 0.15.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,184 @@
1
+ # Native Agent() Revert Plan (P0+P1)
2
+
3
+ 6-round ralplan consensus 결과. Goal: slash command(`src/commands/rlp-desk.md`)가 진짜 leader가 되어 Claude Code Agent() 호출 + Bash codex exec로 worker/verifier를 spawn하는 v0.13.x 이전 방식으로 회귀. `--mode tmux`(zsh runner) 경로 미변경.
4
+
5
+ ## Scope
6
+
7
+ - **P0**: Bug #7 fix 단독 commit + 명시적 invariant ADR
8
+ - **P1**: slash command native prose 회복 + `--mode native` 도입 + Node CLI `--mode agent` deprecation banner
9
+ - **Out-of-scope**: P2 (Node CLI default flip, `--mode agent` hard-error), P3 (Node leader 삭제 ~4.5k LOC + repo-wide ghost-removal gate). 19th launch 종료 후 별도 PR.
10
+
11
+ ## Principles
12
+
13
+ 1. Naming truth: `--mode agent`라는 flag 하나가 두 곳에서 다른 의미를 가지는 상태 해소.
14
+ 2. Single leader per mode.
15
+ 3. Surgical revert: tmux 경로 + 19th launch 영향 0.
16
+ 4. Bug #7 fix preservation: zsh side에 invariant 보존됨을 ADR로 명시.
17
+ 5. Reversibility: silent reclaim 없음. `--mode agent` (Node CLI)는 호환 유지하면서 deprecation warning만.
18
+
19
+ ## P0 — Bug #7 fix commit + Invariant ADR
20
+
21
+ ### a. Bug #7 fix commit
22
+ - 현재 working tree (5 src + 4 untracked tests + 1 plan markdown) 단독 commit
23
+ - Local sync는 이미 완료(`~/.claude/ralph-desk/` chmod 0o444 + banner)
24
+
25
+ ### b. ADR `docs/adr/0001-bug7-invariant-zsh-only-by-structural-necessity.md`
26
+
27
+ 명시적 scope:
28
+ - Bug #7 invariant는 **slash-command Native Agent() / Bash codex exec path**에 한정해 **zsh runner side에 enforce**된다.
29
+ - Native Agent() path는 short-lived per-call subagent — long-lived TUI process가 없어 동일 race를 가지지 않는다.
30
+ - Node CLI `--mode agent`(Node leader, deprecated alpha)는 long-lived tmux pane을 사용 → 동일 race 보유. P3에서 삭제될 때까지 별도 reaper/lock 코드(`src/node/runner/campaign-main-loop.mjs:1091`, `:1577`, `src/node/tmux/pane-manager.mjs`, `src/node/shared/fs.mjs`) 유지.
31
+ - zsh side invariant 인용 (codex critic verified file:line):
32
+ - `src/scripts/lib_ralph_desk.zsh:248` — helpers (`_kill_pane_process`, `_lock_sentinel`, `_unlock_sentinel`)
33
+ - `src/scripts/run_ralph_desk.zsh:2179` — partial-write `jq -e .` validity gate
34
+ - `src/scripts/run_ralph_desk.zsh:2484` — verifier reap+lock (per-US main path)
35
+ - `src/scripts/run_ralph_desk.zsh:2551` — final-verify per-US reap+lock
36
+ - `src/scripts/run_ralph_desk.zsh:2969` — prep cleanup unlock
37
+ - `src/scripts/run_ralph_desk.zsh:3036` — worker reap+lock
38
+ - `src/scripts/run_ralph_desk.zsh:3247` — verifier reap+lock (consensus)
39
+
40
+ ### c. re-sync
41
+ - `node scripts/postinstall.js`
42
+ - banner-aware diff: src ⇆ `~/.claude/ralph-desk/`
43
+
44
+ ### Acceptance
45
+ - AC0.1 `git log -1`이 Bug #7 fix
46
+ - AC0.2 ADR file 존재 + 위 7 file:line 인용 + scope 명문
47
+ - AC0.3 `bash tests/test-bug7-post-sentinel-race.sh` + `bash tests/test-bug7-poll-partial-write.sh` 통과
48
+ - AC0.4 Node 315/315 통과
49
+ - AC0.5 banner-aware diff src ⇆ install 일치
50
+
51
+ ## P1 — Slash native prose + `--mode native` + Node CLI deprecation
52
+
53
+ ### a. `src/commands/rlp-desk.md` audit list (전체)
54
+
55
+ | Line | 현재 | 변경 후 |
56
+ |---|---|---|
57
+ | 192 | init이 emit하는 첫 "/rlp-desk run" Full options reference 블록의 `--mode agent\|tmux` | `--mode native\|tmux (default: native)` (recommended example는 `--mode tmux` 유지) |
58
+ | 227 | 두 번째 init emission | 동일 처리 |
59
+ | 255 | Options block: `- \`--mode agent\|tmux\` (default: \`agent\`)` | `- \`--mode native\|tmux\` (default: \`native\`)` (정확 라인 형태) |
60
+ | 287 | Mode Selection: "If absent or `agent`, use the Agent() path below" | 두 축 명문화: `--mode native` (default, slash native Agent() leader) / `--mode tmux` (zsh runner). Legacy `--mode agent` deprecation+redirect prose. Direct Node CLI `node run.mjs --mode agent`는 deprecated alpha — 별도 paragraph |
61
+ | 334 | tmux fallback "suggest `--mode agent`" | "suggest `--mode native`" |
62
+ | 342 | "SV/flywheel은 `--mode agent`에서 지원" | "SV/flywheel은 현재 Node-leader `--mode agent` (deprecated alpha, direct Node CLI)에서만 구현. Native Agent() path(`--mode native`)는 SV/flywheel 미구현 — post-P3 작업" |
63
+ | 343 | Tmux IMPORTANT RULES "always invokes node ..." | `--mode tmux` 한정으로 scope |
64
+ | 360-410 | "Why Agent mode is structurally immune" + "PLATFORM CONSTRAINT" 분산 | 단일 박스 `### Native Agent() Safety Contract`로 verbatim 흡수. 4 sentinel: turn-keepalive, no `subagent_type`, `mode="bypassPermissions"` mandatory, long-running→tmux |
65
+ | 448, 460 | claude/codex worker dispatch code | 변경 없음 (이미 native wired) |
66
+ | 778 | "agent=LLM leader, tmux=shell leader" help | "native=Native Agent() leader (slash), tmux=zsh leader (production). Legacy `agent` redirects to `native`. Direct Node CLI `--mode agent`는 deprecated alpha — Direct Node CLI invocation 섹션 참조" |
67
+ | 784 | run 예시 fallback에 `--mode agent` | `--mode native` |
68
+ | 802 | "Agent Mode (default: --mode agent)" 헤딩 | "Native Agent() Mode (default: --mode native)" |
69
+
70
+ ### b. `src/node/run.mjs`
71
+
72
+ - 신규 `--mode native` 핸들러:
73
+ - stderr: `ERROR: --mode native is slash-command-only. The Node CLI does not implement it. Use \`/rlp-desk run --mode native\` from a Claude Code session, or use \`--mode {tmux,agent}\` for direct CLI invocation.`
74
+ - exit 2
75
+ - `--mode agent` (Node CLI, line 366-374) deprecation banner 강화:
76
+ ```
77
+ WARNING: --mode agent (Node-leader alpha) is deprecated.
78
+ This is the direct Node-CLI alpha path — UNRELATED to the slash command's
79
+ Native Agent() path (`/rlp-desk run --mode native`).
80
+ For production tmux orchestration use `--mode tmux`.
81
+ For Claude Code Native Agent() campaigns use `/rlp-desk run --mode native`
82
+ from a Claude Code session.
83
+ This mode will hard-error in the next major release.
84
+ ```
85
+ - default 동작 unchanged (silent reclaim NO; backward compat)
86
+ - `--allow-deprecated` flag 도입 X (P3에서 삭제할 ghost flag 회피)
87
+ - wrapper가 silence 원하면 `2>/dev/null`
88
+
89
+ ### c. Tests
90
+
91
+ #### us008 신규 3 cases
92
+ 1. `node run.mjs run demo --mode native` → exit 2 + stderr ERROR 메시지
93
+ 2. `node run.mjs run demo --mode agent` → stderr deprecation banner + exit 0 (default 동작 유지)
94
+ 3. `node run.mjs run demo --mode tmux` 회귀 unchanged
95
+
96
+ #### SV grep/awk guards (`tests/sv-gate-bug7-mode-prose.sh` 신규 또는 sv-gate-fast.sh 병합)
97
+
98
+ ```bash
99
+ # 1. count-aware: --mode native 최소 5회 등장
100
+ [ "$(grep -c '\-\-mode native' src/commands/rlp-desk.md)" -ge 5 ] || { echo "FAIL: --mode native must appear ≥5 times"; exit 1; }
101
+
102
+ # 2. block-aware safety contract
103
+ WINDOW=$(awk '/^### Native Agent\(\) Safety Contract/,/^### /' src/commands/rlp-desk.md)
104
+ echo "$WINDOW" | grep -q 'Turn-keepalive: every status report uses' || { echo "FAIL: turn-keepalive sentinel"; exit 1; }
105
+ echo "$WINDOW" | grep -q 'no `subagent_type` parameter' || { echo "FAIL: no-subagent_type sentinel"; exit 1; }
106
+ echo "$WINDOW" | grep -q 'mode="bypassPermissions" mandatory' || { echo "FAIL: bypassPermissions sentinel"; exit 1; }
107
+ echo "$WINDOW" | grep -qi 'long-running.*tmux' || { echo "FAIL: long-running tmux recommendation"; exit 1; }
108
+
109
+ # 3. dispatch snippet preservation (AC1.5a static)
110
+ awk '/^If claude engine \(default\):/,/^If codex engine:/' src/commands/rlp-desk.md > /tmp/_disp_claude
111
+ grep -q 'Agent(' /tmp/_disp_claude || { echo "FAIL: claude dispatch missing Agent("; exit 1; }
112
+ grep -q 'mode="bypassPermissions"' /tmp/_disp_claude || { echo "FAIL: claude dispatch missing bypassPermissions"; exit 1; }
113
+ awk '/^If codex engine:/,/^\*\*⑥\*\*|^### /' src/commands/rlp-desk.md > /tmp/_disp_codex
114
+ grep -q 'Bash("codex exec' /tmp/_disp_codex || { echo "FAIL: codex dispatch missing Bash codex exec"; exit 1; }
115
+
116
+ # 4. Options block exact match
117
+ WINDOW=$(awk '/^Options \(parse from/,/^- `--worker-model/' src/commands/rlp-desk.md)
118
+ echo "$WINDOW" | grep -qE '^\- `--mode native\|tmux` \(default: `native`\)$' || { echo "FAIL: Options block --mode line not exact"; exit 1; }
119
+ echo "$WINDOW" | grep -qE '\-\-mode .*agent' && { echo "FAIL: stale 'agent' in Options block --mode line"; exit 1; }
120
+
121
+ # 5. Tmux IMPORTANT RULES contradiction removed
122
+ ! awk '/^\*\*IMPORTANT RULES:\*\*/,/^####/' src/commands/rlp-desk.md | grep -q "always invokes node" || { echo "FAIL: stale 'always invokes node'"; exit 1; }
123
+
124
+ # 6. Legacy redirect prose present
125
+ grep -q 'Legacy.*\-\-mode agent.*redirect' src/commands/rlp-desk.md || { echo "FAIL: deprecation prose missing"; exit 1; }
126
+ ```
127
+
128
+ #### AC1.5b: manual transcript artifact
129
+
130
+ `docs/verifications/p1-native-mode-transcript.md` (git-tracked):
131
+
132
+ 1. P1 land 후 Claude Code session에서 `/rlp-desk run sample --mode native` 1 iteration 실행
133
+ 2. 전체 transcript 캡처 — 다음 관측 포함:
134
+ - `Agent(model=…, mode="bypassPermissions", …)` worker dispatch 라인
135
+ - status report가 `Bash("echo '...'")` 로 wrap
136
+ - `subagent_type=` 미사용
137
+ 3. Reviewer가 `## Reviewer Sign-off` 섹션에 이름 + 날짜 기재
138
+ 4. CI guard: 파일 존재 + signoff 비-placeholder 검증 (`grep -E "^- Name: \S+"`, `grep -E "^- Date: [0-9]{4}-[0-9]{2}-[0-9]{2}"`)
139
+
140
+ ### d. Re-sync
141
+ - `node scripts/postinstall.js`
142
+ - banner-aware diff for `src/commands/rlp-desk.md` ⇆ `~/.claude/commands/rlp-desk.md`, `src/node/run.mjs` ⇆ `~/.claude/ralph-desk/node/run.mjs`
143
+
144
+ ### Acceptance
145
+ - AC1.1 6 grep/awk guards all return 0
146
+ - AC1.2 us008 신규 3 cases all green
147
+ - AC1.3 us008/us006 기존 회귀 0
148
+ - AC1.4 banner-aware diff src ⇆ install 일치
149
+ - AC1.5a 정적 dispatch grep (#3) 통과
150
+ - AC1.5b transcript artifact + signoff non-placeholder
151
+
152
+ ## Out-of-scope (deferred PR list)
153
+
154
+ - **P2**: `src/node/run.mjs:16` default `'agent'` → `'tmux'` flip + `--mode agent` (Node CLI) hard-error. 19th launch 종료 후, 외부 wrapper 영향 평가 후 별도 PR.
155
+ - **P3**: Node leader 삭제 (`src/node/runner/campaign-main-loop.mjs`, `src/node/tmux/`, `src/node/polling/` 등 ~4.5k LOC) + Bug-7 Node 통합 테스트 폐기 + repo-wide ghost-removal gate (`rg -n "Node leader\|node-leader\|--mode agent" src docs scripts tests` = 의도된 hits만). P2 후.
156
+ - **`--mode agent` reclaim to Native Agent()**: P3 이후 next major version에서만. 이번 PR에선 silent reclaim 없음.
157
+
158
+ ## Pre-mortem
159
+
160
+ 1. **`--mode agent` 호출자가 native와 alpha 의미를 헷갈린다** — slash command에서 호출 시 deprecation+redirect로 native path 진행. 외부 shell wrapper에서 `node run.mjs run X --mode agent` 호출 시 deprecation banner + 기존 Node leader path. 두 경로 모두 메시지로 명시.
161
+ 2. **Native Agent() turn-end가 사용자를 괴롭힌다** — Safety Contract 박스의 turn-keepalive 명문화로 mitigate. 그래도 100%는 아니므로 docs는 long-running = `--mode tmux` 강력 권고.
162
+ 3. **외부 wrapper가 `--mode agent` (Node CLI) 의존** — 동작 unchanged + deprecation banner만. P3에서야 hard-error. wrapper는 그동안 마이그레이션.
163
+
164
+ ## Verification end-to-end (P0+P1 land 후)
165
+
166
+ 1. `git log --oneline HEAD~3..HEAD` — Bug #7 + ADR + P1 commits
167
+ 2. `node --test 'tests/node/*.test.mjs' 'tests/node/*.mjs'` — 315+3 = 318 통과
168
+ 3. `bash tests/test-bug7-post-sentinel-race.sh` + `bash tests/test-bug7-poll-partial-write.sh` 통과
169
+ 4. `bash tests/sv-gate-bug7-mode-prose.sh` (또는 sv-gate-fast.sh) — 6 grep/awk guards 0
170
+ 5. banner-aware diff src ⇆ `~/.claude/`
171
+ 6. AC1.5b: 사용자가 Claude Code session에서 `/rlp-desk run sample --mode native` 실행 후 transcript 검토 + signoff
172
+
173
+ ## Round-by-round resolution table
174
+
175
+ | Round | Verdict | Findings closed |
176
+ |---|---|---|
177
+ | 1 (Architect) | shift to A-strict | option A → A-strict |
178
+ | 2 (Critic codex) | ITERATE 7 | entrypoint, default flip, ADR scope, naming, reclaim, AC, re-sync |
179
+ | 3 (Architect) | ITERATE 2 | synonym ghost, allow-deprecated ghost |
180
+ | 4 (Critic codex) | ITERATE 4 | init blocks (192/227), fallback (334/342), grep guards, ADR scope |
181
+ | 5 (Critic codex) | ITERATE 3 | label expansion (778/802), exact options match, AC1.5 runnable |
182
+ | 6 (Critic codex) | ITERATE 3 (1 actionable, 2 cross-check false-positives) | signoff non-placeholder check |
183
+
184
+ Net: 모든 v0-v5 actionable findings closed. Round 6 finding 3 (signoff non-placeholder)은 v7에 이미 반영됨 (AC1.5b CI guard 4번째 항목). Round 6 finding 1/2는 v6 base에 이미 포함된 사항 — critic의 cross-check 누락.
@@ -0,0 +1,125 @@
1
+ # rlp-desk 전략 재평가 — autoplan 입력
2
+
3
+ > **목표**: rlp-desk를 계속 발전시킬지(patch/redesign), 폐기 후 재구성할지(rebuild), 기존 도구로 pivot할지 결정.
4
+ > **핵심 KPI**: blueprint 처음 → 끝 자율 완료. 사람 개입 최소.
5
+ > **현재 상태**: 6주간 10개 bug, 매주 1-2개 신규 발견, manual recovery마저 broken (#10).
6
+
7
+ ---
8
+
9
+ ## 1. Vision (BOS dev 합의, 2026 초)
10
+
11
+ 1. ralph-loop를 **fresh-context**로 매번 시작 (컨텍스트 오염 없음)
12
+ 2. idea → plan distillation
13
+ 3. PRD 정형화
14
+ 4. Worker/Verifier 사이클로 반복 개선
15
+ 5. **완전 자율화** — 사람 개입 최소
16
+
17
+ → 5번이 단일 success criterion. 1-4는 5번을 달성하기 위한 메커니즘.
18
+
19
+ ---
20
+
21
+ ## 2. Reality — 6주간 측정된 사실
22
+
23
+ ### Bug 발생 패턴
24
+
25
+ | # | 일자 | 카테고리 | 회수 가능 | 다음 fix가 노출한 다음 bug |
26
+ |---|---|---|---|---|
27
+ | #1 | 2026-05-01 | LLM-runtime (`.claude/` self-modification gate) | partial — codex worker로 우회 | #2 (tmux session) |
28
+ | #2 | 2026-05-01 | tmux session lifecycle | yes | #3 |
29
+ | #3 | 2026-05-04 | verifier no-progress | yes | #4 (regression of #3) |
30
+ | #4 | 2026-05-05 | #3 regression | partial | #5 |
31
+ | #5 | 2026-05-05 | worker dead on reuse (pane lifecycle) | yes | #6 |
32
+ | #6 | 2026-05-06 | claude worker idle false-positive | yes | #7 |
33
+ | #7 | 2026-05-06 | post-sentinel process race (1m43s drift) | yes | #8 + #10 |
34
+ | #8 | 2026-05-06 | worker incomplete + leader A4 fallback | partial | #10 |
35
+ | #9 | (별도) | verified_us 영속성 (status.json) | yes | — |
36
+ | #10 | 2026-05-07 | leader ignores phase=verify on relaunch — **회수마저 깨짐** | NO (이게 회수 메커니즘) | ? |
37
+
38
+ **Pattern observed:**
39
+ - 매주 1-2개 신규 bug
40
+ - 절반은 **이전 fix가 노출**한 새 failure mode (regression style)
41
+ - Bug #10이 가장 심각 — 회수 메커니즘 자체가 broken → BLOCKED 시 operator의 manual recovery가 무효화
42
+
43
+ ### Bug 카테고리 분류
44
+
45
+ | 카테고리 | Bug | 비중 | architectural 필연성? |
46
+ |---|---|---|---|
47
+ | (a) tmux/process lifecycle race | #2, #5, #6, #7 | 40% | **YES** — tmux pane lifecycle은 claude/codex TUI lifecycle과 분리됨. race window가 본질적 |
48
+ | (b) artifact contract / schema | #3, #4, #8, #9 | 40% | partial — schema가 더 strict하면 줄어들지만 LLM이 schema 어기는 빈도가 본질적 |
49
+ | (c) LLM-runtime constraint | #1 | 10% | **YES** — Claude Code의 `.claude/` self-modification gate는 외부 변수 |
50
+ | (d) recovery hygiene | #10 | 10% | accidental — fix 가능 |
51
+
52
+ → **80%가 architectural inevitability** (a + c). schema strict + retry는 (b)를 줄이지만 LLM 비결정성이 한계.
53
+
54
+ ### SV gate 한계
55
+
56
+ - 모든 sv-self-verify-*.sh가 **Worker/Verifier metaphor만 사용** → 실제 LLM agent run 없음
57
+ - grep + unit test + regression의 5-category labeling
58
+ - → 10개 bug가 SV gate 통과 후 production에서 발견됐다는 사실 = **framework이 production failure mode를 cover 못 함**
59
+ - Production failure mode는 **LLM/tmux/network/timing 비결정성** — unit test로 잡을 수 없는 영역
60
+
61
+ ### In-flight 미완 branch
62
+
63
+ - `feat/native-agent-revert`: P0(Bug #7 fix) + P1(slash native prose 회복) — 미완. Plan: 5 round ralplan 합의됨, codex critic APPROVED
64
+ - `feat/bug10-relaunch-hygiene`: PR-A commit 95c0d4e + SV gate 추가 — 방금 완료, push 안 됨
65
+
66
+ → 두 branch 모두 land 안 됨 = 새 bug 발견 시 기존 fix가 무력화될 위험
67
+
68
+ ---
69
+
70
+ ## 3. 4가지 옵션
71
+
72
+ ### Option A — Continue patching (현재 path)
73
+ PR-A (Bug #10) → PR-B (bundler) → PR-C (patterns) → 다음 bug → 반복.
74
+
75
+ ### Option B — Fundamental redesign (vision 유지, architecture 재설계)
76
+ **핵심 변경**: tmux pane orchestration 폐기 → Claude Code Native Agent() / subprocess 직접 dispatch. Sentinel file → in-memory channel. 두 변경으로 (a) 카테고리 80%가 제거.
77
+
78
+ ### Option C — Scrap and rebuild (vision 일부 수정)
79
+ 6주 코드 폐기. Vision 5번 (완전 자율화)은 유지하되 1번(fresh-context)은 task-isolated subprocess로 재정의. ralph-loop 자체 폐기 가능 — 그냥 plan→worker→verify 사이클로 단순화.
80
+
81
+ ### Option D — Pivot to existing tool
82
+ - ralph plugin (cradle): 가벼움, 기능 부족
83
+ - omc (oh-my-claudecode): /ralph + /ralplan + /omc-teams + /autopilot — 이미 multi-model orchestration 있음
84
+ - superpowers: subagent-driven-development, executing-plans, brainstorming — plan→exec 사이클은 이미 있음
85
+ - claude-devfleet: dmux 기반, multi-agent
86
+
87
+ ---
88
+
89
+ ## 4. 평가 항목 (각 옵션마다)
90
+
91
+ | 항목 | 정의 | 이유 |
92
+ |---|---|---|
93
+ | Vision 보존도 | 5개 vision 중 살아남는 개수 | "완전 자율화" 달성 가능성 |
94
+ | Time-to-first-successful-blueprint | 처음으로 blueprint를 끝까지 자율 완료하는 데 걸리는 시간 | **단일 핵심 KPI** |
95
+ | Sunk cost write-off % | 폐기되는 코드/SV 비율 | 결정의 reversibility |
96
+ | Bug regression 위험 | 새 시스템에서 #1-#10 같은 bug가 다시 나올 확률 | "다음 6주에 또 10개?" |
97
+ | Personal capacity ROI | 1주 투자 시 deliverable | sustainability |
98
+
99
+ ---
100
+
101
+ ## 5. In-flight branch 처리 결정
102
+
103
+ 이 평가가 끝난 후 결정:
104
+ - `feat/native-agent-revert`: land / abandon / re-scope?
105
+ - `feat/bug10-relaunch-hygiene`: 이미 commit 95c0d4e, push할까 hold할까?
106
+
107
+ 선택 옵션이 무엇이든 두 branch는 처리 필요.
108
+
109
+ ---
110
+
111
+ ## 6. 제약
112
+
113
+ - BOS dev가 실제 캠페인을 돌려야 함 → short-term (1-2주) patching 불가피
114
+ - rlp-desk는 npm published — breaking change는 user-facing (semver 고려)
115
+ - 분석은 advisory only — 실제 코드 수정/commit/push는 사용자 승인 별도
116
+
117
+ ---
118
+
119
+ ## 7. autoplan에 요구 — 이 문서를 입력으로
120
+
121
+ CEO 관점: rlp-desk가 푸는 문제가 옳은가? 다른 도구로 같은 가치를 이미 얻을 수 있나?
122
+ Eng 관점: 6주간의 architectural pattern을 보면 (a) 80% 카테고리가 patching으로 해결될까? 아니면 redesign이 필연인가?
123
+ DX 관점: rlp-desk는 dev tool — operator(BOS dev)가 매번 30분씩 hand-write recovery를 해야 한다는 사실이 DX failure인가?
124
+
125
+ 각 phase에서 dual voices (Codex + Claude subagent) 실행, consensus table 생성, 4 options steelman.
@@ -0,0 +1,178 @@
1
+ # rlp-desk Stabilization Plan (v0.15.x → v0.16.x)
2
+
3
+ > **Status**: ACTIVE. Replaces the misdirected 2026-05-07 "pivot to omc" decision (PR #8 redirect via this plan).
4
+ > **Goal**: bring rlp-desk to omc /team/ralph/ralplan level of reliability **while preserving rlp-desk's self-driving advantages**.
5
+ > **Non-goal**: pivoting away from rlp-desk. omc is the **benchmark**, not the replacement.
6
+
7
+ ---
8
+
9
+ ## 0. Why this plan exists (correction note)
10
+
11
+ On 2026-05-07 morning I (the assistant) ran `plan-ceo-review` on the question "rlp-desk vs omc /team" and produced a recommendation to enter maintenance mode and pivot to omc. The user immediately corrected: *the goal was always to make rlp-desk work as reliably as omc, NOT to replace it*.
12
+
13
+ This plan is the corrected direction: stabilize rlp-desk by learning from omc's patterns, applying them to rlp-desk's substrate, while protecting the four real differentiators that make rlp-desk worth using in the first place.
14
+
15
+ The misdirected commit `229e1b6` (the "maintenance mode" banner + FROZEN doc) is now reverted in this PR. The pivot prompt-optimizer artifact and BOS validation plan stay on disk but are deferred — they may become useful later as a comparison study, but they are not the active path.
16
+
17
+ ---
18
+
19
+ ## 1. The vision (preserved verbatim)
20
+
21
+ 1. ralph-loop fresh-context per iteration (no context pollution)
22
+ 2. idea → plan distillation
23
+ 3. PRD formalization
24
+ 4. Worker/Verifier cycles with iterative improvement
25
+ 5. **Full autonomy — minimum operator intervention**
26
+
27
+ This vision is the core. Stabilization is in service of it, not a substitute for it.
28
+
29
+ ---
30
+
31
+ ## 2. Differentiators to preserve (rlp-desk-only)
32
+
33
+ These four are the reason rlp-desk exists separately from omc. Stabilization work MUST NOT compromise them:
34
+
35
+ 1. **Multi-engine parallel consensus per iteration**: `--consensus all` runs claude AND codex on every verification, then reconciles. omc /ralph supports `--critic=codex` but as a single critic, not parallel consensus.
36
+ 2. **Multi-mission queue + cross-mission analytics**: `RLP_BACKGROUND=1` chains missions and tracks cross-mission metrics. omc /team is single-task.
37
+ 3. **BLOCK_TAGS P1-D failure taxonomy**: structured `reason_category × recoverable × suggested_action` classification. omc emits simpler verdicts (pass/fail/blocked).
38
+ 4. **Structured SV reports**: post-campaign analytics at `~/.claude/ralph-desk/analytics/<slug>/self-verification-report-NNN.md`. omc has lighter `progress.txt`.
39
+
40
+ These four ARE the value proposition. The stabilization work below is about making the substrate that delivers them as reliable as omc's.
41
+
42
+ ---
43
+
44
+ ## 3. The 10-bug regression pattern (what we're hardening against)
45
+
46
+ Six weeks (2026-05-01 to 2026-05-07), 10 bugs, each prior fix exposing the next. Categorized:
47
+
48
+ | Cat | Bugs | Root cause cluster |
49
+ |---|---|---|
50
+ | (a) tmux/process lifecycle race | #5, #6, #7, #10 | Long-lived TUI processes in tmux panes; sentinel polling races; recovery hygiene |
51
+ | (b) artifact contract / schema | #3, #4, #8, #9 | Worker/Verifier output contract violations; LLM non-determinism on schema; verified_us persistence |
52
+ | (c) LLM-runtime constraint | #1 | Claude Code `.claude/` self-modification gate blocking sentinel writes |
53
+ | (d) recovery hygiene | #10 | Manual recovery on relaunch silently overwritten |
54
+
55
+ **Per category, what omc does differently** (preliminary — to be verified empirically in §5):
56
+
57
+ - **(a) Lifecycle race**: omc /team uses Claude Code native team primitives (`TeamCreate`, `TaskCreate`, `SendMessage`). No tmux, no long-lived TUI, no sentinel polling. Process lifecycle = subagent lifecycle = single Claude Code call. Race window does not exist.
58
+ - **(b) Contract violations**: omc /ralph uses `prd.json` with `passes: bool` per story + reviewer verifies acceptance criteria. Simpler schema = less surface for LLM to violate. omc also has mandatory deslop pass + regression re-verification (`ai-slop-cleaner` + Step 7.6).
59
+ - **(c) Self-modification gate**: omc skills are read by Claude Code via the Skill tool, not written by Workers. Workers don't touch `.claude/` paths. Gate not encountered.
60
+ - **(d) Recovery**: omc /ralph is session-scoped (`.omc/state/sessions/{sessionId}/prd.json`). Per-session state means relaunch starts fresh; there is no "manual recovery" surface to break.
61
+
62
+ These are the patterns to learn from. Adopting them does NOT require pivoting away from rlp-desk; it requires bringing equivalent semantics into rlp-desk's substrate.
63
+
64
+ ---
65
+
66
+ ## 4. Stabilization principles
67
+
68
+ 1. **omc is benchmark, not replacement.** Every change in this plan asks "how does omc avoid this failure mode?" then engineers an equivalent for rlp-desk's stack.
69
+ 2. **Preserve all 4 differentiators.** No change should compromise multi-engine consensus, multi-mission queue, BLOCK_TAGS taxonomy, or SV reports.
70
+ 3. **Substrate first, features second.** Bug categories (a) and (d) are substrate. Categories (b) and (c) are surface. Fix substrate first; surface improvements compound on a stable base.
71
+ 4. **Real-LLM SV gate.** The current SV gate's grep+unit-test labeling missed 10 production bugs. SV must be strengthened to actually catch production failure modes (subset of campaigns run with full claude/codex worker+verifier in CI-like mode).
72
+ 5. **Increment by category.** Each PR closes ONE bug category, not multiple. Avoids "fix-of-fix-of-fix" pattern that produced #4 (regression of #3).
73
+
74
+ ---
75
+
76
+ ## 5. Concrete workstream (revised, per category)
77
+
78
+ ### Phase A — Empirical omc baseline (W1, ~3 days)
79
+
80
+ Before changing rlp-desk, measure omc reliably. Three test campaigns:
81
+
82
+ | Test | Workload | Measure |
83
+ |---|---|---|
84
+ | A1 | omc /ralph "fix small TS error in BOS apps/web/" | operator-touch count, time, cost |
85
+ | A2 | omc /ralph + multi-iter (3+ stories) on a synthetic PRD | operator-touch count, recovery behavior |
86
+ | A3 | omc /team "implement small feature with 3:executor" on synthetic task | parallelism behavior, lock contention |
87
+
88
+ **Output**: `docs/plans/v0.15-stabilization-omc-baseline.md` with per-test metrics. Not a competition, a *measurement*. Establishes the bar rlp-desk needs to reach.
89
+
90
+ ### Phase B — Category (a) substrate hardening (W1-W3, ~2 weeks)
91
+
92
+ The largest cluster (4 of 10 bugs). Goal: tmux/process lifecycle race window → 0 in `--mode tmux`. `--mode native` already addresses this differently; the work here is `--mode tmux`.
93
+
94
+ Sub-deliverables:
95
+ - B1: lifecycle audit (every tmux send-keys / sentinel write / pane reuse — ASCII diagram of timing windows)
96
+ - B2: post-sentinel reaper invariant test (extend Bug #7 fix coverage to all sentinel writes, not just per-US)
97
+ - B3: real-LLM SV scenario for category (a) — actual claude/codex worker dispatched, lifecycle race triggered deterministically, fix verified
98
+ - B4: lifecycle observability (debug log emits race-window measurements per iteration)
99
+
100
+ ### Phase C — Category (d) recovery hygiene completion (W3-W4, ~1 week)
101
+
102
+ Bug #10's PR-A fix covers `phase=verify` honor. Remaining recovery surfaces:
103
+ - C1: phase=blocked recovery (operator clears blocked sentinel + restarts) — currently honored, verify with test
104
+ - C2: phase=worker mid-iter crash recovery (leader killed mid-worker dispatch) — verify, fix if broken
105
+ - C3: cross-mission queue recovery (one mission BLOCKED, queue advances) — verify
106
+ - C4: documented operator recovery cookbook with deterministic jq pipelines
107
+
108
+ ### Phase D — Category (b) contract hardening (W4-W6, ~2 weeks)
109
+
110
+ LLM contract violations are partly inevitable, but the harness can reduce the surface:
111
+ - D1: schema validator at every artifact write (already exists for some; extend to all done-claim/iter-signal/verdict variants)
112
+ - D2: feedback loop — when worker violates contract, next iteration's prompt includes the schema error verbatim (omc-style)
113
+ - D3: verified_us persistence audit (Bug #9) — `status.json` is the source of truth, memory.md is supplementary, contract clear in code
114
+ - D4: real-LLM SV scenario for category (b)
115
+
116
+ ### Phase E — Category (c) LLM-runtime constraint awareness (W6-W7, ~1 week)
117
+
118
+ `.claude/` self-modification gate (Bug #1):
119
+ - E1: Worker prompt explicitly states "do NOT touch `.claude/`; sentinel paths are at `.rlp-desk/memos/`" (already done in v0.13.0 path migration; verify)
120
+ - E2: claude worker pre-flight check — try a no-op write to `.rlp-desk/` before main work; fail fast if blocked
121
+ - E3: cross-engine fallback — when claude worker hits permission gate, mid-flight fallback to codex worker for that iter (already partial; complete)
122
+
123
+ ### Phase F — Real-LLM SV gate (W7-W8, ~2 weeks)
124
+
125
+ The biggest framework upgrade:
126
+ - F1: define "SV scenario" = complete real campaign (1-3 iter, real claude/codex, real tmux or native) executed in CI nightly
127
+ - F2: each merged PR adds at least one SV scenario covering the bug it fixed (Bug #1-#10 retroactively)
128
+ - F3: SV gate becomes "all real-LLM scenarios PASS" before npm publish — replaces the current grep-and-label SV
129
+ - F4: cost budget for SV gate (~$10-20/run nightly, ~$300-600/month — explicit budget approval needed before W7 starts)
130
+
131
+ ### Release cadence
132
+
133
+ - v0.15.2 (this PR): redirect + stabilization plan + Phase A start
134
+ - v0.15.3-v0.15.7: incremental Phase B-E PRs, each landing one category fix + real-LLM SV scenario for that category
135
+ - v0.16.0 (~8-10 weeks from 2026-05-07): real-LLM SV gate active + 10-bug regression pattern verified eliminated empirically (3 consecutive campaigns at omc baseline parity or better)
136
+
137
+ ---
138
+
139
+ ## 6. Success criteria (measurable)
140
+
141
+ | Metric | Current (2026-05-07) | v0.16.0 target | Measurement |
142
+ |---|---|---|---|
143
+ | Bug discovery rate | 1-2/week | <1/month | git log of bug-report-* files in BOS |
144
+ | Operator-touch per campaign | unmeasured (high) | <1 per 5 campaigns | new analytics field in `campaign.jsonl` |
145
+ | Campaign completion rate | unmeasured (low) | >80% | new analytics field |
146
+ | SV gate catches production bugs | 0/10 | >50% (5/10 if Bug #11 happens, caught pre-publish) | post-publish bug review |
147
+ | Differentiator preservation | 4/4 | 4/4 | regression test per differentiator |
148
+
149
+ ---
150
+
151
+ ## 7. What this plan is NOT
152
+
153
+ - NOT a pivot away from rlp-desk
154
+ - NOT a maintenance mode declaration
155
+ - NOT a plan to delete the Node leader (`--mode tmux` and `--mode agent` Node CLI both stay; deletion is a separate decision deferred until stabilization complete)
156
+ - NOT a promise that omc patterns will be copied verbatim — they're inspiration, the implementation is rlp-desk-native
157
+
158
+ ## 8. What this plan IS
159
+
160
+ - A correction of the 2026-05-07 misdirection
161
+ - A category-by-category hardening roadmap with empirical baselines (Phase A)
162
+ - A real-LLM SV gate replacement for the current theatrical SV (Phase F)
163
+ - A preservation contract for the 4 differentiators
164
+ - A concrete release cadence ending in v0.16.0 with measured success criteria
165
+
166
+ ---
167
+
168
+ ## 9. First action (this PR)
169
+
170
+ This PR (`feat/v0.15.2-stabilization-redirect`):
171
+ - Reverts the maintenance-mode banner in `src/node/run.mjs`
172
+ - Replaces with stabilization-in-progress banner
173
+ - Removes `docs/plans/v0.16-FROZEN-status.md` (misdirection artifact)
174
+ - Adds this `docs/plans/v0.15-stabilization-plan.md`
175
+ - Updates `tests/node/us008-cli-entrypoint.test.mjs` regex
176
+ - Bumps to v0.15.2 + npm publish so users see the corrected banner
177
+
178
+ After this lands: Phase A (omc baseline measurement) starts. That's a separate session.
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@ai-dev-methodologies/rlp-desk",
3
- "version": "0.15.0",
3
+ "version": "0.15.2",
4
4
  "description": "Fresh-context iterative loops for Claude Code — autonomous task completion with independent verification",
5
5
  "scripts": {
6
6
  "postinstall": "node scripts/postinstall.js",