wei-wuwei 0.2.0 → 0.2.1

package/CHANGELOG.md

@@ -4,6 +4,14 @@ One section per published version, newest first. `wuwei update` prints the
 sections between the installed version and the new one before it asks;
 `wuwei check` fails when package.json's version has no section here.
 
+## 0.2.1
+
+- `wuwei review-collect`: finds the latest Claude Code session that
+  dispatched a wuwei lens, copies each lens's transcript and report into
+  the review bundle's `reports/`, and prints what each one spent — turns,
+  context built, cached re-reads, and where the reading went. wuwei-review
+  §7 uses it instead of the collator re-typing each report.
+
 ## 0.2.0
 
 Execute runs at a fixed tier; the model policy now covers review only.

package/README.md

@@ -67,6 +67,7 @@ node bin/wuwei.js status <project>   # read-only: streams/claims from .wuwei, dr
 node bin/wuwei.js update             # git pull if behind, diff against what install wrote, apply on yes
 node bin/wuwei.js review-prep <base>  # wuwei-review's prep: dispatcher checks + scan bundle (or --pr <n>)
 node bin/wuwei.js claim [stream] [NN] # list eligible phases, or claim one: cut, claim, push
+node bin/wuwei.js review-collect     # each lens's transcript + report into the bundle, and what each one spent
 node bin/wuwei.js digest-check <f>   # a review digest's arithmetic before it is published
 node bin/wuwei.js plan-check [stream] # plan-phases step 11's checkable half, before sign-off
 node bin/wuwei.js worktree <lens> <sha> # a throwaway worktree no other lens shares (--prune)
@@ -92,8 +93,16 @@ npm in the background, and when a newer version is out it says so on stderr
 (at most hourly; never from a clone or in CI; `WUWEI_NO_UPDATE_CHECK=1` turns
 it off).
 
-Releasing: bump `package.json`, add its `## <version>` section to
-`CHANGELOG.md` (`wuwei check` fails without one), push a `v<version>` tag.
+Releasing is merging. Every merge to main that changes what the package ships
+(`bin`, `skills`, `agents`, `templates`, `wuwei.config.json`) is released by
+`.github/workflows/publish.yml`: the version is bumped by the merged commits'
+Conventional Commit types — `feat` minor, `type!:` or a `BREAKING CHANGE:`
+footer major (minor while under 1.0), anything else patch — `CHANGELOG.md`
+gains a section from the merged PR titles, and the release commit, the
+`v<version>` tag, the npm publish and the GitHub Release follow. A docs- or
+tests-only merge releases nothing; *Run workflow* (`workflow_dispatch`) with a
+bump releases now. A version already set in `package.json` that npm has not
+seen goes out as is.
 
 ## Daily use
 
@@ -189,7 +198,7 @@ wuwei/
 ├── agents/            # canonical subagent definitions
 │   └── _template/
 ├── templates/         # PR / review templates, installed per-repo
-├── bin/wuwei.js       # CLI: build · check · list · init · install · update · status · review-prep · claim · digest-check · plan-check · worktree · mutate · sites · verify · uninstall
+├── bin/wuwei.js       # CLI: build · check · list · init · install · update · status · review-prep · review-collect · claim · digest-check · plan-check · worktree · mutate · sites · verify · uninstall
 │                      #   the per-tool emitters live here too, not in adapters/
 ├── adapters/          # notes only — see bin/wuwei.js for the actual emitters
 ├── docs/

package/bin/wuwei.js

@@ -22,6 +22,8 @@
  *   wuwei claim [<stream>] [<phase>] [--take-over] [--by <id>] [--dry]
  *                              wuwei-execute-phase step 1: list what is eligible,
  *                              or claim one — cut, claim, push
+ *   wuwei review-collect [--session <id>]  each subagent's transcript and report into
+ *                              the bundle's reports/, and what each one spent
  *   wuwei digest-check <file>  wuwei-review §7's arithmetic before publishing: count,
  *                              rows, credits, file:line, Action names, redaction
  *   wuwei worktree <lens> [<sha>]  a throwaway worktree no other lens shares; --prune
@@ -1842,6 +1844,90 @@ async function cmdVerify(argv) {
   console.log('\nflags are leads, not findings: open the shot, and confirm against the spec what the page should say')
 }
 
+// ── review-collect: the lenses' own record, from Claude Code's transcripts ──
+// Claude Code keeps every subagent's transcript under ~/.claude/projects/<cwd,
+// non-alphanumerics as '-'>/<session>/subagents/agent-<id>.jsonl, its type in
+// the .meta.json beside it. §7 used to have the collator re-type each report
+// into the bundle — skipped in practice, and paid for in tokens when not. This
+// copies them, and reads what each one spent
+function transcriptStats(file) {
+  const usage = new Map(), uses = new Map(), reads = new Map()
+  const t = { turns: 0, built: 0, reread: 0, input: 0, output: 0, first: null, last: null, report: '' }
+  const kind = (name, inp = {}) => name === 'Read' ? (/\.wuwei-cache/.test(inp.file_path ?? '') ? 'Read:bundle' : 'Read:tree')
+    : name === 'Bash' ? (/codegraph/.test(inp.command ?? '') ? 'Bash:codegraph' : /\b(git )?grep\b|\brg\b/.test(inp.command ?? '') ? 'Bash:grep' : 'Bash:other') : name
+  for (const line of readFileSync(file, 'utf8').split('\n')) {
+    let d; try { d = JSON.parse(line) } catch { continue }
+    if (d.timestamp) { t.first ??= d.timestamp; t.last = d.timestamp }
+    const m = d.message
+    if (!m || typeof m !== 'object') continue
+    // one message arrives as several lines while it streams: its last usage is its total
+    if (d.type === 'assistant' && m.usage) usage.set(m.id, m.usage)
+    for (const x of Array.isArray(m.content) ? m.content : []) {
+      if (x.type === 'tool_use') {
+        uses.set(x.id, kind(x.name, x.input))
+        if (x.name === 'SubagentHandback' && x.input?.message) t.report = x.input.message
+      } else if (x.type === 'tool_result') {
+        const k = uses.get(x.tool_use_id) ?? '?', r = reads.get(k) ?? { n: 0, tokens: 0 }
+        r.n++; r.tokens += Math.round(JSON.stringify(x.content ?? '').length / 4); reads.set(k, r)
+      } else if (x.type === 'text' && d.type === 'assistant' && x.text?.trim()) t.lastText = x.text
+    }
+  }
+  for (const u of usage.values()) {
+    t.turns++; t.built += u.cache_creation_input_tokens ?? 0; t.reread += u.cache_read_input_tokens ?? 0
+    t.input += u.input_tokens ?? 0; t.output += u.output_tokens ?? 0
+  }
+  t.report ||= t.lastText ?? ''
+  t.reads = [...reads].sort((a, b) => b[1].tokens - a[1].tokens)
+  return t
+}
+
+function cmdReviewCollect(argv) {
+  const flag = name => { const i = argv.indexOf(name); return i === -1 ? null : argv[i + 1] }
+  const projects = join(process.env.CLAUDE_CONFIG_DIR ?? join(homedir(), '.claude'), 'projects')
+  const projDir = join(projects, process.cwd().replace(/[^A-Za-z0-9]/g, '-'))
+  if (!existsSync(projDir)) { console.error(`✗ no Claude Code sessions recorded for ${process.cwd()} (${projDir}) — run it where the review ran (Codex has no subagent transcripts)`); process.exit(1) }
+  const sessions = readdirSync(projDir, { withFileTypes: true }).filter(d => d.isDirectory() && existsSync(join(projDir, d.name, 'subagents')))
+    .map(d => {
+      const dir = join(projDir, d.name, 'subagents')
+      const agents = readdirSync(dir).filter(f => f.endsWith('.meta.json')).map(f => {
+        let meta = {}; try { meta = JSON.parse(readFileSync(join(dir, f), 'utf8')) } catch {}
+        const jsonl = join(dir, f.replace(/\.meta\.json$/, '.jsonl'))
+        return { meta, jsonl, mtime: existsSync(jsonl) ? statSync(jsonl).mtimeMs : 0 }
+      }).filter(a => a.mtime)
+      return { id: d.name, agents, wuwei: agents.some(a => /^wuwei-/.test(a.meta.agentType ?? '')), latest: Math.max(0, ...agents.map(a => a.mtime)) }
+    })
+  const session = flag('--session') ? sessions.find(s => s.id.startsWith(flag('--session')))
+    : sessions.filter(s => s.wuwei).sort((a, b) => b.latest - a.latest)[0]
+  if (!session) { console.error(`✗ ${flag('--session') ? `no session ${flag('--session')}` : 'no session here dispatched a wuwei lens'} under ${projDir}`); process.exit(1) }
+
+  const sha = flag('--sha') ?? quiet('git', ['rev-parse', '--verify', '--quiet', 'HEAD']).stdout?.trim().slice(0, 12) ?? 'nogit'
+  const out = join(process.cwd(), '.wuwei-cache', 'review', sha, 'reports')
+  mkdirSync(out, { recursive: true })
+  const rows = [], used = new Map()
+  for (const a of session.agents.map(a => ({ ...a, s: transcriptStats(a.jsonl) })).sort((x, y) => (x.s.first ?? '').localeCompare(y.s.first ?? ''))) {
+    const type = a.meta.agentType ?? 'agent'
+    const base = (type === 'general-purpose' && a.meta.description ? a.meta.description.toLowerCase().replace(/[^a-z0-9]+/g, '-').replace(/^-|-$/g, '').slice(0, 30) : type).replace(/^wuwei-/, '')
+    const n = (used.get(base) ?? 0) + 1; used.set(base, n)
+    const name = n === 1 ? base : `${base}-${n}`
+    writeFileSync(join(out, `${name}.jsonl`), readFileSync(a.jsonl))
+    if (a.s.report) writeFileSync(join(out, `${name}.md`), a.s.report.trimEnd() + '\n')
+    rows.push({ name, ...a.s })
+  }
+  const k = x => x >= 1e6 ? `${(x / 1e6).toFixed(1)}M` : x >= 1e3 ? `${Math.round(x / 1e3)}k` : String(x)
+  const total = rows.reduce((t, r) => ({ built: t.built + r.built, reread: t.reread + r.reread }), { built: 0, reread: 0 })
+  console.log(`session ${session.id} · ${rows.length} subagent(s) → ${out}\n`)
+  // output tokens are left out: the transcript records a streaming chunk's count, not the message's
+  console.log('| agent | turns | context built | re-read (cached) | where the reading went |\n|---|---|---|---|---|')
+  for (const r of [...rows].sort((a, b) => (b.built + b.reread / 10) - (a.built + a.reread / 10)))
+    console.log(`| ${r.name} | ${r.turns} | ${k(r.built)} | ${k(r.reread)} | ${r.reads.slice(0, 4).map(([kk, v]) => `${kk} ${v.n}× ≈${k(v.tokens)}`).join(' · ') || '—'} |`)
+  console.log(`| **total** | | ${k(total.built)} | ${k(total.reread)} | |`)
+  const byKind = new Map()
+  for (const r of rows) for (const [kk, v] of r.reads) byKind.set(kk, (byKind.get(kk) ?? 0) + v.tokens)
+  const top = [...byKind].sort((a, b) => b[1] - a[1]).slice(0, 3)
+  if (top.length) console.log(`\nmost read, across the lenses: ${top.map(([kk, v]) => `${kk} ≈${k(v)}`).join(' · ')}`)
+  console.log('re-read is billed at about a tenth of context built; a lens with many turns pays its context again on each')
+}
+
 // ── digest-check: wuwei-review §7's arithmetic, before publishing ─────
 // what the collator re-derives by hand: the header count against the table,
 // reporter credits, every file:line against the reviewed tree, every
@@ -2818,6 +2904,7 @@ switch (cmd) {
   case 'update': await cmdUpdate(dry, rest.includes('--no-fetch')); break
   case 'status': cmdStatus(arg); break
   case 'review-prep': cmdReviewPrep(rest); break
+  case 'review-collect': cmdReviewCollect(rest); break
   case 'verify': await cmdVerify(rest); break
   case 'claim': cmdClaim(rest); break
   case 'digest-check': cmdDigestCheck(rest); break
@@ -2827,6 +2914,6 @@ switch (cmd) {
   case 'plan-check': cmdPlanCheck(rest); break
   case 'uninstall': await cmdUninstall(arg); break
   default:
-    console.error(`unknown command '${cmd}'\nusage: wuwei [build|check|list|init [path]|install [path]|update|status [path]|review-prep [base] [--pr n] [--path p]|verify [page] [--phase NN]|claim [stream] [phase]|digest-check <digest.md>|worktree <lens> [sha]|mutate <file>:<line>|sites <pattern>|plan-check [stream]|uninstall [path]|--version] [--dry]`)
+    console.error(`unknown command '${cmd}'\nusage: wuwei [build|check|list|init [path]|install [path]|update|status [path]|review-prep [base] [--pr n] [--path p]|review-collect|verify [page] [--phase NN]|claim [stream] [phase]|digest-check <digest.md>|worktree <lens> [sha]|mutate <file>:<line>|sites <pattern>|plan-check [stream]|uninstall [path]|--version] [--dry]`)
     process.exit(1)
 }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "wei-wuwei",
-  "version": "0.2.0",
+  "version": "0.2.1",
   "description": "為無為，則無不治 — a source-of-truth skills & agents framework that compiles to Claude Code and Codex (Cursor and Gemini CLI planned). Write once, run in every agent, govern without forcing.",
   "type": "module",
   "bin": {

package/skills/wuwei-review/references/prep.md

@@ -31,5 +31,5 @@ slices they need:
   diff.patch    git diff <base>...HEAD, three dots, verbatim
   symbols.md    definitions the diff references, from `codegraph node` — or "graph absent"
   tools/<tool>.json   each detected tool's read-only output over the change (§5), run once
-  reports/<lens>.md   each lens's raw report, as returned — never the session scratchpad
+  reports/<lens>.md   each lens's raw report — `wuwei review-collect`, or written as returned
 ```

package/skills/wuwei-review/skill.md

@@ -102,7 +102,7 @@ disk**; lenses pull the slices they need:
 ```
 .wuwei-cache/review/<reviewed-sha>/     # gitignored — never inside the reviewed tree
   PREP.md · INDEX.md (kind is a first pass by path — reclassify by content) · diff.patch
-  thread.json · tools/<tool>.json · reports/<lens>.md (each lens's raw report, as returned)
+  thread.json · tools/<tool>.json · reports/<lens>.md + .jsonl (`wuwei review-collect`)
 ```
 
 **No copies of the changed files** — each lens's context holds what it reads
@@ -346,9 +346,9 @@ finding closes.
 
 ## 7. Collate
 
-The collator is the dispatching session. It first writes each lens's report
-into the bundle's `reports/<lens>.md` as returned — the harness's output file,
-copied, not re-typed. Then one digest
+The collator is the dispatching session. **`wuwei review-collect`** first
+copies each lens's transcript and report into the bundle's `reports/` —
+never re-typed (no subagents, as on Codex: write them yourself). Then one digest
 against `.wuwei/templates/code-review.md`, opening with which
 panels ran and why. **Whichever panels ran share one table** — code and
 document on a mixed target, or the stream panel's five reporters plus §2 on