claude-code-cache-fix 3.6.0 → 3.6.1

package/README.md

@@ -43,6 +43,8 @@ On every `/v1/messages` request, 7 extensions run in order:
 
 Extensions are hot-reloadable — add, remove, or modify `.mjs` files in `proxy/extensions/` and changes apply to the next request without restarting. Configuration in `proxy/extensions.json`.
 
+**Developing a new extension?** See [docs/parallel-proxy-test-harness.md](docs/parallel-proxy-test-harness.md) for the pattern we use to test extensions end-to-end against real `claude -p` traffic without disturbing the production proxy.
+
 ### Running as a service
 
 **Recommended (Linux/macOS) — `install-service` subcommand:**
@@ -204,6 +206,8 @@ Options (all optional; all fall back to the same env vars used by the CLI):
 
 **CLI invocation is unchanged.** `node proxy/server.mjs`, `cache-fix-proxy server`, and the wrapper's child-fork path all auto-listen and install SIGTERM/SIGINT handlers as before. Library imports never trigger that behavior — the auto-listen is gated behind a main-module check.
 
+*The embeddable factory was contributed by [@bilby91](https://github.com/bilby91) at [Crunchloop DAP](https://dap.crunchloop.ai) — see [PR #123](https://github.com/cnighswonger/claude-code-cache-fix/pull/123).*
+
 ## Quick Start: Preload (CC v2.1.112 and earlier)
 
 If you're on a Node.js-based CC version (v2.1.112 or earlier), the preload interceptor works without a proxy:
@@ -613,6 +617,35 @@ The Mode A/B separation protects against cases where the sentinel might be follo
 | `CACHE_FIX_MICROCOMPACT_REDACT_LEN` | `64` | Mode B prefix length in dump records. Set to `0` to suppress the prefix entirely. |
 | `CACHE_FIX_DUMP_MICROCOMPACT_INCLUDE_NORMALIZED` | unset | Add post-normalization text alongside (not replacing) raw `sentinel_text` in dump records. |
 
+## Thinking summaries (proxy mode, opt-in, Opus 4.7+)
+
+On Opus 4.7, Anthropic flipped the API default for `thinking.display` from `"summarized"` to `"omitted"`. In parallel, Claude Code's CLI has a `!getIsNonInteractiveSession()` gate that propagates `display: "summarized"` only when the session is interactive. The combination means every CC subprocess spawned with `--input-format stream-json` — the VS Code chat panel, the Antigravity panel, the SDK, `claude --print` — sends a thinking-enabled request (`thinking.type` is either `"enabled"` or `"adaptive"` depending on CC version) without `display`, and the API responds with thinking blocks whose `thinking` field is empty (plus a multi-KB signature). The UI shows a static "Thinking" stub while the agent runs but never any reasoning content.
+
+Upstream root cause and patch proposed in [anthropics/claude-code#59844](https://github.com/anthropics/claude-code/issues/59844) (credit: [@ojura](https://github.com/ojura)). This extension is the proxy-side complement: when a request to an Opus 4.7 endpoint has thinking enabled but `display` unset, inject the configured mode at the API boundary. Works on any CC version routed through cache-fix-proxy, no waiting on Anthropic to ship the CLI fix.
+
+```sh
+# Restore summaries (the built-in default — non-interactive surfaces get reasoning content)
+export CACHE_FIX_THINKING_DISPLAY=summarized
+
+# Force-suppress override (agent runtimes that don't want thinking blocks at all)
+export CACHE_FIX_THINKING_DISPLAY=omitted
+
+# Explicit no-op (extension passes through unchanged)
+export CACHE_FIX_THINKING_DISPLAY=disabled
+```
+
+The extension is **default-on** as of v3.6.1. The cache-prefix test measured 0% absolute drop in steady-state `cache_read` ratio when injection is active on Opus 4.7 (5 sequential `claude -p` calls per window, baseline vs injected — both windows held 1.000 cache_read ratio from call 2 onward). Adding `thinking.display` to the request body changes the bytes Anthropic hashes, but Anthropic's cache layer accepts and indexes the injected-prefix the same way it does any other prefix. Users who want the older "no injection" behavior (e.g. to avoid any request-body mutation at all) explicitly set `CACHE_FIX_THINKING_DISPLAY=disabled`.
+
+Scoping rules baked into the extension:
+
+- **Model-gated.** Only fires on requests whose `model` matches `/^claude-opus-4-7/` — covers `claude-opus-4-7` and `claude-opus-4-7-1m`. Sonnet 4.7 needs separate verification (the API default-flip may differ); future versions (4.8+) require an explicit cache-fix bump rather than auto-applying unverified behavior.
+- **User opt-out preserved.** If the request already has `thinking.display` set (either `"summarized"` or `"omitted"`), the extension never overwrites. Explicit user choice always wins.
+- **Thinking-active types only.** The extension fires on `thinking.type` ∈ `{ "enabled", "adaptive" }` — the two active modes that produce thinking blocks on Opus 4.7. Other values (`"disabled"`, future modes) are skipped. Conservative: if Anthropic ships a new thinking type with different display semantics, we'd rather miss the fix than auto-apply incorrect behavior.
+
+| Env var | Default | Purpose |
+|---------|---------|---------|
+| `CACHE_FIX_THINKING_DISPLAY` | `summarized` (built-in) | One of `summarized` / `omitted` / `disabled`. `summarized` restores thinking summaries (default). `omitted` force-suppresses thinking blocks. `disabled` opts the extension out entirely. |
+
 ## System prompt rewrite (preload mode, optional)
 
 The interceptor can rewrite Claude Code's `# Output efficiency` system-prompt section. Disabled by default. Enable with `CACHE_FIX_OUTPUT_EFFICIENCY_REPLACEMENT`. See [docs/output-efficiency-prompts.md](docs/output-efficiency-prompts.md) for the three known prompt variants and usage instructions.
@@ -643,13 +676,13 @@ We monitor 30+ upstream Claude Code issues related to cache, quota, and context
 
 ## Used in production
 
-- **[Crunchloop DAP](https://dap.crunchloop.ai)** — Agent SDK / DAP development environment. First production team to merge the interceptor to trunk for team-wide deployment (2026-04-10). Identified two distinct cache regression patterns through real-world testing — tool ordering jitter and the fresh-session sort gap — and contributed debug traces that drove the v1.5.1 and v1.6.2 fixes.
+- **[Crunchloop DAP](https://dap.crunchloop.ai)** — Agent SDK / DAP development environment. First production team to merge the interceptor to trunk for team-wide deployment (2026-04-10). Identified two distinct cache regression patterns through real-world testing — tool ordering jitter and the fresh-session sort gap — and contributed debug traces that drove the v1.5.1 and v1.6.2 fixes. Contributed the embeddable proxy factory (v3.6.0) that lets the proxy run in-process inside Bun-compiled and DAP-style agent binaries without forking a Node child.
 - **[VM Farms](https://vmfarms.com)** ([@vmfarms](https://github.com/vmfarms)) — Agent development environment running concurrent multi-runner workloads with `--resume --fork-session`. Surfaced three cache-fix proxy-mode bugs: the resume-marker regex no-op (#96), TTL tier detection gap vs preload mode (#97), and image-strip stderr leak past `CACHE_FIX_DEBUG` (#98) — all addressed in the v3.4.0 release.
 
 ## Contributors
 
 - **[@VictorSun92](https://github.com/VictorSun92)** — Original monkey-patch fix for v2.1.88, identified partial scatter on v2.1.90, contributed forward-scan detection, correct block ordering, tighter block matchers, and the optional output-efficiency rewrite hook
-- **[@bilby91](https://github.com/bilby91)** ([Crunchloop DAP](https://dap.crunchloop.ai)) — Agent SDK / DAP production environment validation, 1h cache TTL confirmation, tool ordering jitter discovery via debug trace (fixed in v1.5.1), fresh-session sort bug discovery via SKILLS SORT diagnostic (fixed in v1.6.2). First production team to roll the interceptor to trunk.
+- **[@bilby91](https://github.com/bilby91)** ([Crunchloop DAP](https://dap.crunchloop.ai)) — Agent SDK / DAP production environment validation, 1h cache TTL confirmation, tool ordering jitter discovery via debug trace (fixed in v1.5.1), fresh-session sort bug discovery via SKILLS SORT diagnostic (fixed in v1.6.2). First production team to roll the interceptor to trunk. Designed and contributed the embeddable proxy factory (`startProxy()` / `createProxyServer()`) shipped in v3.6.0 (PR #123).
 - **[@jmarianski](https://github.com/jmarianski)** — Root cause analysis via MITM proxy capture and Ghidra reverse engineering, multi-mode cache test script
 - **[@cnighswonger](https://github.com/cnighswonger)** — Fingerprint stabilization, tool ordering fix, image stripping, monitoring features, overage TTL downgrade discovery, proxy architecture, package maintainer
 - **[@ArkNill](https://github.com/ArkNill)** — Microcompact mechanism analysis, GrowthBook flag documentation, false rate limiter identification, fingerprint verification fix for CC v2.1.108+ (PR #21), Korean README (PR #22), [claude-code-hidden-problem-analysis](https://github.com/ArkNill/claude-code-hidden-problem-analysis) research
@@ -662,6 +695,7 @@ We monitor 30+ upstream Claude Code issues related to cache, quota, and context
 - **[@X-15](https://github.com/X-15)** — VS Code extension validation, per-fix health status analysis confirming safety check behavior on v2.1.105 (#16)
 - **[@deafsquad](https://github.com/deafsquad)** — Universal smoosh_split un-smoosh fix (PR #26), source-level function attribution of resume scatter bug (anthropics/claude-code#43657), OTEL telemetry discovery, proposed and built proxy architecture for v3.0.0
 - **[@vmfarms](https://github.com/vmfarms)** — Concurrent multi-runner production validation, surfaced proxy-mode resume-marker regex no-op (#96), TTL tier detection gap (#97), and image-strip stderr leak (#98)
+- **[@ojura](https://github.com/ojura)** — Opus 4.7 thinking-summaries root-cause analysis: filed [anthropics/claude-code#59844](https://github.com/anthropics/claude-code/issues/59844) with the CLI-binary decode (`!getIsNonInteractiveSession()` gate at offset 230510599 in v2.1.142) and the two-stacked-special-cases framing, which made the `thinking-display` extension (v3.6.1) a clean proxy-side complement to the proposed upstream fix
 
 If you contributed to the community effort on these issues and aren't listed here, please open an issue or PR — we want to credit everyone properly.
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "claude-code-cache-fix",
-  "version": "3.6.0",
+  "version": "3.6.1",
   "description": "Cache optimization proxy and interceptor for Claude Code. Fixes prompt cache bugs, stabilizes prefix, reduces quota burn.",
   "type": "module",
   "exports": {

package/proxy/extensions/thinking-display.mjs

@@ -0,0 +1,79 @@
+// thinking-display extension
+//
+// Restores Opus 4.7 thinking summaries in non-interactive CC surfaces
+// (VS Code chat panel, SDK, `claude --print`, anything spawned with
+// `--input-format stream-json`).
+//
+// Background: Anthropic flipped the `thinking.display` default to `"omitted"`
+// on Opus 4.7. CC's CLI propagates `display: "summarized"` only when the
+// session is interactive (the `!getIsNonInteractiveSession()` gate); every
+// non-interactive subprocess gets the API default of omitted thinking, which
+// renders as an empty stub in the IDE. Upstream root cause and patch proposed
+// in anthropics/claude-code#59844 (credit: @ojura).
+//
+// This extension is the proxy-side workaround. When a request has thinking
+// enabled but `display` unset, inject the configured mode at the API
+// boundary. Works on any CC version routed through cache-fix-proxy without
+// waiting for Anthropic to ship the CLI fix.
+//
+// Config (env var; built-in default is "summarized"):
+//   CACHE_FIX_THINKING_DISPLAY=summarized — inject display: "summarized"
+//     (main case; restores summaries in IDE/SDK/--print). DEFAULT.
+//   CACHE_FIX_THINKING_DISPLAY=omitted    — inject display: "omitted"
+//     (force-suppress override; for agent runtimes that don't want thinking
+//     blocks at all, regardless of what their CLI sends)
+//   CACHE_FIX_THINKING_DISPLAY=disabled   — no injection; extension is a no-op
+//
+// Default flipped to "summarized" in v3.6.1 after the cache-prefix test on
+// Opus 4.7 measured 0% absolute drop in steady-state cache_read ratio with
+// injection enabled (well inside the ≤5% "preserved" threshold). Users who
+// want the older "no injection" behavior set CACHE_FIX_THINKING_DISPLAY=disabled.
+
+const MODEL_REGEX = /^claude-opus-4-7/;
+
+function resolveMode() {
+  const v = process.env.CACHE_FIX_THINKING_DISPLAY;
+  if (v === "summarized" || v === "omitted" || v === "disabled") return v;
+  return "summarized";
+}
+
+// Thinking types that produce thinking blocks. CC v2.1.131+ ships
+// `type: "adaptive"` (dynamic-budget mode) by default for the Bun binary's
+// non-interactive paths; older versions and explicit-budget configs may
+// still send `"enabled"`. Both produce the same empty-thinking symptom
+// when `display` is unset on Opus 4.7, so both are in scope.
+const ACTIVE_THINKING_TYPES = new Set(["enabled", "adaptive"]);
+
+function shouldInject(body) {
+  if (!body || typeof body !== "object") return false;
+  if (typeof body.model !== "string") return false;
+  if (!MODEL_REGEX.test(body.model)) return false;
+  if (!body.thinking || typeof body.thinking !== "object") return false;
+  if (!ACTIVE_THINKING_TYPES.has(body.thinking.type)) return false;
+  // Only inject when display is unset. Preserve any explicit user choice
+  // (including explicit "omitted" for compliance opt-out).
+  return body.thinking.display === undefined;
+}
+
+export { MODEL_REGEX, ACTIVE_THINKING_TYPES, resolveMode, shouldInject };
+
+export default {
+  name: "thinking-display",
+  description:
+    "Inject thinking.display on Opus 4.7 requests when unset, to restore " +
+    "thinking summaries lost to CC's non-interactive CLI gate (claude-code#59844)",
+  enabled: false,
+  order: 360,
+
+  async onRequest(ctx) {
+    const mode = resolveMode();
+    if (mode === "disabled") return;
+    if (!shouldInject(ctx.body)) return;
+
+    ctx.body.thinking.display = mode;
+
+    if (ctx.meta) {
+      ctx.meta.thinkingDisplayInjected = mode;
+    }
+  },
+};

package/proxy/extensions.json

@@ -9,6 +9,7 @@
   "content-strip": { "enabled": true, "order": 330 },
   "tool-input-normalize": { "enabled": true, "order": 340 },
   "microcompact-stability": { "enabled": true, "order": 350 },
+  "thinking-display": { "enabled": true, "order": 360 },
   "cache-control-normalize": { "enabled": true, "order": 400 },
   "messages-cache-breakpoint": { "enabled": true, "order": 410 },
   "ttl-management": { "enabled": true, "order": 500 },