pi-cache-optimizer 2.6.9 → 2.6.11

package/README.md

@@ -33,7 +33,7 @@ Pi extension for improving provider-side KV / prompt cache hit rates. It keeps s
 - Adds a session-id `prompt_cache_key` fallback for `openai-completions` / `openai-responses` payloads when no effective key exists.
 - Warns once for third-party OpenAI-compatible proxies missing cache/session-affinity compat flags.
 - Detects Anthropic adaptive thinking models (opus-4.6+, sonnet-4.6+, fable-5+) missing `forceAdaptiveThinking: true` compat.
-- Shows session-scoped footer stats for supported model families.
+- Shows restart-persistent provider/model footer stats for supported model families.
 - Supports optional router-extension integration through versioned global protocols (`Symbol.for("pi.routing.registry.v1")` and `Symbol.for("pi.cache.hints.v1")`) without importing router packages.
 
 Caching is provider-side and best-effort. Third-party proxies and router extensions can still hide cache usage, reject unsupported parameters, or route requests across multiple upstreams.
@@ -59,12 +59,12 @@ On Pi 0.79.7 and newer, `pi update` updates Pi itself only. To update installed
 | Command | Effect |
 |---|---|
 | `/cache-optimizer` | Interactive menu when UI supports it; otherwise prints help and current state. |
-| `/cache-optimizer enable` | Enables runtime optimizations for the current Pi process, resets current-session stats, and starts a fresh “enabled” measurement. |
-| `/cache-optimizer disable` | Disables optimization for the current Pi process, resets current-session stats, and keeps collecting footer stats in disabled comparison mode. Run `/reload` or restart Pi to return to startup behavior. |
+| `/cache-optimizer enable` | Enables runtime optimizations for the current Pi process, resets local footer stats, and starts a fresh “enabled” measurement. |
+| `/cache-optimizer disable` | Disables optimization for the current Pi process, resets local footer stats, and keeps collecting footer stats in disabled comparison mode. Run `/reload` or restart Pi to return to startup behavior. |
 | `/cache-optimizer doctor` | Shows active model/provider/API/base URL/compat plus low-hit diagnosis. |
 | `/cache-optimizer compat` | Shows copyable compat advice for the active model, if applicable. |
-| `/cache-optimizer stats` | Shows today's session-scoped counters and recent trend for the active model. |
-| `/cache-optimizer reset` | Resets only local stats for the active session + model; upstream provider cache is not modified. |
+| `/cache-optimizer stats` | Shows today's local provider/model counters and recent trend for the active model. |
+| `/cache-optimizer reset` | Resets local footer stats for the active provider/model; upstream provider cache is not modified. |
 | `/cache-optimizer fix` | Auto-repairs safe compat issues for the active model (adaptive thinking, DeepSeek reasoning, OpenAI proxy session affinity). Shows preview + risk warning, requires confirmation. **Only modifies `models.json` after explicit user approval.** |
 
 `enable` / `disable` are current-process switches. For a persistent opt-out, use environment variables below.
@@ -214,9 +214,9 @@ If only one model should change, use `modelOverrides`:
 
 ## Footer stats
 
-Stats are read-only local counters stored at `~/.pi/agent/pi-cache-optimizer-stats.json` and scoped by Pi session + provider/model. They contain only dates and numeric counters — no API keys, prompts, payloads, headers, responses, or model output.
+Stats are read-only local counters stored at `~/.pi/agent/pi-cache-optimizer-stats.json` and keyed by provider/model, so the same channel/model keeps today's footer counters after a Pi process or terminal restart. The file also keeps hashed session buckets for migration/reload bookkeeping. It contains only dates and numeric counters — no API keys, prompts, payloads, headers, responses, or model output.
 
-Pi 0.79+ also includes a built-in footer `CH` marker for the latest prompt cache hit rate. This extension complements that marker with persisted, provider/model/session-scoped counters plus proxy compat diagnostics.
+Pi 0.79+ also includes a built-in footer `CH` marker for the latest prompt cache hit rate. This extension complements that marker with persisted provider/model counters plus proxy compat diagnostics.
 
 Example footer:
 

package/README.zh-CN.md

@@ -33,7 +33,7 @@
 - 对 `openai-completions` / `openai-responses` 请求，在没有有效 key 时使用 Pi session id 补 `prompt_cache_key`。
 - 对缺少缓存 / session-affinity compat 的第三方 OpenAI-compatible 代理给出一次性提醒。
 - 检测 Anthropic adaptive thinking 模型（opus-4.6+、sonnet-4.6+、fable-5+）是否缺少 `forceAdaptiveThinking: true` compat。
-- 为支持的模型家族显示按 session 隔离的底部缓存统计。
+- 为支持的模型家族显示可跨 Pi 进程 / 终端重启延续的 provider/model footer 缓存统计。
 - 通过版本化全局协议（`Symbol.for("pi.routing.registry.v1")` 与 `Symbol.for("pi.cache.hints.v1")`）支持可选的 router extension 集成，而不导入任何 router 包。
 
 缓存是 provider 侧的 best-effort 行为。第三方代理和 router extension 仍可能隐藏缓存 usage、拒绝不支持的参数，或把请求路由到多个上游。
@@ -59,12 +59,12 @@ Pi 0.79.7 及之后，`pi update` 默认只更新 Pi 本体。若要更新已安
 | 命令 | 作用 |
 |---|---|
 | `/cache-optimizer` | UI 支持时打开交互菜单；否则打印帮助和当前状态。 |
-| `/cache-optimizer enable` | 在当前 Pi 进程中开启运行时优化，清零当前 session 统计，并开始新的“开启状态”测量。 |
-| `/cache-optimizer disable` | 在当前 Pi 进程中关闭优化，清零当前 session 统计，并继续以 disabled 对比模式采集 footer 统计。运行 `/reload` 或重启 Pi 后回到启动时行为。 |
+| `/cache-optimizer enable` | 在当前 Pi 进程中开启运行时优化，清零本地 footer 统计，并开始新的“开启状态”测量。 |
+| `/cache-optimizer disable` | 在当前 Pi 进程中关闭优化，清零本地 footer 统计，并继续以 disabled 对比模式采集 footer 统计。运行 `/reload` 或重启 Pi 后回到启动时行为。 |
 | `/cache-optimizer doctor` | 显示当前模型 / provider / API / base URL / compat 与低命中诊断。 |
 | `/cache-optimizer compat` | 对当前模型显示可复制的 compat 建议（如适用）。 |
-| `/cache-optimizer stats` | 显示当前模型今天的 session-scoped 统计和近期趋势。 |
-| `/cache-optimizer reset` | 只重置当前 session + 当前模型的本地统计；不会修改上游 provider 缓存。 |
+| `/cache-optimizer stats` | 显示当前模型今天的本地 provider/model 统计和近期趋势。 |
+| `/cache-optimizer reset` | 重置当前 provider/model 的本地 footer 统计；不会修改上游 provider 缓存。 |
 | `/cache-optimizer fix` | 为当前模型自动修复安全的 compat 问题（adaptive thinking、DeepSeek reasoning、OpenAI proxy session affinity）。展示预览 + 风险提示，需要用户确认。**仅在用户明确批准后才修改 `models.json`。** |
 
 `enable` / `disable` 是当前进程内开关。若要持久关闭某些能力，请使用下面的环境变量。
@@ -214,9 +214,9 @@ Provider 级最小 override：
 
 ## Footer 统计
 
-统计是只读本地计数，保存在 `~/.pi/agent/pi-cache-optimizer-stats.json`，按 Pi session + provider/model 隔离。文件只包含日期和数字计数，不包含 API key、prompt、payload、headers、响应或模型输出。
+统计是只读本地计数，保存在 `~/.pi/agent/pi-cache-optimizer-stats.json`，按 provider/model 作为 footer 展示维度，因此同一个渠道/模型在 Pi 进程或终端重启后会延续今天的统计。文件也保留 hashed session buckets，用于迁移和 reload 记录。文件只包含日期和数字计数，不包含 API key、prompt、payload、headers、响应或模型输出。
 
-Pi 0.79+ 已内置 footer `CH` 标记，用于显示最近一次 prompt cache hit rate。本扩展在此基础上补充持久化的 provider/model/session-scoped 计数，以及代理 compat 诊断。
+Pi 0.79+ 已内置 footer `CH` 标记，用于显示最近一次 prompt cache hit rate。本扩展在此基础上补充持久化的 provider/model 计数，以及代理 compat 诊断。
 
 示例 footer：
 

package/index.ts

@@ -247,6 +247,7 @@ type ContextWithOptionalModelRegistry = Pick<ExtensionContext, "sessionManager">
 
 type CacheStatsState = {
   statsByModel: Record<string, CacheStats>;
+  totalsByModel: Record<string, CacheStats>;
   legacyFamily: Partial<Record<CacheProviderId, CacheStats>>;
   lastRoutedModelBySession?: Record<string, PersistedRoutedModelRef>;
 };
@@ -277,6 +278,14 @@ type PersistedCacheStatsV5 = {
   lastRoutedModelBySession?: Record<string, PersistedRoutedModelRef>;
 };
 
+type PersistedCacheStatsV6 = {
+  version: 6;
+  sessions: Record<string, Record<string, CacheStats>>;
+  totalsByModel: Record<string, CacheStats>;
+  legacyFamily: Partial<Record<CacheProviderId, CacheStats>>;
+  lastRoutedModelBySession?: Record<string, PersistedRoutedModelRef>;
+};
+
 type UsageSnapshot = {
   cacheRead: number;
   cacheWrite: number;
@@ -3426,6 +3435,49 @@ function parseCacheStats(value: unknown): CacheStats | undefined {
   };
 }
 
+function cloneCacheStats(stats: CacheStats): CacheStats {
+  return { ...stats };
+}
+
+function addCacheStatsTotals(target: CacheStats, source: CacheStats): void {
+  target.totalRequests += source.totalRequests;
+  target.hitRequests += source.hitRequests;
+  target.cachedInputTokens += source.cachedInputTokens;
+  target.cacheWriteInputTokens += source.cacheWriteInputTokens;
+  target.totalInputTokens += source.totalInputTokens;
+}
+
+function mergeCacheStatsForTotal(existing: CacheStats | undefined, incoming: CacheStats): CacheStats {
+  if (!existing) return cloneCacheStats(incoming);
+  if (incoming.day > existing.day) return cloneCacheStats(incoming);
+  if (incoming.day < existing.day) return existing;
+  addCacheStatsTotals(existing, incoming);
+  return existing;
+}
+
+function deriveTotalsByModelFromSessionStats(statsByModel: Record<string, CacheStats>): Record<string, CacheStats> {
+  const totals: Record<string, CacheStats> = {};
+  for (const [fullKey, stats] of Object.entries(statsByModel)) {
+    totals[modelKeyFromSessionKey(fullKey)] = mergeCacheStatsForTotal(
+      totals[modelKeyFromSessionKey(fullKey)],
+      stats,
+    );
+  }
+  return totals;
+}
+
+function parsePersistedTotalsByModel(value: unknown): Record<string, CacheStats> | undefined {
+  const record = asRecord(value);
+  if (!record) return undefined;
+
+  const totals: Record<string, CacheStats> = {};
+  for (const [modelKeyStr, rawStats] of Object.entries(record)) {
+    const stats = parseCacheStats(rawStats);
+    if (stats) totals[modelKeyStr] = stats;
+  }
+  return totals;
+}
+
 function parsePersistedRoutedModelRef(value: unknown): PersistedRoutedModelRef | undefined {
   const record = asRecord(value);
   const provider = record?.provider;
@@ -3459,6 +3511,7 @@ function buildExactRouterStatusEntry(
   sessionHash: string | undefined,
   statsByModel: Record<string, CacheStats>,
   lastRoutedModel: PersistedRoutedModelRef | undefined,
+  totalsByModel: Record<string, CacheStats> = {},
 ): { model: PiModel; adapter: CacheProviderAdapter; stats: CacheStats } | undefined {
   if (!sessionHash || !lastRoutedModel) return undefined;
 
@@ -3467,17 +3520,20 @@ function buildExactRouterStatusEntry(
   if (!adapter) return undefined;
 
   const key = makeSessionModelKey(sessionHash, lastRoutedModel.provider, lastRoutedModel.id);
-  return { model, adapter, stats: statsByModel[key] ?? emptyCacheStats() };
+  return { model, adapter, stats: totalsByModel[modelKey(model)] ?? statsByModel[key] ?? emptyCacheStats() };
 }
 
 function parsePersistedCacheStats(value: unknown): CacheStatsState | undefined {
   const record = asRecord(value);
   if (!record) return undefined;
 
-  // version 4/5: session-scoped stats + legacy family fallback.
+  // version 4/5/6: session-scoped stats + legacy family fallback.
   // v5 additionally persists the last actual routed model per session so
   // router/auto can restore the exact upstream footer after /reload.
-  if (record.version === 4 || record.version === 5) {
+  // v6 adds provider/model totals used for footer continuity across Pi
+  // process/terminal restarts, while retaining session buckets for migration
+  // and best-effort preservation of older data.
+  if (record.version === 4 || record.version === 5 || record.version === 6) {
     const legacyFamily: Partial<Record<CacheProviderId, CacheStats>> = {};
     const rawFamily = asRecord(record.legacyFamily);
     if (rawFamily) {
@@ -3514,7 +3570,10 @@ function parsePersistedCacheStats(value: unknown): CacheStatsState | undefined {
       }
     }
 
-    return { statsByModel, legacyFamily, lastRoutedModelBySession };
+    const parsedTotals = parsePersistedTotalsByModel(record.totalsByModel);
+    const totalsByModel = parsedTotals ?? deriveTotalsByModelFromSessionStats(statsByModel);
+
+    return { statsByModel, totalsByModel, legacyFamily, lastRoutedModelBySession };
   }
 
   // version 3: migrate to v4/v5 semantics by wrapping statsByModel into sessions
@@ -3537,7 +3596,7 @@ function parsePersistedCacheStats(value: unknown): CacheStatsState | undefined {
       }
     }
 
-    return { statsByModel, legacyFamily };
+    return { statsByModel, totalsByModel: deriveTotalsByModelFromSessionStats(statsByModel), legacyFamily };
   }
 
   // version 2: migrate statsByProvider into legacyFamily
@@ -3550,13 +3609,13 @@ function parsePersistedCacheStats(value: unknown): CacheStatsState | undefined {
         if (stats) legacyFamily[id] = stats;
       }
     }
-    return { statsByModel: {}, legacyFamily };
+    return { statsByModel: {}, totalsByModel: {}, legacyFamily };
   }
 
   // version 1: single DeepSeek stats -> migrate to legacyFamily.deepseek
   if (record.version === 1) {
     const migrated = parseCacheStats(record.stats);
-    return migrated ? { statsByModel: {}, legacyFamily: { deepseek: migrated } } : undefined;
+    return migrated ? { statsByModel: {}, totalsByModel: {}, legacyFamily: { deepseek: migrated } } : undefined;
   }
 
   return undefined;
@@ -3711,6 +3770,20 @@ function mergeCacheSessions(
   return sessions;
 }
 
+function mergeCacheTotals(
+  existingTotalsByModel: Record<string, CacheStats>,
+  stateTotalsByModel: Record<string, CacheStats>,
+  options: { deleteModelKeys?: string[]; replaceTotals?: boolean } = {},
+): Record<string, CacheStats> {
+  const totals = options.replaceTotals
+    ? { ...stateTotalsByModel }
+    : { ...existingTotalsByModel, ...stateTotalsByModel };
+  for (const key of options.deleteModelKeys ?? []) {
+    delete totals[key];
+  }
+  return totals;
+}
+
 function mergeLastRoutedModels(
   existingLastRoutedModelBySession: Record<string, PersistedRoutedModelRef>,
   state: CacheStatsState,
@@ -3737,11 +3810,16 @@ function mergeLastRoutedModels(
   return merged;
 }
 
-async function writePersistedCacheStats(state: CacheStatsState, currentSessionHash?: string): Promise<void> {
+async function writePersistedCacheStats(
+  state: CacheStatsState,
+  currentSessionHash?: string,
+  options: { deleteModelKeys?: string[]; replaceTotals?: boolean } = {},
+): Promise<void> {
   await mkdir(STATE_DIR, { recursive: true });
 
   // Read existing file to preserve other sessions' data.
   let existingSessions: Record<string, Record<string, CacheStats>> = {};
+  let existingTotalsByModel: Record<string, CacheStats> = {};
   let existingLastRoutedModelBySession: Record<string, PersistedRoutedModelRef> = {};
   try {
     const raw = await readFile(STATE_FILE_PATH, "utf8");
@@ -3758,6 +3836,7 @@ async function writePersistedCacheStats(state: CacheStatsState, currentSessionHa
           existingSessions[hash][modelKey] = stats;
         }
       }
+      existingTotalsByModel = { ...(parsed.totalsByModel ?? {}) };
       existingLastRoutedModelBySession = { ...(parsed.lastRoutedModelBySession ?? {}) };
     }
   } catch {
@@ -3765,15 +3844,17 @@ async function writePersistedCacheStats(state: CacheStatsState, currentSessionHa
   }
 
   const sessions = mergeCacheSessions(existingSessions, state, currentSessionHash);
+  const totalsByModel = mergeCacheTotals(existingTotalsByModel, state.totalsByModel, options);
   const lastRoutedModelBySession = mergeLastRoutedModels(
     existingLastRoutedModelBySession,
     state,
     currentSessionHash,
   );
 
-  const payload: PersistedCacheStatsV5 = {
-    version: 5,
+  const payload: PersistedCacheStatsV6 = {
+    version: 6,
     sessions,
+    totalsByModel,
     legacyFamily: state.legacyFamily,
     ...(Object.keys(lastRoutedModelBySession).length > 0 ? { lastRoutedModelBySession } : {}),
   };
@@ -4833,6 +4914,19 @@ function composeMissingEntryInsertion(
   modelId: string,
   compatKeys: Record<string, unknown>,
 ): { modifiedText: string; placementLabel: string } {
+  // Comments preserve length when stripped (`stripJsoncComments` replaces
+  // comment bytes 1-for-1 with spaces), so offsets derived from the
+  // comment-stripped text map cleanly back to the original. However,
+  // `lastIndexOf("{", pos)` / `lastIndexOf("[", pos)` must NOT be run
+  // against the raw original: a comment like `// add [more] here with a {
+  // brace` would surface `[` / `{` bytes that have no structural meaning,
+  // contaminating the `hasExisting`/`hasExistingElements` decision below
+  // and producing a stray leading comma. Run the structural searches
+  // against the comment-stripped version; keep the indentation lookups
+  // (which only care about newlines + leading whitespace) on the
+  // original since comments never contain forward-scan-relevant bytes.
+  const cleanText = stripJsoncComments(originalText);
+
   // Resolve a sensible indentation step from an arbitrary byte offset in
   // the original file.
   const indentUnitAt = (offset: number): string => {
@@ -4867,9 +4961,11 @@ function composeMissingEntryInsertion(
     const inner1 = inner0 + unit; // indent of compat keys inside the model
     const inner2 = inner1 + unit; // indent of compat values
 
-    // Determine whether the array is empty (need to skip the leading newline).
-    const arrayInterior = originalText.slice(
-      originalText.lastIndexOf("[", diagnosis.modelsEnd) + 1,
+    // Determine whether the array is empty (need to skip the leading comma).
+    // Search for the models `[` on the comment-stripped text so a `[` inside
+    // a comment cannot be mistaken for the array opener.
+    const arrayInterior = cleanText.slice(
+      cleanText.lastIndexOf("[", diagnosis.modelsEnd) + 1,
       diagnosis.modelsEnd,
     ).trim();
     const hasExistingElements = arrayInterior.length > 0;
@@ -4903,8 +4999,10 @@ function composeMissingEntryInsertion(
     const inner3 = inner2 + unit;
 
     const compatBlock = formatCompactCompat(inner3);
-    const providersInterior = originalText.slice(
-      originalText.lastIndexOf("{", diagnosis.providersEnd) + 1,
+    // Search for the providers `{` on the comment-stripped text so a `{`
+    // inside a comment cannot be mistaken for the providers object opener.
+    const providersInterior = cleanText.slice(
+      cleanText.lastIndexOf("{", diagnosis.providersEnd) + 1,
       diagnosis.providersEnd,
     ).trim();
     const hasExisting = providersInterior.length > 0;
@@ -5279,6 +5377,7 @@ function selfCheckFix(
   providerLabel: string,
   modelId: string,
   compatKeys: Record<string, unknown>,
+  placement: "provider" | "model" = "model",
 ): string | null {
   try {
     // Step 1: Parse both versions as JSONC (comments + trailing commas allowed).
@@ -5371,7 +5470,18 @@ function selfCheckFix(
           } else {
             const origCompat = origObj[key] as Record<string, unknown>;
             const modCompat = modObj[key] as Record<string, unknown>;
-            const mayRepairThisCompat = origObj === origProvider || origObj === origTargetModelRecord;
+            // Only the compat object at the level ACTUALLY edited may have
+            // its values repaired by this fix. The un-edited level must
+            // remain byte/structure-equivalent, so its same-name keys stay
+            // under full validation. Using a disjunction OR (provider ||
+            // target) here would silently skip validation at the un-edited
+            // level, masking corruption (e.g. a buggy editor accidentally
+            // breaking provider.compat.sendSessionAffinityHeaders while
+            // the fix was a model-level repair). Track placement — only
+            // the placement-resolved object's own compat may be exempt.
+            const mayRepairThisCompat =
+              (placement === "provider" && origObj === origProvider) ||
+              (placement === "model" && origObj === origTargetModelRecord);
             for (const ck of Object.keys(origCompat)) {
               if (!(ck in modCompat)) return false;
               // The fix may repair an existing wrong compat value (for example
@@ -5393,12 +5503,15 @@ function selfCheckFix(
       return "Modified file: original structure was altered (data loss detected)";
     }
 
-    // Step 8: Basic format sanity checks
-    if (modified.length < original.length) {
-      return "Modified file: content is shorter than original (possible truncation)";
-    }
+    // Note: we intentionally do NOT enforce `modified.length >= original.length`.
+    // The surgical editor may replace an existing compat value with a shorter one
+    // (e.g. `false` -> `true`), which legitimately shrinks the file by a byte.
+    // Real data loss / truncation is already caught by Step 7's isSubset
+    // (every original key still present) and Step 8's root-bracket integrity
+    // check below — a surviving length heuristic would false-positive on every
+    // such value repair. (Tracked: the mofas glm-5.2 self-check failure path.)
 
-    // Step 9: Validate root bracket integrity with the same string/comment-aware
+    // Step 8: Validate root bracket integrity with the same string/comment-aware
     // scanner used for edits. Do not count raw braces: comments or strings may
     // legitimately contain unmatched `{` / `}` bytes.
     const modifiedClean = stripJsoncComments(modified);
@@ -5628,6 +5741,8 @@ export const __internals_for_tests = {
   emptyAllCacheStats,
   parseCacheStats,
   parsePersistedCacheStats,
+  deriveTotalsByModelFromSessionStats,
+  parsePersistedTotalsByModel,
   // Recent sample / stats output / diagnosis helpers
   MAX_RECENT_SAMPLES,
   buildStatsOutput,
@@ -5659,6 +5774,7 @@ export const __internals_for_tests = {
   getCacheHintsService,
   // Persistence helpers (for reload/reset tests)
   mergeCacheSessions,
+  mergeCacheTotals,
   mergeLastRoutedModels,
   writePersistedCacheStats,
   readPersistedCacheStats,
@@ -5673,6 +5789,9 @@ export const __internals_for_tests = {
   locateModelInJsonc,
   composeFixInsertion,
   selfCheckFix,
+  analyzeModelsJsonForMissingEntry,
+  composeMissingEntryInsertion,
+  selfCheckMissingEntryInsertion,
   decideFixPlacement,
   chooseFixPlacement,
   findExistingCompatKeysInJsonc,
@@ -5695,10 +5814,13 @@ export default function (pi: ExtensionAPI) {
   const promptCacheRetention400Models = new Set<string>();
   const warnedPromptCacheRetention400Models = new Set<string>();
   let cacheStatsByModel: Record<string, CacheStats> = {};
+  let cacheStatsTotalsByModel: Record<string, CacheStats> = {};
   let cacheStatsLegacyFamily: Partial<Record<CacheProviderId, CacheStats>> = emptyAllCacheStats();
   let lastStatusText: string | undefined;
   let persistenceWarningShown = false;
   let persistTimer: ReturnType<typeof setTimeout> | null = null;
+  let replacePersistedTotalsOnNextWrite = false;
+  const pendingDeletedTotalModelKeys = new Set<string>();
   let integrityNotificationShown = false;
   let currentSessionId = "";
   let currentSessionHash = "";
@@ -5789,6 +5911,7 @@ export default function (pi: ExtensionAPI) {
   function getCacheStatsState(): CacheStatsState {
     return {
       statsByModel: cacheStatsByModel,
+      totalsByModel: cacheStatsTotalsByModel,
       legacyFamily: cacheStatsLegacyFamily,
       ...(currentSessionHashSet && lastActualRoutedModel
         ? { lastRoutedModelBySession: { [currentSessionHash]: lastActualRoutedModel } }
@@ -5796,16 +5919,15 @@ export default function (pi: ExtensionAPI) {
     };
   }
 
-  /** Look up active stats for a model, falling back to legacy family. */
+  /** Look up visible cumulative stats for a model, falling back to legacy family. */
   function getStatsForModel(model: PiModel | undefined, adapter: CacheProviderAdapter): CacheStats {
     if (model) {
-      const key = sessionModelKey(model);
-      const existing = cacheStatsByModel[key];
+      const key = modelKey(model);
+      const existing = cacheStatsTotalsByModel[key];
       if (existing) return existing;
     }
 
-    // Fallback: legacy family bucket — used when model key is unknown
-    // or this model hasn't been seen yet in this session.
+    // Fallback: legacy family bucket — used when model key is unknown.
     const family = cacheStatsLegacyFamily[adapter.id];
     if (family) return family;
 
@@ -5814,7 +5936,7 @@ export default function (pi: ExtensionAPI) {
     return created;
   }
 
-  /** Get or create a stats entry for the given model key. */
+  /** Get or create a session-scoped stats entry for the given key. */
   function getOrCreateStatsByModelKey(key: string): CacheStats {
     const existing = cacheStatsByModel[key];
     if (existing) return existing;
@@ -5824,10 +5946,27 @@ export default function (pi: ExtensionAPI) {
     return created;
   }
 
+  /** Get or create the cumulative provider/model stats entry shown in the footer. */
+  function getOrCreateTotalStatsForModel(model: PiModel): CacheStats {
+    const key = modelKey(model);
+    const existing = cacheStatsTotalsByModel[key];
+    if (existing) return existing;
+
+    const created = emptyCacheStats();
+    cacheStatsTotalsByModel[key] = created;
+    return created;
+  }
+
   function resetStatsForModel(model: PiModel): void {
-    const sk = sessionModelKey(model);
-    delete cacheStatsByModel[sk];
-    recentSamplesByModelKey.delete(sk);
+    const displayKey = modelKey(model);
+    for (const key of Object.keys(cacheStatsByModel)) {
+      if (modelKeyFromSessionScoped(key) === displayKey) delete cacheStatsByModel[key];
+    }
+    delete cacheStatsTotalsByModel[displayKey];
+    pendingDeletedTotalModelKeys.add(displayKey);
+    for (const key of Array.from(recentSamplesByModelKey.keys())) {
+      if (modelKeyFromSessionScoped(key) === displayKey) recentSamplesByModelKey.delete(key);
+    }
     lastStatusText = undefined;
   }
 
@@ -5836,6 +5975,8 @@ export default function (pi: ExtensionAPI) {
     for (const key of Object.keys(cacheStatsByModel)) {
       if (key.startsWith(prefix)) delete cacheStatsByModel[key];
     }
+    cacheStatsTotalsByModel = {};
+    replacePersistedTotalsOnNextWrite = true;
     for (const key of Array.from(recentSamplesByModelKey.keys())) {
       if (key.startsWith(prefix)) recentSamplesByModelKey.delete(key);
     }
@@ -5845,7 +5986,16 @@ export default function (pi: ExtensionAPI) {
 
   async function persistCacheStats(ctx?: ExtensionContext): Promise<void> {
     try {
-      await writePersistedCacheStats(getCacheStatsState(), currentSessionHashSet ? currentSessionHash : undefined);
+      await writePersistedCacheStats(
+        getCacheStatsState(),
+        currentSessionHashSet ? currentSessionHash : undefined,
+        {
+          deleteModelKeys: Array.from(pendingDeletedTotalModelKeys),
+          replaceTotals: replacePersistedTotalsOnNextWrite,
+        },
+      );
+      pendingDeletedTotalModelKeys.clear();
+      replacePersistedTotalsOnNextWrite = false;
     } catch (error) {
       console.warn(`${LOG_PREFIX}: failed to persist cache stats`, error);
       if (!persistenceWarningShown) {
@@ -5895,6 +6045,15 @@ export default function (pi: ExtensionAPI) {
       }
     }
 
+    // Roll over cumulative provider/model totals.
+    for (const key of Object.keys(cacheStatsTotalsByModel)) {
+      const stats = cacheStatsTotalsByModel[key];
+      if (stats && stats.day !== day) {
+        cacheStatsTotalsByModel[key] = emptyCacheStats(day);
+        changed = true;
+      }
+    }
+
     // Roll over legacy family entries.
     for (const id of CACHE_PROVIDER_IDS) {
       const stats = cacheStatsLegacyFamily[id];
@@ -5927,6 +6086,7 @@ export default function (pi: ExtensionAPI) {
         persisted,
         currentSessionHashSet ? currentSessionHash : undefined,
       );
+      cacheStatsTotalsByModel = persisted?.totalsByModel ?? {};
       cacheStatsLegacyFamily = persisted?.legacyFamily ?? emptyAllCacheStats();
       lastActualRoutedModel = currentSessionHashSet
         ? persisted?.lastRoutedModelBySession?.[currentSessionHash]
@@ -5944,6 +6104,7 @@ export default function (pi: ExtensionAPI) {
       persisted,
       currentSessionHashSet ? currentSessionHash : undefined,
     );
+    cacheStatsTotalsByModel = persisted?.totalsByModel ?? {};
     cacheStatsLegacyFamily = persisted?.legacyFamily ?? emptyAllCacheStats();
     lastActualRoutedModel = currentSessionHashSet
       ? persisted?.lastRoutedModelBySession?.[currentSessionHash]
@@ -5961,15 +6122,9 @@ export default function (pi: ExtensionAPI) {
    * meaningful footer content on session_start after reload.
    */
   function findBestRouterModelStats(): { adapter: CacheProviderAdapter; stats: CacheStats } | undefined {
-    if (!currentSessionHash) return undefined;
-    const prefix = `${currentSessionHash}:`;
     let best: { adapter: CacheProviderAdapter; stats: CacheStats; total: number } | undefined;
 
-    for (const [key, stats] of Object.entries(cacheStatsByModel)) {
-      if (!key.startsWith(prefix)) continue;
-
-      // Extract provider/id from key like "abc123:run-claude/claude-opus-4-8"
-      const modelKeyPart = key.slice(prefix.length);
+    for (const [modelKeyPart, stats] of Object.entries(cacheStatsTotalsByModel)) {
       const slashIdx = modelKeyPart.indexOf("/");
       if (slashIdx < 0 || slashIdx >= modelKeyPart.length - 1) continue;
       const modelId = modelKeyPart.slice(slashIdx + 1);
@@ -6023,6 +6178,7 @@ export default function (pi: ExtensionAPI) {
         currentSessionHashSet ? currentSessionHash : undefined,
         cacheStatsByModel,
         lastActualRoutedModel,
+        cacheStatsTotalsByModel,
       ) ?? findBestRouterModelStats();
       if (realEntry) {
         const statsText = formatCacheStats(realEntry.adapter, realEntry.stats);
@@ -6033,11 +6189,10 @@ export default function (pi: ExtensionAPI) {
     }
 
     if (adapter) {
-      // Display session-scoped stats. A model that has never been used
-      // in this session shows 0/0. The message_end hook populates
-      // cacheStatsByModel[sessionModelKey(displayModel)] on first use.
-      const sk = displayModel ? sessionModelKey(displayModel) : undefined;
-      const stats = sk ? cacheStatsByModel[sk] : undefined;
+      // Display provider/model cumulative stats. A model that has never
+      // been used locally shows 0/0. The message_end hook updates both the
+      // current session bucket and this restart-persistent totals bucket.
+      const stats = displayModel ? cacheStatsTotalsByModel[modelKey(displayModel)] : undefined;
       const statsText = formatCacheStats(adapter, stats ?? emptyCacheStats());
       statusText = runtimeOptimizerEnabled ? statsText : `Cache Optimizer disabled · ${statsText}`;
     }
@@ -6371,6 +6526,7 @@ export default function (pi: ExtensionAPI) {
     if (statsModel) {
       const sk = sessionModelKey(statsModel);
       addUsageToCacheStats(getOrCreateStatsByModelKey(sk), usage);
+      addUsageToCacheStats(getOrCreateTotalStatsForModel(statsModel), usage);
     } else {
       addUsageToCacheStats(getStatsForModel(undefined, adapter), usage);
     }
@@ -6389,7 +6545,7 @@ export default function (pi: ExtensionAPI) {
   //   stats   — show active model stats bucket, recent trend, usage
   //   compat  — show compat suggestion with file path
   //   fix     — auto-fix compat issues (writes models.json, requires UI)
-  //   reset   — reset current session model stats bucket (local only)
+  //   reset   — reset current provider/model footer stats bucket (local only)
   //   (no args) — interactive menu (with UI) or help summary
   // ────────────────────────────────────────────────────────────────
   pi.registerCommand("cache-optimizer", {
@@ -6405,13 +6561,13 @@ export default function (pi: ExtensionAPI) {
         resetCurrentSessionStats();
         await flushPersistCacheStats(cmdCtx as unknown as ExtensionContext);
         await publishStatus(cmdCtx as unknown as ExtensionContext, model);
-        cmdCtx.ui.notify(`✅ Pi Cache Optimizer enabled for this Pi process. Current-session stats were reset for before/after comparison.\n${formatOptimizerRuntimeMode()}`, "info");
+        cmdCtx.ui.notify(`✅ Pi Cache Optimizer enabled for this Pi process. Local footer stats were reset for before/after comparison.\n${formatOptimizerRuntimeMode()}`, "info");
       } else if (subcommand === "disable") {
         setRuntimeOptimizerEnabled(false);
         resetCurrentSessionStats();
         await flushPersistCacheStats(cmdCtx as unknown as ExtensionContext);
         await publishStatus(cmdCtx as unknown as ExtensionContext, model);
-        cmdCtx.ui.notify(`⏸️ Pi Cache Optimizer disabled for this Pi process. Current-session stats were reset and will keep collecting while disabled for comparison.\n${formatOptimizerRuntimeMode()}`, "warning");
+        cmdCtx.ui.notify(`⏸️ Pi Cache Optimizer disabled for this Pi process. Local footer stats were reset and will keep collecting while disabled for comparison.\n${formatOptimizerRuntimeMode()}`, "warning");
       } else if (subcommand === "doctor") {
         if (!model) {
           cmdCtx.ui.notify("No active model selected. Select a model first with /model or pi --model.", "warning");
@@ -6420,7 +6576,7 @@ export default function (pi: ExtensionAPI) {
         const diagnosis = buildDoctorDiagnosis(model, { promptCacheRetention400: promptCacheRetention400Models.has(modelKey(model)) });
         const adapter = selectAdapterForModel(model);
         const sk = model ? sessionModelKey(model) : undefined;
-        const statsState = sk ? cacheStatsByModel[sk] : undefined;
+        const statsState = model ? cacheStatsTotalsByModel[modelKey(model)] : undefined;
         const samples = sk ? getRecentSamples(sk) : [];
         const lowHitLines = buildLowHitDiagnosis(model, adapter, statsState, samples);
         const fullDiagnosis = lowHitLines.length > 0
@@ -6434,7 +6590,7 @@ export default function (pi: ExtensionAPI) {
         }
         const adapter = selectAdapterForModel(model);
         const sk = model ? sessionModelKey(model) : undefined;
-        const statsState = sk ? cacheStatsByModel[sk] : undefined;
+        const statsState = model ? cacheStatsTotalsByModel[modelKey(model)] : undefined;
         const samples = sk ? getRecentSamples(sk) : [];
         const output = buildStatsOutput(model, adapter, statsState, samples);
         cmdCtx.ui.notify(output, "info");
@@ -6467,7 +6623,7 @@ export default function (pi: ExtensionAPI) {
 
         const displayKey = modelKey(model);
 
-        // Reset session-scoped stats for the effective active model. If the
+        // Reset local footer stats for the effective active model. If the
         // selected model is a virtual router and the protocol exposes a live
         // route, this clears the real upstream bucket, not the router shell.
         resetStatsForModel(model);
@@ -6479,9 +6635,9 @@ export default function (pi: ExtensionAPI) {
         await publishStatus(cmdCtx as unknown as ExtensionContext, model);
 
         cmdCtx.ui.notify(
-          `✅ Reset local session cache stats for "${displayKey}". ` +
+          `✅ Reset local footer cache stats for "${displayKey}". ` +
           "Upstream provider prompt cache was not modified. " +
-          "New requests will start a fresh stats bucket for this Pi session.",
+          "New requests will start a fresh local stats bucket for this provider/model.",
           "info",
         );
       } else if (subcommand === "fix") {
@@ -6692,7 +6848,7 @@ export default function (pi: ExtensionAPI) {
         const modifiedText = composeFixInsertion(originalText, location, suggestion.compatKeys, decision.placement);
 
         // Self-check
-        const checkError = selfCheckFix(originalText, modifiedText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys);
+        const checkError = selfCheckFix(originalText, modifiedText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys, decision.placement);
         if (checkError !== null) {
           cmdCtx.ui.notify(
             `❌ Self-check failed before write: ${checkError}\n` +
@@ -6761,7 +6917,7 @@ export default function (pi: ExtensionAPI) {
 
           // Post-write self-check (read back)
           const writtenText = await readFile(MODELS_JSON_PATH, "utf8");
-          const postCheckError = selfCheckFix(originalText, writtenText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys);
+          const postCheckError = selfCheckFix(originalText, writtenText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys, decision.placement);
           if (postCheckError !== null) {
             // Restore from backup
             await copyFile(backupPath, MODELS_JSON_PATH);
@@ -6796,7 +6952,7 @@ export default function (pi: ExtensionAPI) {
             "Stats — Show cache stats and trend",
             "Compat — Show compat suggestion",
             "Fix — Auto-fix compat issues (writes models.json)",
-            "Reset — Reset local session stats",
+            "Reset — Reset local provider/model stats",
             "Cancel",
           ];
           const choice = await cmdCtx.ui.select("Cache Optimizer", menuOptions);
@@ -6805,13 +6961,13 @@ export default function (pi: ExtensionAPI) {
             resetCurrentSessionStats();
             await flushPersistCacheStats(cmdCtx as unknown as ExtensionContext);
             await publishStatus(cmdCtx as unknown as ExtensionContext, model);
-            cmdCtx.ui.notify(`✅ Pi Cache Optimizer enabled for this Pi process. Current-session stats were reset for before/after comparison.\n${formatOptimizerRuntimeMode()}`, "info");
+            cmdCtx.ui.notify(`✅ Pi Cache Optimizer enabled for this Pi process. Local footer stats were reset for before/after comparison.\n${formatOptimizerRuntimeMode()}`, "info");
           } else if (choice === menuOptions[1]) {
             setRuntimeOptimizerEnabled(false);
             resetCurrentSessionStats();
             await flushPersistCacheStats(cmdCtx as unknown as ExtensionContext);
             await publishStatus(cmdCtx as unknown as ExtensionContext, model);
-            cmdCtx.ui.notify(`⏸️ Pi Cache Optimizer disabled for this Pi process. Current-session stats were reset and will keep collecting while disabled for comparison.\n${formatOptimizerRuntimeMode()}`, "warning");
+            cmdCtx.ui.notify(`⏸️ Pi Cache Optimizer disabled for this Pi process. Local footer stats were reset and will keep collecting while disabled for comparison.\n${formatOptimizerRuntimeMode()}`, "warning");
           } else if (choice === menuOptions[2]) {
             if (!model) {
               cmdCtx.ui.notify("No active model selected. Select a model first with /model or pi --model.", "warning");
@@ -6819,7 +6975,7 @@ export default function (pi: ExtensionAPI) {
               const diagnosis = buildDoctorDiagnosis(model, { promptCacheRetention400: promptCacheRetention400Models.has(modelKey(model)) });
               const adapter = selectAdapterForModel(model);
               const sk = model ? sessionModelKey(model) : undefined;
-              const statsState = sk ? cacheStatsByModel[sk] : undefined;
+              const statsState = model ? cacheStatsTotalsByModel[modelKey(model)] : undefined;
               const samples = sk ? getRecentSamples(sk) : [];
               const lowHitLines = buildLowHitDiagnosis(model, adapter, statsState, samples);
               const fullDiagnosis = lowHitLines.length > 0
@@ -6833,7 +6989,7 @@ export default function (pi: ExtensionAPI) {
             } else {
               const adapter = selectAdapterForModel(model);
               const sk = model ? sessionModelKey(model) : undefined;
-              const statsState = sk ? cacheStatsByModel[sk] : undefined;
+              const statsState = model ? cacheStatsTotalsByModel[modelKey(model)] : undefined;
               const samples = sk ? getRecentSamples(sk) : [];
               const output = buildStatsOutput(model, adapter, statsState, samples);
               cmdCtx.ui.notify(output, "info");
@@ -6890,7 +7046,7 @@ export default function (pi: ExtensionAPI) {
 
             const menuDecision = chooseFixPlacement(originalText, location, suggestion.compatKeys, suggestion.providerLabel);
             const modifiedText = composeFixInsertion(originalText, location, suggestion.compatKeys, menuDecision.placement);
-            const checkError = selfCheckFix(originalText, modifiedText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys);
+            const checkError = selfCheckFix(originalText, modifiedText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys, menuDecision.placement);
             if (checkError !== null) {
               cmdCtx.ui.notify(`❌ Self-check failed: ${checkError}\nNo changes made.`, "error");
               return;
@@ -6936,7 +7092,7 @@ export default function (pi: ExtensionAPI) {
               await rename(tempPath, MODELS_JSON_PATH);
 
               const writtenText = await readFile(MODELS_JSON_PATH, "utf8");
-              const postCheck = selfCheckFix(originalText, writtenText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys);
+              const postCheck = selfCheckFix(originalText, writtenText, suggestion.providerLabel, suggestion.modelId, suggestion.compatKeys, menuDecision.placement);
               if (postCheck !== null) {
                 await copyFile(backupPath, MODELS_JSON_PATH);
                 cmdCtx.ui.notify(`❌ Post-write check failed: ${postCheck}\nBackup restored.`, "error");
@@ -6968,7 +7124,7 @@ export default function (pi: ExtensionAPI) {
                 await flushPersistCacheStats(cmdCtx as unknown as ExtensionContext);
                 await publishStatus(cmdCtx as unknown as ExtensionContext, model);
                 cmdCtx.ui.notify(
-                  `✅ Reset local session cache stats for "${displayKey}". ` +
+                  `✅ Reset local footer cache stats for "${displayKey}". ` +
                   "Upstream provider prompt cache was not modified.",
                   "info",
                 );
@@ -6988,7 +7144,7 @@ export default function (pi: ExtensionAPI) {
         diagnosis.push("  stats   — Show active model stats bucket and recent trend");
         diagnosis.push("  compat  — Show compat suggestion with edit location");
         diagnosis.push("  fix     — Auto-fix compat issues (writes models.json, requires UI)");
-        diagnosis.push("  reset   — Reset local session stats for current model (does not affect upstream)");
+        diagnosis.push("  reset   — Reset local provider/model stats for current model (does not affect upstream)");
         diagnosis.push("");
         diagnosis.push(formatOptimizerRuntimeMode());
         diagnosis.push("");

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "pi-cache-optimizer",
-  "version": "2.6.9",
+  "version": "2.6.11",
   "description": "Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.",
   "keywords": [
     "pi-package",