dsh-all-usage 1.1.9 → 1.1.10

package/CHANGELOG.md

@@ -2,6 +2,22 @@
 
 All notable changes to `dsh-all-usage` are documented here.
 
+## [1.1.10] - 2026-09-14
+
+### Fixed
+
+- **The ledger fast path is back.** DSH 0.1.5 renamed `sessionPersistence.listSnapshots()` to `list()`, so the plugin never obtained a per-session revision: `sessionsSkippedByRevision` stayed at 0 and every baseline re-read every session log (431 reads / ~13 minutes for 479 sessions on the maintainer's host). Both spellings are now accepted; against a real 0.1.5 service the plugin reports `persistenceSnapshotsAvailable: true` and skips unchanged sessions again.
+- **A registry change during a baseline is no longer dropped.** `synchronizeWorkspaceRegistry()` returned early while `scan.done` was false, so a workspace added during the (previously very long) scan stayed invisible until the next restart. Such a change is now remembered and replayed as soon as the scan settles.
+
+### Changed
+
+- The workspace registry is additionally polled every 30 seconds, so a missed `domain/changed` event can no longer leave the workspace list stale until a restart.
+- `/api/all-usage/status` exposes `workspaceProbeEvents`, `workspaceSyncRuns`, `workspaceSyncAdded`, `workspaceSyncRemoved` and `workspaceSyncDeferred` (cumulative, not reset by a baseline) so the probe can be verified on a live host.
+
+### Note
+
+- The first start after upgrading still reads every log once: ledger records written before this release carry no `lastRevision`, so the revision comparison has nothing to match against. From the next start on, unchanged sessions are applied from the ledger without re-reading their logs.
+
 ## [1.1.9] - 2026-09-12
 
 ### Fixed

package/README.md

@@ -105,25 +105,11 @@ node scripts/replay-fixture.mjs fixtures/usage-events.json
 
 ### 最近更新
 
-**v1.1.5**
+**v1.1.10**
 
-- **删除工作区不再丢数据**：工作区被删除后，已记录的用量不再从统计中移除，而是与其它已删工作区一起汇总为一行「已删除」（含尚未落账的实时用量）；磁盘账本行保留原工作区 id 与 cwd，因此可逆、可在重启后重建同一个桶。
-- **工作区注册探针**：自动跟随 DSH 工作区注册表（`domain/changed` 事件）；只对新增/删除的工作区增量重扫，未变化工作区直接复用账本，零全量重扫。移除了手动“刷新工作区”按钮与其 `POST /api/all-usage/workspaces/refresh` 路由。
-- **严格注册边界**：统计只包含 cwd 能映射到已注册工作区的会话；未登记目录（即使存在）与历史 `unregistered:` 账本行不再进入统计。已删除工作区的**历史**用量保留（汇总为「已删除」行），但其目录不会再接纳新会话。
-
-**v1.1.4**
-
-- **模型品牌图标**：请求日志、选中调用详情、模型统计表、成本设置匹配表、环形图图例与模型筛选下拉现在显示真实厂商品牌 SVG（DeepSeek、OpenAI、Claude、Gemini、Meta、Zhipu、xAI、Qwen、Doubao、Kimi、MiniMax）；模型命名空间优先于 DSH 供应商名，未知或混牌行保持中性。图标在构建期以 data URI 内嵌并由 scripts/svg-guard.mjs 校验（实体解码、CSS 转义/CDO/命名空间、url()/image-set() 均覆盖，注释与文本不误杀），运行时零网络请求。
-- **构建安全加固**：补齐 CDO/CDC 邻接 at-import、命名空间 style 元素、CSS 转义 url() 与外部 image-set() 四类绕过，并把 CSS 检查收窄到 style 属性与 style 体；对抗用例现在断言拒绝原因。
-- 三张用量仪表盘截图刷新为当前 UI。
-
-**v1.1.3**
-
-- 成本统计支持经验证的 context-tiered 官方费率、可展开费率表和显式价格覆盖。
-- **性能优化**：账本采用稳定分片、dirty flush 合并和 revision 快路径；查询、趋势和固定 53 周热力图改用写入时聚合索引，减少历史扫描、存储写放大和 Dashboard 重渲染。
-- 定价目录、价格同步、模型检索和映射编辑强化确定性与并发刷新边界。
-- 加强非法序列、旧账本、工作区重建、滞后 persistence revision 与复合账本键的恢复保护。
-- 增加 Node 22/24、DSH rc.1/rc.2 runtime smoke、脱敏 fixture replay 和包内容发布门禁。
+- **恢复账本的 revision 快路径**：DSH 0.1.5 把 `sessionPersistence.listSnapshots()` 改名为 `list()`，插件因此拿不到每会话 revision，`sessionsSkippedByRevision` 恒为 0、每次启动都重读全部会话日志（实测 479 个会话读了 431 个、约 13 分钟）。现在两种写法都支持，未变化的会话重新从账本复用。
+- **扫描期间的工作区变更不再被丢弃**：以前基线运行中到达的注册表变更会被直接忽略，导致新增工作区必须重启才出现；现在会被记住并在扫描结束后立即补跑，另有每 30 秒的注册表轮询兜底。
+- 升级后**首次**启动仍会全量读一次（旧账本记录没有 `lastRevision` 字段），此后启动走快路径。
 
 完整版本记录见 [CHANGELOG.md](CHANGELOG.md)。
 
@@ -306,25 +292,11 @@ The command loads the real plugin Host, calls its compatible APIs, checks the do
 
 ### Latest Update
 
-**v1.1.5**
-
-- **Deleting a workspace no longer loses data**: usage already recorded for a removed workspace is no longer subtracted; it is summed with every other removed workspace into one "Deleted" row (including usage folded from the live feed that had not been persisted yet). Persisted ledger rows keep their original workspace id and cwd, so the mapping stays reversible and the same bucket is rebuilt after a restart.
-- **Workspace registry probe**: all-usage follows DSH's workspace registry automatically through the `domain/changed` event; only added/removed workspaces are reprocessed incrementally while unchanged workspaces reuse their ledger with zero rescan. The manual Refresh workspaces control and its `POST /api/all-usage/workspaces/refresh` route were removed.
-- **Strict registration boundary**: only sessions whose cwd maps to a registered workspace are counted; unregistered directories (even existing ones) and legacy `unregistered:` ledger rows never re-enter statistics. Usage already recorded for a deleted workspace is kept in the "Deleted" row, but its directory never accepts new sessions again.
-
-**v1.1.4**
-
-- **Vendor brand icons**: request logs, selected-call details, the model summary table, the cost-settings match table, donut legends, and the model filter dropdown now render real vendor brand SVGs (DeepSeek, OpenAI, Claude, Gemini, Meta, Zhipu, xAI, Qwen, Doubao, Kimi, MiniMax); the model namespace wins over the DSH provider name, and unknown or mixed-brand rows stay neutral. Icons are embedded as data URIs at build time and validated by scripts/svg-guard.mjs (entity decoding, CSS escapes/CDO/namespaced styles, url()/image-set() all covered, comments and text stay inert), with zero runtime network access.
-- **Build hardening**: per the independent audit, closed four bypass classes (CDO/CDC-adjacent at-import, namespaced style elements, CSS-escaped url(), external image-set()) and scoped the CSS checks to style attributes and bodies; adversarial fixtures now assert the rejection reason.
-- Refreshed the three usage-dashboard screenshots to the current UI.
-
-**v1.1.3**
+**v1.1.10**
 
-- Added validated context-tiered official pricing, expandable rate schedules, and explicit price overrides.
-- **Performance optimizations**: the durable ledger uses stable shards, dirty-flush coalescing, and revision reuse; scoped queries, trends, and the fixed 53-week heatmap use ingest-time aggregates to reduce historical scans, storage write amplification, and Dashboard rerenders.
-- Hardened deterministic pricing catalogs, pricing sync, official-model search, and mapping refresh races.
-- Strengthened recovery for invalid sequences, legacy ledgers, recreated workspaces, lagging persistence revisions, and composite ledger keys.
-- Added Node 22/24, DSH rc.1/rc.2 runtime smoke, redacted fixture replay, and package-content release gates.
+- **The ledger fast path is back**: DSH 0.1.5 renamed `sessionPersistence.listSnapshots()` to `list()`, so no per-session revision was ever obtained — `sessionsSkippedByRevision` stayed at 0 and every start re-read every session log (431 reads / ~13 minutes for 479 sessions). Both spellings are accepted now, and unchanged sessions are applied from the ledger again.
+- **A registry change during a baseline is no longer dropped**: a change arriving mid-scan used to be ignored, so a newly added workspace only appeared after a restart. It is now replayed as soon as the scan settles, with a 30-second registry poll as a safety net.
+- The first start after upgrading still reads every log once (older ledger records carry no `lastRevision`); later starts take the fast path.
 
 See [CHANGELOG.md](CHANGELOG.md) for the complete version history.
 

package/lib/plugin.js

@@ -70,6 +70,14 @@ function apply(ctx) {
       sessionsSkippedByRevision: 0,
       sessionsRestoredFromLedger: 0,
       sessionsFailed: 0,
+      // Cumulative registry-probe diagnostics. They deliberately survive a
+      // baseline reset so the status endpoint can show whether the
+      // `domain/changed` fast path fires at all on this host.
+      workspaceProbeEvents: 0,
+      workspaceSyncRuns: 0,
+      workspaceSyncAdded: 0,
+      workspaceSyncRemoved: 0,
+      workspaceSyncDeferred: 0,
     },
     ledgerRecords: new Map(),
     queryCache: new Map(),
@@ -105,6 +113,8 @@ function apply(ctx) {
     reconcileInFlight: false,
     reconcileTimer: null,
     workspaceSyncTimer: null,
+    workspaceSyncDeferred: false,
+    workspaceProbeTimer: null,
     workspaceSyncInFlight: false,
     workspaceSyncPending: false,
   }
@@ -172,6 +182,11 @@ function apply(ctx) {
       sessionsSkippedByRevision: state.sync.sessionsSkippedByRevision,
       sessionsRestoredFromLedger: state.sync.sessionsRestoredFromLedger,
       sessionsFailed: state.sync.sessionsFailed,
+      workspaceProbeEvents: state.sync.workspaceProbeEvents,
+      workspaceSyncRuns: state.sync.workspaceSyncRuns,
+      workspaceSyncAdded: state.sync.workspaceSyncAdded,
+      workspaceSyncRemoved: state.sync.workspaceSyncRemoved,
+      workspaceSyncDeferred: state.sync.workspaceSyncDeferred,
     }
   }
   Object.assign(host, { commitPendingStats, markStatsChanged, resetSyncState, beginSync, noteSyncError, syncSnapshot })
@@ -277,6 +292,7 @@ function apply(ctx) {
   state.pricingReady = host.pricing.loadPricing().then(() => { host.pricing.schedulePricingSync() })
   void host.sessionSync.runBaseline()
   host.sessionSync.scheduleReconcileTimer()
+  host.sessionSync.scheduleWorkspaceProbeTimer()
   state.aliasesReady = loadAliases()
 }
 

package/lib/session-sync.js

@@ -4,6 +4,10 @@ import { contextTimeKey, extractUsageEvent, pickPricingTime, touchContextTimes,
 const RECONCILE_INTERVAL_MS = 120000
 const RECONCILE_HINT_DELAY_MS = 3000
 const WORKSPACE_SYNC_DEBOUNCE_MS = 300
+// The registry event is a fast path, not a guarantee: a change that lands while a
+// baseline runs used to be dropped outright, and a missed event left the plugin
+// stale until the next restart. The (in-memory) registry list is polled as well.
+const WORKSPACE_PROBE_INTERVAL_MS = 30000
 
 export function createSessionSync(host) {
   const { ctx, state } = host
@@ -154,6 +158,25 @@ export function createSessionSync(host) {
     if (typeof cwd !== 'string' || cwd === '') return undefined
     return state.pathIndex.get(workspacePathKey(cwd))
   }
+  // DSH 0.1.5 replaced \`sessionPersistence.listSnapshots()\` with \`list()\`; both
+  // return per-session \`{ header, revision }\` rows. Without a revision the
+  // ledger-reuse fast path never fires, so every baseline re-reads every log.
+  async function loadSessionRevisions() {
+    const source = sessionPersistence
+    if (source === undefined || source === null) return null
+    const read = typeof source.list === 'function'
+      ? () => source.list()
+      : (typeof source.listSnapshots === 'function' ? () => source.listSnapshots() : null)
+    if (read === null) return null
+    const rows = await read()
+    if (!Array.isArray(rows)) return null
+    const revisions = new Map()
+    for (const row of rows) {
+      const rid = row && row.header && typeof row.header.id === 'string' ? row.header.id : undefined
+      if (rid !== undefined && row && typeof row.revision === 'string') revisions.set(rid, row.revision)
+    }
+    return revisions
+  }
   function wsForLiveSession(session, sid) {
     let wsId = state.memberOf.get(sid)
     if (wsId !== undefined) return wsId
@@ -406,24 +429,18 @@ export function createSessionSync(host) {
     if (state.disposed || generation !== state.aggregationGeneration) return
     // v1.0.8: cheap per-session change signal (header line + stat, no full-log read)
     let snapshots = null
-    if (sessionPersistence !== undefined && typeof sessionPersistence.listSnapshots === 'function') {
-      try {
-        const rows = await sessionPersistence.listSnapshots()
-        if (state.disposed || generation !== state.aggregationGeneration) return
-        if (Array.isArray(rows)) {
-          state.sync.persistenceSnapshotsAvailable = true
-          snapshots = new Map()
-          for (const row of rows) {
-            const rid = row && row.header && typeof row.header.id === 'string' ? row.header.id : undefined
-            if (rid !== undefined && row && typeof row.revision === 'string') snapshots.set(rid, row.revision)
-          }
-        }
-      } catch (err) {
-        console.error('[all-usage] session persistence snapshots unavailable:', err)
-        if (state.disposed || generation !== state.aggregationGeneration) return
-        state.sync.persistenceSnapshotsAvailable = false
-        markStatsChanged('scan')
+    try {
+      const revisions = await loadSessionRevisions()
+      if (state.disposed || generation !== state.aggregationGeneration) return
+      if (revisions !== null) {
+        state.sync.persistenceSnapshotsAvailable = true
+        snapshots = revisions
       }
+    } catch (err) {
+      console.error('[all-usage] session persistence snapshots unavailable:', err)
+      if (state.disposed || generation !== state.aggregationGeneration) return
+      state.sync.persistenceSnapshotsAvailable = false
+      markStatsChanged('scan')
     }
     if (state.disposed || generation !== state.aggregationGeneration) return
     if (setupFailed || !Array.isArray(records)) {
@@ -504,6 +521,10 @@ export function createSessionSync(host) {
     state.knownSessionIds.clear()
     for (const sid of listedSessionIds) state.knownSessionIds.add(sid)
     state.scan.done = true
+    if (state.workspaceSyncDeferred) {
+      state.workspaceSyncDeferred = false
+      scheduleWorkspaceSync()
+    }
     state.sync.lastCompletedAt = Date.now()
     if (state.sync.sessionsFailed === 0) {
       state.sync.lastErrorAt = 0
@@ -529,6 +550,7 @@ export function createSessionSync(host) {
       return
     }
     state.workspaceSyncInFlight = true
+    state.sync.workspaceSyncRuns += 1
     try {
       await synchronizeWorkspaceRegistry()
     } catch (err) {
@@ -543,9 +565,15 @@ export function createSessionSync(host) {
     }
   }
   async function synchronizeWorkspaceRegistry() {
-    // The first baseline reads the registry with the latest list, so a probe
-    // arriving before it completes has nothing to add.
-    if (state.disposed || !state.scan.done) return
+    if (state.disposed) return
+    // A registry change that lands while a baseline is running used to be
+    // dropped outright, which is why a new workspace could stay invisible until
+    // the next restart. Remember it and re-run once the scan settles.
+    if (!state.scan.done) {
+      state.workspaceSyncDeferred = true
+      state.sync.workspaceSyncDeferred += 1
+      return
+    }
     let workspaces
     try {
       workspaces = ctx.workspaceRegistry.list()
@@ -559,6 +587,8 @@ export function createSessionSync(host) {
     for (const id of state.wsMeta.keys()) if (!next.wsMeta.has(id)) removedWs.add(id)
     const addedWs = new Set()
     for (const id of next.wsMeta.keys()) if (!state.wsMeta.has(id)) addedWs.add(id)
+    state.sync.workspaceSyncAdded += addedWs.size
+    state.sync.workspaceSyncRemoved += removedWs.size
     // Reuse path: no membership change — metadata only, zero rescan.
     if (removedWs.size === 0 && addedWs.size === 0) {
       installWorkspaceSnapshot(next)
@@ -606,20 +636,10 @@ export function createSessionSync(host) {
     state.sync.sessionsTotal = records.length
     markStatsChanged('scan')
     let snapshots = null
-    if (sessionPersistence !== undefined && typeof sessionPersistence.listSnapshots === 'function') {
-      try {
-        const rows = await sessionPersistence.listSnapshots()
-        if (Array.isArray(rows)) {
-          snapshots = new Map()
-          for (const row of rows) {
-            const rid = row && row.header && typeof row.header.id === 'string' ? row.header.id : undefined
-            if (rid !== undefined && row && typeof row.revision === 'string') snapshots.set(rid, row.revision)
-          }
-        }
-      } catch (err) {
-        console.error('[all-usage] session persistence snapshots unavailable:', err)
-        markStatsChanged('scan')
-      }
+    try {
+      snapshots = await loadSessionRevisions()
+    } catch (err) {
+      console.error('[all-usage] session persistence snapshots unavailable:', err)
     }
     for (const record of records) {
       if (state.disposed) return
@@ -698,6 +718,20 @@ export function createSessionSync(host) {
     }, RECONCILE_INTERVAL_MS)
     if (state.reconcileTimer && typeof state.reconcileTimer.unref === 'function') state.reconcileTimer.unref()
   }
+  // Belt and braces for the registry probe: the event fast path can be missed
+  // (dropped while scanning, or never delivered), and unlike the event this
+  // cannot silently leave the workspace list stale until a restart.
+  function scheduleWorkspaceProbeTimer() {
+    if (state.disposed || state.workspaceProbeTimer !== null) return
+    state.workspaceProbeTimer = setTimeout(() => {
+      state.workspaceProbeTimer = null
+      if (!state.disposed) {
+        void runWorkspaceSync()
+        scheduleWorkspaceProbeTimer()
+      }
+    }, WORKSPACE_PROBE_INTERVAL_MS)
+    if (state.workspaceProbeTimer && typeof state.workspaceProbeTimer.unref === 'function') state.workspaceProbeTimer.unref()
+  }
 
   // ---------- live feed ----------
   ctx.on('session/event', (session, event) => {
@@ -775,6 +809,7 @@ export function createSessionSync(host) {
     if (change === undefined || change === null) return
     if (change.domain !== 'workspace') return
     if (change.table !== 'workspaces' && change.table !== '') return
+    state.sync.workspaceProbeEvents += 1
     scheduleWorkspaceSync()
   })
 
@@ -800,6 +835,7 @@ export function createSessionSync(host) {
     reconcileSessions,
     scheduleReconcileHint,
     scheduleReconcileTimer,
+    scheduleWorkspaceProbeTimer,
     markLedgerDirty
   }
 }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "dsh-all-usage",
-  "version": "1.1.9",
+  "version": "1.1.10",
   "description": "DeepSeek Harness usage dashboard with model, provider, workspace, cache, balance, and CSV insights",
   "repository": {
     "type": "git",