dsh-layered-memory 0.8.2 → 0.8.4

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.en.md CHANGED
@@ -10,7 +10,7 @@
10
10
  [简体中文](README.md) · [Latest release](https://github.com/JunNanLYS/dsh-layered-memory/releases/latest) · [Report issues](https://github.com/JunNanLYS/dsh-layered-memory/issues)
11
11
 
12
12
  [![npm version](https://img.shields.io/npm/v/dsh-layered-memory?color=6f83ff&style=flat-square&label=npm)](https://www.npmjs.com/package/dsh-layered-memory)
13
- [![DSH 0.1.0-rc.8](https://img.shields.io/badge/DSH-0.1.0--rc.8-8b5cf6?style=flat-square)](https://github.com/deepseek-ai/deepseek-harness)
13
+ [![DSH 0.1.1-rc.2](https://img.shields.io/badge/DSH-0.1.1--rc.2-8b5cf6?style=flat-square)](https://github.com/deepseek-ai/deepseek-harness)
14
14
  [![MIT License](https://img.shields.io/badge/license-MIT-536990?style=flat-square)](LICENSE)
15
15
 
16
16
  </div>
@@ -21,7 +21,7 @@ Requires Node ≥ 22.16. Two invocation styles — the `npx` prefix can replace
21
21
  any command below:
22
22
 
23
23
  ```bash
24
- # Option 1: run the official CLI directly via npx (no pre-installed dsh; version can be pinned, e.g. dsh-layered-memory@0.8.0)
24
+ # Option 1: run the official CLI directly via npx (no pre-installed dsh; version can be pinned, e.g. dsh-layered-memory@0.8.2)
25
25
  npx -y @deepseek-ai/dsh plugin --profile web add dsh-layered-memory
26
26
 
27
27
  # Option 2: with the dsh CLI installed (dsh is a pnpm forwarder; npm i -g pnpm first if missing)
@@ -144,39 +144,43 @@ trajectory view):
144
144
 
145
145
  ## Measured Comparison (DSH-MemBench: Automated Benchmark)
146
146
 
147
- Screenshots show what the plugin looks like — this section answers "**what does enabling it actually buy you?**" with measured numbers from an **automated benchmark** ([`bench/`](./bench/), one command to reproduce). Method: the same scenario bank with verbatim-identical inputs runs in **Group A (memory on)** and **Group B (memory off)**, 3 repetitions each, merged; environment DeepSeek official `deepseek-v4-flash`, plugin 0.8.0, Windows; taxonomy adapted from [LongMemEval](https://github.com/xiaowu0162/longmemeval) / [LoCoMo](https://snap-research.github.io/locomo/) / [AMB](https://github.com/vectorize-io/agent-memory-benchmark).
147
+ Screenshots show what the plugin looks like — this section answers "**what does enabling it actually buy you?**" with measured numbers from an **automated benchmark** ([`bench/`](./bench/), one command to reproduce). Method: the same scenario bank with verbatim-identical inputs runs in **Group A (memory on)** with 3 merged repetitions and **Group B (memory off)** with 1 repetition (a memory-off long task burns multiples of the tokens per scenario — a cost guardrail); the dialog track now runs Group A only (memory-off probes in independent sessions cannot succeed, so the control carries no information — retired). Workflow-track environment: DeepSeek official `deepseek-v4-flash` (reasoning effort high), judge `glm-5.3`, plugin 0.8.3, Windows; taxonomy adapted from [LongMemEval](https://github.com/xiaowu0162/longmemeval) / [LoCoMo](https://snap-research.github.io/locomo/) / [AMB](https://github.com/vectorize-io/agent-memory-benchmark).
148
148
 
149
- ### Dialog track (15 scenarios × 6 probe types × 3 reps = 270 questions/group): does it remember correctly
149
+ ### Dialog track (15 scenarios × 6 probe types × 3 reps = 270 questions): does it remember correctly
150
+
151
+ > Archived 0.8.0 baseline (Group A data; the dialog-track B arm has since been retired — Group A only).
150
152
 
151
153
  <p align="center">
152
154
  <img src="./assets/readme/bench-dialog.svg" width="100%"
153
- alt="DSH-MemBench dialog track, Group A vs Group B bar chart: overall accuracy A (memory on) 92.6% (250/270) vs B (memory off) 17.8% (48/270); per probe type, 45 each — extraction A 45/45 vs B 3/45, multi-hop A 45/45 vs B 0/45, temporal A 43/45 vs B 0/45, knowledge updates A 31/45 vs B 0/45, scene recall A 41/45 vs B 0/45, abstention both 45/45 with 0 fabricated">
155
+ alt="DSH-MemBench dialog track accuracy chart (Group A, memory on): overall accuracy 92.6% (250/270); per probe type, 45 each — extraction 45/45, multi-hop 45/45, temporal 43/45, knowledge updates 31/45, scene recall 41/45, abstention 45/45 with 0 fabricated; the dialog-track B arm is retired (memory-off probes in independent sessions cannot succeed)">
154
156
  </p>
155
157
 
156
158
  **Dual-channel recall** (Group A): passive injection hit rate **75.1%** (the answer's key points appear in the recall injection, 169/225); most of the rest the model recovered by **actively calling the memory tools** — 84 questions with active queries, **60 rescued by tools**. The end-to-end 92.6% is the composite of both channels plus model utilization. With the memory store accumulating across scenarios for the whole run, 144 probe injections carried other scenarios' memories (honestly counted) — yet overall accuracy held at 92.6%: interference resistance under a growing store, measured.
157
159
 
158
- ### Workflow track (4 scenarios × 3 reps, real tool sandbox): does it do it right, and cheaper
160
+ ### Workflow track (7 scenarios · Group A ×3 / Group B ×1, real tool sandbox): does it do it right, and cheaper
159
161
 
160
162
  <p align="center">
161
163
  <img src="./assets/readme/bench-workflow.svg" width="100%"
162
- alt="DSH-MemBench workflow track, Group A vs Group B: task completion A 24/33 (72.7%) vs B 11/33 (33.3%); cost comparison (Group B as the full-bar baseline) — steps 125 vs 186 (B +49%), tool calls 184 vs 296 (B +61%), input tokens 1.30M vs 1.86M (B +43%); asks-user-for-help A 0 vs B 3; login scenario input tokens A 241k vs B 453k (+88%)">
164
+ alt="DSH-MemBench workflow track, Group A vs Group B: probe-phase completion A 59/69 (85.5%) vs B 10/23 (43.5%); cost comparison (Group B as the full-bar baseline, per-scenario means) — steps 24.3 vs 41.4 (B +70%), tool calls 37.7 vs 62.1 (B +65%), input tokens 266k vs 1.81M (B 6.8×); style-convention scenario probes A 12/12 vs B 0/4; long-task input tokens per scenario A 266k vs B 1.81M">
163
165
  </p>
164
166
 
165
- **Login scenario close-up** (credentials exist only in memory; the site is a local service with unforgeable tokens): Group A completed all three runs **in a single turn each** (6/6, 241k input); Group B had to **ask the user for credentials every time** (3 asks, double the turns) and still finished only 5/6, at 453k input **+88%**. This is one of memory's core values: **what it saves is not task difficulty, but pointless round-trips and re-teaching**.
167
+ **Probe-phase completion 85.5% vs 43.5% (+42pp)**: both groups have live context during teach/change phases — the probe phase (continuation task in a fresh session) is the pure memory window. Group A scored a perfect 12/12 on all three new probe archetypes (workflow knowledge update / twin-runbook disambiguation / style-convention continuity), consistent across all three reps; Group B scored **0/4** on style-convention probes (naming/structure/thousands-separator/footer conventions exist only in memory they cannot be explored out of the sandbox), while on the workflow-update scenario it can reverse-engineer the procedure by reading the script (discrimination limited by sandbox affordances, honestly noted).
168
+
169
+ **Long-task cost: Group B burns 6.8× Group A's input tokens per scenario** (1.81M vs 266k) — without memory the agent advances by re-exploring, and under a high reasoning effort it even builds its own projects to probe what a one-line script convention would have done; output tokens 3× (46.2k vs 15.4k), steps +70%. This is memory's core value: **what it saves is not task difficulty, but pointless round-trips and re-exploration**.
166
170
 
167
171
  ### Methodology & reproduction
168
172
 
169
173
  ```bash
170
- node bench/harness/run.mjs --arm A --repeats 3 --provider deepseek-official --model deepseek-v4-flash
171
- node bench/harness/run.mjs --arm B --repeats 3 --provider deepseek-official --model deepseek-v4-flash # dialog track
172
- node bench/harness/run.mjs --track workflow --arm A/B --repeats 3 ... # workflow track
174
+ node bench/harness/run.mjs --arm A --repeats 3 --provider deepseek-official --model deepseek-v4-flash # dialog track (Group A only)
175
+ node bench/harness/run.mjs --track workflow --arm AB --repeats 3 ... # workflow track (A/B arms in parallel)
173
176
  node bench/harness/report.mjs --latest [dialog|workflow] # aggregate report
174
177
  ```
175
178
 
176
- - Scoring: programmatic `contains-all` plus an LLM judge against key points (every answer and verdict is preserved in `result.json` for human audit); workflow completion is verified programmatically from produced files and their contents;
177
- - Metrics come from provider-reported usage (input with cache-hit split) and session-event folding; the **steady-state cache rate** excludes each session's first request (A 88.7% vs B 85.4% memory injection does not hurt caching);
178
- - Regression use: run before/after a plugin change and diff with `compare.mjs` (environment header check + Group-B control-drift warning);
179
- - Limitations (stated honestly): single machine, 3 merged runs; the judge model is the same as the tested model; the scenario bank is author-built (biased toward memory-advantage scenarios — reproduce it yourself); the tool audit flags out-of-sandbox access (agents occasionally probed the user home dir in tests; this benchmark's answers never exist in the real memory store, so the numbers are unaffected).
179
+ - Scoring: programmatic `contains-all` plus an LLM judge against key points (every answer and verdict is preserved in `result.json` for human audit); workflow completion is verified programmatically from produced files and their contents (four check kinds: positive / forbidden-word / must-not-exist / exists);
180
+ - Live progress: running the benchmark auto-starts a local progress panel and opens the browser (`--no-panel` to disable) — per-arm scenario/phase/message-level progress, heartbeat & activity freshness (distinguishes "stuck" from "process died"), and cumulative cost as it accrues;
181
+ - Metrics come from provider-reported usage (input with cache-hit split) and session-event folding; the steady-state cache rate excludes each session's first request (archived 0.8.0 baseline: A 88.7% vs B 85.4% — memory injection does not hurt caching);
182
+ - Regression use: run before/after a plugin change and diff with `compare.mjs` (environment header check including git SHA + Group-B control-drift warning);
183
+ - Limitations (stated honestly): single machine; Group A ×3 merged, Group B ×1 (cost guardrail — noisier); judge vs tested model: same model in the archived dialog baseline, heterogeneous in the new workflow run (glm-5.3 judging v4-flash); the scenario bank is author-built (biased toward memory-advantage scenarios — reproduce it yourself); sandbox-file affordances partially leak procedures (Group B can reverse-engineer by reading scripts — discrimination limits honestly noted); dual-tier tool audit (strict violation voids the scenario / loose heuristic flags only), with 0 violations measured on both sides.
180
184
 
181
185
  Full reports and per-question data: [`bench/baseline/`](./bench/baseline/).
182
186
 
@@ -234,8 +238,8 @@ the bundle layer appends and causes `duplicate loader entry id` startup failure)
234
238
  | `embedding.mirror` | `https://hf-mirror.com` | Download mirror root for local models (can be changed back to `https://huggingface.co`) |
235
239
  | `embedding.proxy` | `''` | Three-state download proxy: `''` (default) = auto-detect proxy env vars (`HTTPS_PROXY`/`ALL_PROXY` etc., honoring `NO_PROXY`); `none` = disable, always direct; any other value = proxy URL (e.g. `http://127.0.0.1:7890`). Direct connections to the mirror are intermittently unreachable on some networks (connect timeouts and poisoned bytes have both been observed) — keep the default auto-detection on machines with a proxy |
236
240
  | `llm.provider/model` | empty | Static distillation route (deployment pin): when **both** fields are set the route is locked, outranking the settings-page selection and the default model (deployments can force distillation onto a specific route); when empty the route follows "settings-page selection → default model". At runtime, switch among **configured providers** (including custom ones added in dsh Settings → Models) via the "distillation model" picker in Settings → Memory → Overview — effective immediately, no restart needed |
237
- | `llm.maxTokens` | `65536` | Fallback output cap for non-layered calls. Each distillation stage has its own budget (extraction 16k / dedup 8k / L2 32k / L3 16k; auto ×4 when reasoning effort is high/max, so thinking can't starve the text budget); the per-layer budgets are runtime-adjustable in Settings → Memory → Overview → distillation parameters (empty/0 = built-in defaults) |
238
- | `llm.reasoningEffort` | `off` | Distillation reasoning-effort tier (deployment default): `off` / `high` / `max`; empty string = don't send (follow model default). Distillation is structured extraction, so thinking is off by default a reasoning model (e.g. v4-flash) at its default `high` tier can consume the entire output budget on thinking, leaving 0 chars of text; set to empty string for models that don't recognize the effort parameter. Switchable at runtime in Settings → Memory → Overview ("follow config" falls back to this value) |
241
+ | `llm.maxTokens` | `65536` | Fallback output cap for non-layered calls. Each distillation stage has its own budget (extraction 16k / dedup 8k / L2 32k / L3 16k; auto ×4 when the reasoning effort is high/xhigh/max, so thinking can't starve the text budget); the per-layer budgets are runtime-adjustable in Settings → Memory → Overview → distillation parameters (empty/0 = built-in defaults) |
242
+ | `llm.reasoningEffort` | empty | Distillation reasoning effort: empty = **auto** (resolved from model capability: the model's default tier, else `high`); an explicit value (`off`/`none`/`minimal`/`low`/`medium`/`high`/`xhigh`/`max`) is only sent when the model declares supporteffort vocabularies differ across providers (deepseek accepts `off`, OpenAI-style APIs use `none`, models that declare no tiers get nothing), and unsupported tiers degrade to not-sending with a one-time warning; output budgets auto-×4 at high/xhigh/max. Switchable at runtime in Settings → Memory → Overview; the selectable tiers follow the current model live |
239
243
  | `llm.temperature` | `0.3` | Distillation temperature |
240
244
  | `llm.maxInputChars` | `700000` | Input character budget per distillation call (over-budget L1 inputs are chunked automatically); runtime-adjustable in Settings → distillation parameters → input budget (empty/0 = follow this value) |
241
245
  | `llm.timeoutMs` | `120000` | Per-call distillation timeout (ms) |
@@ -297,7 +301,10 @@ The dsh host prints plugin logs to the console; the plugin mirrors info and abov
297
301
  chars, duration)` → `L1 extraction done` → `pipeline end`; the next turn shows
298
302
  `recall hit N L1 records`. Empty LLM output carries full diagnostics (finish reason /
299
303
  token counts / reasoning excerpt); JSON parse failures include the first 400 characters
300
- of the raw model output; all failure warns carry the first stack frame.
304
+ of the raw model output; all failure warns carry the first stack frame. The JSONL
305
+ fact source is appended per turn and relies on OS write-back (no per-line fsync);
306
+ an extreme crash (power loss) loses at most a small tail, and the index DB can be
307
+ fully re-derived from the fact source via "Rebuild memories".
301
308
 
302
309
  ## Differences from MemoryCore
303
310
 
package/README.md CHANGED
@@ -10,7 +10,7 @@
10
10
  [English](README.en.md) · [最新发行版](https://github.com/JunNanLYS/dsh-layered-memory/releases/latest) · [反馈问题](https://github.com/JunNanLYS/dsh-layered-memory/issues)
11
11
 
12
12
  [![npm version](https://img.shields.io/npm/v/dsh-layered-memory?color=6f83ff&style=flat-square&label=npm)](https://www.npmjs.com/package/dsh-layered-memory)
13
- [![DSH 0.1.0-rc.8](https://img.shields.io/badge/DSH-0.1.0--rc.8-8b5cf6?style=flat-square)](https://github.com/deepseek-ai/deepseek-harness)
13
+ [![DSH 0.1.1-rc.2](https://img.shields.io/badge/DSH-0.1.1--rc.2-8b5cf6?style=flat-square)](https://github.com/deepseek-ai/deepseek-harness)
14
14
  [![MIT License](https://img.shields.io/badge/license-MIT-536990?style=flat-square)](LICENSE)
15
15
 
16
16
  </div>
@@ -20,7 +20,7 @@
20
20
  需要 Node ≥ 22.16。两种调用方式任选(`npx` 前缀可替换下面任何 `dsh` 命令):
21
21
 
22
22
  ```bash
23
- # 方式一:npx 直接跑官方 CLI(无需预装 dsh;可 pin 版本,如 dsh-layered-memory@0.8.0
23
+ # 方式一:npx 直接跑官方 CLI(无需预装 dsh;可 pin 版本,如 dsh-layered-memory@0.8.2
24
24
  npx -y @deepseek-ai/dsh plugin --profile web add dsh-layered-memory
25
25
 
26
26
  # 方式二:已装 dsh CLI(dsh 是 pnpm 转发器,未装 pnpm 时先 npm i -g pnpm)
@@ -124,39 +124,43 @@ npx tsc src/smoke.ts --outDir dist-smoke --module nodenext --moduleResolution no
124
124
 
125
125
  ## 实测对比(DSH-MemBench:自动化基准)
126
126
 
127
- 图文回答"长什么样",这一节用**自动化基准**的实测数字回答"**开了到底有什么用**"([`bench/`](./bench/),一条命令可复现)。方法:同场景库、逐字相同输入,**A 组(记忆开)** **B 组(记忆关)** 各跑 3 次取合并值;环境 DeepSeek 官方 `deepseek-v4-flash`、插件 0.8.0、Windows;题型设计借鉴 [LongMemEval](https://github.com/xiaowu0162/longmemeval) / [LoCoMo](https://snap-research.github.io/locomo/) / [AMB](https://github.com/vectorize-io/agent-memory-benchmark)。
127
+ 图文回答"长什么样",这一节用**自动化基准**的实测数字回答"**开了到底有什么用**"([`bench/`](./bench/),一条命令可复现)。方法:同场景库、逐字相同输入,**A 组(记忆开)跑 3 次取合并值,B 组(记忆关)跑 1 次**(无记忆的长任务每场景要吞数倍 token,成本护栏);对话赛道只跑 A 组(B 组会话独立无记忆必然失败,对照无信息量,已下线)。工作流赛道环境:DeepSeek 官方 `deepseek-v4-flash`(思考档 high)、判卷 `glm-5.3`、插件 0.8.3、Windows;题型设计借鉴 [LongMemEval](https://github.com/xiaowu0162/longmemeval) / [LoCoMo](https://snap-research.github.io/locomo/) / [AMB](https://github.com/vectorize-io/agent-memory-benchmark)。
128
128
 
129
- ### 对话赛道(15 场景 × 6 题型 × 3 次 = 270 题/组):答得准吗
129
+ ### 对话赛道(15 场景 × 6 题型 × 3 次 = 270 题):答得准吗
130
+
131
+ > 0.8.0 留档基线(A 组数据;此后对话赛道 B 组下线,只跑 A 组)。
130
132
 
131
133
  <p align="center">
132
134
  <img src="./assets/readme/bench-dialog.svg" width="100%"
133
- alt="DSH-MemBench 对话赛道 A/B 对照条形图:A 组(记忆开)总准确率 92.6%(250/270),B 组(记忆关)17.8%(48/270);分题型各 45 题——抽取 A 45/45 对 B 3/45、多跳 A 45/45 对 B 0/45、时序 A 43/45 对 B 0/45、知识更新 A 31/45 对 B 0/45、场景回忆 A 41/45 对 B 0/45、拒答两组均 45/45 且 0 编造">
135
+ alt="DSH-MemBench 对话赛道准确率图(A 组·记忆开):总准确率 92.6%(250/270);分题型各 45 题——抽取 45/45、多跳 45/45、时序 43/45、知识更新 31/45、场景回忆 41/45、拒答 45/45 且 0 编造;对话赛道 B 组已下线(会话独立无记忆必然失败)">
134
136
  </p>
135
137
 
136
138
  **召回双通道**(A 组):被动注入召回率 **75.1%**(该题要点出现在召回注入中,169/225),其余多数由模型**主动调用记忆工具**查回——84 题主动查询、**60 题靠工具兜底答对**;端到端 92.6% 是两通道 + 模型利用的合成结果。记忆库跨场景全程累积下,探针召回注入混入其他场景记忆 144 次(已如实计数),总准确率仍稳在 92.6%——抗干扰能力经受住了膨胀记忆库的考验。
137
139
 
138
- ### 工作流赛道(4 场景 × 3 次,真实工具沙箱):做得对、做得省吗
140
+ ### 工作流赛道(7 场景 · A 组 3 次 / B 组 1 次,真实工具沙箱):做得对、做得省吗
139
141
 
140
142
  <p align="center">
141
143
  <img src="./assets/readme/bench-workflow.svg" width="100%"
142
- alt="DSH-MemBench 工作流赛道 A/B 对照图:任务完成度 A 组 24/3372.7%)对 B 组 11/3333.3%);成本对比(B 组为满格基准)——步骤 125186(B +49%)、工具调用 184296(B +61%)、输入 token 1.30M 对 1.86M(B +43%);向用户求助 A 0 次对 B 3 次;登录场景输入 token A 241k 对 B 453k(+88%)">
144
+ alt="DSH-MemBench 工作流赛道 A/B 对照图:探针段完成度 A 组 59/6985.5%)对 B 组 10/2343.5%);成本对比(B 组为满格基准,每场景均值)——步骤 24.341.4(B +70%)、工具调用 37.762.1(B +65%)、输入 token 266k 对 1.81M(B 6.8 倍);风格规范场景探针 A 12/12 B 0/4;长任务每场景输入 token A 266k 对 B 1.81M">
143
145
  </p>
144
146
 
145
- **登录场景特写**(凭据只存在于记忆,站点为本地服务、令牌不可伪造):A 组三次全部**一轮直取**完成(6/6,241k 输入);B 组每次都要**反问用户要凭据**(3 次求助、双倍轮次)才完成 5/6,输入 453k——**+88%**。这正是记忆的核心价值之一:**省掉的不是任务难度,是无谓的往返与重复教学**。
147
+ **探针段完成度 85.5% vs 43.5%(+42pp)**:教学/变更段两组都有现场上下文,探针段(新会话延续任务)才是纯记忆窗口——A 组三个新考法场景(流程知识更新 / 双胞胎消歧 / 风格规范延续)全部 12/12 满分且三轮一致;B 组在风格规范场景探针 **0/4**(命名/结构/千分位/页脚约定只存记忆,沙箱探不出来),在流程更新场景则能靠读脚本逆向(判别力受沙箱可供性限制,已如实标注)。
148
+
149
+ **长任务成本:B 组每场景输入 token 是 A 组的 6.8 倍**(1.81M vs 266k)——无记忆时 agent 靠重新探索前进,high 思考档下甚至会自建工程去探测本可用一条脚本约定完成的流程;输出 token 3 倍(46.2k vs 15.4k)、步骤 +70%。这正是记忆的核心价值:**省掉的不是任务难度,是无谓的往返与重复探索**。
146
150
 
147
151
  ### 方法论与复现
148
152
 
149
153
  ```bash
150
- node bench/harness/run.mjs --arm A --repeats 3 --provider deepseek-official --model deepseek-v4-flash
151
- node bench/harness/run.mjs --arm B --repeats 3 --provider deepseek-official --model deepseek-v4-flash # 对话赛道
152
- node bench/harness/run.mjs --track workflow --arm A/B --repeats 3 ... # 工作流赛道
154
+ node bench/harness/run.mjs --arm A --repeats 3 --provider deepseek-official --model deepseek-v4-flash # 对话赛道(只跑 A 组)
155
+ node bench/harness/run.mjs --track workflow --arm AB --repeats 3 ... # 工作流赛道(A/B 双组并行)
153
156
  node bench/harness/report.mjs --latest [dialog|workflow] # 汇总报告
154
157
  ```
155
158
 
156
- - 判分:`contains-all` 程序判 + 判卷模型按要点判(答案原文与判分理由全部留痕 `result.json` 可人工复核);工作流完成度为产物文件 + 关键内容程序化校验;
157
- - 指标全部来自供应商上报 usage(输入含缓存命中拆分)与会话事件折叠;**稳态缓存率**剔除每会话首请求(A 88.7% vs B 85.4%——记忆注入不伤缓存);
158
- - 回归用途:改插件前后各跑一遍,`compare.mjs` 出对比表(环境头校验 + B 组对照组漂移告警);
159
- - 局限(诚实声明):单机 ×3 次合并、判卷模型与被测模型同源、作者自建场景库(倾向记忆优势场景,欢迎自行复现);工具审计会标记越界访问(实测 Agent 偶发探测用户主目录,本基准场景答案不存于真实记忆库、数字不受影响)。
159
+ - 判分:`contains-all` 程序判 + 判卷模型按要点判(答案原文与判分理由全部留痕 `result.json` 可人工复核);工作流完成度为产物文件 + 关键内容程序化校验(四型判据:正检查/禁词/产物缺席/存在性);
160
+ - 实时进度:跑基准时自动拉起本地进度面板并打开浏览器(`--no-panel` 关闭)——A/B 双臂场景/阶段/消息粒度进度、心跳与活动新鲜度(直判"卡住 vs 进程挂了")、累计成本随跑随涨;
161
+ - 指标全部来自供应商上报 usage(输入含缓存命中拆分)与会话事件折叠;稳态缓存率剔除每会话首请求(0.8.0 留档基线:A 88.7% vs B 85.4%——记忆注入不伤缓存);
162
+ - 回归用途:改插件前后各跑一遍,`compare.mjs` 出对比表(环境头校验含 gitSha + B 组对照组漂移告警);
163
+ - 局限(诚实声明):单机;A 组 ×3 合并、B 组 ×1(成本护栏,噪声更大);判卷与被测模型:对话留档基线同源、工作流新跑为异构(glm-5.3 判 v4-flash);作者自建场景库(倾向记忆优势场景,欢迎自行复现);沙箱文件的可供性会部分泄露流程(B 组可读脚本逆向,判别力受限处已如实标注);工具审计双档(严格违规判负/宽松提示),实测双方 0 违规。
160
164
 
161
165
  完整报告与逐题数据:[`bench/baseline/`](./bench/baseline/)。
162
166
 
@@ -251,13 +255,22 @@ ONNX 量化 **CPU 推理**——无需 API Key,数据不出本机)。本地
251
255
  | `embedding.mirror` | `https://hf-mirror.com` | 本地模型下载镜像根地址(可改回官方 `https://huggingface.co`) |
252
256
  | `embedding.proxy` | `''` | 模型下载代理三态:`''`(默认)= 自动探测代理环境变量(`HTTPS_PROXY`/`ALL_PROXY` 等,尊重 `NO_PROXY`);`none` = 禁用强制直连;其他值 = 代理 URL(如 `http://127.0.0.1:7890`)。镜像直连在国内网络间歇不可达(直连超时与污染字节交替出现过),开代理的机器建议保持默认自动探测 |
253
257
  | `llm.provider/model` | 空 | 蒸馏模型静态路由(部署 pin):provider 与 model **双字段齐**时锁定蒸馏路由,优先于设置页的运行时选择与默认模型(部署可强制蒸馏走指定路由);留空则跟随"设置页选择 → 默认模型"。运行时可在设置页 → 记忆 → 概览的"蒸馏模型"选择器从**已配置的供应商**(含 dsh 设置 → 模型里添加的自定义供应商)中切换,即时生效无需重启 |
254
- | `llm.maxTokens` | `65536` | 未分层调用的兜底输出总闸。各蒸馏层有独立预算(抽取 16k / 去重 8k / L2 32k / L3 16k;思考档 high/max 时自动 ×4,防 reasoning 吃光预算),分层预算可在设置页 → 记忆 → 概览 → 蒸馏参数运行时调整(留空/0 = 跟随内置默认) |
255
- | `llm.reasoningEffort` | `off` | 蒸馏思考档位(部署默认):`off` / `high` / `max`,空串不传(跟随模型默认)。蒸馏是结构化抽取任务,默认关思考——推理模型(如 v4-flash)默认 high 档的思考可把任意输出预算全部吃光导致正文 0 字符;非推理模型不认识 effort 时需设为空串。运行时可在设置页 → 记忆 → 概览临时切换(选"跟随配置"即回退本值) |
258
+ | `llm.maxTokens` | `65536` | 未分层调用的兜底输出总闸。各蒸馏层有独立预算(抽取 16k / 去重 8k / L2 32k / L3 16k;思考档 high/xhigh/max 时自动 ×4,防 reasoning 吃光预算),分层预算可在设置页 → 记忆 → 概览 → 蒸馏参数运行时调整(留空/0 = 跟随内置默认) |
259
+ | `llm.reasoningEffort` | | 蒸馏思考档位:空串 = **自动**(按模型能力解析:模型默认档 `high`);显式值(`off`/`none`/`minimal`/`low`/`medium`/`high`/`xhigh`/`max`)仅在该模型声明支持时发送——跨供应商 effort 词汇表不同(deepseek `off`,OpenAI 系是 `none`,未声明档位的模型不传),不支持的档位自动降级为不传并告警一次;思考档 high/xhigh/max 时输出预算自动 ×4。运行时在设置页 → 记忆 → 概览切换,可选档位表跟随当前模型实时显示 |
256
260
  | `llm.temperature` | `0.3` | 蒸馏温度 |
257
261
  | `llm.maxInputChars` | `700000` | 单次蒸馏输入字符预算(超限的 L1 输入自动分块抽取);运行时可在设置页 → 蒸馏参数 → 输入预算调整(留空/0 = 跟随本值) |
258
262
  | `llm.timeoutMs` | `120000` | 单次蒸馏调用超时(ms) |
259
263
  | `tools` | `true` | 是否注册模型可调用的记忆工具 |
260
264
 
265
+ ## 日志与故障排查
266
+
267
+ dsh 宿主把插件日志打到控制台;插件另把 info 级以上镜像到数据目录的 `memory.log`。
268
+ 一轮对话的典型日志路径:`L0 捕获` → `L0 落盘` → `蒸馏管线开始` → `LLM 调用(输入/输出
269
+ 字符数、耗时)` → `L1 阶段完成` → `管线结束`;下一轮开头是 `召回注入 N 条 L1`。LLM 空输出
270
+ 带完整诊断(finish reason / token 计数 / reasoning 摘录);JSON 解析失败记录模型原始输出
271
+ 前 400 字符;所有失败告警带堆栈首帧。JSONL 事实源按轮次追加、依赖操作系统写回(不做逐条
272
+ fsync),断电等极端崩溃最多丢最后一小段尾部,检索库可用「重建记忆」从事实源全量重导。
273
+
261
274
  ## 与 MemoryCore 的差异
262
275
 
263
276
  - 内嵌完整管线(不依赖外部 Gateway),蒸馏复用 DSH 自己的 LLM;
@@ -1,87 +1,76 @@
1
1
  <svg xmlns="http://www.w3.org/2000/svg"
2
- width="1200" height="690" viewBox="0 0 1200 690"
2
+ width="1200" height="630" viewBox="0 0 1200 630"
3
3
  role="img" aria-labelledby="benchDialogTitle benchDialogDesc">
4
- <title id="benchDialogTitle">DSH-MemBench 对话赛道:A/B 两组准确率对照</title>
5
- <desc id="benchDialogDesc">同题同输入对照:A 组(记忆开)总准确率 92.6%(250/270),B 组(记忆关)17.8%(48/270)。分题型(每题型 45 题):抽取 A 45/45 B 3/45;多跳 A 45/45 对 B 0/45;时序 A 43/45 对 B 0/45;知识更新 A 31/45 对 B 0/45;场景回忆 A 41/45 对 B 0/45;拒答两组均 45/45、0 编造。</desc>
4
+ <title id="benchDialogTitle">DSH-MemBench 对话赛道:A 组(记忆开)准确率</title>
5
+ <desc id="benchDialogDesc">A 组(记忆开)总准确率 92.6%(250/270,15 场景 × 6 题型 × 3 次)。分题型(每题型 45 题):抽取 45/45;多跳 45/45;时序 43/45;知识更新 31/45;场景回忆 41/45;拒答 45/45、0 编造。对话赛道 B 组已下线(会话独立、无记忆必然失败,对照无信息量)。</desc>
6
6
 
7
- <rect width="1200" height="690" rx="26" fill="#0D1526"/>
7
+ <rect width="1200" height="630" rx="26" fill="#0D1526"/>
8
8
 
9
9
  <g font-family="-apple-system,BlinkMacSystemFont,'Segoe UI','PingFang SC','Microsoft YaHei',sans-serif">
10
10
 
11
11
  <!-- ── 标题与图例 ── -->
12
- <text x="64" y="66" font-size="26" font-weight="700" fill="#EFF3FA">对话赛道:同题同输入 · A/B 对照准确率</text>
13
- <text x="64" y="94" font-size="18" fill="#8296B3">15 场景 × 6 题型 × 3 次 = 270 题/组(每题型 45 题)· 条长 = 答对率,数值 = 答对题数</text>
12
+ <text x="64" y="66" font-size="26" font-weight="700" fill="#EFF3FA">对话赛道:记忆开 · 准确率</text>
13
+ <text x="64" y="94" font-size="18" fill="#8296B3">15 场景 × 6 题型 × 3 次 = 270 题(每题型 45 题)· 条长 = 答对率,数值 = 答对题数</text>
14
14
 
15
15
  <rect x="842" y="50" width="18" height="18" rx="5" fill="#FFD15D"/>
16
16
  <text x="868" y="65" font-size="18" fill="#C2CDDE">A 组 · 记忆开</text>
17
- <rect x="842" y="76" width="18" height="18" rx="5" fill="#4E6DA8"/>
18
- <text x="868" y="91" font-size="18" fill="#C2CDDE">B 组 · 记忆关</text>
19
17
 
20
18
  <!-- ── 网格线(0/25/50/75/100%)── -->
21
19
  <g stroke="#1C2A47" stroke-width="1">
22
- <line x1="260" y1="122" x2="260" y2="614"/>
23
- <line x1="435" y1="122" x2="435" y2="614"/>
24
- <line x1="610" y1="122" x2="610" y2="614"/>
25
- <line x1="785" y1="122" x2="785" y2="614"/>
26
- <line x1="960" y1="122" x2="960" y2="614"/>
20
+ <line x1="260" y1="122" x2="260" y2="530"/>
21
+ <line x1="435" y1="122" x2="435" y2="530"/>
22
+ <line x1="610" y1="122" x2="610" y2="530"/>
23
+ <line x1="785" y1="122" x2="785" y2="530"/>
24
+ <line x1="960" y1="122" x2="960" y2="530"/>
27
25
  </g>
28
26
  <g font-size="17" fill="#8296B3" text-anchor="middle">
29
- <text x="260" y="640">0%</text>
30
- <text x="435" y="640">25%</text>
31
- <text x="610" y="640">50%</text>
32
- <text x="785" y="640">75%</text>
33
- <text x="960" y="640">100%</text>
27
+ <text x="260" y="558">0%</text>
28
+ <text x="435" y="558">25%</text>
29
+ <text x="610" y="558">50%</text>
30
+ <text x="785" y="558">75%</text>
31
+ <text x="960" y="558">100%</text>
34
32
  </g>
35
33
 
36
34
  <!-- ── 总准确率(强调行)── -->
37
- <text x="240" y="176" font-size="21" font-weight="700" fill="#EFF3FA" text-anchor="end">总准确率</text>
35
+ <text x="240" y="169" font-size="21" font-weight="700" fill="#EFF3FA" text-anchor="end">总准确率</text>
38
36
  <rect x="260" y="148" width="648" height="26" rx="6" fill="#FFD15D"/>
39
37
  <text x="922" y="169" font-size="22" font-weight="700" fill="#FFD15D">92.6%(250/270)</text>
40
- <rect x="260" y="182" width="124" height="26" rx="6" fill="#4E6DA8"/>
41
- <text x="396" y="203" font-size="22" font-weight="700" fill="#8FA6C6">17.8%(48/270)</text>
42
38
 
43
- <line x1="64" y1="226" x2="1136" y2="226" stroke="#263A5C" stroke-width="1.5"/>
39
+ <line x1="64" y1="200" x2="1136" y2="200" stroke="#263A5C" stroke-width="1.5"/>
44
40
 
45
41
  <!-- ── 分题型行 ── -->
46
42
  <!-- 抽取 -->
47
- <text x="240" y="286" font-size="19" fill="#C2CDDE" text-anchor="end">抽取</text>
48
- <rect x="260" y="254" width="700" height="18" rx="5" fill="#FFD15D"/>
49
- <text x="974" y="269" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
50
- <rect x="260" y="278" width="47" height="18" rx="5" fill="#4E6DA8"/>
51
- <text x="319" y="293" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">3/45</text>
43
+ <text x="240" y="249" font-size="19" fill="#C2CDDE" text-anchor="end">抽取</text>
44
+ <rect x="260" y="234" width="700" height="18" rx="5" fill="#FFD15D"/>
45
+ <text x="974" y="249" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
52
46
 
53
47
  <!-- 多跳 -->
54
- <text x="240" y="348" font-size="19" fill="#C2CDDE" text-anchor="end">多跳</text>
55
- <rect x="260" y="316" width="700" height="18" rx="5" fill="#FFD15D"/>
56
- <text x="974" y="331" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
57
- <text x="272" y="355" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">0/45</text>
48
+ <text x="240" y="303" font-size="19" fill="#C2CDDE" text-anchor="end">多跳</text>
49
+ <rect x="260" y="288" width="700" height="18" rx="5" fill="#FFD15D"/>
50
+ <text x="974" y="303" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
58
51
 
59
52
  <!-- 时序 -->
60
- <text x="240" y="410" font-size="19" fill="#C2CDDE" text-anchor="end">时序</text>
61
- <rect x="260" y="378" width="669" height="18" rx="5" fill="#FFD15D"/>
62
- <text x="943" y="393" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">43/45</text>
63
- <text x="272" y="417" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">0/45</text>
53
+ <text x="240" y="357" font-size="19" fill="#C2CDDE" text-anchor="end">时序</text>
54
+ <rect x="260" y="342" width="669" height="18" rx="5" fill="#FFD15D"/>
55
+ <text x="943" y="357" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">43/45</text>
64
56
 
65
57
  <!-- 知识更新 -->
66
- <text x="240" y="472" font-size="19" fill="#C2CDDE" text-anchor="end">知识更新 *</text>
67
- <rect x="260" y="440" width="482" height="18" rx="5" fill="#FFD15D"/>
68
- <text x="756" y="455" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">31/45</text>
69
- <text x="272" y="479" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">0/45</text>
58
+ <text x="240" y="411" font-size="19" fill="#C2CDDE" text-anchor="end">知识更新 *</text>
59
+ <rect x="260" y="396" width="482" height="18" rx="5" fill="#FFD15D"/>
60
+ <text x="756" y="411" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">31/45</text>
70
61
 
71
62
  <!-- 场景回忆 -->
72
- <text x="240" y="534" font-size="19" fill="#C2CDDE" text-anchor="end">场景回忆</text>
73
- <rect x="260" y="502" width="638" height="18" rx="5" fill="#FFD15D"/>
74
- <text x="912" y="517" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">41/45</text>
75
- <text x="272" y="541" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">0/45</text>
63
+ <text x="240" y="465" font-size="19" fill="#C2CDDE" text-anchor="end">场景回忆</text>
64
+ <rect x="260" y="450" width="638" height="18" rx="5" fill="#FFD15D"/>
65
+ <text x="912" y="465" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">41/45</text>
76
66
 
77
67
  <!-- 拒答 -->
78
- <text x="240" y="596" font-size="19" fill="#C2CDDE" text-anchor="end">拒答 *</text>
79
- <rect x="260" y="564" width="700" height="18" rx="5" fill="#FFD15D"/>
80
- <text x="974" y="579" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
81
- <rect x="260" y="588" width="700" height="18" rx="5" fill="#4E6DA8"/>
82
- <text x="974" y="603" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
68
+ <text x="240" y="519" font-size="19" fill="#C2CDDE" text-anchor="end">拒答 *</text>
69
+ <rect x="260" y="504" width="700" height="18" rx="5" fill="#FFD15D"/>
70
+ <text x="974" y="519" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">45/45</text>
83
71
 
84
72
  <!-- ── 脚注 ── -->
85
- <text x="64" y="672" font-size="16" fill="#8296B3">* 知识更新:改口后仍答旧值记 0 分(直接考核 L1 去重更新);拒答:没发生过的事编造即 0 分(两组均 0 编造)。</text>
73
+ <text x="64" y="600" font-size="16" fill="#8296B3">* 知识更新:改口后仍答旧值记 0 分(直接考核 L1 去重更新);拒答:没发生过的事编造即 0 分(0 编造)。</text>
74
+ <text x="64" y="622" font-size="16" fill="#8296B3">对话赛道 B 组已下线:Harness 会话彼此独立,无记忆的探针必然失败,对照无信息量。</text>
86
75
  </g>
87
76
  </svg>
@@ -2,7 +2,7 @@
2
2
  width="1200" height="660" viewBox="0 0 1200 660"
3
3
  role="img" aria-labelledby="benchWorkflowTitle benchWorkflowDesc">
4
4
  <title id="benchWorkflowTitle">DSH-MemBench 工作流赛道:A/B 两组完成度与成本对照</title>
5
- <desc id="benchWorkflowDesc">真实工具沙箱(4 场景 × 3 次)探针会话合计:任务完成度 A 组 24/3372.7%)对 B 组 11/3333.3%);成本对比以 B 组为满格基准,A 组相对更省——步骤 125186(B +49%)、工具调用 184296(B +61%)、输入 token 1.30M 对 1.86M(B +43%);向用户求助 A 0 次对 B 3 次;登录场景输入 token A 241k B 453k(+88%)。</desc>
5
+ <desc id="benchWorkflowDesc">真实工具沙箱(7 场景,A 3 / B 组 1 轮)探针段合计:任务完成度 A 组 59/6985.5%)对 B 组 10/2343.5%);成本对比以 B 组为满格基准(每场景均值),A 组相对更省——步骤 24.341.4(B +70%)、工具调用 37.762.1(B +65%)、输入 token 266k 对 1.81M(B 6.8 倍);风格规范场景探针 A 12/12 B 0/4;向用户求助 A 3 轮共 1 次、B 组 1 轮 1 次。</desc>
6
6
 
7
7
  <rect width="1200" height="660" rx="26" fill="#0D1526"/>
8
8
 
@@ -10,70 +10,70 @@
10
10
 
11
11
  <!-- ── 标题与图例 ── -->
12
12
  <text x="64" y="66" font-size="26" font-weight="700" fill="#EFF3FA">工作流赛道:真实工具沙箱 · 做得对,也更省</text>
13
- <text x="64" y="94" font-size="18" fill="#8296B3">4 场景 × 3 · 探针会话合计 · 成本行以 B 组为满格基准,蓝徽章 = B 组多付</text>
13
+ <text x="64" y="94" font-size="18" fill="#8296B3">7 场景 · A 组 3 / B 1 轮(成本护栏)· 探针段合计 · 成本行以 B 组为满格基准</text>
14
14
 
15
15
  <rect x="842" y="50" width="18" height="18" rx="5" fill="#FFD15D"/>
16
16
  <text x="868" y="65" font-size="18" fill="#C2CDDE">A 组 · 记忆开</text>
17
17
  <rect x="842" y="76" width="18" height="18" rx="5" fill="#4E6DA8"/>
18
18
  <text x="868" y="91" font-size="18" fill="#C2CDDE">B 组 · 记忆关</text>
19
19
 
20
- <!-- ── 任务完成度 ── -->
21
- <text x="64" y="152" font-size="20" font-weight="700" fill="#EFF3FA">任务完成度</text>
22
- <text x="186" y="152" font-size="17" fill="#8296B3">(产物程序化校验)</text>
20
+ <!-- ── 探针段完成度 ── -->
21
+ <text x="64" y="152" font-size="20" font-weight="700" fill="#EFF3FA">探针段完成度</text>
22
+ <text x="216" y="152" font-size="17" fill="#8296B3">(新会话延续任务,产物程序化校验)</text>
23
23
 
24
- <rect x="260" y="170" width="509" height="26" rx="6" fill="#FFD15D"/>
25
- <text x="783" y="191" font-size="22" font-weight="700" fill="#FFD15D">24/33 · 72.7%</text>
26
- <rect x="260" y="206" width="233" height="26" rx="6" fill="#4E6DA8"/>
27
- <text x="505" y="227" font-size="22" font-weight="700" fill="#8FA6C6">11/33 · 33.3%</text>
24
+ <rect x="260" y="170" width="598" height="26" rx="6" fill="#FFD15D"/>
25
+ <text x="872" y="191" font-size="22" font-weight="700" fill="#FFD15D">59/69 · 85.5%</text>
26
+ <rect x="260" y="206" width="304" height="26" rx="6" fill="#4E6DA8"/>
27
+ <text x="578" y="227" font-size="22" font-weight="700" fill="#8FA6C6">10/23 · 43.5%</text>
28
28
 
29
29
  <line x1="64" y1="258" x2="1136" y2="258" stroke="#263A5C" stroke-width="1.5"/>
30
30
 
31
31
  <!-- ── 成本对比(B = 满格基准)── -->
32
32
  <text x="64" y="290" font-size="20" font-weight="700" fill="#EFF3FA">成本对比</text>
33
- <text x="166" y="290" font-size="17" fill="#8296B3">(B 组 = 满格基准,条越短越省)</text>
33
+ <text x="166" y="290" font-size="17" fill="#8296B3">(每场景均值,B 组 = 满格基准,条越短越省)</text>
34
34
 
35
35
  <!-- 步骤 -->
36
36
  <text x="240" y="348" font-size="19" fill="#C2CDDE" text-anchor="end">步骤</text>
37
- <rect x="260" y="318" width="376" height="18" rx="5" fill="#FFD15D"/>
38
- <text x="648" y="333" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">125</text>
37
+ <rect x="260" y="318" width="329" height="18" rx="5" fill="#FFD15D"/>
38
+ <text x="603" y="333" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">24.3</text>
39
39
  <rect x="260" y="342" width="560" height="18" rx="5" fill="#4E6DA8"/>
40
- <text x="834" y="357" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">186</text>
40
+ <text x="834" y="357" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">41.4</text>
41
41
  <rect x="980" y="321" width="136" height="36" rx="10" fill="#315DA6"/>
42
- <text x="1048" y="345" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +49%</text>
42
+ <text x="1048" y="345" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +70%</text>
43
43
 
44
44
  <!-- 工具调用 -->
45
45
  <text x="240" y="430" font-size="19" fill="#C2CDDE" text-anchor="end">工具调用</text>
46
- <rect x="260" y="400" width="348" height="18" rx="5" fill="#FFD15D"/>
47
- <text x="620" y="415" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">184</text>
46
+ <rect x="260" y="400" width="340" height="18" rx="5" fill="#FFD15D"/>
47
+ <text x="614" y="415" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">37.7</text>
48
48
  <rect x="260" y="424" width="560" height="18" rx="5" fill="#4E6DA8"/>
49
- <text x="834" y="439" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">296</text>
49
+ <text x="834" y="439" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">62.1</text>
50
50
  <rect x="980" y="403" width="136" height="36" rx="10" fill="#315DA6"/>
51
- <text x="1048" y="427" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +61%</text>
51
+ <text x="1048" y="427" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +65%</text>
52
52
 
53
53
  <!-- 输入 token -->
54
54
  <text x="240" y="512" font-size="19" fill="#C2CDDE" text-anchor="end">输入 token</text>
55
- <rect x="260" y="482" width="391" height="18" rx="5" fill="#FFD15D"/>
56
- <text x="663" y="497" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">1.30M</text>
55
+ <rect x="260" y="482" width="82" height="18" rx="5" fill="#FFD15D"/>
56
+ <text x="356" y="497" font-size="18" font-weight="700" fill="#FFD15D" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">266k</text>
57
57
  <rect x="260" y="506" width="560" height="18" rx="5" fill="#4E6DA8"/>
58
- <text x="834" y="521" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">1.86M</text>
58
+ <text x="834" y="521" font-size="18" font-weight="700" fill="#8FA6C6" font-family="ui-monospace,SFMono-Regular,Menlo,Consolas,monospace">1.81M</text>
59
59
  <rect x="980" y="485" width="136" height="36" rx="10" fill="#315DA6"/>
60
- <text x="1048" y="509" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +43%</text>
60
+ <text x="1048" y="509" font-size="19" font-weight="700" fill="#FFD15D" text-anchor="middle">B +580%</text>
61
61
 
62
62
  <!-- ── 底部特写卡片 ── -->
63
63
  <rect x="64" y="544" width="512" height="72" rx="14" fill="#15223A" stroke="#263A5C" stroke-width="1.5"/>
64
- <text x="88" y="574" font-size="17" fill="#8296B3">向用户求助(探针会话)</text>
64
+ <text x="88" y="574" font-size="17" fill="#8296B3">风格规范场景 · 探针段(约定只存记忆,沙箱探不出来)</text>
65
65
  <text x="88" y="600" font-size="20" font-weight="700">
66
- <tspan fill="#FFD15D">A 0 次</tspan>
67
- <tspan fill="#8FA6C6"> · B 3 次(每轮要凭据)</tspan>
66
+ <tspan fill="#FFD15D">A 12/12</tspan>
67
+ <tspan fill="#8FA6C6"> · B 0/4</tspan>
68
68
  </text>
69
69
 
70
70
  <rect x="624" y="544" width="512" height="72" rx="14" fill="#15223A" stroke="#263A5C" stroke-width="1.5"/>
71
- <text x="648" y="574" font-size="17" fill="#8296B3">登录场景 · 输入 token(凭据只存在记忆里)</text>
71
+ <text x="648" y="574" font-size="17" fill="#8296B3">长任务成本 · 每场景输入 token(B 无记忆重新探索)</text>
72
72
  <text x="648" y="600" font-size="20" font-weight="700">
73
- <tspan fill="#FFD15D">A 241k</tspan>
74
- <tspan fill="#8FA6C6"> · B 453k</tspan>
73
+ <tspan fill="#FFD15D">A 266k</tspan>
74
+ <tspan fill="#8FA6C6"> · B 1.81M</tspan>
75
75
  </text>
76
76
  <rect x="1040" y="578" width="72" height="26" rx="8" fill="#315DA6"/>
77
- <text x="1076" y="597" font-size="18" font-weight="700" fill="#FFD15D" text-anchor="middle">+88%</text>
77
+ <text x="1076" y="597" font-size="18" font-weight="700" fill="#FFD15D" text-anchor="middle">6.8×</text>
78
78
  </g>
79
79
  </svg>