dsh-super-code 0.3.8 → 0.3.9

package/README.en.md

@@ -0,0 +1,144 @@
+# dsh-super-code
+
+[中文](README.md) · English
+
+A smarter, leaner, faster, and easier-to-use coding plugin for DeepSeek Harness.
+
+On SWE-bench Pro hard-100, compared with the official Standard preset (same host DSH `0.2.1-rc.2`, same model, both on high reasoning effort and legacy budgets):
+
+| | Standard + high | Super Code |
+|---|---:|---:|
+| Passed | 46/100 | **49/100** |
+| Net time per task | 20.9 min | **16.4 min** (-21.3%) |
+| Tokens per task | 7.81 M | **5.11 M** (-34.6%) |
+| Model calls per task | 92 | **69** (-25.5%) |
+
+Tested on version `0.3.5`. [Full results and limitations](docs/en/EvaluationResults.md)
+
+## Install
+
+Supports Harness from `0.1.5-alpha.1`, with Web verified through `0.2.1-rc.4`; see [compatibility](docs/en/Compatibility.md) for tested desktop versions.
+
+**Desktop**: open **Plugins → Add plugin** in the left sidebar, enter `dsh-super-code`, then click **Install** and **Enable now** (on older versions, reload or restart when prompted). Desktop includes its own runtime; Node.js is not required.
+
+**Web / CLI**: requires Node.js 22 or later.
+
+```bash
+npm install -g @deepseek-ai/dsh            # skip if dsh is already installed
+dsh plugin --profile web add dsh-super-code
+```
+
+<details>
+<summary>Install from a Release package</summary>
+
+Download the `.tgz` file from [GitHub Releases](https://github.com/ArtlexYoung/dsh-super-code/releases).
+
+Desktop: enter the full path of the package in "Package name or address", then click **Install**.
+
+[![Enter the package path](docs/images/install-tgz-preview.png)](docs/images/install-tgz.png)
+
+Web: run the following command (use the actual file name):
+
+```bash
+dsh plugin --profile web add ./dsh-super-code-0.3.9.tgz
+```
+
+</details>
+
+## Usage
+
+1. Open **Settings → Agent Presets** and select **Super Code** (identifier `super-code`).
+2. Create a new session and describe the task.
+
+Model, reasoning effort, permissions, and tools follow the Harness settings and need no separate configuration. Child Agents use the parent Agent's model by default.
+
+If the preset is not listed, check its status in **Settings → Super Code**, or see [troubleshooting](docs/en/UsageGuide.md#cant-find-the-preset).
+
+[![Super Code settings](docs/images/preset-settings-preview.png)](docs/images/preset-settings.png)
+
+Select **Super Code** in the right sidebar. It contains three sections:
+
+- **Tasks**: goal, step progress, tool-call summaries, and changed files. Read-only.
+- **Collaborative execution**: the Agent execution tree. Click a node to view details.
+- **Memory**: view, add, edit, and delete project memory and global preferences.
+
+The three sections open one at a time. Tasks opens by default; click the current heading to collapse it.
+
+[![Task sidebar](docs/images/task-status-preview.png)](docs/images/task-status.png)
+
+[![Agent tree](docs/images/agent-tree-preview.png)](docs/images/agent-tree.png)
+
+Screenshots use the current UI with sample data to illustrate the plugin.
+
+## Features
+
+| Feature | Description |
+|---|---|
+| Batched tool calls | Reads multiple files in parallel within one model call, reducing round trips |
+| Layered memory | Current task, project lessons, and global preferences are stored separately, each with its source |
+| Runtime budgets | Uses the better-performing legacy compression budgets by default; adjustable in Settings |
+| Deletion protection | Directs Agents to use recoverable `trash` by default; can switch to strict confirmation |
+| MCP connection | Allows external MCP clients to delegate tasks to DSH. Off by default |
+| Frontend Skill | Loaded on demand for UI work to check alignment, hit areas, and browser behavior |
+
+See the [usage guide](docs/en/UsageGuide.md).
+
+## Recent releases
+
+- **0.3.9**: Polished Settings and the task sidebar, improved MCP conversation control, fixed PTC child-tool approvals, and verified rc.4 Web compatibility.
+- **0.3.8**: Added MCP connection; external clients can delegate, inspect, continue, and cancel DSH conversations. Added a Home overview in Settings.
+- **0.3.7**: Added three-level deletion protection (Relaxed by default). Added Task status to the sidebar.
+
+[Full changelog](docs/en/Changelog.md)
+
+Versions follow `major.performance.maintenance`: a change in the second number indicates improved coding results or efficiency; the third covers fixes, UI, and compatibility. Every release requires extensive regression testing, so the release cycle may be long.
+
+## Evaluation
+
+### Method
+
+- **Task set**: SWE-bench Pro hard-100, graded with the official grader. Tuning uses only 33 hard tasks selected from the SWE-bench dev split; hard-100 is used only to evaluate frozen candidates and investigate issues, never for tuning, to avoid overfitting to the evaluation tasks.
+- **Baseline**: the official Standard preset rather than Minimal. On the old host, Standard + high passed 51 tasks and Minimal + high passed 46, with Standard using 23.5% fewer tokens per task. Comparing against the stronger baseline gives a stricter conclusion.
+- **Controlled variables**: same host, model, reasoning effort, and budgets; only the Agent preset differs.
+- **Metrics**: tasks passed, net time per task (excluding failed requests and retry waits), tokens per task, and model calls per task.
+
+### Process
+
+1. **Old-host baseline** (DSH `0.1.5-rc.2`, `deepseek-v4.1-flash`, high): the Super Code `0.3.0` candidate passed 56 tasks, the official Standard preset 51, and Minimal 46. Relative to Minimal, time fell by 47.6% and tokens by 44.9%.
+2. **Regression after the host upgrade**: after upgrading to DSH `0.2.1-rc.2` and `deepseek-v4.1-flash-1017`, under default budgets Standard dropped to 46 and Super Code `0.3.4` to 41, below Standard. Investigation found the new host had tightened context budgets: the compression threshold fell from 800,000 to 550,464 tokens, and retained verbatim context from 160,000 to 98,560 tokens.
+3. **Retest with legacy budgets**: both sides used legacy budgets. Standard stayed at 46 with 14.2% more tokens; Super Code `0.3.5` rose to 49 with only 0.4% more tokens and 19.4% less net time. Based on this, the plugin uses legacy budgets by default from `0.3.6`.
+4. **Cross-model check** (`glm-5.3-flash`, max): Super Code `0.3.4` passed 45 tasks and native ZCode 29. Super Code used less net time per task (32.9 vs 52.3 min) and more tokens (5.50 M vs 3.61 M).
+
+### Summary
+
+| Comparison | Passed | Efficiency |
+|---|---|---|
+| New host, legacy budgets: Super Code `0.3.5` vs Standard + high | 49 vs 46 | Net time -21.3%, tokens -34.6%, model calls -25.5% |
+| New host, default budgets: Super Code `0.3.4` vs Standard + high | 41 vs 46 | Tokens -25.5%, net time +13.9% |
+| Old host: Super Code `0.3.0` candidate vs Standard + high | 56 vs 51 | Raw time -34.9%, tokens -27.9% |
+| Old host: Super Code `0.3.0` candidate vs Minimal + high | 56 vs 46 | Time -47.6%, tokens -44.9% |
+| GLM-5.3-flash: Super Code `0.3.4` vs native ZCode | 45 vs 29 | Time -37.1%, tokens +52.4% |
+
+### Limitations
+
+- Each configuration was run once. The same task can pass in one run and fail in another; run-to-run variance for a fixed configuration has not been estimated.
+- The default-budget and legacy-budget runs used different plugin versions (`0.3.4` → `0.3.5`), so the gain cannot be attributed entirely to budgets.
+- `0.3.6` – `0.3.9` have not been re-evaluated on the 100 tasks.
+- The cross-model comparison is between two complete systems and cannot isolate the plugin's contribution.
+
+[Results and methodology](docs/en/EvaluationResults.md) · [All result tables](eval/results/swebench-pro-final-100/ResultsTables.md)
+
+## Acknowledgements
+
+This project recognizes the [LINUX DO](https://linux.do) community.
+
+| Project | Reference |
+|---|---|
+| [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) (MIT) | Host runtime: Agents, sessions, tools, PTC, Skills, UI extensions |
+| [ZCode](https://github.com/zai-org/ZCode) (Apache-2.0) | UI design |
+| [Agent Skills](https://agentskills.io/specification) | File format of the frontend Skill |
+| [Apple HIG](https://developer.apple.com/design/human-interface-guidelines), [WCAG 2.2](https://www.w3.org/TR/WCAG22/) | Interaction and accessibility principles in the frontend Skill |
+| [SWE-bench](https://github.com/SWE-bench/SWE-bench), [SWE-bench Pro](https://github.com/scaleapi/SWE-bench_Pro-os) (code MIT) | Tuning and evaluation tasks |
+| [js-yaml](https://github.com/nodeca/js-yaml), [Zod](https://github.com/colinhacks/zod) (MIT) | YAML parsing, data validation |
+
+[Detailed acknowledgements and licenses](docs/en/Acknowledgements.md) · This project is licensed under [Apache-2.0](LICENSE).

package/README.md

@@ -1,239 +1,144 @@
 # dsh-super-code
 
-一个更快、更节省、更聪明的 DeepSeek Harness 编码插件。简单任务直接做，复杂任务按需组织专业 Agent；任务状态和有来源的经验可以留到后续对话，不必反复交代。
+中文 · [English](README.en.md)
 
-A faster, more efficient coding plugin for DeepSeek Harness. It handles straightforward tasks directly, brings in specialist Agents when useful, and keeps sourced knowledge available for later conversations.
+一个更聪明、更节省、更快速、更好用的 DeepSeek Harness 编码插件。
 
-在同一组 SWE-bench Pro hard-100 中，0.3.0 的评测候选相比官方 minimal，平均回答耗时减少 **48%**、每题总 token 减少 **45%**、模型调用次数减少 **44.4%**，通过率从 **46% 提高到 56%**。[完整结果与限制](docs/EvaluationResults.md)
+在 SWE-bench Pro hard-100 上，与官方标准预设对比（同一宿主 DSH `0.2.1-rc.2`、同一模型、均为 high 思考等级与旧预算）：
 
-On the same SWE-bench Pro hard-100 set, the evaluation candidate for 0.3.0 uses **48% less response time**, **45% fewer total tokens**, and **44.4% fewer model calls**, with **56% passing versus 46%** for official minimal. [Full results and limitations](docs/EvaluationResults.md)
-
-# 1 版本与更新 · Versions and Updates
-
-为保证版本效果，发布前需要进行大量测试和回归验证，耗时较久，因此更新周期可能较长。
-
-Extensive testing and regression checks are needed to verify each release's effectiveness. This takes time, so release cycles may be longer.
-
-版本号采用 **主版本.效果优化版本.维护版本**，例如 `0.3.8`：
-
-Version numbers follow **major.performance-improvement.maintenance**, for example `0.3.8`:
-
-| 位置 / Position | 含义 / Meaning |
-|---|---|
-| 第一位 / First (`0`) | 主版本，仅在大范围重构时调整。 / Major version; changes only for extensive refactoring. |
-| 第二位 / Second (`3`) | 效果优化版本，记录编码效果、效率等方面的优化。 / Performance-improvement version; tracks improvements to coding results, efficiency, and related capabilities. |
-| 第三位 / Third (`8`) | 维护版本，记录问题修复、UI 优化、兼容性适配等更新。 / Maintenance version; tracks bug fixes, UI improvements, compatibility updates, and similar changes. |
-
-## 0.3.8 · What's New
-
-新增默认关闭、仅监听本机的 MCP 连接，支持目录授权、连接容量和显式选择复用或新建 DSH 对话。[更新详情](docs/Changelog.md)
-
-Adds an opt-in localhost-only MCP connection with directory authorization, connection capacity, and explicit reuse-or-create DSH conversation selection. [Changelog](docs/Changelog.md)
-
-## 0.3.7 · What's New
-
-新增默认宽松的三档删除保护，以及全展开、虚拟滚动的任务状态侧栏。[更新详情](docs/Changelog.md)
-
-Adds three deletion-protection modes, defaulting to Relaxed, and a fully expanded task-status sidebar with virtual scrolling. [Changelog](docs/Changelog.md)
-
-## 0.3.6 · What's New
-
-针对新版 Harness 预算收紧后的效果退化，新增预算配置并默认恢复此前效果更好的旧预算，无需手动填写。[更新详情](docs/Changelog.md)
-
-Adds configurable budgets and restores the older, better-performing budgets without manual setup to address regressions observed after newer Harness versions reduced them. [Changelog](docs/Changelog.md)
-
-[查看完整版本记录 · Full changelog](docs/Changelog.md)
-
-# 2 开始使用 · Get Started
-
-支持 Harness `0.1.5-alpha.1` 至 `0.2.1-rc.2`，按所用客户端选择安装方式；[各版本与客户端的验证范围](docs/Compatibility.md)。
-
-Supports Harness `0.1.5-alpha.1` through `0.2.1-rc.2`. Choose the installation method for your client; see [validation coverage by version and client](docs/Compatibility.md).
-
-正式版提供默认关闭的 **MCP 连接**：首页集中显示预设、保护、连接及在线/历史对话数量，客户端与关联会话详情在“连接”页；在“连接”中勾选工作目录并启用，通过连接 Prompt 配置 MCP 客户端。连接后先用 `dsh_sessions` 查看目录最近对话和连接额度，由调用方选择复用或新建，避免无意创建过多会话。外部会话新增目录需在 DSH 弹窗中同意，委派沿用宿主模型与权限。[连接配置、工具和恢复说明](docs/UsageGuide.md#mcp-连接--mcp-connection)
-
-The release provides an opt-in **MCP connection** with a Home overview for presets, protection, connections and connected/past conversation counts; client and linked-session details are in Connection. Select directories and enable it under Connection, then configure an MCP client using the connection prompt. After connecting, call `dsh_sessions` to see recent conversations and connection capacity, then explicitly choose reuse or a new root. Additional directories require consent in a DSH dialog. Delegation uses the host model and permissions. [Setup, tools and recovery](docs/UsageGuide.md#mcp-连接--mcp-connection)
-
-## 2.1 安装 · Install
-
-### 官方桌面版 · Official Desktop
+| | 标准 + high | Super Code |
+|---|---:|---:|
+| 通过 | 46/100 | **49/100** |
+| 每题净耗时 | 20.9 分钟 | **16.4 分钟**（-21.3%） |
+| 每题 token | 781 万 | **511 万**（-34.6%） |
+| 每题模型调用 | 92 次 | **69 次**（-25.5%） |
 
-打开左侧 **插件 → 添加插件**，在“包名或地址”中输入 `dsh-super-code`，点击 **安装**。新版安装完成后点击 **立即启用**；其他版本按提示重新加载或重启。桌面版自带运行环境，无需另外安装 Node.js。
+基于版本 `0.3.5` 测试。[完整结果与限制](docs/EvaluationResults.md)
 
-Open **Plugins → Add plugin**, enter `dsh-super-code` in “Package name or address”, and click **Install**. On newer hosts, click **Enable now** when installation finishes; on other versions, reload or restart if prompted. The desktop app includes its runtime; no separate Node.js installation is needed.
+## 安装
 
-### Web / 命令行版 · Web / CLI
+支持 Harness `0.1.5-alpha.1` 起的版本，Web 已验证至 `0.2.1-rc.4`；桌面版验证范围见[兼容性记录](docs/Compatibility.md)。
 
-需要 Node.js 22 或更高版本。通过 npm 安装 Harness，再添加插件；已有 `dsh` 命令时跳过第一行。
+**桌面版**：在左侧打开「插件 → 添加插件」，输入 `dsh-super-code`，依次点击「安装」和「立即启用」（旧版本请按提示重载或重启）。桌面版内置运行环境，无需安装 Node.js。
 
-Requires Node.js 22 or later. Install Harness via npm, then add the plugin. Skip the first line if `dsh` is already installed.
+**Web / 命令行版**：需要 Node.js 22 及以上版本。
 
 ```bash
-npm install -g @deepseek-ai/dsh
+npm install -g @deepseek-ai/dsh            # 已安装 dsh 命令可跳过
 dsh plugin --profile web add dsh-super-code
 ```
 
 <details>
-<summary>使用 Release 安装包（可选） · Install a Release package (optional)</summary>
+<summary>使用 Release 安装包</summary>
+
+从 [GitHub Releases](https://github.com/ArtlexYoung/dsh-super-code/releases) 下载 `.tgz` 文件。
 
-从 [GitHub Releases](https://github.com/ArtlexYoung/dsh-super-code/releases) 下载 `.tgz` 包。桌面版在“包名或地址”中填入文件的完整路径；Web 版运行以下命令，将文件名替换为实际下载的版本。
+桌面版：在「包名或地址」中填写安装包的完整路径，然后点击「安装」。
 
-Download a `.tgz` package from [GitHub Releases](https://github.com/ArtlexYoung/dsh-super-code/releases). On desktop, enter its full path in “Package name or address”. For Web, run the command below with the filename you downloaded.
+[![填写安装包路径](docs/images/install-tgz-preview.png)](docs/images/install-tgz.png)
+
+Web 版：运行以下命令（文件名以实际下载的为准）：
 
 ```bash
-dsh plugin --profile web add ./dsh-super-code-0.3.8.tgz
+dsh plugin --profile web add ./dsh-super-code-0.3.9.tgz
 ```
 
 </details>
 
-## 2.2 选中预设 · Select the Preset
-
-打开 **设置 → Agent 预设**，选择 **Super Code 模式**（默认标识符 `super-code`）。
-
-Open **Settings → Agent Presets** and choose **Super Code** (default identifier: `super-code`).
-
-## 2.3 开始对话 · Start a Conversation
-
-新建会话，描述你要完成的编码任务。模型、推理等级、权限和工具沿用 Harness 的设置；子 Agent 默认继承父 Agent 的模型，不用另配模型池。
-
-Open a new session and describe the task. Models, reasoning effort, permissions, and tools come from Harness; child Agents inherit the parent's model by default.
-
-没看到预设？在“设置”→ **Super Code** 查看状态；旧插件版本的入口在“插件配置”中。[安装与排查](docs/UsageGuide.md)
-
-Can't find the preset? Open “Settings” → **Super Code**. Older plugin versions place this under “Plugin configuration”. [Setup and troubleshooting](docs/UsageGuide.md)
-
-[![Super Code 配置入口 · Super Code settings](docs/images/preset-settings-preview.png)](docs/images/preset-settings.png)
-
-右侧 **Super Code** 页面依次展示任务状态、协作执行和记忆库，默认展开任务状态，点击标题切换。任务、步骤和已加载动作直接展开，虚拟滚动保持长列表流畅；保留圆圈 Agent 执行树及记忆的查看、新增、编辑和删除。任务状态只读取现有记录，不改变提示词或模型行为。[界面与记忆说明](docs/UsageGuide.md)
-
-The **Super Code** sidebar contains Task status, Agent execution, and Memory library, with Task status open by default. Tasks, steps, and loaded activity stay expanded in a virtualized list. The circular Agent graph and memory browsing, creation, editing, and deletion remain available. Task status reads existing records without changing prompts or model behavior. [Interface and memory guide](docs/UsageGuide.md)
-
-[![Agent 执行树 · Agent execution tree](docs/images/agent-tree-preview.png)](docs/images/agent-tree.png)
-
-# 3 效果 · Results
+## 使用
 
-当前版本迭代的效果优化均使用从 SWE-bench 官方 dev 集中筛选出的 **33 道有效困难题**；SWE-bench Pro hard-100 的 100 题用于候选冻结后的效果评测及 bug 排查，不参与效果调优。详见[评测口径与限制](docs/EvaluationResults.md)。
+1. 打开「设置 → Agent 预设」，选择 **Super Code 模式**（标识符 `super-code`）。
+2. 新建会话，描述任务即可。
 
-Current iterations are optimized on **33 valid difficult tasks selected from the official SWE-bench dev split**. The 100 SWE-bench Pro hard-100 tasks are used to evaluate frozen candidates and investigate bugs, not for performance tuning. See the [methodology and limitations](docs/EvaluationResults.md).
+模型、推理等级、权限和工具均沿用 Harness 的设置，无需单独配置；子 Agent 默认使用父 Agent 的模型。
 
-## 3.1 各版本成绩 · Version Results
+若未找到预设，可在「设置 → Super Code 模式」中查看状态，或参阅[排查方法](docs/UsageGuide.md#找不到预设)。
 
-五组均使用 **DSH `0.1.5-rc.2`**、**`deepseek-v4.1-flash`** 和 `high` 思考等级，完成同一批 100 题；评分环境异常已用原补丁复核。0.2.0 和 0.3.0 对应已评测的候选，耗时保留历史原始作答口径。
+[![Super Code 设置页](docs/images/preset-settings-preview.png)](docs/images/preset-settings.png)
 
-All five runs used **DSH `0.1.5-rc.2`**, **`deepseek-v4.1-flash`**, and `high` reasoning on the same 100 tasks. Grading anomalies were rechecked with the original patches. Versions 0.2.0 and 0.3.0 refer to evaluated candidates; times retain the historical response-time convention.
+在右侧边栏选择「Super Code」，包含三个部分：
 
-| 指标 / Metric | 官方 minimal + high | 0.0.9 | 0.1.2 | 0.2.0 | 0.3.0 |
-|---|---:|---:|---:|---:|---:|
-| 通过 / Passed | 46/100 | 50/100 | 53/100 | 54/100 | **56/100** |
-| 平均耗时（历史）/ Original minutes per task | 25.685 | 16.458 | 16.011 | 15.148 | **13.461** |
-| 平均总 token / Total tokens per task | 11,578,046.900 | 9,623,216.520 | 9,938,176.210 | 9,299,093.840 | **6,381,968.850** |
-| 缓存输入 token/题 / Cached input | 11,404,101.120 | 9,461,981.440 | 9,775,799.040 | 9,142,005.760 | 6,231,823.360 |
-| 模型调用/题 / Model calls | 124.660 | 92.780 | 99.780 | 93.830 | **69.290** |
+- **任务**：目标、步骤进度、工具调用汇总和已修改的文件，只读。
+- **协作执行**：Agent 执行树，点击节点可查看详情。
+- **记忆**：查看、新增、编辑和删除项目记忆与全局偏好。
 
-五组均按相同规则复核。通过数已包含实际测试全部通过、仅因测试名称差异被误判的记录；用量和耗时保持原作答数据。修正依据见[评测说明](docs/EvaluationResults.md)。
+三个部分互斥展开，默认显示任务；点击当前标题可收起。
 
-All five runs were reviewed under the same rules. Pass counts include verified cases where every test passed but test-name differences caused a grading mismatch. Original usage and timing are unchanged. See the [evaluation report](docs/EvaluationResults.md) for correction evidence.
+[![任务侧边栏](docs/images/task-status-preview.png)](docs/images/task-status.png)
 
-## 3.2 官方预设成绩 · Official Preset Results
+[![Agent 执行树](docs/images/agent-tree-preview.png)](docs/images/agent-tree.png)
 
-本表使用 **DSH `0.1.5-rc.2`** 和 **`deepseek-v4.1-flash`**，思考等级按列标明；成绩包含后续原补丁复评与测试名称修正。各列只统计有效结果，未满 100 题的列不参与完整 100 题排名。
+截图使用当前界面与演示数据，仅展示插件外观。
 
-This table uses **DSH `0.1.5-rc.2`** and **`deepseek-v4.1-flash`**, with reasoning effort shown per column. Scores include subsequent original-patch regrades and verified test-name corrections. Each column uses valid scores only; incomplete columns are excluded from full 100-task rankings.
+## 功能
 
-| 指标 / Metric | 极简 minimal + high | 极简 minimal + max | 标准 standard + high | PTC + high | 创造 creative + high | 标准 standard + max |
-|---|---:|---:|---:|---:|---:|---:|
-| 有效进度 / Valid scores | 100/100 | 100/100 | 100/100 | 100/100 | 100/100 | 99/100 |
-| 通过/有效 / Passed / valid | 46/100 | 50/100 | 51/100 | 47/100 | 49/100 | 49/99 |
-| 待环境复评 / Pending regrades | 0 | 0 | 0 | 0 | 0 | 0 |
-| 原始分钟/题 / Original minutes | 25.685 | 32.529 | 20.683 | 17.302 | 19.856 | 20.452 |
-| 净分钟/题 / Net minutes | 25.122 | 32.009 | 18.826 | 15.122 | 18.714 | 19.561 |
-| 模型调用/题 / Model calls | 124.660 | 138.920 | 92.370 | 71.160 | 93.600 | 101.061 |
-| 总 token/题 / Total tokens | 11,578,046.900 | 14,966,097.260 | 8,854,513.910 | 6,238,434.510 | 9,292,949.400 | 11,526,872.192 |
-| 缓存输入 token/题 / Cached input | 11,404,101.120 | 14,770,140.160 | 8,713,578.230 | 6,099,266.510 | 9,145,025.240 | 11,349,317.818 |
-| 非缓存输入 token/题 / Uncached input | 73,068.830 | 79,357.380 | 58,114.810 | 61,668.140 | 60,262.050 | 68,006.202 |
-| 输出 token/题 / Output | 100,876.950 | 116,599.720 | 82,820.870 | 77,499.860 | 87,662.110 | 109,548.172 |
-| 缺少用量的请求 / Requests without usage | 3 | 11 | 4 | 5 | 2 | 0 |
-
-净耗时扣除最终有效作答中的失败请求和重试等待；两种耗时均不含官方评分。调用次数排除已记录的失败请求。总 token = 缓存输入 + 非缓存输入 + 输出，输出含思考 token。复评分保留原作答的用量和耗时；有效题目范围变化时，均值会随之变化。未返回的用量不估算，数字不等于完整账单。
-
-Net time excludes failed requests and retry waits in the final valid answer; both time measures exclude grading. Call counts exclude logged failed requests. Total tokens = cached input + uncached input + output, including reasoning. Regrading preserves each answer's original usage and timing; means change when the valid subset changes. Missing usage is not estimated, so these figures are not a complete bill.
-
-创造保留官方预设与工具定义；评测隔离禁止 `cordis_run` 在宿主上执行动态代码，只读检查仍可使用。极简 + high 复用历史基线，宿主修订与本轮不同，不能把差异完全归因于思考等级。
-
-Creative retains the official preset and tools; evaluation isolation blocks host-side dynamic execution through `cordis_run`, while read-only inspection remains available. Minimal + high reuses a historical baseline with different Harness revisions, so the results do not isolate reasoning effort.
-
-## 3.3 跨模型迁移 · Cross-Model Transfer
-
-将模型换为 **`glm-5.3-flash`**，思考等级统一为 **`max`**，仍使用同一批 hard-100。两组均完成 100 题：Super Code 使用 **DSH `0.1.5-rc.2` + 插件 `0.3.4`**；对照使用完整原生 **ZCode Desktop `3.14.4` / CLI `0.16.9`**，没有抽取部分源码模拟 Agent。
-
-Both runs completed the same hard-100 set using **`glm-5.3-flash`** with **`max`** reasoning. Super Code ran on **DSH `0.1.5-rc.2` + plugin `0.3.4`**; the comparison used the complete native **ZCode Desktop `3.14.4` / CLI `0.16.9`**, rather than an extracted Agent implementation.
+| 功能 | 说明 |
+|---|---|
+| 批量工具调用 | 在一次模型调用中并行读取多个文件，减少往返次数 |
+| 分层记忆 | 当前任务、项目经验和全局偏好分别存储，每条记录均标注来源 |
+| 运行预算 | 默认使用效果更好的旧压缩预算，可在设置中调整 |
+| 删除保护 | 默认引导 Agent 使用可恢复的 `trash`，可切换为严格确认 |
+| MCP 连接 | 允许外部 MCP 客户端将任务委派给 DSH 执行，默认关闭 |
+| 前端 Skill | 开发页面时按需加载，检查对齐、点击区域和浏览器表现 |
 
-| 指标 / Metric | DSH + Super Code 0.3.4 | 原生 ZCode / Native ZCode |
-|---|---:|---:|
-| 通过 / Passed | 44/100 | 28/100 |
-| 净分钟/题 / Net minutes | 32.896 | 52.320 |
-| 模型调用/题 / Model calls | 66.890 | 64.310 |
-| 总 token/题 / Total tokens | 5,499,154.470 | 3,609,511.930 |
-| 缓存输入 token/题 / Cached input | 5,302,796.160 | 3,356,862.720 |
-| 缺少用量的请求 / Requests without usage | 29 | 120 |
+详见[使用说明](docs/UsageGuide.md)。
 
-这轮 Super Code 通过率高 **16 个百分点**，平均净耗时更少，但 token 更多。这说明方案可在 GLM 上运行并取得有效结果；对照比较的是两套完整系统，不能据此分离插件的贡献，也不能推及所有模型。缺失用量未估算。[测试脚本与记录](eval/glm/README.md)
+## 最近更新
 
-Super Code passed **16 percentage points** more tasks and used less net time, but more tokens. This demonstrates working transfer to GLM in this run. The comparison covers two complete systems, so it neither isolates the plugin's contribution nor establishes gains across all models. Missing usage is not estimated. [Scripts and records](eval/glm/README.md)
+- **0.3.9**：美化设置和任务侧栏，完善 MCP 对话控制并修复 PTC 子工具审批，验证 rc.4 Web 兼容性。
+- **0.3.8**：新增 MCP 连接，外部客户端可委派、查看、继续和取消 DSH 对话；设置页新增首页概览。
+- **0.3.7**：新增三档删除保护（默认宽松）；侧边栏新增任务状态。
 
-## 3.4 新版 DSH 与预算 · New DSH and Budgets
+[完整版本记录](docs/Changelog.md)
 
-以下四组均使用 **DSH `0.2.1-rc.2`**、新模型 **`deepseek-v4.1-flash-1017`**（调用标识 `deepseek/deepseek-flash`）和 **`high`** 思考，完成同一批 100 题。这里只展示官方预设与正式插件版本。
+版本号格式为「主版本.效果版本.维护版本」：第二位变化表示编码效果或效率有提升，第三位表示修复、界面和兼容性更新。每次发布前均需完成大量回归测试，因此更新周期可能较长。
 
-All four runs completed the same 100 tasks on **DSH `0.2.1-rc.2`**, using the newer **`deepseek-v4.1-flash-1017`** model (API ID: `deepseek/deepseek-flash`) with **`high`** reasoning. Only official presets and released plugin versions are shown here.
+## 评测
 
-| 指标 / Metric | 标准 / Standard · 默认 / Default | Super Code 0.3.4 · 默认 / Default | 标准 / Standard · 旧预算 / Legacy | Super Code 0.3.5 · 旧预算 / Legacy |
-|---|---:|---:|---:|---:|
-| 通过/有效 / Passed / valid | 45/100 | 40/99 | 46/100 | 48/99 |
-| 待核查 / Pending review | 0 | 1 | 0 | 1 |
-| 净分钟/题 / Net minutes | 17.875 | 20.458 | 20.870 | 16.486 |
-| 模型调用/题 / Model calls | 85.050 | 69.051 | 91.980 | 68.616 |
-| 总 token/题 / Total tokens | 6,832,805.820 | 5,125,240.424 | 7,806,295.960 | 5,131,724.556 |
-| 缓存输入 token/题 / Cached input | 6,710,566.400 | 5,008,071.111 | 7,679,298.560 | 5,016,822.909 |
-| 缺少用量的请求 / Requests without usage | 0 | 0 | 0 | 1 |
+### 评测方法
 
-两组 Super Code 各有一条 NodeBB 环境异常待核查，暂不计入有效评分和均值。npm 依赖已离线打包，但参考答案仍遇到初始化超时；原答案、判分记录和用量保留。
+- **题集**：SWE-bench Pro hard-100，使用官方评分器。调优仅使用 SWE-bench dev 中筛选的 33 道困难题；hard-100 只用于评测冻结后的候选版本和排查问题，不参与调优，以避免对评测题过拟合。
+- **对照**：官方标准预设，而非 minimal。旧宿主实测中，标准 + high 通过 51 题，minimal + high 通过 46 题，且标准每题 token 少 23.5%。与更强的对照比较，结论更严格。
+- **控制变量**：同一宿主、同一模型、同一思考等级、同一预算，仅替换 Agent 预设。
+- **指标**：通过数、每题净耗时（扣除失败请求和重试等待）、每题 token、每题模型调用次数。
 
-Each Super Code run has one NodeBB environment issue pending review, excluded from valid-score counts and means. npm dependencies are bundled offline, but reference setup still times out; original answers, verdicts, and usage are retained.
+### 评测过程
 
-- **新版组合出现退化。** 相比旧 DSH / 旧模型，标准通过数从 51 降到 45，Super Code 从 0.3.0 候选的 56 降到 0.3.4 的 40；这同时涉及宿主、模型和插件版本变化。
-- **预算是已定位的影响因素。** 新版更早压缩上下文、保留更少原文，PTC 执行时限也有变化。恢复旧预算后，Super Code 从 40 回升至 48，标准从 45 到 46。**0.3.6 已默认恢复旧预算**；表中验证组实际是 **0.3.5 + 显式旧预算**，不是另跑的 0.3.6 成绩。
-- **结果仍有波动。** v4.1 的多轮实验中，同一道题存在一轮通过、另一轮失败的情况。后续版本会尝试改善这种不稳定性；各轮配置也有变化，本轮回升不代表已消除波动，也不能证明全部退化都由预算造成。
+1. **旧宿主基线**（DSH `0.1.5-rc.2`，`deepseek-v4.1-flash`，high）：Super Code `0.3.0` 候选通过 56 题，官方标准预设 51 题，minimal 46 题。相对 minimal，耗时减少 47.6%，token 减少 44.9%。
+2. **宿主升级后效果下降**：升级到 DSH `0.2.1-rc.2` 和 `deepseek-v4.1-flash-1017` 后，在默认预算下标准降至 46 题，Super Code `0.3.4` 降至 41 题，低于标准。排查发现新宿主收紧了上下文预算：压缩阈值由 800,000 降至 550,464 token，保留原文由 160,000 降至 98,560 token。
+3. **恢复旧预算后复测**：双方均使用旧预算。标准仍为 46 题，token 增加 14.2%；Super Code `0.3.5` 提升至 49 题，token 仅增加 0.4%，净耗时减少 19.4%。据此，`0.3.6` 起插件默认使用旧预算。
+4. **跨模型验证**（`glm-5.3-flash`，max）：Super Code `0.3.4` 通过 45 题，原生 ZCode 通过 29 题；Super Code 每题净耗时更少（32.9 vs 52.3 分钟），token 更多（550 万 vs 361 万）。
 
-- **The newer combination regressed.** Standard fell from 51 passes on the older host/model to 45; Super Code fell from 56 for the 0.3.0 candidate to 40 for 0.3.4. Host, model, and plugin versions changed together.
-- **Budgets are one identified factor.** The newer host compresses earlier, retains less verbatim context, and changes PTC execution deadlines. Restoring the older budgets raised Super Code from 40 to 48 and standard from 45 to 46. **Version 0.3.6 restores these defaults.** The measured row is **0.3.5 with explicit legacy budgets**, not a separate 0.3.6 run.
-- **Run-to-run variation remains.** Across v4.1 experiments, the same task has both passed and failed. Future versions will aim to reduce this variability. Configurations also changed between runs; the recovery does not establish stability or attribute the entire regression to budgets.
+### 结果汇总
 
-[预算诊断、逐题记录与限制 · Budget diagnosis, per-task records, and limitations](docs/EvaluationResults.md#新版-dsh-与预算--new-dsh-and-budgets)
+| 对比 | 通过 | 效率 |
+|---|---|---|
+| 新宿主、旧预算：Super Code `0.3.5` vs 标准 + high | 49 vs 46 | 净耗时 -21.3%，token -34.6%，模型调用 -25.5% |
+| 新宿主、默认预算：Super Code `0.3.4` vs 标准 + high | 41 vs 46 | token -25.5%，净耗时 +13.9% |
+| 旧宿主：Super Code `0.3.0` 候选 vs 标准 + high | 56 vs 51 | 原始耗时 -34.9%，token -27.9% |
+| 旧宿主：Super Code `0.3.0` 候选 vs minimal + high | 56 vs 46 | 耗时 -47.6%，token -44.9% |
+| GLM-5.3-flash：Super Code `0.3.4` vs 原生 ZCode | 45 vs 29 | 耗时 -37.1%，token +52.4% |
 
-[多维指标、逐题证据与统计口径](docs/EvaluationResults.md)
+### 限制
 
-[Detailed metrics, per-task evidence, and methodology](docs/EvaluationResults.md)
+- 每组配置只运行一轮。同一道题在不同轮次中结果可能不同，目前尚未估计固定配置下的随机波动。
+- 默认预算与旧预算两组的插件版本不同（`0.3.4` → `0.3.5`），收益不能全部归因于预算。
+- `0.3.6` ~ `0.3.9` 未重新运行 100 题评测。
+- 跨模型对比是两套完整系统之间的比较，无法单独分离插件的贡献。
 
-[使用说明 · Usage](docs/UsageGuide.md) · [兼容性 · Compatibility](docs/Compatibility.md) · [版本记录 · Changelog](docs/Changelog.md)
+[评测结果与口径](docs/EvaluationResults.md) · [完整成绩表](eval/results/swebench-pro-final-100/ResultsTables.md)
 
-# 4 致谢 · Acknowledgements
+## 致谢
 
 本项目认可 [LINUX DO](https://linux.do) 社区。
 
-This project recognizes the [LINUX DO](https://linux.do) community.
-
-感谢以下项目与资料。具体贡献、借鉴范围和许可证说明见[详细致谢文档](docs/Acknowledgements.md)。
-
-Thanks to the projects and resources below. See the [detailed acknowledgements](docs/Acknowledgements.md) for contributions, design references, and license notes.
-
-| 项目 / Reference | 类型与许可证 / Type and license | 贡献与借鉴 / Contribution and influence |
-| --- | --- | --- |
-| [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) | 宿主 / Harness，MIT | Agent、会话、工具、PTC、Skill 与 Web / 桌面扩展接口 / Agents, sessions, tools, PTC, Skills, Web and desktop APIs |
-| [ZCode](https://github.com/zai-org/ZCode) | UI 设计参考 / UI reference，Apache-2.0 | 紧凑布局、视觉层级、设置分组与交互状态 / Compact layouts, hierarchy, settings groups, interaction states |
-| [Agent Skills](https://agentskills.io/specification) | 开放规范 / Open specification，Apache-2.0 | SKILL.md、元数据、参考目录与按需加载 / SKILL.md, metadata, resource directories, progressive disclosure |
-| [Apple Human Interface Guidelines](https://developer.apple.com/design/human-interface-guidelines) | 设计指南，官方文档条款 / Design guidance, documentation terms | 前端 Skill 的布局、操作负担与反馈原则 / Layout, ergonomic controls, feedback guidance for the frontend Skill |
-| [W3C WCAG 2.2](https://www.w3.org/TR/WCAG22/) | Web 无障碍标准，W3C 文档条款 / Accessibility standard, W3C document terms | 操作目标尺寸、间距与浏览器验证 / Target size, spacing, browser validation |
-| [SWE-bench](https://github.com/SWE-bench/SWE-bench) | 评测代码 MIT；数据另见条款 / MIT code; separate data terms | dev 集有效困难 33 题的来源与评分基础 / Source and grading foundation for the 33 valid difficult dev tasks |
-| [SWE-bench Pro](https://github.com/scaleapi/SWE-bench_Pro-os) | 评测代码 MIT；数据另见条款 / MIT code; separate data terms | 冻结候选的 hard-100 评测与 bug 排查 / Frozen-candidate hard-100 evaluation and bug investigation |
-| [js-yaml](https://github.com/nodeca/js-yaml) / [Zod](https://github.com/colinhacks/zod) | 运行依赖 / Runtime dependencies，MIT | YAML 解析与数据校验 / YAML parsing and data validation |
+| 项目 | 参考内容 |
+|---|---|
+| [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness)（MIT） | 运行宿主：Agent、会话、工具、PTC、Skill、界面扩展 |
+| [ZCode](https://github.com/zai-org/ZCode)（Apache-2.0） | 界面设计 |
+| [Agent Skills](https://agentskills.io/specification) | 前端 Skill 的文件格式 |
+| [Apple HIG](https://developer.apple.com/design/human-interface-guidelines)、[WCAG 2.2](https://www.w3.org/TR/WCAG22/) | 前端 Skill 的交互与无障碍原则 |
+| [SWE-bench](https://github.com/SWE-bench/SWE-bench)、[SWE-bench Pro](https://github.com/scaleapi/SWE-bench_Pro-os)（代码 MIT） | 调优题与评测题 |
+| [js-yaml](https://github.com/nodeca/js-yaml)、[Zod](https://github.com/colinhacks/zod)（MIT） | YAML 解析、数据校验 |
+
+[详细致谢与许可证](docs/Acknowledgements.md) · 本项目采用 [Apache-2.0](LICENSE) 许可证。