dsh-super-code 0.1.1 → 0.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +34 -78
- package/client/index.js +195 -79
- package/lib/core/guidance.d.ts +1 -1
- package/lib/core/guidance.d.ts.map +1 -1
- package/lib/core/guidance.js +1 -1
- package/lib/core/guidance.js.map +1 -1
- package/lib/core/teams.d.ts +1 -1
- package/lib/core/teams.d.ts.map +1 -1
- package/lib/core/teams.js +9 -9
- package/lib/core/teams.js.map +1 -1
- package/lib/dsh/preset-installation.d.ts +22 -3
- package/lib/dsh/preset-installation.d.ts.map +1 -1
- package/lib/dsh/preset-installation.js +152 -9
- package/lib/dsh/preset-installation.js.map +1 -1
- package/lib/dsh/preset-metadata.d.ts +15 -0
- package/lib/dsh/preset-metadata.d.ts.map +1 -0
- package/lib/dsh/preset-metadata.js +83 -0
- package/lib/dsh/preset-metadata.js.map +1 -0
- package/lib/dsh/super-code.js +1 -1
- package/lib/dsh/super-code.js.map +1 -1
- package/package.json +11 -11
- package/presets/super-code/preset.yml +1 -1
package/README.md
CHANGED
|
@@ -1,110 +1,66 @@
|
|
|
1
1
|
# dsh-super-code
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
一个更快、更节省、更聪明的 DeepSeek Harness 编码插件。它会根据任务选择调研、设计、开发、验证和优化方法:简单任务直接完成,复杂任务按需组织工作。
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
A faster, more efficient, smarter coding plugin for DeepSeek Harness. It selects research, design, development, verification, and optimization methods to fit the task: straightforward work stays simple, while complex work is coordinated as needed.
|
|
6
6
|
|
|
7
|
-
|
|
7
|
+
在选定的 SWE-bench Pro hard-100 评测中,`0.1.2` 相比 DSH minimal 平均回答耗时减少约 38%,每题输入 token 减少约 14%,正确率提高 8 个百分点。[评测方法与完整结果](docs/EvaluationResults.md)
|
|
8
8
|
|
|
9
|
-
On the selected SWE-bench Pro hard-100
|
|
9
|
+
On the selected SWE-bench Pro hard-100 tasks, `0.1.2` reduced average response time by about 38% and input tokens per task by about 14% versus DSH minimal, while accuracy increased by 8 percentage points. [Methods and full results](docs/EvaluationResults.md)
|
|
10
10
|
|
|
11
|
-
##
|
|
11
|
+
## 开始使用 · Get Started
|
|
12
12
|
|
|
13
|
-
|
|
13
|
+
需要 DeepSeek Harness 0.1.5-alpha.1 或更高版本。三步就能开始:
|
|
14
14
|
|
|
15
|
-
|
|
15
|
+
You'll need DeepSeek Harness 0.1.5-alpha.1 or later. To get started:
|
|
16
16
|
|
|
17
|
-
|
|
17
|
+
1. **安装插件:** 在 `dsh-market` 搜索 `dsh-super-code`,或运行下面的命令。
|
|
18
18
|
|
|
19
|
-
|
|
19
|
+
**Install the plugin:** Search for `dsh-super-code` in `dsh-market`, or run:
|
|
20
20
|
|
|
21
|
-
|
|
21
|
+
```bash
|
|
22
|
+
dsh plugin --profile web add dsh-super-code
|
|
23
|
+
```
|
|
22
24
|
|
|
23
|
-
|
|
25
|
+
2. **选中预设:** 打开 Harness“设置”→“Agent 预设”,选择 `super-code`。
|
|
24
26
|
|
|
25
|
-
|
|
27
|
+
**Select the preset:** In Harness, open “Settings” → “Agent Presets” and select `super-code`.
|
|
26
28
|
|
|
27
|
-
|
|
28
|
-
dsh plugin --profile web add dsh-super-code
|
|
29
|
-
```
|
|
29
|
+
3. **开始对话:** 新建会话,直接描述你要完成的编码任务。
|
|
30
30
|
|
|
31
|
-
|
|
31
|
+
**Start a conversation:** Open a new conversation and describe the coding task you want done.
|
|
32
32
|
|
|
33
|
-
|
|
33
|
+
没看到 `super-code`?打开“设置”→“插件”→“插件配置”→ **Super Code** 查看状态并手动安装。标识符已被占用时可换一个,不会覆盖已有预设。[排查与预设管理](docs/UsageGuide.md)
|
|
34
34
|
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
If the preset is missing, the plugin attempts a one-time user-preset installation on first load. Open **Super Code** under “Settings” → “Plugins” → “Plugin configuration” to check its status or install manually. Choose another name if it is taken. Existing presets are preserved; user copies are not automatically updated or reinstalled after deletion.
|
|
38
|
-
|
|
39
|
-
[版本记录 · Changelog](docs/CHANGELOG.md)
|
|
35
|
+
Can't find `super-code`? Open “Settings” → “Plugins” → “Plugin configuration” → **Super Code** to check its status and install it manually. If the identifier is taken, choose another; existing presets are left untouched. [Troubleshooting and preset management](docs/UsageGuide.md)
|
|
40
36
|
|
|
41
37
|
[](docs/images/preset-settings.png)
|
|
42
38
|
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
The current version has no three-pool model configuration. Configure a provider under Harness “Settings” → “Models”, then select the model and reasoning effort below the message input. Existing working settings can be reused. The plugin follows the current session model, and child Agents inherit their parent's selection unless explicitly overridden.
|
|
46
|
-
|
|
47
|
-
## 效果 · Results
|
|
48
|
-
|
|
49
|
-
SWE-bench Pro hard-100,使用 `deepseek-v4.1-flash`、reasoning `high`、原生 DSH Web RPC 和官方评分器。
|
|
50
|
-
|
|
51
|
-
SWE-bench Pro hard-100 with `deepseek-v4.1-flash`, reasoning `high`, native DSH Web RPC, and the official grader.
|
|
52
|
-
|
|
53
|
-
> 提示:
|
|
54
|
-
> SWE-bench Pro 是面向真实软件工程任务的高难度评测集。每道题都来自真实开源仓库,通常需要理解现有代码、修改多个文件、运行测试并根据失败结果继续修复,评测结果以官方测试是否通过为准。这里选取其中难度最高的 100 道题,重点观察长任务中的正确率、调用次数、token 和耗时。
|
|
55
|
-
>
|
|
56
|
-
> SWE-bench Pro is a challenging benchmark for real-world software engineering tasks. Each task comes from a real open-source repository and typically requires understanding existing code, editing multiple files, running tests, and iterating on failures. The official test result is the pass criterion. This evaluation uses the 100 hardest selected tasks to measure accuracy, model calls, token usage, and elapsed time on long-running tasks.
|
|
57
|
-
>
|
|
58
|
-
> 经过预评测,`DSH minimal` 预设和 `deepseek-v4.1-flash` 的 `high` 思考强度取得了最高正确率,因此将它们作为统一比较基准。
|
|
59
|
-
>
|
|
60
|
-
> In preliminary runs, the `DSH minimal` preset with `deepseek-v4.1-flash` at `high` reasoning achieved the highest accuracy, so it is used as the common baseline.
|
|
61
|
-
|
|
62
|
-
这批结果来自 `0.0.9` 候选;`0.1.0` 沿用该历史基准,未重新执行完整 100 题评测。
|
|
39
|
+
模型、推理等级、权限和工具沿用 Harness 的设置;子 Agent 默认继承父 Agent 的模型选择,不用再配置一套。
|
|
63
40
|
|
|
64
|
-
|
|
41
|
+
Models, reasoning effort, permissions, and tools come from Harness. Child Agents inherit the parent Agent's model choice by default, so there's no second set of settings to manage.
|
|
65
42
|
|
|
66
|
-
|
|
67
|
-
|---|---:|---:|---:|
|
|
68
|
-
| 有效评分 / Valid scores | 100/100 | 100/100 | **持平 / 0%** |
|
|
69
|
-
| 通过题数 / Passed | 41 | 46 | **+12.2%** |
|
|
70
|
-
| 正确率 / Accuracy | 41% | 46% | **+5 个百分点 / +5 pp** |
|
|
71
|
-
| 平均模型调用/题 / Model calls per task | 124.85 | 92.78 | **-25.7%** |
|
|
72
|
-
| 平均工具调用/题 / Tool calls per task | 126.54 | 115.41 | **-8.9%** |
|
|
73
|
-
| 每题平均总输入 token / Average total input tokens per task | 11,477,170 | 9,525,316 | **-17.0%** |
|
|
74
|
-
| 每题平均总输出 token / Average total output tokens per task | 100,877 | 97,901 | **-3.0%** |
|
|
75
|
-
| 缓存命中率 / Cache hit rate | 99.360% | 99.329% | **-0.031%** |
|
|
76
|
-
| 平均测试时长 / Average test time | 25.49 分钟 / min | 16.27 分钟 / min | **-36.2%** |
|
|
77
|
-
|
|
78
|
-
> 因为输入和输出 token 均有减少,因此缓存命中率略微下降是可以接受的,属于正常波动范围。
|
|
79
|
-
>
|
|
80
|
-
> Since both input and output token usage decrease, the slight drop in cache hit rate is acceptable and within normal variation.
|
|
81
|
-
|
|
82
|
-
> Token 指标按每道题的历史明细计算:先分别合计该题已记录模型调用的输入(含缓存)和输出 token,再对 100 道题取平均,包含多轮调用和上下文增长;未返回用量的请求不作估算,不代表完整账单费用。
|
|
83
|
-
>
|
|
84
|
-
> Token metrics are calculated from task histories: input (including cached tokens) and output tokens are summed separately across recorded model calls for each task, then averaged over 100 tasks. This includes multi-turn calls and context growth. Requests without reported usage are not estimated; these figures do not represent complete billing costs.
|
|
85
|
-
|
|
86
|
-
测试题号和每题明细见 [`eval/results/swebench-pro-final-100/`](eval/results/swebench-pro-final-100/),详细文档见 [`docs/`](docs/)。
|
|
87
|
-
|
|
88
|
-
Task IDs and per-task details are available in [`eval/results/swebench-pro-final-100/`](eval/results/swebench-pro-final-100); detailed documentation is in [`docs/`](docs/).
|
|
43
|
+
任务开始后,可以在右侧 Agent 执行树查看每个 Agent 的状态与用量。拖动空白处平移,滚轮或按钮缩放;点一个节点,就能在侧栏标签中查看详情。[界面说明](docs/UsageGuide.md)
|
|
89
44
|
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
安装后,在 DeepSeek Harness 的“设置”→“Agent 预设”中选择 `super-code`。创建任务后,插件会按任务复杂度组织调研、实现和验证;复杂任务可在右侧 Agent 执行树中查看进度,点击节点查看对应的执行内容和用量。
|
|
93
|
-
|
|
94
|
-
After installation, select `super-code` under “Settings” → “Agent Presets” in DeepSeek Harness. The plugin organizes research, implementation, and verification according to task complexity; for complex tasks, use the Agent execution tree on the right to inspect progress, execution details, and usage.
|
|
45
|
+
Once a task is running, the Agent tree on the right shows each Agent's status and usage. Drag empty space to pan, zoom with the wheel or buttons, and click a node to see its details in a sidebar tab. [Interface guide](docs/UsageGuide.md)
|
|
95
46
|
|
|
96
47
|
[](docs/images/agent-tree.png)
|
|
97
48
|
|
|
98
|
-
|
|
49
|
+
## 效果 · Results
|
|
99
50
|
|
|
100
|
-
|
|
51
|
+
这组成绩来自选定的 SWE-bench Pro hard-100,使用 `deepseek-v4.1-flash`、`high` 推理等级、原生 DSH Web RPC 和官方评分器。两组都完成了 100/100 题评分。
|
|
101
52
|
|
|
102
|
-
|
|
53
|
+
These results come from the selected SWE-bench Pro hard-100 tasks, using `deepseek-v4.1-flash`, `high` reasoning, native DSH Web RPC, and the official grader. Both runs received scores for all 100 tasks.
|
|
103
54
|
|
|
104
|
-
|
|
55
|
+
| 指标 / Metric | DSH minimal | super-code 0.1.2 | 变化 / Change |
|
|
56
|
+
|---|---:|---:|---:|
|
|
57
|
+
| 正确率 / Accuracy | 41% | **49%** | **+8 个百分点 / +8 pp** |
|
|
58
|
+
| 平均模型调用/题 / Model calls per task | 124.85 | 99.78 | -20.1% |
|
|
59
|
+
| 平均输入 token/题 / Input tokens per task | 11,477,170 | 9,840,383 | -14.3% |
|
|
60
|
+
| 平均回答耗时 / Response time | 25.69 分钟 / min | 16.01 分钟 / min | -37.7% |
|
|
105
61
|
|
|
106
|
-
|
|
62
|
+
两次运行使用不同的 Harness 提交,不能将全部差异归因于插件。完整指标、回退题目、统计口径和逐题证据见[评测文档](docs/EvaluationResults.md)。
|
|
107
63
|
|
|
108
|
-
|
|
64
|
+
The runs used different Harness commits, so not every difference can be attributed to the plugin. See the [evaluation details](docs/EvaluationResults.md) for all metrics, regressions, calculation methods, and per-task evidence.
|
|
109
65
|
|
|
110
|
-
|
|
66
|
+
[使用说明 · Usage guide](docs/UsageGuide.md) · [评测详情 · Evaluation details](docs/EvaluationResults.md) · [版本记录 · Changelog](docs/Changelog.md)
|