dsh-auto-model-routing 0.0.0-stage → 0.3.0

package/CHANGELOG.md

@@ -0,0 +1,8 @@
+# Changelog
+
+## 0.3.0
+
+- Publish as a standalone DSH bundle with the companion `subagent-model-routing` skill included.
+- Replace the separate ohmydsh skill customization with a package-owned filesystem skill provider. Skill and tools now enable/disable together.
+- Add npm/Git installation instructions, demo GIFs, licensing and OIDC release automation.
+- Keep the existing tier rubric, effort mappings, default MANUAL mode, credentials and stored state unchanged.

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 prgrmrwy
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -1,3 +1,68 @@
-# Temporary Holding Version
+# dsh-auto-model-routing
 
-This version is a temporary placeholder for this package. An operational version to replace this has been submitted for review and is awaiting a staged release.
+English · [简体中文](README.zh.md)
+
+![AUTO in action: a refactor-and-debug turn is judged complex and runs at high, a follow-up rename is judged simple and drops to low; hovering the AUTO chip shows the decision, clicking it switches to MANUAL](docs/auto-routing.gif)
+
+<!-- problem -->
+You should not have to raise or lower reasoning effort by hand for every message. In AUTO, each user turn is judged by the Jev decision model (via OpenRouter) as `simple` / `standard` / `complex` / `escalated`, and the plugin changes **only the reasoning effort** of the model you already picked. Provider and model are never changed. If Jev fails for any reason, AUTO switches itself off and the chip shows why.
+
+**Install.** DSH `0.2.0-rc.2`, Node.js `>=22.19`.
+
+```sh
+dsh plugin --profile web add dsh-auto-model-routing
+# Or install source (approve the local build when prompted):
+dsh plugin --profile web add prgrmrwy/dsh-auto-model-routing
+```
+
+Restart DSH, refresh the Web page, then configure your OpenRouter key in **Settings → 自动模型路由**. The companion skill is included; it guides delegation but does not enforce every dispatch. Unlike model-pool routers or local classifiers, this plugin uses external Jev judgments and never switches the main model. The demos use an isolated Host with local mock Jev/model responses.
+
+In [ohmydsh](https://github.com/prgrmrwy/ohmydsh), enable only the local `auto-model-routing` entry and run `dsh build`; no separate skill customization is needed.
+
+## Use
+
+| Where | What you do |
+|---|---|
+| **AUTO / MANUAL chip** (left of the model picker) | Click to switch. Hover to see this turn's effort, the latest Jev decision and its distribution. |
+| **Decision hint** | Appears above the chip for 3 s after each judgment, e.g. `complex → high · 0.70s`. |
+| **Gauge button** on a reply | Hover for the judgment; click to record which tier the turn should have used. |
+| **Settings → 自动模型路由** | OpenRouter key, default mode, effort cap, Jev deadline, hint switch and the routing maps (below). |
+
+![Settings → Auto model routing: judging service, session defaults, and the Claude / GPT routing maps with main-chat effort and sub-agent recommendation per tier](docs/settings.gif)
+
+**Default effort.** Each model starts at its officially recommended effort: `standard` keeps it, `simple` goes one step down, `complex` one up, `escalated` two up. The result is capped (default `xhigh`), and AUTO never picks `max`. Each cell of the routing map can override this: main efforts apply to every model of a provider family, and sub-agent cells are full model + effort pairs.
+
+**Sub-agents.** The `route_subagent` tool uses the same judgment and returns provider/model/effort (Claude: Haiku → Sonnet → Opus → Opus; GPT: Luna → Sol → Sol → Sol). It only judges when the root chat is AUTO, and otherwise returns `routed: false`. These routes must be in the official sub-agent allowlist, which is fixed when a chat is created.
+
+## Good to know
+
+- **New chats default to MANUAL.** You can change this in Settings.
+- **Fail closed.** No key, out of credits, rate limit, region block, timeout or a bad reply: the chat goes to `MANUAL · Jev 停用` with the reason. Click AUTO to retry. There is no local fallback and no retry.
+- **MANUAL only stops changes.** The chat keeps the last effort AUTO set. AUTO also writes it into the official selection, so new chats start from it.
+- **Data sent out.** In AUTO, every user turn sends up to 8000 characters of your message and short parts of the previous turn to OpenRouter / TypeSafe (`typesafe/jev-1.13`). The text is redacted by shape first (keys, tokens, URL credentials, IPs). This is best effort and does not guarantee that every secret is removed.
+- **The key** is stored through the official DSH credentials service, never in the plugin config. A key in the launch environment (`OPENROUTER_API_KEY`) takes precedence and is read-only. To move it to the GUI, remove it from the launch environment, restart once, then save it in Settings.
+- **Files.** Settings live in `$DSH_HOME/plugins/dsh-auto-model-routing/config.json`; per-chat mode and judgments live in `$DSH_HOME/state/auto-model-routing/`. Changes take effect on the next request; no restart is needed.
+
+## Architecture
+<!-- section: architecture -->
+
+![auto-model-routing architecture: the chip and RPC endpoints, the agent/pre-step hook asking Jev through OpenRouter, the agent/request hook rewriting only reasoning effort, and the route_subagent tool sharing the same judgment](docs/architecture.dual.svg)
+
+An `agent/pre-step` hook judges step 1 of each user turn. An `agent/request` hook (prepended) then rewrites only `reasoningEffort`, and syncs it to the official model selection. Entry point: [`src/index.ts`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/index.ts). Rubric: [`src/rubric.json`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/rubric.json). Effort table: [`src/effort.ts`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/effort.ts). UI: [`src/client/`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/client/index.ts). Regression cases: [`eval/`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/eval/README.md). Diagram source: [`docs/architecture.json`](docs/architecture.json) (archify).
+
+## Development
+
+```sh
+npm test
+npm run typecheck
+npm run build
+```
+
+Tests use the real AgentLoop with a fake LLM stream and a loopback fake Jev; they never call OpenRouter. `node scripts/label-report.mjs` summarizes your tier labels per rubric version.
+
+Specs and design: the current spec is [`openspec/specs/auto-model-routing`](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/specs/auto-model-routing/spec.md). The archived changes record the design history: [routing](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/changes/archive/2026-10-22-auto-model-routing/design.md) (decisions D1–D14) and [settings](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/changes/archive/2026-10-23-auto-model-routing-settings/design.md). The companion skill is [`skills/subagent-model-routing`](skills/subagent-model-routing/SKILL.md). Before you change the hooks, read [DSH plugin integration pitfalls](https://github.com/prgrmrwy/ohmydsh/blob/main/docs/architecture/dsh-plugin-integration-pitfalls.md).
+
+## Removal
+<!-- section: removal -->
+
+Run `dsh plugin --profile web remove dsh-auto-model-routing`, then restart DSH and refresh the page. In ohmydsh, set `enabled: false` and rebuild instead. The plugin-owned skill and tools disappear; settings and logs remain. Chats keep the last effort AUTO set until you pick another one.

package/README.zh.md

@@ -0,0 +1,68 @@
+# dsh-auto-model-routing
+
+[English](README.md) · 简体中文
+
+![AUTO 实际效果：「重构并调试」被判为 complex，用 high；随后的「改个名」被判为 simple，降到 low；悬停 AUTO 芯片查看判档，点击切到 MANUAL](docs/auto-routing.gif)
+
+<!-- problem -->
+不必每条消息都手动调高或调低推理强度。AUTO 下，每个用户回合由 Jev 决策模型（经 OpenRouter）判为 `simple` / `standard` / `complex` / `escalated`，插件**只调整你已选模型的推理强度**，不换 provider 和模型。Jev 任何失败都会让 AUTO 自动停用，芯片上显示原因。
+
+**安装**：DSH `0.2.0-rc.2`，Node.js `>=22.19`。
+
+```sh
+dsh plugin --profile web add dsh-auto-model-routing
+# 或从源码安装（出现提示时批准本地构建）：
+dsh plugin --profile web add prgrmrwy/dsh-auto-model-routing
+```
+
+重启 DSH、刷新页面，再到**设置 → 自动模型路由**配置 OpenRouter key。配套 skill 已包含，提供委派指引，但不强制拦截每次派发。与模型池路由或本地分类器不同，本插件用外部 Jev 判档，始终不换主模型。演示来自隔离 Host，使用本地模拟的 Jev 和模型响应。
+
+在 [ohmydsh](https://github.com/prgrmrwy/ohmydsh) 中只需启用 local `auto-model-routing` 条目并运行 `dsh build`，不再单独启用 skill 条目。
+
+## 使用
+
+| 位置 | 操作 |
+|---|---|
+| **AUTO / MANUAL 芯片**（模型选择器左侧） | 点击切换；悬停查看本回合 effort、最近一次 Jev 决策及其分布 |
+| **判档提示** | 每次判档后在芯片上方显示 3 秒，例如 `complex → high · 0.70s` |
+| 回复下方的**仪表按钮** | 悬停看判档，点击标注「这轮应该用哪档」 |
+| **设置 → 自动模型路由** | OpenRouter key、默认模式、强度上限、判档等待上限、提示开关、路由映射（见下图） |
+
+![设置 → 自动模型路由：判档服务、会话默认值，以及 Claude / GPT 分页下每档的主会话推理等级与子会话推荐](docs/settings.gif)
+
+**缺省强度**：从各模型的官方推荐起点出发。standard 取起点，simple 降一级，complex 升一级，escalated 升两级；受上限约束（缺省 `xhigh`），AUTO 永不选 `max`。路由映射可逐格覆盖：主会话等级作用于同体系所有模型，子会话格为完整的 model + effort。
+
+**子会话**：`route_subagent` 工具用同一套判档，返回 provider/model/effort（Claude：Haiku → Sonnet → Opus → Opus；GPT：Luna → Sol → Sol → Sol）。只有根会话为 AUTO 时才判档，否则返回 `routed: false`。这些路由须在官方子智能体允许列表中，该列表在会话创建时固定。
+
+## 须知
+
+- **新会话缺省 MANUAL**，可在设置中改。
+- **失败即关闭**：无 key、余额不足、限流、地区受限、超时或响应无效时，会话切到 `MANUAL · Jev 停用` 并显示原因，点 AUTO 重试。没有本地降级，也不重试。
+- **MANUAL 只停止调整**：会话保持 AUTO 最后设定的 effort。AUTO 也会把它写入官方模型选择，所以新会话会从这个值开始。
+- **外发数据**：AUTO 下每个用户回合会把你的消息（最多 8000 字符）和上一轮的少量片段发给 OpenRouter / TypeSafe（`typesafe/jev-1.13`）。外发前先按形态脱敏（密钥、token、URL 凭据、IP），这是尽力而为，不保证去掉所有敏感信息。
+- **key** 经官方 DSH 凭据服务保存，不写进插件配置。启动环境里的 `OPENROUTER_API_KEY` 优先且只读；要迁到 GUI，先从启动环境删掉它，重启一次，再在设置页保存。
+- **文件**：设置在 `$DSH_HOME/plugins/dsh-auto-model-routing/config.json`；每个会话的模式与判档记录在 `$DSH_HOME/state/auto-model-routing/`。改动在下一次请求生效，无需重启。
+
+## 架构
+<!-- section: architecture -->
+
+![auto-model-routing 架构图：芯片与 RPC 端点、agent/pre-step 钩子经 OpenRouter 请求 Jev、agent/request 钩子只改推理强度、route_subagent 工具共用同一判断](docs/architecture.dual.svg)
+
+`agent/pre-step` 钩子在每个用户回合的第 1 步判档；随后以 prepend 注册的 `agent/request` 钩子只改写 `reasoningEffort`，并同步到官方模型选择。入口 [`src/index.ts`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/index.ts)，判档规则 [`src/rubric.json`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/rubric.json)，强度表 [`src/effort.ts`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/effort.ts)，界面 [`src/client/`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/src/client/index.ts)，回归用例 [`eval/`](https://github.com/prgrmrwy/dsh-auto-model-routing/blob/main/eval/README.zh.md)，图源 [`docs/architecture.json`](docs/architecture.json)（archify）。
+
+## 开发验证
+
+```sh
+npm test
+npm run typecheck
+npm run build
+```
+
+测试使用真实 AgentLoop、假 LLM 流和本地回环假 Jev，不访问 OpenRouter。`node scripts/label-report.mjs` 按规则版本汇总你的档位标注。
+
+规范与设计：当前规范见 [`openspec/specs/auto-model-routing`](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/specs/auto-model-routing/spec.md)。归档 change 记录了设计演进：[路由](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/changes/archive/2026-10-22-auto-model-routing/design.md)（决策 D1–D14）与[设置](https://github.com/prgrmrwy/ohmydsh/blob/main/openspec/changes/archive/2026-10-23-auto-model-routing-settings/design.md)。配套 skill 见 [`skills/subagent-model-routing`](skills/subagent-model-routing/SKILL.md)。修改钩子前先读 [DSH 插件集成陷阱](https://github.com/prgrmrwy/ohmydsh/blob/main/docs/architecture/dsh-plugin-integration-pitfalls.md)。
+
+## 移除
+<!-- section: removal -->
+
+运行 `dsh plugin --profile web remove dsh-auto-model-routing`，重启 DSH 并刷新页面；ohmydsh 则设为 `enabled: false` 并构建。插件提供的 skill 与工具一并撤销，设置和日志保留。会话保持 AUTO 最后设定的 effort，直到在模型选择器里另选。

package/cordis.patch.yml

@@ -0,0 +1,9 @@
+- insert:
+    - id: dsh-auto-model-routing
+      name: dsh-auto-model-routing
+    - id: auto-model-routing-skills
+      name: '@deepseek-ai/dsh-skill-filesystem'
+      config:
+        providerName: auto-model-routing-plugin
+        includeDefaultRoots: false
+        bundledSkillDir: !!js process.getBuiltinModule('node:path').join(process.getBuiltinModule('node:path').dirname(process.getBuiltinModule('node:module').createRequire(baseUrl).resolve('dsh-auto-model-routing/package.json')), 'skills')

package/docs/SCREENSHOTS.md

@@ -0,0 +1,6 @@
+# Screenshots
+
+| file | kind | source | date | reviewer | verdict | note |
+| --- | --- | --- | --- | --- | --- | --- |
+| auto-routing.gif | screenshot | isolated DSH_HOME instance (temp HOME/XDG/DSH_HOME under /tmp, port 3199), synthetic data: local mock model and mock Jev on loopback, demo prompts; recorded with agent-browser, converted with ffmpeg | 2026-10-23 | lead | pass (viewed frames: demo prompts and mock replies only; no hostname, user, path, token or real session) | AUTO chip, decision hint, hover panel, switch to MANUAL |
+| settings.gif | screenshot | same isolated instance and recording run as auto-routing.gif | 2026-10-23 | lead | pass (viewed frames: settings section only; key field empty, source shown as launch environment of the isolated process) | Settings → 自动模型路由, Claude/GPT routing maps |