dsh-dl-server 0.1.1 → 0.2.0

package/README.md

@@ -17,14 +17,18 @@ A persistent download queue for DeepSeek Harness.
 Settings → Plugins → Install a third-party plugin → Add plugin
 ```
 
-Type **`dsh-dl-server`**, confirm, then **restart DSH once**.
+Type **`dsh-dl-server@0.1.1`**, confirm, then **restart DSH once**.
 
 ### From the command line
 
 ```sh
-dsh plugin add dsh-dl-server
+dsh plugin add dsh-dl-server@0.1.1
 ```
 
+> **Pin the version.** `0.1.0` declared `@deepseek-ai/dsh-storage-domain` as a regular dependency, so pnpm installed a second copy inside the plugin; the injected service then no longer matched the host and the plugin never mounted (every service stayed `pending`). `0.1.1` moves it to `peerDependencies`.
+>
+> pnpm also caches registry metadata — without an explicit version you may still resolve `0.1.0`.
+
 > `dsh` must be on your PATH. The desktop build ships one at
 > `…\DeepSeek Harness\resources\runtime\cli\bin\dsh.cmd`; if you have never added it, use the UI path.
 
@@ -63,6 +67,17 @@ A download started in one session is visible to every other session — progress
 | `download_cancel` | Cancel, optionally dropping the partial file |
 | `download_cleanup` | Drop records (the default scope leaves downloaded files alone) |
 
+## New in 0.2.0
+
+| | |
+| --- | --- |
+| **Mirror expansion** | GitHub Releases / HuggingFace / raw.githubusercontent / PyPI URLs gain a fallback mirror automatically. The original always stays first. |
+| **Mirror cooldown** | Two consecutive failures on one host parks it for 10 minutes instead of retrying it on every job. |
+| **Size-aware concurrency** | Under 1 MB skips aria2 entirely; 1–8 MB runs 4 connections; only 8 MB and up gets 16. |
+| **Session fairness** | When two sessions queue at once they share the slots instead of one of them taking the whole queue. |
+| **Cumulative disk budget** | Enqueue counts what already-queued jobs still need, so a batch cannot quietly fill the disk. |
+| **Failures are no longer silent** | Checkpoint write errors are counted and surfaced in `download_status` under `storage`; an unwritable destination is refused before the transfer starts. |
+
 ## Example
 
 ```

package/README.zh.md

@@ -17,18 +17,22 @@
 设置 → 插件 → 安装第三方插件 → 添加插件
 ```
 
-输入框里填 **`dsh-dl-server`**，确认，然后**重启一次 DSH**。
+输入框里填 **`dsh-dl-server@0.1.1`**，确认，然后**重启一次 DSH**。
 
 ### 方式二：命令行
 
 ```sh
-dsh plugin add dsh-dl-server
+dsh plugin add dsh-dl-server@0.1.1
 ```
 
+> **带上 `@0.1.1`。** `0.1.0` 把 `@deepseek-ai/dsh-storage-domain` 声明成了普通依赖，pnpm 会给插件装第二份，服务和宿主对不上、插件挂不住（全部 `pending`）。0.1.1 改成 `peerDependencies` 已修复。
+>
+> 另外 pnpm 会缓存 registry 元数据 —— 不带版本号时可能仍然解析到 `0.1.0`。
+
 > `dsh` 需要先在 PATH 里。桌面版自带的那份在
 > `…\DeepSeek Harness\resources\runtime\cli\bin\dsh.cmd`，没加过 PATH 的话用方式一。
 
-**要求 DSH 0.2.1-rc.5 或以上。**
+**要求 DSH 0.2.1 或以上。**
 **aria2 可选** —— 装了走 16 线程分段，没装走单流兜底，一样能下，只是慢一些。
 
 ---
@@ -63,6 +67,17 @@ DLS 做的是**队列层**，不是传输层。
 | `download_cancel` | 取消，可选删掉半截文件 |
 | `download_cleanup` | 清记录（默认不动已下载的文件） |
 
+## 0.2.0 新增
+
+| 能力 | 说明 |
+| --- | --- |
+| **镜像表** | GitHub Releases / HuggingFace / raw.githubusercontent / PyPI 的地址自动多带一个镜像，原地址永远排第一 |
+| **镜像冷却** | 同一 host 连续失败两次就冷却 10 分钟，不再每次撞 |
+| **并发分档** | < 1 MB 不进 aria2；1–8 MB 开 4 连接；≥ 8 MB 才 16 |
+| **会话级公平** | 两个会话同时排队时各占一半槽位，一个会话吃不下整条队列 |
+| **磁盘余量累加** | 入队时把「已在队列里还没下完的」一起算进去，批量入队写不满盘 |
+| **失败不再静默** | 断点写失败会计数并通过 `download_status` 的 `storage` 字段暴露；目标目录不可写在传输开始前就拒绝 |
+
 ## 用它
 
 ```

package/lib/domain.js

@@ -10,6 +10,10 @@ const JobRecordSchema = z.object({
   origin: z.string().optional(),
 
   urls: z.array(z.string()).min(1),
+  /** Mirrors derived from the original URL at enqueue time, for diagnostics. */
+  mirrors: z
+    .array(z.object({ from: z.string(), to: z.string(), rule: z.string() }))
+    .optional(),
   destPath: z.string(),
 
   state: z.enum(['queued', 'running', 'paused', 'completed', 'failed', 'canceled']),

package/lib/mirrors.js

@@ -0,0 +1,102 @@
+/**
+ * Mirror expansion for well-known hosts.
+ *
+ * Pure functions only: no network, no state. The point is to turn one URL into
+ * a small ordered list so the transport can fall back when the origin is slow or
+ * blocked — the original URL always stays first.
+ *
+ * What this deliberately does NOT do: prove that a mirror serves the same bytes.
+ * A third-party mirror can return an older build, an HTML error page, or worse.
+ * Only `expectSha256` can prove that, and it is checked after the download. The
+ * mitigation here is the cooldown in `queue.js`: a host that fails twice stops
+ * being tried for a while.
+ */
+
+/** @typedef {{ from: string, to: string, rule: string }} MirrorApplication */
+
+const RULES = [
+  {
+    name: 'huggingface',
+    test: (u) => u.hostname === 'huggingface.co',
+    rewrite: (u) => {
+      const out = new URL(u.href)
+      out.hostname = 'hf-mirror.com'
+      return out.href
+    },
+  },
+  {
+    name: 'github-release',
+    test: (u) => u.hostname === 'github.com' && /\/releases\/download\//.test(u.pathname),
+    rewrite: (u) => `https://ghproxy.net/${u.href}`,
+  },
+  {
+    name: 'raw-githubusercontent',
+    test: (u) => u.hostname === 'raw.githubusercontent.com',
+    rewrite: (u) => {
+      const out = new URL(u.href)
+      out.hostname = 'raw.gitmirror.com'
+      return out.href
+    },
+  },
+  {
+    name: 'pythonhosted',
+    test: (u) => u.hostname === 'files.pythonhosted.org',
+    rewrite: (u) => {
+      const out = new URL(u.href)
+      out.hostname = 'pypi.tuna.tsinghua.edu.cn'
+      return out.href
+    },
+  },
+]
+
+/** Hosts we already treat as mirrors; expanding them again would recurse. */
+const ALREADY_MIRROR = new Set(['hf-mirror.com', 'ghproxy.net', 'raw.gitmirror.com', 'pypi.tuna.tsinghua.edu.cn'])
+
+/**
+ * @param {string[]} urls
+ * @returns {{ urls: string[], applied: MirrorApplication[] }}
+ */
+export function expandMirrors(urls) {
+  const out = []
+  const seen = new Set()
+  /** @type {MirrorApplication[]} */
+  const applied = []
+
+  const push = (url) => {
+    if (seen.has(url)) return
+    seen.add(url)
+    out.push(url)
+  }
+
+  for (const url of urls) {
+    push(url)
+
+    let parsed
+    try {
+      parsed = new URL(url)
+    } catch {
+      continue
+    }
+    if (ALREADY_MIRROR.has(parsed.hostname)) continue
+
+    for (const rule of RULES) {
+      if (!rule.test(parsed)) continue
+      const mirror = rule.rewrite(parsed)
+      if (seen.has(mirror)) continue
+      push(mirror)
+      applied.push({ from: url, to: mirror, rule: rule.name })
+      break
+    }
+  }
+
+  return { urls: out, applied }
+}
+
+/** Hostname of a URL, or `undefined` when it does not parse. */
+export function hostOf(url) {
+  try {
+    return new URL(url).hostname
+  } catch {
+    return undefined
+  }
+}