diskformer 0.6.8 → 0.6.9

package/CHANGELOG.md

@@ -1,5 +1,18 @@
 # Changelog
 
+## 0.6.9 (2026-10-24)
+- DeepSeek V4.1 Flash 1017 (763B, 6 of 384 experts active) in the chat demo as a tech demo: ISTA-DASLab's GSQ-RCO
+  IQ1_M (4 parts, 120.7 GB) plus its separate Engram tables (110.6 GB), 231.3 GB in all, at an 8 GB GPU budget.
+  In Chrome it loaded in 173 s and answered one prompt as the native build does ("The capital of France is
+  **Paris**."); about 0.4 tok/s natively from an external SSD (1.3 GB of experts read per token). Layers 0-2 on
+  llama.cpp's CPU backend match a float64 reference within llama.cpp's own rounding. Not gated on 9 prompts.
+- The fork (`webgpu-diskformer` at `5ac033a52`) takes draft PR 30817 (DeepSeek-V4.1) with a loader for ISTA's
+  layout (separate Engram file, unfused gate, u32 candidate layer) and WebGPU shaders for its ops:
+  LIGHTNING_INDEXER, DSV4_HC_PRE/POST/COMB, TOP_K_MASK, POOL_1D, ROPE_BACK, f16 CONCAT and BF16 CPY.
+  Regression gates on the new build: Granite 4.0 H Tiny 9/9 and Nemotron 3.5 Bolt E4B 9/9 in Chrome.
+- `load({ extra })` mounts stored side files beside the GGUF; the chat demo downloads a catalog entry's side
+  files with its parts. `scripts/chrome-gate.mjs --extra` and `--dist`.
+
 ## 0.6.8 (2026-10-24)
 - Nemotron 3.5 Bolt E4B (dense, `gemma4`, 6.18 GB) in the chat demo: 9/9 replies identical to llama-server on WebGPU
   in Chrome, 30 tok/s at a 5 GB budget. Three fixes made it run in a browser:

package/ggml/dist/BUILD.md

@@ -4,7 +4,7 @@
 because diskformer.naklitechie.com and the HF Space serve them and their CI has no Emscripten; the npm package ships them
 as `diskformer/llama`.
 
-Built from the fork `NakliTechie/llama.cpp` branch `webgpu-diskformer` at `e13de0a3c` (upstream master of 2026-10-22 merged in; head size 512 flash attention on the GPU; a thread-free log in wasm), Emscripten 6.0.13 (Homebrew),
+Built from the fork `NakliTechie/llama.cpp` branch `webgpu-diskformer` at `5ac033a52` (upstream master of 2026-10-22 merged in; head size 512 flash attention on the GPU; a thread-free log in wasm; DeepSeek-V4.1 from draft PR 30817 with WebGPU shaders for its ops), Emscripten 6.0.13 (Homebrew),
 emdawnwebgpu from the fork's `emdawnwebgpu_pkg`, all C++ with `-fwasm-exceptions`. Rebuild (copies here as a
 post-build step):
 
@@ -12,7 +12,7 @@ post-build step):
 
 sha256 (check a copy with `shasum -a 256`):
 
-    a860e077df70b8799d894a3d22885c4c5f5d384fefcddcea8c86ed0ae50b4460  df-chat.wasm
+    9c532bdddb66821d7be2dff2d2008f9a976ca7b497574fa2f1520b4f9ab9ff58  df-chat.wasm
     0f8a1a7e3eb75ef8f999d553d2fc1a124c4de1b6c6edb597643486752bcdce08  df-chat.mjs
 
 Update the fork commit and the checksums whenever the build changes.

package/ggml/llama.js

@@ -52,8 +52,9 @@ export class Llama {
 
   // Loads a stored GGUF: budget (bytes of GPU memory, slots planned from it) or slots (experts per layer on the GPU).
   // draft: a stored drafter GGUF (DFlash, DSpark, MTP...) for speculative decoding; replies stay greedy-identical.
-  load({ name, budget = 0, slots = 0, ctx = 1024, env = {}, draft = null }, onPlan) {
-    return this.request({ type: 'load', opfsName: name, budget, slots, ctx, env, draft }, ['loaded'], (d) => { if (d.type === 'plan' && onPlan) onPlan(d.plan); });
+  // extra: stored side files the model opens beside the GGUF, by name (DeepSeek-V4.1's Engram tables).
+  load({ name, budget = 0, slots = 0, ctx = 1024, env = {}, draft = null, extra = [] }, onPlan) {
+    return this.request({ type: 'load', opfsName: name, budget, slots, ctx, env, draft, extra }, ['loaded'], (d) => { if (d.type === 'plan' && onPlan) onPlan(d.plan); });
   }
 
   // A reply through the model's chat template; greedy. Resolves { text, stats }. thinking: false renders the template

package/ggml/worker.mjs

@@ -3,7 +3,7 @@
 // sync access handles, straight into the wasm heap. A GGUF gets into OPFS by download (resumable, from a URL) or by
 // copying a picked file; with opfs: false a picked File is read in place instead (slower).
 //
-// Messages in: load {opfsName | file, budget | slots, ctx, env, draft} · chat {messages, n, thinking} · complete {prompt, n} (the gate)
+// Messages in: load {opfsName | file, budget | slots, ctx, env, draft, extra} · chat {messages, n, thinking} · complete {prompt, n} (the gate)
 //   · abort · download {url, name, size} · list · remove {name}
 // Messages out: log · progress · plan · loaded · piece · done · downloaded · models · removed · error
 import createModule from './dist/df-chat.mjs';  // built from ggml/build-wasm, see ggml/dist/BUILD.md
@@ -195,8 +195,14 @@ onmessage = async ({ data }) => {
       // draft: a drafter GGUF in OPFS (DFlash, DSpark, MTP...) for speculative decoding; read whole at load, not paged
       const draftFile = data.draft ? await (await ggufDir(false)).getFileHandle(data.draft).then((h) => h.getFile())
         .catch(() => { throw new Error(`${data.draft} is not in OPFS; download the drafter first`); }) : null;
+      // extra: side files the model opens by name beside the GGUF (DeepSeek-V4.1's Engram tables), from OPFS
+      const extraFiles = [];
+      for (const name of data.extra || []) {
+        extraFiles.push(await (await ggufDir(false)).getFileHandle(name).then((h) => h.getFile())
+          .catch(() => { throw new Error(`${name} is not in OPFS; download it first`); }));
+      }
       mod.FS.mkdir('/m');
-      mod.FS.mount(mod.WORKERFS, { files: draftFile ? [...files, draftFile] : files }, '/m');
+      mod.FS.mount(mod.WORKERFS, { files: [...files, ...(draftFile ? [draftFile] : []), ...extraFiles] }, '/m');
       if (draftFile) mod._df_set_draft(str('/m/' + draftFile.name));
       const t0 = performance.now();
       // a GPU budget (bytes) becomes slots through df_plan; else data.slots as given

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "diskformer",
-  "version": "0.6.8",
+  "version": "0.6.9",
   "description": "Run a model larger than your GPU memory in a browser tab: weights stay in OPFS, WebGPU holds only what each step needs. llama.cpp with paged MoE experts (diskformer/llama), a disk tier, and hand-written MoE engines.",
   "type": "module",
   "license": "MIT",