turbollm 1.7.0 → 1.7.2

package/README.md

@@ -79,7 +79,7 @@ TurboLLM does the opposite:
   a **VRAM-fit verdict before you load** — no more flag guessing.
 - **📊 Real tokens/sec, never faked.** Speed in the model list is *measured on your machine*
   from actual generation — live while you chat, and remembered per model.
-- **🪶 Lightweight.** A ~0.3 MB npm package on Node — **no Electron, no bundled Chromium, no
+- **🪶 Lightweight.** A ~2 MB npm package on Node — **no Electron, no bundled Chromium, no
   Python**. It downloads only the engine your GPU actually needs (Vulkan ≈ 38 MB).
 - **🔌 Drop-in APIs.** OpenAI **and** Anthropic-compatible — so Claude Code and every existing
   tool work unchanged.
@@ -261,6 +261,12 @@ library, and loads it on the fly** if it isn't already running — then keeps up
 hot** in an LRU pool so the next switch is instant. An agent (or Claude Code) that hops between a
 coding model, a vision model, and an embedder just names each one and it works — no pre-wiring.
 
+**One command wires up more than just Claude Code.** `turbollm launch <cli>` also supports
+`opencode`, `kilo`, `openclaw`, and `hermes` — each gets pointed at TurboLLM the way that tool
+expects (config file merge, or its own CLI command) instead of a manual copy-paste setup. Inside
+Claude Code, `/model` lists your local models directly (with **Auto Model Swap** on in Settings →
+Gateway) so you can switch mid-session instead of only at launch.
+
 </details>
 
 <details>
@@ -289,7 +295,7 @@ connected); **Remove** undoes it.
 
 <br/>
 
-- A **~0.3 MB npm package** on Node — no Electron, no bundled Chromium, no Python.
+- A **~2 MB npm package** on Node — no Electron, no bundled Chromium, no Python.
 - **Offline-first** — no account, no backend, no internet, no telemetry.
 - **Windows · macOS · Linux**, with a CPU fallback when there's no GPU.
 
@@ -370,12 +376,20 @@ turbollm launch claude               # auto-loads a model if none is running, th
 turbollm launch claude --model qwen3-8b   # load a specific model first, then launch
 ```
 
-It sets Claude Code's `ANTHROPIC_BASE_URL` / `ANTHROPIC_MODEL` at TurboLLM and execs `claude`;
-extra args are forwarded. If no model is loaded it auto-loads your last-used one (or the first
-in your library); `--model` picks a specific one by key or name. If `claude` isn't installed,
-it tells you how. The in-app
-**Developer** screen also shows copy-paste env snippets for any OpenAI- or Anthropic-compatible
-tool (Open WebUI, Kilo Code, opencode, …).
+It sets Claude Code's `ANTHROPIC_BASE_URL` and pins `ANTHROPIC_MODEL` to whatever model is
+loaded (so the status line, `/status`, and context-window sizing all reflect the real model),
+then execs `claude`; extra args are forwarded. If no model is loaded it auto-loads your
+last-used one (or the first in your library); `--model` picks a specific one by key or name.
+If `claude` isn't installed, it tells you how.
+
+Other coding CLIs work too — `turbollm launch opencode`, `turbollm launch kilo`, and
+`turbollm launch openclaw` write a `turbollm` provider into that tool's own config file
+(preserving anything you already configured) and then launch it. If an existing config can't
+be parsed, TurboLLM refuses to overwrite it and prints how to add the provider by hand.
+`turbollm launch hermes` does the equivalent for [Hermes Agent](https://github.com/NousResearch/hermes-agent)
+via its own `hermes config set` command (its config is YAML, so we drive its CLI instead of
+hand-editing that file). The in-app **Developer** screen also shows copy-paste snippets for
+any OpenAI- or Anthropic-compatible tool (Open WebUI, Kilo Code, opencode, …).
 
 ---
 
@@ -402,6 +416,7 @@ turbollm --addr 0.0.0.0:6996    # bind all interfaces (LAN sharing)
 turbollm --stop                 # stop a running daemon (any terminal)
 turbollm launch claude          # start Claude Code (auto-loads a model if none is running)
 turbollm launch claude --model qwen3-8b   # load a specific model, then launch
+turbollm launch opencode        # wire opencode (or kilo / openclaw) to TurboLLM, then launch
 ```
 
 | Flag | Description |
@@ -415,7 +430,9 @@ turbollm launch claude --model qwen3-8b   # load a specific model, then launch
 
 `turbollm launch claude` also accepts `--model <key|name>` to load a specific model before
 launching; without it, an already-loaded model is used, or the last-used / first model is
-auto-loaded.
+auto-loaded. The same command works with `opencode`, `kilo`, and `openclaw` — each gets a
+`turbollm` provider merged into its own config file before it starts — and with `hermes`,
+which gets configured via its own `hermes config set` command instead.
 
 ---
 
@@ -429,7 +446,7 @@ Use `--config <file>` to point at an alternate config (its directory becomes the
 
 ## Requirements
 
-- **Node.js 22 or newer** — enforced at startup with a clear message. <https://nodejs.org>
+- **Node.js 22.13.0 or newer** — enforced at startup with a clear message. <https://nodejs.org>
 - **Windows, macOS, or Linux.**
 - A GPU is recommended but **not required** — a CPU build is provisioned as a fallback.
 - On Windows, the first time the auto-downloaded `llama-server` runs, SmartScreen/Defender may
@@ -475,7 +492,7 @@ Prefer Open WebUI's chat breadth? It works great pointed at TurboLLM's OpenAI en
 
 ## Troubleshooting
 
-- **`TurboLLM requires Node.js 22 or newer`** — upgrade Node: <https://nodejs.org>.
+- **`TurboLLM requires Node.js 22.13.0 or newer`** — upgrade Node: <https://nodejs.org>.
 - **Model won't load / OOM** — pick a smaller quant (the VRAM verdict warns you), lower GPU
   offload, or close other GPU apps. Failures surface in the Engines screen with the engine log.
 - **Windows Defender / SmartScreen prompt** — that's the upstream `llama-server` binary on
@@ -502,7 +519,7 @@ node dist/cli.js --port 6996
 Frontend hot-reload: `cd web && npm run dev` (proxies `/api` and `/v1` to the daemon on
 :6996).
 
-**Stack:** Node ≥22 · TypeScript · Hono · `node:sqlite` · tsup — and a React 19 + Tailwind v4 +
+**Stack:** Node ≥22.13 · TypeScript · Hono · `node:sqlite` · tsup — and a React 19 + Tailwind v4 +
 shadcn/ui frontend. One TypeScript codebase, shipped as an npm package.
 
 ---

package/bin/turbollm.mjs

@@ -1,25 +1,29 @@
-#!/usr/bin/env node
-// Hand-written launcher shim — NOT bundled by tsup. It runs before the bundled
-// daemon (dist/cli.js) loads, so it can do two things that must happen before
-// node:sqlite is imported (the bundle hoists that import, emitting an experimental
-// warning that PowerShell renders as a scary red error block on every run):
-//   1. Guard the Node version with a friendly message (node:sqlite needs Node 22+).
-//   2. Register a 'warning' filter that swallows the node:sqlite experimental notice
-//      while still printing every other warning.
-// Then it hands off to the real CLI via dynamic import (same process; argv intact).
-const major = Number(process.versions.node.split('.')[0])
-if (major < 22) {
-  process.stderr.write(
-    `TurboLLM requires Node.js 22 or newer.\n` +
-      `You are running Node.js ${process.versions.node}.\n` +
-      `Please upgrade: https://nodejs.org\n`,
-  )
-  process.exit(1)
-}
-
-process.on('warning', (w) => {
-  if (w.name === 'ExperimentalWarning' && /SQLite/i.test(w.message)) return
-  process.stderr.write(`${w.stack ?? `${w.name}: ${w.message}`}\n`)
-})
-
-await import('../dist/cli.js')
+#!/usr/bin/env node
+// Hand-written launcher shim — NOT bundled by tsup. It runs before the bundled
+// daemon (dist/cli.js) loads, so it can do two things that must happen before
+// node:sqlite is imported (the bundle hoists that import, emitting an experimental
+// warning that PowerShell renders as a scary red error block on every run):
+//   1. Guard the Node version with a friendly message (node:sqlite needs Node 22.13+ —
+//      that's when node:sqlite became available WITHOUT the --experimental-sqlite flag;
+//      on 22.5.0-22.12.x it's registered only behind that flag, so importing it bare
+//      throws ERR_UNKNOWN_BUILTIN_MODULE: "No such built-in module: node:sqlite"
+//      (GitHub #40) even though `node -v` reports 22.x).
+//   2. Register a 'warning' filter that swallows the node:sqlite experimental notice
+//      while still printing every other warning.
+// Then it hands off to the real CLI via dynamic import (same process; argv intact).
+const [major, minor] = process.versions.node.split('.').map(Number)
+if (major < 22 || (major === 22 && minor < 13)) {
+  process.stderr.write(
+    `TurboLLM requires Node.js 22.13.0 or newer (needs node:sqlite unflagged).\n` +
+      `You are running Node.js ${process.versions.node}.\n` +
+      `Please upgrade: https://nodejs.org\n`,
+  )
+  process.exit(1)
+}
+
+process.on('warning', (w) => {
+  if (w.name === 'ExperimentalWarning' && /SQLite/i.test(w.message)) return
+  process.stderr.write(`${w.stack ?? `${w.name}: ${w.message}`}\n`)
+})
+
+await import('../dist/cli.js')