turbollm 1.7.6 → 1.8.0

package/README.md

@@ -170,6 +170,10 @@ the detail:
   (`-ngl`), **MoE CPU-offload (`--n-cpu-moe`)**, parallel slots, **KV-cache quant type** (incl.
   low-bit on supporting forks), CPU threads, flash attention, and **speculative decoding (NextN /
   MTP / draft, with a configurable draft min/max window)**.
+- **Auto-fit GPU layers / MoE offload** — an optional toggle (off by default) that hands the
+  GPU/CPU split decision to llama.cpp's own memory-fitting logic at load time instead of a fixed
+  number, honored by Auto-tune too. Useful when a large context or model doesn't fit your usual
+  fixed setting.
 - **Fast by default:** flash attention on, NextN self-speculative decoding on for models that
   carry a draft head, threads auto — safely gated to what your engine actually accepts.
 - **Multi-GPU, per model** — split a model across cards (layer/row split + main-GPU pick on
@@ -232,6 +236,35 @@ the detail:
   in chat (name, preferences, hardware) using your own loaded model, and carries them into future
   new conversations. Nothing leaves your device; the full fact list is reviewable and deletable
   from Settings → Memory, and turning the toggle off stops new chats from seeing it immediately.
+- **Thinking-budget control** — a graduated slider, not just on/off: cap reasoning to a specific
+  token count, disable it entirely, or leave it unlimited. Works in Chat and Code alike.
+
+</details>
+
+<details>
+<summary><strong>🧑‍💻 Code — a local coding agent, in a real project directory</strong></summary>
+<em>(experimental, off by default — Settings → Experimental)</em>
+
+<br/>
+
+Workspace → Code hands a task to an agent running on the same model you already have loaded —
+point it at a repo folder, describe what you want, and it reads, edits, and runs commands to get
+there. Entirely local; nothing leaves your machine.
+
+- **Real repo access** — plans and edits end-to-end (or asks before mutating, or plan-only,
+  depending on mode), with an optional isolated git worktree so your actual checkout stays
+  untouched, and a real diff summary of what changed.
+- **Persistent sessions** — archive/filter past runs, revert to any earlier message (with
+  optional real file-edit reversal), attach files as context, and a "Coding activity" dashboard
+  (sessions, tasks shipped, files touched, diff shipped, streaks) built from real history, not
+  mock data.
+- **Real LSP integration** for TypeScript/JavaScript and Python — detects the language, installs
+  the language server if needed, and uses it for edits.
+- **The same tools Chat gets from Customize** — any connected MCP server, plus the sandboxed
+  `run_code` tool — are available to Code too, alongside honest skill invocation and
+  `AGENTS.md`/`agents.md` support.
+- **Independent access control** — gated behind its own API key on non-host devices, separate
+  from Chat's gate, and hidden entirely until you opt in from Settings → Experimental.
 
 </details>
 
@@ -363,6 +396,10 @@ CUDA / a compiler — MSVC on Windows, gcc/clang on Linux), hands you the exact
 (or a 1-click **"Build it for me"** on Windows and Linux), then drops you into the folder scan
 above.
 
+**Or skip the manual clone entirely** — Engines screen → **Add via git repo**: paste any
+llama.cpp-compatible fork's git URL (+ optional branch, defaults to the repo's own default) and
+build it in-app with the same 1-click flow, no separate "point at a folder" step needed.
+
 **Auto-provisioned default.** Don't want to fetch anything? On first run TurboLLM downloads
 the right upstream prebuilt for your GPU automatically — and a **backend picker** lets you
 switch between CUDA / ROCm / Metal / SYCL / Vulkan / CPU at any time (it downloads the variant

package/dist/{chunk-TPYU5ZAX.js → chunk-U4OPDHSX.js}

@@ -7,11 +7,17 @@ import { join } from "path";
 // src/engines/compat.ts
 function engineAcceptsFormat(engineKind, format) {
   if (engineKind === "mlx") return format === "mlx";
+  if (engineKind === "rapid-mlx") return format === "mlx";
   if (engineKind === "vllm") return format === "mlx";
   return format === "gguf";
 }
+function engineRejectsAudioModel(engineKind) {
+  return engineKind === "rapid-mlx";
+}
 var ENGINE_MODEL_ALIAS = "default_model";
+var RAPID_MLX_MODEL_ALIAS = "default";
 function engineModelAlias(engineKind) {
+  if (engineKind === "rapid-mlx") return RAPID_MLX_MODEL_ALIAS;
   return engineKind === "mlx" || engineKind === "vllm" || engineKind === "sglang" ? ENGINE_MODEL_ALIAS : null;
 }
 var VENDOR_DISPLAY = {
@@ -86,7 +92,7 @@ Write ONE reusable skill as raw JSON \u2014 no markdown fences.` }
         ],
         temperature: 0.3,
         max_tokens: 800,
-        reasoning_budget: 0,
+        thinking_budget_tokens: 0,
         chat_template_kwargs: { enable_thinking: false },
         response_format: { type: "json_object" },
         stream: false
@@ -168,6 +174,7 @@ ${f.content}`);
 
 export {
   engineAcceptsFormat,
+  engineRejectsAudioModel,
   engineModelAlias,
   evaluateVariant,
   distillFromConversation,