turbollm 1.0.0 → 1.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +5 -1
- package/dist/cli.js +1127 -144
- package/dist/webdist/assets/{ChatScreen-CEMM3c4T.js → ChatScreen-DY2flMe9.js} +1 -1
- package/dist/webdist/assets/{CustomizeScreen-QBH-lamm.js → CustomizeScreen-Cl6H68Sy.js} +4 -4
- package/dist/webdist/assets/DeveloperScreen-zC1nePXh.js +1 -0
- package/dist/webdist/assets/EnginesScreen-CrsziC3B.js +7 -0
- package/dist/webdist/assets/ModelDetailDialog-BOvumdHI.js +1 -0
- package/dist/webdist/assets/{ModelDirs-MIQRpOiQ.js → ModelDirs-Bj-XrX0c.js} +1 -1
- package/dist/webdist/assets/ModelsScreen-BTir-kDY.js +1 -0
- package/dist/webdist/assets/SettingsScreen-B696egCa.js +1 -0
- package/dist/webdist/assets/check-DFwkcl_5.js +1 -0
- package/dist/webdist/assets/{circle-x-DoZx722k.js → circle-x-CsuAddI_.js} +1 -1
- package/dist/webdist/assets/{common-BkuT8XJF.js → common-DIXPIrUd.js} +1 -1
- package/dist/webdist/assets/{copy-button-CvYEyWud.js → copy-button-BtQZA6P8.js} +1 -1
- package/dist/webdist/assets/dialog-Dpyml8ZT.js +1 -0
- package/dist/webdist/assets/index-BklQn62W.css +1 -0
- package/dist/webdist/assets/{index-BhB9CGsv.js → index-sjgdofsd.js} +5 -5
- package/dist/webdist/assets/{pencil-Co_wjceA.js → pencil-BuQwoNyj.js} +1 -1
- package/dist/webdist/assets/{personas-D9qR7c_5.js → personas-CQapYHeK.js} +1 -1
- package/dist/webdist/assets/{plus-mxaaevXg.js → plus-B1w15FoZ.js} +1 -1
- package/dist/webdist/assets/{radix-RipaNCX7.js → radix-BFvMxQq9.js} +1 -1
- package/dist/webdist/assets/refresh-cw-BoAcjLtt.js +1 -0
- package/dist/webdist/assets/save-DE1APWTG.js +1 -0
- package/dist/webdist/assets/{skeleton-D2X0KEDs.js → skeleton-Dvq8tYzC.js} +1 -1
- package/dist/webdist/assets/{sparkles-B3j8q0hr.js → sparkles-C54kYWeQ.js} +1 -1
- package/dist/webdist/assets/{trash-2-Dm-i43d8.js → trash-2-DIMVgidH.js} +1 -1
- package/dist/webdist/index.html +3 -3
- package/package.json +1 -1
- package/dist/webdist/assets/DeveloperScreen-CUSmAT_L.js +0 -1
- package/dist/webdist/assets/EnginesScreen-CxVyQ04U.js +0 -5
- package/dist/webdist/assets/ModelDetailDialog-CtrZ6odT.js +0 -1
- package/dist/webdist/assets/ModelsScreen-BuZH5fye.js +0 -1
- package/dist/webdist/assets/SettingsScreen-DpyvTxBO.js +0 -1
- package/dist/webdist/assets/alert-dialog-NJbgeueX.js +0 -1
- package/dist/webdist/assets/check-R4c79Xkn.js +0 -1
- package/dist/webdist/assets/external-link-CLr8NpF9.js +0 -1
- package/dist/webdist/assets/index-B3f5udGb.css +0 -1
- package/dist/webdist/assets/save-d7rhw6iu.js +0 -1
package/README.md
CHANGED
|
@@ -96,7 +96,7 @@ TurboLLM does the opposite:
|
|
|
96
96
|
- Bring any `llama-server`-compatible engine — stock builds or community forks — with real capability probing
|
|
97
97
|
- **Hardware-aware recommendation** — detects your GPU and tells you which engine/build fits; engines that can't run here are greyed with the reason
|
|
98
98
|
- **Curated catalog** — llama.cpp, KoboldCpp, llamafile, MLX, vLLM, plus forks (ik_llama, TurboQuant) — one-click install where a prebuilt exists
|
|
99
|
-
- **
|
|
99
|
+
- **End-to-end build from source** (Windows + CUDA) — clone, `cmake` (Ninja + `nvcc`), compile `llama-server`, bundle its CUDA runtime, and auto-register it from inside the app, with a live compiler log and a success screen. **No CUDA Toolkit? Click "Download CUDA"** — it fetches NVIDIA's official build components (~0.5 GB) and assembles a toolkit for you. Or point it at a conda-env / custom CUDA path. (Manual command guide kept for other setups.)
|
|
100
100
|
- **Honest updates** — checks the real upstream release/commit and flags *Update available* / *Rebuild available* (never a fake "you're on the latest"), with per-engine auto-update
|
|
101
101
|
- Auto-provision a GPU-matched `llama-server` build on first run (CUDA / ROCm / Metal / SYCL / Vulkan, CPU fallback)
|
|
102
102
|
- One engine dropdown, grouped — pick the engine; a version dropdown appears when you have more than one build
|
|
@@ -225,6 +225,10 @@ the UI when something fails to load.
|
|
|
225
225
|
## Auto-tuning & performance
|
|
226
226
|
|
|
227
227
|
- **Auto-benchmark on load** derives fast defaults for your exact GPU.
|
|
228
|
+
- **Recommended sampling from the model card** — auto-tune reads the model's Hugging Face card
|
|
229
|
+
(falling back to the original model behind a requant) and prefills the author's recommended
|
|
230
|
+
`temperature / top_k / top_p / min_p`, shown in the results table and applied on Save. No
|
|
231
|
+
recommendation → your sampling is left untouched.
|
|
228
232
|
- **Real measured tokens/sec** in the model list — **live** while a model is generating,
|
|
229
233
|
**last-session** when it's idle (never a synthetic estimate).
|
|
230
234
|
- **Full load-parameter UI**, a superset of what other tools expose:
|