genai-electron 0.5.0 → 0.7.1

package/LICENSE

@@ -1,21 +1,21 @@
-MIT License
-
-Copyright (c) 2025 Luigi Acerbi
-
-Permission is hereby granted, free of charge, to any person obtaining a copy
-of this software and associated documentation files (the "Software"), to deal
-in the Software without restriction, including without limitation the rights
-to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
-copies of the Software, and to permit persons to whom the Software is
-furnished to do so, subject to the following conditions:
-
-The above copyright notice and this permission notice shall be included in all
-copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
-OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
-SOFTWARE.
+MIT License
+
+Copyright (c) 2025 Luigi Acerbi
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -1,85 +1,87 @@
-# genai-electron
-
-> **Version**: 0.5.0 | **Status**: Production Ready - LLM & Image Generation
-
-Electron-specific library for managing local AI model servers (llama.cpp, stable-diffusion.cpp). Handles platform-specific operations to run AI models locally. Complements [genai-lite](https://github.com/lacerbi/genai-lite) for API abstraction.
-
-## Features
-
-- ✅ **System detection** - Auto-detect RAM, CPU, GPU, VRAM capabilities
-- ✅ **Model management** - Download GGUF models with progress tracking and metadata extraction
-- ✅ **LLM server** - Manage llama-server lifecycle with auto-configuration
-- ✅ **Image generation** - Local image generation via stable-diffusion.cpp
-- ✅ **Multi-component diffusion models** - Flux 2, SDXL split components with aggregate checksum validation
-- ✅ **Resource orchestration** - Automatic LLM offload/reload when memory constrained
-- ✅ **Binary management** - Automatic binary download with GPU variant testing (CUDA→Vulkan→CPU)
-- ✅ **TypeScript-first** - Full type safety, minimal runtime dependencies
-
-## Installation
-
-```bash
-npm install genai-electron
-npm install electron@>=25.0.0  # Peer dependency
-```
-
-## Quick Start
-
-```typescript
-import { app } from 'electron';
-import { systemInfo, modelManager, llamaServer } from 'genai-electron';
-
-app.whenReady().then(async () => {
-  // Detect capabilities
-  const caps = await systemInfo.detect();
-  console.log('RAM:', (caps.memory.total / 1024 ** 3).toFixed(1), 'GB');
-
-  // Download model (if needed)
-  await modelManager.downloadModel({
-    source: 'url',
-    url: 'https://huggingface.co/TheBloke/Llama-2-7B-GGUF/resolve/main/llama-2-7b.Q4_K_M.gguf',
-    name: 'Llama 2 7B',
-    type: 'llm'
-  });
-
-  // Start server with auto-config
-  await llamaServer.start({
-    modelId: 'llama-2-7b',
-    port: 8080
-  });
-
-  console.log('Server ready on port 8080');
-});
-```
-
-Use with [genai-lite](https://github.com/lacerbi/genai-lite) for AI interactions (chat, image generation).
-
-## Documentation
-
-📚 **[Complete Documentation](genai-electron-docs/index.md)** - Full API reference, guides, and examples
-
-**Quick Links**:
-- [Installation & Setup](genai-electron-docs/installation-and-setup.md)
-- [System Detection](genai-electron-docs/system-detection.md)
-- [Model Management](genai-electron-docs/model-management.md)
-- [LLM Server](genai-electron-docs/llm-server.md)
-- [Image Generation](genai-electron-docs/image-generation.md)
-- [TypeScript Reference](genai-electron-docs/typescript-reference.md)
-- [Troubleshooting](genai-electron-docs/troubleshooting.md)
-
-## Example App
-
-See **[electron-control-panel](examples/electron-control-panel/)** for a full-featured reference implementation.
-
-## Platform Support
-
-- **macOS**: 11+ (Intel, Apple Silicon with Metal)
-- **Windows**: 10+ (64-bit, CPU and CUDA)
-- **Linux**: Ubuntu 20.04+, Debian 11+, Fedora 35+ (CPU, CUDA, ROCm)
-
-## License
-
-MIT License - see [LICENSE](LICENSE) file for details.
-
-## Related Projects
-
-- **[genai-lite](https://github.com/lacerbi/genai-lite)** - Lightweight API abstraction for AI providers (cloud and local)
+# genai-electron
+
+> **Version**: 0.7.1 | **Status**: Production Ready - LLM & Image Generation, hardened server lifecycle
+
+Electron-specific library for managing local AI model servers (llama.cpp, stable-diffusion.cpp). Handles platform-specific operations to run AI models locally. Complements [genai-lite](https://github.com/lacerbi/genai-lite) for API abstraction.
+
+## Features
+
+- ✅ **System detection** - Auto-detect RAM, CPU, GPU, VRAM capabilities
+- ✅ **Model management** - Download GGUF models with progress tracking and metadata extraction
+- ✅ **LLM server** - Manage llama-server lifecycle with auto-configuration
+- ✅ **Image generation** - Local image generation via stable-diffusion.cpp
+- ✅ **Multi-component diffusion models** - Flux 2, SDXL split components with aggregate checksum validation
+- ✅ **Resource orchestration** - Automatic LLM offload/reload when memory constrained
+- ✅ **Reliable server lifecycle** - Crash auto-restart, hang watchdog, automatic port selection, occupancy safety, log rotation
+- ✅ **Advanced launch control** - KV-cache quantization, flash-attention control, MoE CPU offload, multi-shard GGUF downloads, image-generation cancellation
+- ✅ **Binary management** - Automatic binary download with GPU variant testing (CUDA→Vulkan→CPU)
+- ✅ **TypeScript-first** - Full type safety, minimal runtime dependencies
+
+## Installation
+
+```bash
+npm install genai-electron
+npm install electron@>=25.0.0  # Peer dependency
+```
+
+## Quick Start
+
+```typescript
+import { app } from 'electron';
+import { systemInfo, modelManager, llamaServer } from 'genai-electron';
+
+app.whenReady().then(async () => {
+  // Detect capabilities
+  const caps = await systemInfo.detect();
+  console.log('RAM:', (caps.memory.total / 1024 ** 3).toFixed(1), 'GB');
+
+  // Download model (if needed)
+  await modelManager.downloadModel({
+    source: 'url',
+    url: 'https://huggingface.co/TheBloke/Llama-2-7B-GGUF/resolve/main/llama-2-7b.Q4_K_M.gguf',
+    name: 'Llama 2 7B',
+    type: 'llm'
+  });
+
+  // Start server with auto-config (port is optional — defaults to 8080;
+  // pass port: 'auto' to have the OS pick a free port)
+  const info = await llamaServer.start({
+    modelId: 'llama-2-7b'
+  });
+
+  console.log(`Server ready on port ${info.port}`);
+});
+```
+
+Use with [genai-lite](https://github.com/lacerbi/genai-lite) for AI interactions (chat, image generation).
+
+## Documentation
+
+📚 **[Complete Documentation](genai-electron-docs/index.md)** - Full API reference, guides, and examples
+
+**Quick Links**:
+- [Installation & Setup](genai-electron-docs/installation-and-setup.md)
+- [System Detection](genai-electron-docs/system-detection.md)
+- [Model Management](genai-electron-docs/model-management.md)
+- [LLM Server](genai-electron-docs/llm-server.md)
+- [Image Generation](genai-electron-docs/image-generation.md)
+- [TypeScript Reference](genai-electron-docs/typescript-reference.md)
+- [Troubleshooting](genai-electron-docs/troubleshooting.md)
+
+## Example App
+
+See **[electron-control-panel](examples/electron-control-panel/)** for a full-featured reference implementation.
+
+## Platform Support
+
+- **macOS**: 11+ (Intel, Apple Silicon with Metal)
+- **Windows**: 10+ (64-bit; CUDA, Vulkan, CPU)
+- **Linux**: Ubuntu 20.04+, Debian 11+, Fedora 35+ (Vulkan, CPU — no CUDA prebuilt upstream; build from source for CUDA)
+
+## License
+
+MIT License - see [LICENSE](LICENSE) file for details.
+
+## Related Projects
+
+- **[genai-lite](https://github.com/lacerbi/genai-lite)** - Lightweight API abstraction for AI providers (cloud and local)

package/dist/config/defaults.d.ts

@@ -5,10 +5,22 @@ export declare const DEFAULT_PORTS: {
 };
 export declare const DEFAULT_TIMEOUTS: {
     readonly download: 300000;
-    readonly serverStart: 60000;
+    readonly serverStart: 120000;
     readonly serverStop: 10000;
     readonly healthCheck: 5000;
 };
+export declare const DEFAULT_LOG_ROTATION: {
+    readonly maxFileSize: number;
+    readonly maxArchives: 2;
+};
+export declare const KV_SIZING: {
+    readonly floorContextTokens: 4096;
+    readonly computeBufferBytes: number;
+    readonly gpuWeightsOverhead: 1.1;
+    readonly cpuWeightsOverhead: 1.2;
+    readonly osRamMarginBytes: number;
+    readonly minPartialReserveBytes: number;
+};
 export type BinaryVariant = 'cuda' | 'vulkan' | 'metal' | 'cpu';
 export interface BinaryDependency {
     url: string;
@@ -23,44 +35,44 @@ export interface BinaryVariantConfig {
 }
 export declare const BINARY_VERSIONS: {
     readonly llamaServer: {
-        readonly version: "b7956";
+        readonly version: "b9860";
         readonly variants: {
             readonly 'darwin-arm64': readonly [{
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-macos-arm64.tar.gz";
-                readonly checksum: "3abe5f4ca01258759fe593331f4dc45e439b3bfaf1127b2061ed18bfa0f82960";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-macos-arm64.tar.gz";
+                readonly checksum: "35a2e8c3528adc71db5044e7ad7de8d8b96a4221e737958915e31538a005f1d9";
             }];
             readonly 'darwin-x64': readonly [{
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-macos-x64.tar.gz";
-                readonly checksum: "6becaf739a2e1f58ac78da9c909eee932a25799a778ef1da3bfb6a42aeb2e7a8";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-macos-x64.tar.gz";
+                readonly checksum: "d442123d5441c82b23b412a58d91e149f60723adfc20a7cc9df04a3908cb5113";
             }];
             readonly 'win32-x64': readonly [{
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-cuda-12.4-x64.zip";
-                readonly checksum: "3f8d62dcb542cdeb2213ead9a51dd1c33ddd497aa85039170b2a7e1b99931f01";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-cuda-12.4-x64.zip";
+                readonly checksum: "70c433fcb55bcb0e0ff0d4a4fc5f02c11a14303445e0525b526071bccdc6c848";
                 readonly dependencies: readonly [{
-                    readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/cudart-llama-bin-win-cuda-12.4-x64.zip";
+                    readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/cudart-llama-bin-win-cuda-12.4-x64.zip";
                     readonly checksum: "8c79a9b226de4b3cacfd1f83d24f962d0773be79f1e7b75c6af4ded7e32ae1d6";
                     readonly description: "CUDA 12.4 runtime libraries required for NVIDIA GPU acceleration";
                 }];
             }, {
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-vulkan-x64.zip";
-                readonly checksum: "7a4caccf406540a647e636f1b750c09a3bd1aeee5ff7b257b3e91551b7b7c57b";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-vulkan-x64.zip";
+                readonly checksum: "c3f0703c8fca8fa4cbc01a347d7180fca092e889fe693268bf1192fd07350c13";
             }, {
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-cpu-x64.zip";
-                readonly checksum: "a092148f651e21d60b129bd6533e16e32b96a69da3573c79d5fcbeb4c149ea36";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-cpu-x64.zip";
+                readonly checksum: "d33871623713345cd90b54e516ebada79039cab636e51b22c8c9feae72567837";
             }];
             readonly 'linux-x64': readonly [{
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-ubuntu-x64.tar.gz";
-                readonly checksum: "a71ccffc351726f189cc3d532a414ba6130fe6814ca1f6563c9af3e7ae4de294";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-ubuntu-vulkan-x64.tar.gz";
+                readonly checksum: "4aaa4ca2ed9f608cf26cb6ba0cdad9c5b8e8f2d1e95c4f04bb3fa9a1a8c86806";
             }, {
                 readonly type: BinaryVariant;
-                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-ubuntu-vulkan-x64.tar.gz";
-                readonly checksum: "174ce7d23249b3911e7754433284ab3b7027ce8cdce7f5c040b60cc823b9b12e";
+                readonly url: "https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-ubuntu-x64.tar.gz";
+                readonly checksum: "b68e8072eb88d1cc8b8e9d6ea8237aae87b34c6d8bbffda958c870e4dc949714";
             }];
         };
     };

package/dist/config/defaults.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"defaults.d.ts","sourceRoot":"","sources":["../../src/config/defaults.ts"],"names":[],"mappings":"AAKA,OAAO,KAAK,EAAE,sBAAsB,EAAE,MAAM,mBAAmB,CAAC;AAKhE,eAAO,MAAM,aAAa;;;CAKhB,CAAC;AAKX,eAAO,MAAM,gBAAgB;;;;;CASnB,CAAC;AAKX,MAAM,MAAM,aAAa,GAAG,MAAM,GAAG,QAAQ,GAAG,OAAO,GAAG,KAAK,CAAC;AAMhE,MAAM,WAAW,gBAAgB;IAE/B,GAAG,EAAE,MAAM,CAAC;IAEZ,QAAQ,EAAE,MAAM,CAAC;IAEjB,WAAW,CAAC,EAAE,MAAM,CAAC;CACtB;AAKD,MAAM,WAAW,mBAAmB;IAElC,IAAI,EAAE,aAAa,CAAC;IAEpB,GAAG,EAAE,MAAM,CAAC;IAEZ,QAAQ,EAAE,MAAM,CAAC;IAEjB,YAAY,CAAC,EAAE,SAAS,gBAAgB,EAAE,CAAC;CAC5C;AAWD,eAAO,MAAM,eAAe;;;;;+BASD,aAAa;;;;;+BAOf,aAAa;;;;;+BAOZ,aAAa;;;;;;;;;+BAYX,aAAa;;;;+BAKhB,aAAa;;;;;+BAOZ,aAAa;;;;+BAKX,aAAa;;;;;;;;;;+BAed,aAAa;;;;;;+BAWd,aAAa;;;;;;;;;+BAYX,aAAa;;;;+BAKhB,aAAa;;;;;+BAYb,aAAa;;;;;;CAO5B,CAAC;AAKX,eAAO,MAAM,yBAAyB,EAAE,MAAM,CAAC,sBAAsB,EAAE,MAAM,CAQ5E,CAAC;AAMF,eAAO,MAAM,yBAAyB,EAAE,SAAS,sBAAsB,EAQ7D,CAAC;AAUX,eAAO,MAAM,yBAAyB;;;;CAO5B,CAAC;AAKX,eAAO,MAAM,yBAAyB;;;;CAO5B,CAAC"}
+{"version":3,"file":"defaults.d.ts","sourceRoot":"","sources":["../../src/config/defaults.ts"],"names":[],"mappings":"AAKA,OAAO,KAAK,EAAE,sBAAsB,EAAE,MAAM,mBAAmB,CAAC;AAKhE,eAAO,MAAM,aAAa;;;CAKhB,CAAC;AAKX,eAAO,MAAM,gBAAgB;;;;;CASnB,CAAC;AAKX,eAAO,MAAM,oBAAoB;;;CAKvB,CAAC;AAKX,eAAO,MAAM,SAAS;;;;;;;CAaZ,CAAC;AAKX,MAAM,MAAM,aAAa,GAAG,MAAM,GAAG,QAAQ,GAAG,OAAO,GAAG,KAAK,CAAC;AAMhE,MAAM,WAAW,gBAAgB;IAE/B,GAAG,EAAE,MAAM,CAAC;IAEZ,QAAQ,EAAE,MAAM,CAAC;IAEjB,WAAW,CAAC,EAAE,MAAM,CAAC;CACtB;AAKD,MAAM,WAAW,mBAAmB;IAElC,IAAI,EAAE,aAAa,CAAC;IAEpB,GAAG,EAAE,MAAM,CAAC;IAEZ,QAAQ,EAAE,MAAM,CAAC;IAEjB,YAAY,CAAC,EAAE,SAAS,gBAAgB,EAAE,CAAC;CAC5C;AAWD,eAAO,MAAM,eAAe;;;;;+BAeD,aAAa;;;;;+BAOf,aAAa;;;;;+BAOZ,aAAa;;;;;;;;;+BAYX,aAAa;;;;+BAKhB,aAAa;;;;;+BAOV,aAAa;;;;+BAKhB,aAAa;;;;;;;;;;+BAeX,aAAa;;;;;;+BAWd,aAAa;;;;;;;;;+BAYX,aAAa;;;;+BAKhB,aAAa;;;;;+BAYb,aAAa;;;;;;CAO5B,CAAC;AAKX,eAAO,MAAM,yBAAyB,EAAE,MAAM,CAAC,sBAAsB,EAAE,MAAM,CAQ5E,CAAC;AAMF,eAAO,MAAM,yBAAyB,EAAE,SAAS,sBAAsB,EAQ7D,CAAC;AAUX,eAAO,MAAM,yBAAyB;;;;CAO5B,CAAC;AAKX,eAAO,MAAM,yBAAyB;;;;CAO5B,CAAC"}

package/dist/config/defaults.js

@@ -4,36 +4,48 @@ export const DEFAULT_PORTS = {
 };
 export const DEFAULT_TIMEOUTS = {
     download: 300000,
-    serverStart: 60000,
+    serverStart: 120000,
     serverStop: 10000,
     healthCheck: 5000,
 };
+export const DEFAULT_LOG_ROTATION = {
+    maxFileSize: 5 * 1024 * 1024,
+    maxArchives: 2,
+};
+export const KV_SIZING = {
+    floorContextTokens: 4096,
+    computeBufferBytes: 1 * 1024 ** 3,
+    gpuWeightsOverhead: 1.1,
+    cpuWeightsOverhead: 1.2,
+    osRamMarginBytes: 2 * 1024 ** 3,
+    minPartialReserveBytes: 1.5 * 1024 ** 3,
+};
 export const BINARY_VERSIONS = {
     llamaServer: {
-        version: 'b7956',
+        version: 'b9860',
         variants: {
             'darwin-arm64': [
                 {
                     type: 'metal',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-macos-arm64.tar.gz',
-                    checksum: '3abe5f4ca01258759fe593331f4dc45e439b3bfaf1127b2061ed18bfa0f82960',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-macos-arm64.tar.gz',
+                    checksum: '35a2e8c3528adc71db5044e7ad7de8d8b96a4221e737958915e31538a005f1d9',
                 },
             ],
             'darwin-x64': [
                 {
                     type: 'cpu',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-macos-x64.tar.gz',
-                    checksum: '6becaf739a2e1f58ac78da9c909eee932a25799a778ef1da3bfb6a42aeb2e7a8',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-macos-x64.tar.gz',
+                    checksum: 'd442123d5441c82b23b412a58d91e149f60723adfc20a7cc9df04a3908cb5113',
                 },
             ],
             'win32-x64': [
                 {
                     type: 'cuda',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-cuda-12.4-x64.zip',
-                    checksum: '3f8d62dcb542cdeb2213ead9a51dd1c33ddd497aa85039170b2a7e1b99931f01',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-cuda-12.4-x64.zip',
+                    checksum: '70c433fcb55bcb0e0ff0d4a4fc5f02c11a14303445e0525b526071bccdc6c848',
                     dependencies: [
                         {
-                            url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/cudart-llama-bin-win-cuda-12.4-x64.zip',
+                            url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/cudart-llama-bin-win-cuda-12.4-x64.zip',
                             checksum: '8c79a9b226de4b3cacfd1f83d24f962d0773be79f1e7b75c6af4ded7e32ae1d6',
                             description: 'CUDA 12.4 runtime libraries required for NVIDIA GPU acceleration',
                         },
@@ -41,25 +53,25 @@ export const BINARY_VERSIONS = {
                 },
                 {
                     type: 'vulkan',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-vulkan-x64.zip',
-                    checksum: '7a4caccf406540a647e636f1b750c09a3bd1aeee5ff7b257b3e91551b7b7c57b',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-vulkan-x64.zip',
+                    checksum: 'c3f0703c8fca8fa4cbc01a347d7180fca092e889fe693268bf1192fd07350c13',
                 },
                 {
                     type: 'cpu',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-win-cpu-x64.zip',
-                    checksum: 'a092148f651e21d60b129bd6533e16e32b96a69da3573c79d5fcbeb4c149ea36',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-win-cpu-x64.zip',
+                    checksum: 'd33871623713345cd90b54e516ebada79039cab636e51b22c8c9feae72567837',
                 },
             ],
             'linux-x64': [
                 {
-                    type: 'cuda',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-ubuntu-x64.tar.gz',
-                    checksum: 'a71ccffc351726f189cc3d532a414ba6130fe6814ca1f6563c9af3e7ae4de294',
+                    type: 'vulkan',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-ubuntu-vulkan-x64.tar.gz',
+                    checksum: '4aaa4ca2ed9f608cf26cb6ba0cdad9c5b8e8f2d1e95c4f04bb3fa9a1a8c86806',
                 },
                 {
-                    type: 'vulkan',
-                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b7956/llama-b7956-bin-ubuntu-vulkan-x64.tar.gz',
-                    checksum: '174ce7d23249b3911e7754433284ab3b7027ce8cdce7f5c040b60cc823b9b12e',
+                    type: 'cpu',
+                    url: 'https://github.com/ggml-org/llama.cpp/releases/download/b9860/llama-b9860-bin-ubuntu-x64.tar.gz',
+                    checksum: 'b68e8072eb88d1cc8b8e9d6ea8237aae87b34c6d8bbffda958c870e4dc949714',
                 },
             ],
         },

package/dist/config/defaults.js.map

@@ -1 +1 @@
-{"version":3,"file":"defaults.js","sourceRoot":"","sources":["../../src/config/defaults.ts"],"names":[],"mappings":"AAUA,MAAM,CAAC,MAAM,aAAa,GAAG;IAE3B,KAAK,EAAE,IAAI;IAEX,SAAS,EAAE,IAAI;CACP,CAAC;AAKX,MAAM,CAAC,MAAM,gBAAgB,GAAG;IAE9B,QAAQ,EAAE,MAAM;IAEhB,WAAW,EAAE,KAAK;IAElB,UAAU,EAAE,KAAK;IAEjB,WAAW,EAAE,IAAI;CACT,CAAC;AA2CX,MAAM,CAAC,MAAM,eAAe,GAAG;IAE7B,WAAW,EAAE;QAEX,OAAO,EAAE,OAAO;QAEhB,QAAQ,EAAE;YACR,cAAc,EAAE;gBACd;oBACE,IAAI,EAAE,OAAwB;oBAC9B,GAAG,EAAE,kGAAkG;oBACvG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,YAAY,EAAE;gBACZ;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,gGAAgG;oBACrG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,MAAuB;oBAC7B,GAAG,EAAE,qGAAqG;oBAC1G,QAAQ,EAAE,kEAAkE;oBAC5E,YAAY,EAAE;wBACZ;4BACE,GAAG,EAAE,sGAAsG;4BAC3G,QAAQ,EAAE,kEAAkE;4BAC5E,WAAW,EAAE,kEAAkE;yBAChF;qBACF;iBACF;gBACD;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,kGAAkG;oBACvG,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,+FAA+F;oBACpG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,MAAuB;oBAC7B,GAAG,EAAE,iGAAiG;oBACtG,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,wGAAwG;oBAC7G,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;SACF;KACF;IAED,YAAY,EAAE;QAEZ,OAAO,EAAE,oBAAoB;QAE7B,QAAQ,EAAE;YACR,cAAc,EAAE;gBACd;oBACE,IAAI,EAAE,OAAwB;oBAC9B,GAAG,EAAE,yIAAyI;oBAC9I,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,YAAY,EAAE,EAEb;YACD,WAAW,EAAE;gBAEX;oBACE,IAAI,EAAE,MAAuB;oBAC7B,GAAG,EAAE,8HAA8H;oBACnI,QAAQ,EAAE,kEAAkE;oBAC5E,YAAY,EAAE;wBACZ;4BACE,GAAG,EAAE,oHAAoH;4BACzH,QAAQ,EAAE,kEAAkE;4BAC5E,WAAW,EAAE,gEAAgE;yBAC9E;qBACF;iBACF;gBACD;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,8HAA8H;oBACnI,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,4HAA4H;oBACjI,QAAQ,EAAE,kEAAkE;iBAC7E;aAMF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,yIAAyI;oBAC9I,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;SACF;KACF;CACO,CAAC;AAKX,MAAM,CAAC,MAAM,yBAAyB,GAA2C;IAC/E,eAAe,EAAE,mBAAmB;IACpC,MAAM,EAAE,UAAU;IAClB,MAAM,EAAE,UAAU;IAClB,KAAK,EAAE,SAAS;IAChB,GAAG,EAAE,OAAO;IACZ,UAAU,EAAE,cAAc;IAC1B,GAAG,EAAE,OAAO;CACb,CAAC;AAMF,MAAM,CAAC,MAAM,yBAAyB,GAAsC;IAC1E,iBAAiB;IACjB,QAAQ;IACR,QAAQ;IACR,OAAO;IACP,KAAK;IACL,YAAY;IACZ,KAAK;CACG,CAAC;AAUX,MAAM,CAAC,MAAM,yBAAyB,GAAG;IAEvC,sBAAsB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAErC,qBAAqB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAEpC,uBAAuB,EAAE,GAAG;CACpB,CAAC;AAKX,MAAM,CAAC,MAAM,yBAAyB,GAAG;IAEvC,OAAO,EAAE,CAAC,MAAM,EAAE,MAAM,EAAE,QAAQ,CAAC;IAEnC,QAAQ,EAAE,CAAC,QAAQ,EAAE,QAAQ,CAAC;IAE9B,OAAO,EAAE,CAAC,QAAQ,EAAE,QAAQ,EAAE,QAAQ,CAAC;CAC/B,CAAC"}
+{"version":3,"file":"defaults.js","sourceRoot":"","sources":["../../src/config/defaults.ts"],"names":[],"mappings":"AAUA,MAAM,CAAC,MAAM,aAAa,GAAG;IAE3B,KAAK,EAAE,IAAI;IAEX,SAAS,EAAE,IAAI;CACP,CAAC;AAKX,MAAM,CAAC,MAAM,gBAAgB,GAAG;IAE9B,QAAQ,EAAE,MAAM;IAEhB,WAAW,EAAE,MAAM;IAEnB,UAAU,EAAE,KAAK;IAEjB,WAAW,EAAE,IAAI;CACT,CAAC;AAKX,MAAM,CAAC,MAAM,oBAAoB,GAAG;IAElC,WAAW,EAAE,CAAC,GAAG,IAAI,GAAG,IAAI;IAE5B,WAAW,EAAE,CAAC;CACN,CAAC;AAKX,MAAM,CAAC,MAAM,SAAS,GAAG;IAEvB,kBAAkB,EAAE,IAAI;IAExB,kBAAkB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAEjC,kBAAkB,EAAE,GAAG;IAEvB,kBAAkB,EAAE,GAAG;IAEvB,gBAAgB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAE/B,sBAAsB,EAAE,GAAG,GAAG,IAAI,IAAI,CAAC;CAC/B,CAAC;AA2CX,MAAM,CAAC,MAAM,eAAe,GAAG;IAE7B,WAAW,EAAE;QAEX,OAAO,EAAE,OAAO;QAQhB,QAAQ,EAAE;YACR,cAAc,EAAE;gBACd;oBACE,IAAI,EAAE,OAAwB;oBAC9B,GAAG,EAAE,kGAAkG;oBACvG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,YAAY,EAAE;gBACZ;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,gGAAgG;oBACrG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,MAAuB;oBAC7B,GAAG,EAAE,qGAAqG;oBAC1G,QAAQ,EAAE,kEAAkE;oBAC5E,YAAY,EAAE;wBACZ;4BACE,GAAG,EAAE,sGAAsG;4BAC3G,QAAQ,EAAE,kEAAkE;4BAC5E,WAAW,EAAE,kEAAkE;yBAChF;qBACF;iBACF;gBACD;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,kGAAkG;oBACvG,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,+FAA+F;oBACpG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,wGAAwG;oBAC7G,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,iGAAiG;oBACtG,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;SACF;KACF;IAED,YAAY,EAAE;QAEZ,OAAO,EAAE,oBAAoB;QAE7B,QAAQ,EAAE;YACR,cAAc,EAAE;gBACd;oBACE,IAAI,EAAE,OAAwB;oBAC9B,GAAG,EAAE,yIAAyI;oBAC9I,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;YACD,YAAY,EAAE,EAEb;YACD,WAAW,EAAE;gBAEX;oBACE,IAAI,EAAE,MAAuB;oBAC7B,GAAG,EAAE,8HAA8H;oBACnI,QAAQ,EAAE,kEAAkE;oBAC5E,YAAY,EAAE;wBACZ;4BACE,GAAG,EAAE,oHAAoH;4BACzH,QAAQ,EAAE,kEAAkE;4BAC5E,WAAW,EAAE,gEAAgE;yBAC9E;qBACF;iBACF;gBACD;oBACE,IAAI,EAAE,QAAyB;oBAC/B,GAAG,EAAE,8HAA8H;oBACnI,QAAQ,EAAE,kEAAkE;iBAC7E;gBACD;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,4HAA4H;oBACjI,QAAQ,EAAE,kEAAkE;iBAC7E;aAMF;YACD,WAAW,EAAE;gBACX;oBACE,IAAI,EAAE,KAAsB;oBAC5B,GAAG,EAAE,yIAAyI;oBAC9I,QAAQ,EAAE,kEAAkE;iBAC7E;aACF;SACF;KACF;CACO,CAAC;AAKX,MAAM,CAAC,MAAM,yBAAyB,GAA2C;IAC/E,eAAe,EAAE,mBAAmB;IACpC,MAAM,EAAE,UAAU;IAClB,MAAM,EAAE,UAAU;IAClB,KAAK,EAAE,SAAS;IAChB,GAAG,EAAE,OAAO;IACZ,UAAU,EAAE,cAAc;IAC1B,GAAG,EAAE,OAAO;CACb,CAAC;AAMF,MAAM,CAAC,MAAM,yBAAyB,GAAsC;IAC1E,iBAAiB;IACjB,QAAQ;IACR,QAAQ;IACR,OAAO;IACP,KAAK;IACL,YAAY;IACZ,KAAK;CACG,CAAC;AAUX,MAAM,CAAC,MAAM,yBAAyB,GAAG;IAEvC,sBAAsB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAErC,qBAAqB,EAAE,CAAC,GAAG,IAAI,IAAI,CAAC;IAEpC,uBAAuB,EAAE,GAAG;CACpB,CAAC;AAKX,MAAM,CAAC,MAAM,yBAAyB,GAAG;IAEvC,OAAO,EAAE,CAAC,MAAM,EAAE,MAAM,EAAE,QAAQ,CAAC;IAEnC,QAAQ,EAAE,CAAC,QAAQ,EAAE,QAAQ,CAAC;IAE9B,OAAO,EAAE,CAAC,QAAQ,EAAE,QAAQ,EAAE,QAAQ,CAAC;CAC/B,CAAC"}

package/dist/config/reasoning-models.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"reasoning-models.d.ts","sourceRoot":"","sources":["../../src/config/reasoning-models.ts"],"names":[],"mappings":"AAwBA,eAAO,MAAM,wBAAwB,EAAE,SAAS,MAAM,EAIrD,CAAC;AAmBF,wBAAgB,sBAAsB,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAGhE"}
+{"version":3,"file":"reasoning-models.d.ts","sourceRoot":"","sources":["../../src/config/reasoning-models.ts"],"names":[],"mappings":"AAyBA,eAAO,MAAM,wBAAwB,EAAE,SAAS,MAAM,EAIrD,CAAC;AAmBF,wBAAgB,sBAAsB,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAGhE"}

package/dist/config/reasoning-models.js.map

@@ -1 +1 @@
-{"version":3,"file":"reasoning-models.js","sourceRoot":"","sources":["../../src/config/reasoning-models.ts"],"names":[],"mappings":"AAwBA,MAAM,CAAC,MAAM,wBAAwB,GAAsB;IACzD,OAAO;IACP,aAAa;IACb,SAAS;CACV,CAAC;AAmBF,MAAM,UAAU,sBAAsB,CAAC,QAAgB;IACrD,MAAM,aAAa,GAAG,QAAQ,CAAC,WAAW,EAAE,CAAC;IAC7C,OAAO,wBAAwB,CAAC,IAAI,CAAC,CAAC,OAAO,EAAE,EAAE,CAAC,aAAa,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC;AACrF,CAAC"}
+{"version":3,"file":"reasoning-models.js","sourceRoot":"","sources":["../../src/config/reasoning-models.ts"],"names":[],"mappings":"AAyBA,MAAM,CAAC,MAAM,wBAAwB,GAAsB;IACzD,OAAO;IACP,aAAa;IACb,SAAS;CACV,CAAC;AAmBF,MAAM,UAAU,sBAAsB,CAAC,QAAgB;IACrD,MAAM,aAAa,GAAG,QAAQ,CAAC,WAAW,EAAE,CAAC;IAC7C,OAAO,wBAAwB,CAAC,IAAI,CAAC,CAAC,OAAO,EAAE,EAAE,CAAC,aAAa,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC;AACrF,CAAC"}

package/dist/index.d.ts

@@ -18,7 +18,9 @@ export { StorageManager } from './managers/StorageManager.js';
 export { ProcessManager } from './process/ProcessManager.js';
 export { LogManager } from './process/log-manager.js';
 export { Downloader } from './download/Downloader.js';
-export { checkHealth, waitForHealthy, isServerResponding } from './process/health-check.js';
+export { checkHealth, waitForHealthy, isServerResponding, normalizeHealthHost, } from './process/health-check.js';
+export { findFreePort, isPortBindable } from './process/port-utils.js';
+export { estimateKVBytesPerToken, floorContextToGranularity, KV_CACHE_BYTES_PER_ELEMENT, CONTEXT_GRANULARITY_LADDER, } from './utils/kv-cache-math.js';
 export { getCPUInfo, getRecommendedThreads } from './system/cpu-detect.js';
 export { getMemoryInfo, estimateVRAM } from './system/memory-detect.js';
 export { detectGPU } from './system/gpu-detect.js';
@@ -34,9 +36,9 @@ export { formatErrorForUI } from './utils/error-helpers.js';
 export type { UIErrorFormat } from './utils/error-helpers.js';
 export { PATHS, getBinaryPath, getModelFilePath, getModelDirectory } from './config/paths.js';
 export { BINARY_VERSIONS, DEFAULT_PORTS, DEFAULT_TIMEOUTS, DIFFUSION_VRAM_THRESHOLDS, DIFFUSION_COMPONENT_FLAGS, DIFFUSION_COMPONENT_ORDER, } from './config/defaults.js';
-export type { GPUInfo, CPUInfo, MemoryInfo, SystemCapabilities, SystemRecommendations, ModelType, ModelInfo, ModelSource, DownloadConfig, DownloadProgress, DownloadProgressCallback, GGUFMetadata, MetadataFetchStrategy, DiffusionComponentRole, DiffusionComponentInfo, DiffusionModelComponents, DiffusionComponentDownload, ServerStatus, HealthStatus, ServerConfig, ServerInfo, LlamaServerConfig, ServerEvent, ServerEventData, BinaryLogEvent, ImageSampler, ImageGenerationStage, ImageGenerationProgress, ImageGenerationConfig, ImageGenerationResult, DiffusionServerConfig, DiffusionServerInfo, GenerationStatus, GenerationState, Optional, RequiredKeys, OptionalKeys, JSONValue, } from './types/index.js';
+export type { GPUInfo, CPUInfo, MemoryInfo, SystemCapabilities, SystemRecommendations, ModelType, ModelInfo, ModelSource, DownloadConfig, DownloadProgress, DownloadProgressCallback, GGUFMetadata, MetadataFetchStrategy, DiffusionComponentRole, DiffusionComponentInfo, DiffusionModelComponents, DiffusionComponentDownload, ShardInfo, ServerStatus, HealthStatus, KVCacheType, FlashAttentionSetting, ServerConfig, ServerInfo, LlamaServerConfig, ServerEvent, ServerEventData, BinaryLogEvent, OptimalConfigHints, ImageSampler, ImageGenerationStage, ImageGenerationProgress, ImageGenerationConfig, ImageGenerationResult, DiffusionServerConfig, DiffusionServerInfo, GenerationStatus, GenerationState, Optional, RequiredKeys, OptionalKeys, JSONValue, } from './types/index.js';
 export type { SpawnOptions, SpawnResult } from './process/ProcessManager.js';
 export type { HealthCheckResponse } from './process/health-check.js';
-export type { LogLevel, LogEntry } from './process/log-manager.js';
+export type { LogLevel, LogEntry, LogRotationOptions } from './process/log-manager.js';
 export { GenaiElectronError, ModelNotFoundError, DownloadError, InsufficientResourcesError, ServerError, PortInUseError, FileSystemError, ChecksumError, BinaryError, } from './errors/index.js';
 //# sourceMappingURL=index.d.ts.map

package/dist/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAmDA,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAkB9E,eAAO,MAAM,UAAU,YAA2B,CAAC;AA0BnD,eAAO,MAAM,YAAY,cAA6B,CAAC;AAmCvD,eAAO,MAAM,WAAW,oBAA2B,CAAC;AAuCpD,eAAO,MAAM,eAAe,wBAI3B,CAAC;AAMF,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAC9E,OAAO,EAAE,oBAAoB,EAAE,MAAM,oCAAoC,CAAC;AAC1E,YAAY,EAAE,aAAa,EAAE,MAAM,oCAAoC,CAAC;AACxE,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,aAAa,EAAE,MAAM,6BAA6B,CAAC;AAC5D,OAAO,EAAE,cAAc,EAAE,MAAM,8BAA8B,CAAC;AAC9D,OAAO,EAAE,cAAc,EAAE,MAAM,6BAA6B,CAAC;AAC7D,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AAMtD,OAAO,EAAE,WAAW,EAAE,cAAc,EAAE,kBAAkB,EAAE,MAAM,2BAA2B,CAAC;AAC5F,OAAO,EAAE,UAAU,EAAE,qBAAqB,EAAE,MAAM,wBAAwB,CAAC;AAC3E,OAAO,EAAE,aAAa,EAAE,YAAY,EAAE,MAAM,2BAA2B,CAAC;AACxE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AACnD,OAAO,EAAE,iBAAiB,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AACnF,OAAO,EAAE,eAAe,EAAE,cAAc,EAAE,MAAM,wBAAwB,CAAC;AACzE,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,iBAAiB,EAAE,sBAAsB,EAAE,YAAY,EAAE,MAAM,wBAAwB,CAAC;AACjG,OAAO,EACL,WAAW,EACX,eAAe,EACf,cAAc,EACd,KAAK,EACL,SAAS,EACT,OAAO,EACP,cAAc,GACf,MAAM,2BAA2B,CAAC;AACnC,OAAO,EACL,eAAe,EACf,UAAU,EACV,WAAW,EACX,UAAU,EACV,QAAQ,EACR,iBAAiB,EACjB,WAAW,EACX,gBAAgB,GACjB,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,sBAAsB,EAAE,wBAAwB,EAAE,MAAM,8BAA8B,CAAC;AAChG,OAAO,EAAE,kBAAkB,EAAE,MAAM,+BAA+B,CAAC;AACnE,OAAO,EAAE,gBAAgB,EAAE,MAAM,0BAA0B,CAAC;AAC5D,YAAY,EAAE,aAAa,EAAE,MAAM,0BAA0B,CAAC;AAM9D,OAAO,EAAE,KAAK,EAAE,aAAa,EAAE,gBAAgB,EAAE,iBAAiB,EAAE,MAAM,mBAAmB,CAAC;AAC9F,OAAO,EACL,eAAe,EACf,aAAa,EACb,gBAAgB,EAChB,yBAAyB,EACzB,yBAAyB,EACzB,yBAAyB,GAC1B,MAAM,sBAAsB,CAAC;AAM9B,YAAY,EAEV,OAAO,EACP,OAAO,EACP,UAAU,EACV,kBAAkB,EAClB,qBAAqB,EAErB,SAAS,EACT,SAAS,EACT,WAAW,EACX,cAAc,EACd,gBAAgB,EAChB,wBAAwB,EACxB,YAAY,EACZ,qBAAqB,EACrB,sBAAsB,EACtB,sBAAsB,EACtB,wBAAwB,EACxB,0BAA0B,EAE1B,YAAY,EACZ,YAAY,EACZ,YAAY,EACZ,UAAU,EACV,iBAAiB,EACjB,WAAW,EACX,eAAe,EACf,cAAc,EAEd,YAAY,EACZ,oBAAoB,EACpB,uBAAuB,EACvB,qBAAqB,EACrB,qBAAqB,EACrB,qBAAqB,EACrB,mBAAmB,EACnB,gBAAgB,EAChB,eAAe,EAEf,QAAQ,EACR,YAAY,EACZ,YAAY,EACZ,SAAS,GACV,MAAM,kBAAkB,CAAC;AAE1B,YAAY,EAAE,YAAY,EAAE,WAAW,EAAE,MAAM,6BAA6B,CAAC;AAE7E,YAAY,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AAErE,YAAY,EAAE,QAAQ,EAAE,QAAQ,EAAE,MAAM,0BAA0B,CAAC;AAMnE,OAAO,EACL,kBAAkB,EAClB,kBAAkB,EAClB,aAAa,EACb,0BAA0B,EAC1B,WAAW,EACX,cAAc,EACd,eAAe,EACf,aAAa,EACb,WAAW,GACZ,MAAM,mBAAmB,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAmDA,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAkB9E,eAAO,MAAM,UAAU,YAA2B,CAAC;AA0BnD,eAAO,MAAM,YAAY,cAA6B,CAAC;AAmCvD,eAAO,MAAM,WAAW,oBAA2B,CAAC;AAuCpD,eAAO,MAAM,eAAe,wBAI3B,CAAC;AAMF,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAC9E,OAAO,EAAE,oBAAoB,EAAE,MAAM,oCAAoC,CAAC;AAC1E,YAAY,EAAE,aAAa,EAAE,MAAM,oCAAoC,CAAC;AACxE,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,aAAa,EAAE,MAAM,6BAA6B,CAAC;AAC5D,OAAO,EAAE,cAAc,EAAE,MAAM,8BAA8B,CAAC;AAC9D,OAAO,EAAE,cAAc,EAAE,MAAM,6BAA6B,CAAC;AAC7D,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AAMtD,OAAO,EACL,WAAW,EACX,cAAc,EACd,kBAAkB,EAClB,mBAAmB,GACpB,MAAM,2BAA2B,CAAC;AACnC,OAAO,EAAE,YAAY,EAAE,cAAc,EAAE,MAAM,yBAAyB,CAAC;AACvE,OAAO,EACL,uBAAuB,EACvB,yBAAyB,EACzB,0BAA0B,EAC1B,0BAA0B,GAC3B,MAAM,0BAA0B,CAAC;AAClC,OAAO,EAAE,UAAU,EAAE,qBAAqB,EAAE,MAAM,wBAAwB,CAAC;AAC3E,OAAO,EAAE,aAAa,EAAE,YAAY,EAAE,MAAM,2BAA2B,CAAC;AACxE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AACnD,OAAO,EAAE,iBAAiB,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AACnF,OAAO,EAAE,eAAe,EAAE,cAAc,EAAE,MAAM,wBAAwB,CAAC;AACzE,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,iBAAiB,EAAE,sBAAsB,EAAE,YAAY,EAAE,MAAM,wBAAwB,CAAC;AACjG,OAAO,EACL,WAAW,EACX,eAAe,EACf,cAAc,EACd,KAAK,EACL,SAAS,EACT,OAAO,EACP,cAAc,GACf,MAAM,2BAA2B,CAAC;AACnC,OAAO,EACL,eAAe,EACf,UAAU,EACV,WAAW,EACX,UAAU,EACV,QAAQ,EACR,iBAAiB,EACjB,WAAW,EACX,gBAAgB,GACjB,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,sBAAsB,EAAE,wBAAwB,EAAE,MAAM,8BAA8B,CAAC;AAChG,OAAO,EAAE,kBAAkB,EAAE,MAAM,+BAA+B,CAAC;AACnE,OAAO,EAAE,gBAAgB,EAAE,MAAM,0BAA0B,CAAC;AAC5D,YAAY,EAAE,aAAa,EAAE,MAAM,0BAA0B,CAAC;AAM9D,OAAO,EAAE,KAAK,EAAE,aAAa,EAAE,gBAAgB,EAAE,iBAAiB,EAAE,MAAM,mBAAmB,CAAC;AAC9F,OAAO,EACL,eAAe,EACf,aAAa,EACb,gBAAgB,EAChB,yBAAyB,EACzB,yBAAyB,EACzB,yBAAyB,GAC1B,MAAM,sBAAsB,CAAC;AAM9B,YAAY,EAEV,OAAO,EACP,OAAO,EACP,UAAU,EACV,kBAAkB,EAClB,qBAAqB,EAErB,SAAS,EACT,SAAS,EACT,WAAW,EACX,cAAc,EACd,gBAAgB,EAChB,wBAAwB,EACxB,YAAY,EACZ,qBAAqB,EACrB,sBAAsB,EACtB,sBAAsB,EACtB,wBAAwB,EACxB,0BAA0B,EAC1B,SAAS,EAET,YAAY,EACZ,YAAY,EACZ,WAAW,EACX,qBAAqB,EACrB,YAAY,EACZ,UAAU,EACV,iBAAiB,EACjB,WAAW,EACX,eAAe,EACf,cAAc,EACd,kBAAkB,EAElB,YAAY,EACZ,oBAAoB,EACpB,uBAAuB,EACvB,qBAAqB,EACrB,qBAAqB,EACrB,qBAAqB,EACrB,mBAAmB,EACnB,gBAAgB,EAChB,eAAe,EAEf,QAAQ,EACR,YAAY,EACZ,YAAY,EACZ,SAAS,GACV,MAAM,kBAAkB,CAAC;AAE1B,YAAY,EAAE,YAAY,EAAE,WAAW,EAAE,MAAM,6BAA6B,CAAC;AAE7E,YAAY,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AAErE,YAAY,EAAE,QAAQ,EAAE,QAAQ,EAAE,kBAAkB,EAAE,MAAM,0BAA0B,CAAC;AAMvF,OAAO,EACL,kBAAkB,EAClB,kBAAkB,EAClB,aAAa,EACb,0BAA0B,EAC1B,WAAW,EACX,cAAc,EACd,eAAe,EACf,aAAa,EACb,WAAW,GACZ,MAAM,mBAAmB,CAAC"}

package/dist/index.js

@@ -17,7 +17,9 @@ export { StorageManager } from './managers/StorageManager.js';
 export { ProcessManager } from './process/ProcessManager.js';
 export { LogManager } from './process/log-manager.js';
 export { Downloader } from './download/Downloader.js';
-export { checkHealth, waitForHealthy, isServerResponding } from './process/health-check.js';
+export { checkHealth, waitForHealthy, isServerResponding, normalizeHealthHost, } from './process/health-check.js';
+export { findFreePort, isPortBindable } from './process/port-utils.js';
+export { estimateKVBytesPerToken, floorContextToGranularity, KV_CACHE_BYTES_PER_ELEMENT, CONTEXT_GRANULARITY_LADDER, } from './utils/kv-cache-math.js';
 export { getCPUInfo, getRecommendedThreads } from './system/cpu-detect.js';
 export { getMemoryInfo, estimateVRAM } from './system/memory-detect.js';
 export { detectGPU } from './system/gpu-detect.js';

package/dist/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAmDA,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAkB9E,MAAM,CAAC,MAAM,UAAU,GAAG,UAAU,CAAC,WAAW,EAAE,CAAC;AA0BnD,MAAM,CAAC,MAAM,YAAY,GAAG,YAAY,CAAC,WAAW,EAAE,CAAC;AAmCvD,MAAM,CAAC,MAAM,WAAW,GAAG,IAAI,kBAAkB,EAAE,CAAC;AAuCpD,MAAM,CAAC,MAAM,eAAe,GAAG,IAAI,sBAAsB,CACvD,SAAS,EACT,SAAS,EACT,WAAW,CACZ,CAAC;AAMF,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAC9E,OAAO,EAAE,oBAAoB,EAAE,MAAM,oCAAoC,CAAC;AAE1E,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,aAAa,EAAE,MAAM,6BAA6B,CAAC;AAC5D,OAAO,EAAE,cAAc,EAAE,MAAM,8BAA8B,CAAC;AAC9D,OAAO,EAAE,cAAc,EAAE,MAAM,6BAA6B,CAAC;AAC7D,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AAMtD,OAAO,EAAE,WAAW,EAAE,cAAc,EAAE,kBAAkB,EAAE,MAAM,2BAA2B,CAAC;AAC5F,OAAO,EAAE,UAAU,EAAE,qBAAqB,EAAE,MAAM,wBAAwB,CAAC;AAC3E,OAAO,EAAE,aAAa,EAAE,YAAY,EAAE,MAAM,2BAA2B,CAAC;AACxE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AACnD,OAAO,EAAE,iBAAiB,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AACnF,OAAO,EAAE,eAAe,EAAE,cAAc,EAAE,MAAM,wBAAwB,CAAC;AACzE,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,iBAAiB,EAAE,sBAAsB,EAAE,YAAY,EAAE,MAAM,wBAAwB,CAAC;AACjG,OAAO,EACL,WAAW,EACX,eAAe,EACf,cAAc,EACd,KAAK,EACL,SAAS,EACT,OAAO,EACP,cAAc,GACf,MAAM,2BAA2B,CAAC;AACnC,OAAO,EACL,eAAe,EACf,UAAU,EACV,WAAW,EACX,UAAU,EACV,QAAQ,EACR,iBAAiB,EACjB,WAAW,EACX,gBAAgB,GACjB,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,sBAAsB,EAAE,wBAAwB,EAAE,MAAM,8BAA8B,CAAC;AAChG,OAAO,EAAE,kBAAkB,EAAE,MAAM,+BAA+B,CAAC;AACnE,OAAO,EAAE,gBAAgB,EAAE,MAAM,0BAA0B,CAAC;AAO5D,OAAO,EAAE,KAAK,EAAE,aAAa,EAAE,gBAAgB,EAAE,iBAAiB,EAAE,MAAM,mBAAmB,CAAC;AAC9F,OAAO,EACL,eAAe,EACf,aAAa,EACb,gBAAgB,EAChB,yBAAyB,EACzB,yBAAyB,EACzB,yBAAyB,GAC1B,MAAM,sBAAsB,CAAC;AA8D9B,OAAO,EACL,kBAAkB,EAClB,kBAAkB,EAClB,aAAa,EACb,0BAA0B,EAC1B,WAAW,EACX,cAAc,EACd,eAAe,EACf,aAAa,EACb,WAAW,GACZ,MAAM,mBAAmB,CAAC"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAmDA,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAkB9E,MAAM,CAAC,MAAM,UAAU,GAAG,UAAU,CAAC,WAAW,EAAE,CAAC;AA0BnD,MAAM,CAAC,MAAM,YAAY,GAAG,YAAY,CAAC,WAAW,EAAE,CAAC;AAmCvD,MAAM,CAAC,MAAM,WAAW,GAAG,IAAI,kBAAkB,EAAE,CAAC;AAuCpD,MAAM,CAAC,MAAM,eAAe,GAAG,IAAI,sBAAsB,CACvD,SAAS,EACT,SAAS,EACT,WAAW,CACZ,CAAC;AAMF,OAAO,EAAE,UAAU,EAAE,MAAM,wBAAwB,CAAC;AACpD,OAAO,EAAE,YAAY,EAAE,MAAM,4BAA4B,CAAC;AAC1D,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,sBAAsB,EAAE,MAAM,sCAAsC,CAAC;AAC9E,OAAO,EAAE,oBAAoB,EAAE,MAAM,oCAAoC,CAAC;AAE1E,OAAO,EAAE,kBAAkB,EAAE,MAAM,kCAAkC,CAAC;AACtE,OAAO,EAAE,aAAa,EAAE,MAAM,6BAA6B,CAAC;AAC5D,OAAO,EAAE,cAAc,EAAE,MAAM,8BAA8B,CAAC;AAC9D,OAAO,EAAE,cAAc,EAAE,MAAM,6BAA6B,CAAC;AAC7D,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AAMtD,OAAO,EACL,WAAW,EACX,cAAc,EACd,kBAAkB,EAClB,mBAAmB,GACpB,MAAM,2BAA2B,CAAC;AACnC,OAAO,EAAE,YAAY,EAAE,cAAc,EAAE,MAAM,yBAAyB,CAAC;AACvE,OAAO,EACL,uBAAuB,EACvB,yBAAyB,EACzB,0BAA0B,EAC1B,0BAA0B,GAC3B,MAAM,0BAA0B,CAAC;AAClC,OAAO,EAAE,UAAU,EAAE,qBAAqB,EAAE,MAAM,wBAAwB,CAAC;AAC3E,OAAO,EAAE,aAAa,EAAE,YAAY,EAAE,MAAM,2BAA2B,CAAC;AACxE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AACnD,OAAO,EAAE,iBAAiB,EAAE,mBAAmB,EAAE,MAAM,2BAA2B,CAAC;AACnF,OAAO,EAAE,eAAe,EAAE,cAAc,EAAE,MAAM,wBAAwB,CAAC;AACzE,OAAO,EAAE,UAAU,EAAE,MAAM,0BAA0B,CAAC;AACtD,OAAO,EAAE,iBAAiB,EAAE,sBAAsB,EAAE,YAAY,EAAE,MAAM,wBAAwB,CAAC;AACjG,OAAO,EACL,WAAW,EACX,eAAe,EACf,cAAc,EACd,KAAK,EACL,SAAS,EACT,OAAO,EACP,cAAc,GACf,MAAM,2BAA2B,CAAC;AACnC,OAAO,EACL,eAAe,EACf,UAAU,EACV,WAAW,EACX,UAAU,EACV,QAAQ,EACR,iBAAiB,EACjB,WAAW,EACX,gBAAgB,GACjB,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,sBAAsB,EAAE,wBAAwB,EAAE,MAAM,8BAA8B,CAAC;AAChG,OAAO,EAAE,kBAAkB,EAAE,MAAM,+BAA+B,CAAC;AACnE,OAAO,EAAE,gBAAgB,EAAE,MAAM,0BAA0B,CAAC;AAO5D,OAAO,EAAE,KAAK,EAAE,aAAa,EAAE,gBAAgB,EAAE,iBAAiB,EAAE,MAAM,mBAAmB,CAAC;AAC9F,OAAO,EACL,eAAe,EACf,aAAa,EACb,gBAAgB,EAChB,yBAAyB,EACzB,yBAAyB,EACzB,yBAAyB,GAC1B,MAAM,sBAAsB,CAAC;AAkE9B,OAAO,EACL,kBAAkB,EAClB,kBAAkB,EAClB,aAAa,EACb,0BAA0B,EAC1B,WAAW,EACX,cAAc,EACd,eAAe,EACf,aAAa,EACb,WAAW,GACZ,MAAM,mBAAmB,CAAC"}

package/dist/managers/BinaryManager.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"BinaryManager.d.ts","sourceRoot":"","sources":["../../src/managers/BinaryManager.ts"],"names":[],"mappings":"AAWA,OAAO,EAAE,KAAK,mBAAmB,EAAyB,MAAM,uBAAuB,CAAC;AA0CxF,MAAM,WAAW,mBAAmB;IAElC,IAAI,EAAE,OAAO,GAAG,WAAW,CAAC;IAE5B,UAAU,EAAE,MAAM,CAAC;IAEnB,WAAW,EAAE,MAAM,CAAC;IAEpB,QAAQ,EAAE,SAAS,mBAAmB,EAAE,CAAC;IAEzC,GAAG,CAAC,EAAE,CAAC,OAAO,EAAE,MAAM,EAAE,KAAK,CAAC,EAAE,MAAM,GAAG,MAAM,GAAG,OAAO,KAAK,IAAI,CAAC;IAMnE,aAAa,CAAC,EAAE,MAAM,CAAC;IAMvB,aAAa,CAAC,EAAE,MAAM,EAAE,CAAC;IAEzB,OAAO,CAAC,EAAE,MAAM,CAAC;CAClB;AAQD,qBAAa,aAAa;IACxB,OAAO,CAAC,MAAM,CAAsB;gBAExB,MAAM,EAAE,mBAAmB;YASzB,mBAAmB;YA8BnB,mBAAmB;YAuBnB,gCAAgC;IAyCxC,YAAY,CAAC,eAAe,UAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;YAwJ9C,oBAAoB;YA+DpB,sBAAsB;IA2FpC,OAAO,CAAC,gBAAgB;YAoEV,sBAAsB;IAqBpC,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,kBAAkB,CAWxC;IASF,OAAO,CAAC,iBAAiB;YAsBX,wBAAwB;YAqBxB,kBAAkB;YAmIlB,gBAAgB;YAuEhB,UAAU;IA4BxB,OAAO,CAAC,GAAG;CAKZ"}
+{"version":3,"file":"BinaryManager.d.ts","sourceRoot":"","sources":["../../src/managers/BinaryManager.ts"],"names":[],"mappings":"AAWA,OAAO,EAAE,KAAK,mBAAmB,EAAyB,MAAM,uBAAuB,CAAC;AA0CxF,MAAM,WAAW,mBAAmB;IAElC,IAAI,EAAE,OAAO,GAAG,WAAW,CAAC;IAE5B,UAAU,EAAE,MAAM,CAAC;IAEnB,WAAW,EAAE,MAAM,CAAC;IAEpB,QAAQ,EAAE,SAAS,mBAAmB,EAAE,CAAC;IAEzC,GAAG,CAAC,EAAE,CAAC,OAAO,EAAE,MAAM,EAAE,KAAK,CAAC,EAAE,MAAM,GAAG,MAAM,GAAG,OAAO,KAAK,IAAI,CAAC;IAMnE,aAAa,CAAC,EAAE,MAAM,CAAC;IAMvB,aAAa,CAAC,EAAE,MAAM,EAAE,CAAC;IAEzB,OAAO,CAAC,EAAE,MAAM,CAAC;CAClB;AAQD,qBAAa,aAAa;IACxB,OAAO,CAAC,MAAM,CAAsB;gBAExB,MAAM,EAAE,mBAAmB;YASzB,mBAAmB;YA8BnB,mBAAmB;YAuBnB,gCAAgC;IAyCxC,YAAY,CAAC,eAAe,UAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;YAwJ9C,oBAAoB;YA+DpB,sBAAsB;IA8GpC,OAAO,CAAC,gBAAgB;YAoEV,sBAAsB;IAqBpC,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,kBAAkB,CAWxC;IASF,OAAO,CAAC,iBAAiB;YAsBX,wBAAwB;YAqBxB,kBAAkB;YAmIlB,gBAAgB;YAuEhB,UAAU;IA4BxB,OAAO,CAAC,GAAG;CAKZ"}

package/dist/managers/BinaryManager.js

@@ -228,7 +228,16 @@ export class BinaryManager {
             const extractedBinaryPath = await extractBinary(archivePath, extractDir, binaryNamesToSearch);
             const works = await this.testBinary(extractedBinaryPath);
             if (works) {
-                await copyDirectory(extractDir, PATHS.binaries[type]);
+                const extractedBinaryDir = path.dirname(extractedBinaryPath);
+                await copyDirectory(extractedBinaryDir, PATHS.binaries[type]);
+                if (path.resolve(extractedBinaryDir) !== path.resolve(extractDir)) {
+                    const rootEntries = await fs.readdir(extractDir, { withFileTypes: true });
+                    for (const entry of rootEntries) {
+                        if (entry.isFile()) {
+                            await fs.copyFile(path.join(extractDir, entry.name), path.join(PATHS.binaries[type], entry.name));
+                        }
+                    }
+                }
                 if (process.platform !== 'win32') {
                     await fs.chmod(finalBinaryPath, 0o755);
                 }
@@ -364,7 +373,7 @@ export class BinaryManager {
                 try {
                     const controller = new AbortController();
                     const fetchTimer = setTimeout(() => controller.abort(), 2000);
-                    const response = await fetch(`http://localhost:${testPort}/health`, {
+                    const response = await fetch(`http://127.0.0.1:${testPort}/health`, {
                         signal: controller.signal,
                     });
                     clearTimeout(fetchTimer);
@@ -389,7 +398,7 @@ export class BinaryManager {
             }
             const controller = new AbortController();
             const fetchTimer = setTimeout(() => controller.abort(), 5000);
-            const completionResponse = await fetch(`http://localhost:${testPort}/completion`, {
+            const completionResponse = await fetch(`http://127.0.0.1:${testPort}/completion`, {
                 method: 'POST',
                 headers: { 'Content-Type': 'application/json' },
                 body: JSON.stringify({ prompt: '2+2=', n_predict: 4 }),