@octocodeai/freellama 0.6.0 → 0.6.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (3) hide show
  1. package/LICENSE-MIT +1 -1
  2. package/README.md +10 -7
  3. package/package.json +10 -9
package/LICENSE-MIT CHANGED
@@ -1,6 +1,6 @@
1
1
  MIT License
2
2
 
3
- Copyright (c) FreeLlama contributors
3
+ Copyright (c) 2026 Guy Bary
4
4
 
5
5
  Permission is hereby granted, free of charge, to any person obtaining a copy of this software and
6
6
  associated documentation files (the "Software"), to deal in the Software without restriction, including
package/README.md CHANGED
@@ -9,7 +9,7 @@ submit managed tasks. Ollama supplies model loading and inference.
9
9
  The JavaScript launcher locates the
10
10
  compiled Rust CLI in the matching optional native package and forwards arguments, signals, and exit
11
11
  status. In a source checkout, it uses `target/release/freellama` after a build. Routing and execution
12
- logic remain in [`freellama-core`](../rust-core/README.md).
12
+ logic remain in [`freellama-core`](https://github.com/bgauryy/FreeLlama/blob/main/packages/rust-core/README.md).
13
13
 
14
14
  ```mermaid
15
15
  flowchart LR
@@ -23,6 +23,9 @@ flowchart LR
23
23
 
24
24
  ## Run it
25
25
 
26
+ Install from npm (`npm install -g @octocodeai/freellama`) or crates.io (`cargo install freellama-cli`);
27
+ both give the `freellama` command. The examples use `npx` so nothing needs installing first.
28
+
26
29
  ```bash
27
30
  npx @octocodeai/freellama doctor
28
31
  npx @octocodeai/freellama auth-token --out ~/.local/share/freellama/auth.token
@@ -43,9 +46,9 @@ npx @octocodeai/freellama route --task coding --objective fastest
43
46
  npx @octocodeai/freellama task --task completion --objective fastest "Reply with exactly OK."
44
47
  ```
45
48
 
46
- Read the repository [CLI reference](../../docs/CLI.md) for the complete command map, task kinds, routing
49
+ Read the repository [CLI reference](https://github.com/bgauryy/FreeLlama/blob/main/docs/CLI.md) for the complete command map, task kinds, routing
47
50
  confidence, policy generation, and admission controls. Use the
48
- [Scope history and model warming reference](../../docs/SCOPES_AND_WARMING.md) for `scope`, `warm`,
51
+ [Scope history and model warming reference](https://github.com/bgauryy/FreeLlama/blob/main/docs/SCOPES_AND_WARMING.md) for `scope`, `warm`,
49
52
  and the scoped task flags.
50
53
 
51
54
  ## Run separate CPU and GPU backends
@@ -60,7 +63,7 @@ npx @octocodeai/freellama serve \
60
63
  ```
61
64
 
62
65
  Managed tasks for assigned models use the CPU backend; other managed models and raw Ollama
63
- passthrough use the primary backend. See [CPU and GPU model routing](../../docs/CPU_GPU_ROUTING.md)
66
+ passthrough use the primary backend. See [CPU and GPU model routing](https://github.com/bgauryy/FreeLlama/blob/main/docs/CPU_GPU_ROUTING.md)
64
67
  for the process setup, verification steps, and measured concurrency result.
65
68
 
66
69
  The primary admission pool derives its default weighted budget from observed Ollama parallelism;
@@ -75,13 +78,13 @@ The health endpoint advertises backend, guarded-preference, runtime-feedback, an
75
78
  persistence contracts, plus per-backend admission capacity. Comparable speed samples require matching
76
79
  model digest, observed context, controls, process settings, and serial admission identity. A successful
77
80
  parallel request can report verified placement without qualifying a speed sample. See
78
- [feedback and adaptive profiles](../../docs/MONITORING.md#adaptive-concurrency) for sample eligibility.
81
+ [feedback and adaptive profiles](https://github.com/bgauryy/FreeLlama/blob/main/docs/MONITORING.md#adaptive-concurrency) for sample eligibility.
79
82
  Treat a missing contract as a stale running binary, then rebuild and restart before testing placement.
80
83
 
81
84
  Authentication covers both control routes and raw Ollama passthrough. A nonloopback listener also
82
85
  requires `--allow-remote`; terminate TLS and add tenant authorization outside FreeLlama. The CLI
83
86
  persists bounded aggregate feedback by default. Use `--ephemeral-feedback` only for disposable
84
- runs. See the [production runbook](../../docs/PRODUCTION.md).
87
+ runs. See the [production runbook](https://github.com/bgauryy/FreeLlama/blob/main/docs/PRODUCTION.md).
85
88
 
86
89
  ## Build the launcher and binary
87
90
 
@@ -119,7 +122,7 @@ errors, and the files included in the package. Core CLI contracts live in
119
122
 
120
123
  `delegate_research` and the online model-library view are MCP-only. Control-plane startup, proxy
121
124
  startup, auth-token creation, and benchmarks are CLI-only. Generate a routing policy with
122
- `freellama policy from-eval` (see [CLI reference](../../docs/CLI.md#earn-medium-routing-confidence)).
125
+ `freellama policy from-eval` (see [CLI reference](https://github.com/bgauryy/FreeLlama/blob/main/docs/CLI.md#earn-medium-routing-confidence)).
123
126
 
124
127
  Use the surfaces together: the CLI starts and verifies the local services; MCP lets an agent inspect
125
128
  that state and submit bounded work. An installed MCP client can read `freellama://docs/index` and
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@octocodeai/freellama",
3
- "version": "0.6.0",
3
+ "version": "0.6.2",
4
4
  "description": "Local Ollama model gateway, router, and benchmarker — CLI. Wraps the compiled Rust binary from packages/rust-core.",
5
5
  "repository": {
6
6
  "type": "git",
@@ -33,16 +33,17 @@
33
33
  "test": "vitest run",
34
34
  "test:watch": "vitest"
35
35
  },
36
+ "author": "Guy Bary",
36
37
  "license": "Apache-2.0 OR MIT",
37
38
  "optionalDependencies": {
38
- "@octocodeai/freellama-native-darwin-arm64": "0.6.0",
39
- "@octocodeai/freellama-native-darwin-x64": "0.6.0",
40
- "@octocodeai/freellama-native-linux-arm64-gnu": "0.6.0",
41
- "@octocodeai/freellama-native-linux-arm64-musl": "0.6.0",
42
- "@octocodeai/freellama-native-linux-x64-gnu": "0.6.0",
43
- "@octocodeai/freellama-native-linux-x64-musl": "0.6.0",
44
- "@octocodeai/freellama-native-win32-arm64-msvc": "0.6.0",
45
- "@octocodeai/freellama-native-win32-x64-msvc": "0.6.0"
39
+ "@octocodeai/freellama-native-darwin-arm64": "0.6.2",
40
+ "@octocodeai/freellama-native-darwin-x64": "0.6.2",
41
+ "@octocodeai/freellama-native-linux-arm64-gnu": "0.6.2",
42
+ "@octocodeai/freellama-native-linux-arm64-musl": "0.6.2",
43
+ "@octocodeai/freellama-native-linux-x64-gnu": "0.6.2",
44
+ "@octocodeai/freellama-native-linux-x64-musl": "0.6.2",
45
+ "@octocodeai/freellama-native-win32-arm64-msvc": "0.6.2",
46
+ "@octocodeai/freellama-native-win32-x64-msvc": "0.6.2"
46
47
  },
47
48
  "publishConfig": {
48
49
  "access": "public",