adaptive-memory-multi-model-router 2.13.0 → 2.13.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/LANDING.md CHANGED
@@ -1,46 +1,43 @@
1
- # A3M
2
- ### The intelligence layer for model choice
1
+ # A3M Router — Parallel Multi-LLM Execution with Intelligent Merge
3
2
 
4
- *One prompt in. The right model out.*
3
+ *One prompt. All providers. The best answer.*
5
4
 
6
5
  ---
7
6
 
8
- ## What it is
7
+ ## What It Is
9
8
 
10
- A quiet intelligence layer between your app and every model.
9
+ A routing layer between your app and every LLM provider. Routes every query to the cheapest capable model, runs multiple providers in parallel when quality matters, and scores results to return the best answer.
11
10
 
12
- ## What it does
11
+ ## What It Does
13
12
 
14
- - Chooses the right model
15
- - Protects quality
16
- - Reduces cost
17
- - Recovers gracefully when providers fail
13
+ - **Parallel ensemble** Runs NVIDIA + Groq + OpenAI simultaneously, scores results, picks best
14
+ - **Smart routing** — 12 heuristic signals classify query complexity, routes to cheapest capable model
15
+ - **Cost control** — Hard per-user/team budgets with real-time tracking and alerts
16
+ - **Fault tolerance** Circuit breaker, automatic failover, exponential backoff with jitter
17
+ - **Memory persistence** — Cross-session episodic memory with keyword indexing
18
18
 
19
- ## What it feels like
20
-
21
- **Calm. Invisible. Trustworthy.**
22
-
23
- ---
24
-
25
- ## The Evidence
19
+ ## By the Numbers
26
20
 
27
21
  | Metric | Result |
28
22
  |--------|--------|
29
- | Routing Accuracy | 100% |
30
- | Fault Injection Pass Rate | 100% |
31
- | Projected Cost Savings | $0.33 per query |
32
-
33
- ---
23
+ | Routing Accuracy | **99.5%** ±1 tier |
24
+ | Cost Savings | **62%** vs all-premium |
25
+ | Providers | **47+** |
26
+ | Cache Hit Rate | **30%+** |
27
+ | Size | **19.5 KB** |
28
+ | Startup | **<100ms** |
34
29
 
35
- ## Start in 60 seconds
30
+ ## Start in 30 Seconds
36
31
 
37
32
  ```bash
38
33
  npm install adaptive-memory-multi-model-router
39
- npx a3m-router serve
34
+ npx a3m-router serve # OpenAI proxy at localhost:8787
35
+ npx a3m-router route "What is 2+2?" # Routing decision
36
+ npx a3m-router compare "Explain AI" # All providers side-by-side
40
37
  ```
41
38
 
42
- Then point any OpenAI-compatible client to `http://localhost:8787`
39
+ Point any OpenAI-compatible client to `http://localhost:8787` with `model: "auto"`.
43
40
 
44
41
  ---
45
42
 
46
- *A3M. Send any AI request. It chooses wisely.*
43
+ *A3M Router. Parallel multi-LLM execution with result merging.*
package/MANIFESTO.md CHANGED
@@ -1,6 +1,6 @@
1
- # A3M Manifesto
1
+ # A3M Manifesto — Intelligent Multi-LLM Routing
2
2
 
3
- *Intelligence that chooses wisely.*
3
+ *The intelligence layer between your app and every model.*
4
4
 
5
5
  ---
6
6
 
@@ -8,47 +8,34 @@
8
8
 
9
9
  LLM ops are noisy. Expensive. Fragile.
10
10
 
11
- Your team decides model-by-model, request-by-request. Bills accumulate. Providers fail silently. Quality varies. One bad routing decision and your app breaks.
11
+ You choose providers one at a time. Bills accumulate. Providers fail silently. Quality varies across models. And when one provider fails, everyone retries at once — making the problem worse.
12
12
 
13
- ---
14
-
15
- ## The Truth
16
-
17
- **A3M is not a router. A3M is taste for AI systems.**
18
-
19
- It removes noise. Picks wisely. Makes every request feel inevitable.
20
-
21
- ---
13
+ **Sequential fallback is the default. It shouldn't be.**
22
14
 
23
- ## One Prompt In. The Right Model Out.
15
+ ## The Insight
24
16
 
25
- That's the whole story.
17
+ Every query is different. Some need deep reasoning. Some need creative writing. Some need quick lookups. Most don't need GPT-4o — but you pay for it anyway.
26
18
 
27
- A quiet intelligence layer between your app and every model. Chooses the right model. Protects quality. Reduces cost. Recovers gracefully when providers fail.
19
+ **Nobody does parallel multi-LLM execution with result merging. Everyone does sequential fallback (try A B C).**
28
20
 
29
- Feels like: **Calm. Invisible. Trustworthy.**
21
+ ## The Solution
30
22
 
31
- ---
32
-
33
- ## The Evidence
34
-
35
- | Metric | Value |
36
- |--------|-------|
37
- | Routing Accuracy | 100% |
38
- | Fault Injection Pass Rate | 100% |
39
- | Projected Cost Delta | -$0.33 per query |
40
-
41
- ---
23
+ A3M Router is a routing layer that sits between your app and every LLM provider. It:
42
24
 
43
- ## The Simplest Start
25
+ 1. **Routes** every query to the cheapest capable model (99.5% accuracy)
26
+ 2. **Executes in parallel** when quality matters (ensemble voting)
27
+ 3. **Enforces budgets** with hard caps per user and team
28
+ 4. **Recovers gracefully** when providers fail (circuit breaker, failover)
29
+ 5. **Learns from history** (persistent memory, exponential moving average)
44
30
 
45
- ```bash
46
- npm install adaptive-memory-multi-model-router
47
- npx a3m-router serve
48
- ```
31
+ ## The Principles
49
32
 
50
- One prompt in. The right model out.
33
+ 1. **Parallel first** When quality matters, run providers concurrently, not sequentially
34
+ 2. **Transparent scoring** — Every ensemble result shows why it won
35
+ 3. **Cost-aware** — Route simple queries to cheap providers automatically
36
+ 4. **Zero ML** — Heuristic routing achieves 99.5% accuracy without GPUs or training
37
+ 5. **Self-hosted** — No vendor lock-in, no account required
51
38
 
52
39
  ---
53
40
 
54
- *A3M. Send any AI request. It chooses wisely.*
41
+ *A3M Router. Parallel multi-LLM execution with intelligent merge.*