adaptive-memory-multi-model-router 2.13.0 → 2.13.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LANDING.md +23 -26
- package/MANIFESTO.md +21 -34
- package/README.md +136 -199
- package/dist/tui/dashboard.d.ts +5 -12
- package/dist/tui/dashboard.js +470 -270
- package/dist/tui/dashboard.js.map +1 -1
- package/package.json +2 -2
- package/src/tui/dashboard.ts +502 -313
- package/tmlpd-pi-extension/README.md +29 -29
package/LANDING.md
CHANGED
|
@@ -1,46 +1,43 @@
|
|
|
1
|
-
# A3M
|
|
2
|
-
### The intelligence layer for model choice
|
|
1
|
+
# A3M Router — Parallel Multi-LLM Execution with Intelligent Merge
|
|
3
2
|
|
|
4
|
-
*One prompt
|
|
3
|
+
*One prompt. All providers. The best answer.*
|
|
5
4
|
|
|
6
5
|
---
|
|
7
6
|
|
|
8
|
-
## What
|
|
7
|
+
## What It Is
|
|
9
8
|
|
|
10
|
-
A
|
|
9
|
+
A routing layer between your app and every LLM provider. Routes every query to the cheapest capable model, runs multiple providers in parallel when quality matters, and scores results to return the best answer.
|
|
11
10
|
|
|
12
|
-
## What
|
|
11
|
+
## What It Does
|
|
13
12
|
|
|
14
|
-
-
|
|
15
|
-
-
|
|
16
|
-
-
|
|
17
|
-
-
|
|
13
|
+
- **Parallel ensemble** — Runs NVIDIA + Groq + OpenAI simultaneously, scores results, picks best
|
|
14
|
+
- **Smart routing** — 12 heuristic signals classify query complexity, routes to cheapest capable model
|
|
15
|
+
- **Cost control** — Hard per-user/team budgets with real-time tracking and alerts
|
|
16
|
+
- **Fault tolerance** — Circuit breaker, automatic failover, exponential backoff with jitter
|
|
17
|
+
- **Memory persistence** — Cross-session episodic memory with keyword indexing
|
|
18
18
|
|
|
19
|
-
##
|
|
20
|
-
|
|
21
|
-
**Calm. Invisible. Trustworthy.**
|
|
22
|
-
|
|
23
|
-
---
|
|
24
|
-
|
|
25
|
-
## The Evidence
|
|
19
|
+
## By the Numbers
|
|
26
20
|
|
|
27
21
|
| Metric | Result |
|
|
28
22
|
|--------|--------|
|
|
29
|
-
| Routing Accuracy |
|
|
30
|
-
|
|
|
31
|
-
|
|
|
32
|
-
|
|
33
|
-
|
|
23
|
+
| Routing Accuracy | **99.5%** ±1 tier |
|
|
24
|
+
| Cost Savings | **62%** vs all-premium |
|
|
25
|
+
| Providers | **47+** |
|
|
26
|
+
| Cache Hit Rate | **30%+** |
|
|
27
|
+
| Size | **19.5 KB** |
|
|
28
|
+
| Startup | **<100ms** |
|
|
34
29
|
|
|
35
|
-
## Start in
|
|
30
|
+
## Start in 30 Seconds
|
|
36
31
|
|
|
37
32
|
```bash
|
|
38
33
|
npm install adaptive-memory-multi-model-router
|
|
39
|
-
npx a3m-router serve
|
|
34
|
+
npx a3m-router serve # OpenAI proxy at localhost:8787
|
|
35
|
+
npx a3m-router route "What is 2+2?" # Routing decision
|
|
36
|
+
npx a3m-router compare "Explain AI" # All providers side-by-side
|
|
40
37
|
```
|
|
41
38
|
|
|
42
|
-
|
|
39
|
+
Point any OpenAI-compatible client to `http://localhost:8787` with `model: "auto"`.
|
|
43
40
|
|
|
44
41
|
---
|
|
45
42
|
|
|
46
|
-
*A3M.
|
|
43
|
+
*A3M Router. Parallel multi-LLM execution with result merging.*
|
package/MANIFESTO.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
|
-
# A3M Manifesto
|
|
1
|
+
# A3M Manifesto — Intelligent Multi-LLM Routing
|
|
2
2
|
|
|
3
|
-
*
|
|
3
|
+
*The intelligence layer between your app and every model.*
|
|
4
4
|
|
|
5
5
|
---
|
|
6
6
|
|
|
@@ -8,47 +8,34 @@
|
|
|
8
8
|
|
|
9
9
|
LLM ops are noisy. Expensive. Fragile.
|
|
10
10
|
|
|
11
|
-
|
|
11
|
+
You choose providers one at a time. Bills accumulate. Providers fail silently. Quality varies across models. And when one provider fails, everyone retries at once — making the problem worse.
|
|
12
12
|
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
## The Truth
|
|
16
|
-
|
|
17
|
-
**A3M is not a router. A3M is taste for AI systems.**
|
|
18
|
-
|
|
19
|
-
It removes noise. Picks wisely. Makes every request feel inevitable.
|
|
20
|
-
|
|
21
|
-
---
|
|
13
|
+
**Sequential fallback is the default. It shouldn't be.**
|
|
22
14
|
|
|
23
|
-
##
|
|
15
|
+
## The Insight
|
|
24
16
|
|
|
25
|
-
|
|
17
|
+
Every query is different. Some need deep reasoning. Some need creative writing. Some need quick lookups. Most don't need GPT-4o — but you pay for it anyway.
|
|
26
18
|
|
|
27
|
-
|
|
19
|
+
**Nobody does parallel multi-LLM execution with result merging. Everyone does sequential fallback (try A → B → C).**
|
|
28
20
|
|
|
29
|
-
|
|
21
|
+
## The Solution
|
|
30
22
|
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
## The Evidence
|
|
34
|
-
|
|
35
|
-
| Metric | Value |
|
|
36
|
-
|--------|-------|
|
|
37
|
-
| Routing Accuracy | 100% |
|
|
38
|
-
| Fault Injection Pass Rate | 100% |
|
|
39
|
-
| Projected Cost Delta | -$0.33 per query |
|
|
40
|
-
|
|
41
|
-
---
|
|
23
|
+
A3M Router is a routing layer that sits between your app and every LLM provider. It:
|
|
42
24
|
|
|
43
|
-
|
|
25
|
+
1. **Routes** every query to the cheapest capable model (99.5% accuracy)
|
|
26
|
+
2. **Executes in parallel** when quality matters (ensemble voting)
|
|
27
|
+
3. **Enforces budgets** with hard caps per user and team
|
|
28
|
+
4. **Recovers gracefully** when providers fail (circuit breaker, failover)
|
|
29
|
+
5. **Learns from history** (persistent memory, exponential moving average)
|
|
44
30
|
|
|
45
|
-
|
|
46
|
-
npm install adaptive-memory-multi-model-router
|
|
47
|
-
npx a3m-router serve
|
|
48
|
-
```
|
|
31
|
+
## The Principles
|
|
49
32
|
|
|
50
|
-
|
|
33
|
+
1. **Parallel first** — When quality matters, run providers concurrently, not sequentially
|
|
34
|
+
2. **Transparent scoring** — Every ensemble result shows why it won
|
|
35
|
+
3. **Cost-aware** — Route simple queries to cheap providers automatically
|
|
36
|
+
4. **Zero ML** — Heuristic routing achieves 99.5% accuracy without GPUs or training
|
|
37
|
+
5. **Self-hosted** — No vendor lock-in, no account required
|
|
51
38
|
|
|
52
39
|
---
|
|
53
40
|
|
|
54
|
-
*A3M.
|
|
41
|
+
*A3M Router. Parallel multi-LLM execution with intelligent merge.*
|