adaptive-memory-multi-model-router 2.2.8 → 2.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -51
- package/assets/benchmark-results-pro.svg +1857 -0
- package/assets/cost-comparison-pro.svg +2708 -0
- package/assets/feature-matrix-pro.svg +2899 -0
- package/assets/growth-chart-pro.svg +1050 -0
- package/assets/hero-banner.svg +2033 -0
- package/assets/logo-icon.svg +99 -0
- package/assets/provider-health-pro.svg +2710 -0
- package/assets/routing-flow-pro.svg +2238 -0
- package/assets/social-preview-pro.svg +1685 -0
- package/assets/tier-distribution-pro.svg +2110 -0
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -62,42 +62,6 @@ For **generative engine optimization** — synthesizing multiple AI models into
|
|
|
62
62
|
|:---|:---|:---|
|
|
63
63
|
| Learns from your usage over time. Remembers which models work for your query types. Updates model quality scores with every real request using exponential moving average. No retraining. | 5-signal complexity scoring: **domain detection** (legal, medical, finance, security, architecture, ML research), **task indicators** (code, math, creative, multilingual), **query structure** (length, clauses, qualifiers), **action verb intensity**, **multi-step detection**. All regex + keyword. Zero ML weights. | **Semantic cache** — trigram Jaccard similarity skips duplicate LLM calls. **Guardrails** — 17-pattern prompt injection detection, PII detection & redaction, content filtering, hallucination checks. **Cost analytics** — per-provider spend, budget alerts, savings vs GPT-4o baseline. **Circuit breaker** — 3 failures → 60s cooldown, automatic provider failover. |
|
|
64
64
|
|
|
65
|
-
## 📊 Visual Overview
|
|
66
|
-
|
|
67
|
-
### Complete Routing Pipeline
|
|
68
|
-

|
|
69
|
-
|
|
70
|
-
### Tier Distribution
|
|
71
|
-

|
|
72
|
-
|
|
73
|
-
### Benchmark Results
|
|
74
|
-

|
|
75
|
-
|
|
76
|
-
### Cost Comparison (10K queries/month)
|
|
77
|
-

|
|
78
|
-
|
|
79
|
-
### Feature Comparison
|
|
80
|
-

|
|
81
|
-
|
|
82
|
-
### Provider Health
|
|
83
|
-

|
|
84
|
-
|
|
85
|
-
### Complexity Scoring
|
|
86
|
-

|
|
87
|
-
|
|
88
|
-
### Key Metrics
|
|
89
|
-
|
|
90
|
-
| Metric | Value | Notes |
|
|
91
|
-
|--------|-------|-------|
|
|
92
|
-
| Routing latency | <4ms | Guardrails + Cache + Classifier + Selection |
|
|
93
|
-
| Cache hit rate | ~30% | Trigram Jaccard similarity |
|
|
94
|
-
| ±1 tier accuracy | 99.5% | 200-query internal benchmark |
|
|
95
|
-
| Cost savings | 74% vs GPT-4o | 10K queries/month |
|
|
96
|
-
| Package size | 19.5 KB | gzipped |
|
|
97
|
-
| Startup time | <100ms | No ML weights loading |
|
|
98
|
-
|
|
99
|
-
|
|
100
|
-
|
|
101
65
|
---
|
|
102
66
|
|
|
103
67
|
## Quick Start
|
|
@@ -254,7 +218,7 @@ LiteLLM ████████████████ ~500ms
|
|
|
254
218
|
|
|
255
219
|
See full benchmark methodology at [`scripts/routing-benchmark-v2.js`](scripts/routing-benchmark-v2.js) or run it with `node scripts/routing-benchmark-v2.js`.
|
|
256
220
|
|
|
257
|
-
| Metric | A3M Router |
|
|
221
|
+
| Metric | A3M Router | LiteLLM |
|
|
258
222
|
|--------|:----------:|:---------------:|
|
|
259
223
|
| **±1 tier accuracy** | **99.5%** | N/A (manual) |
|
|
260
224
|
| Exact tier match | 64.5% | N/A |
|
|
@@ -310,7 +274,7 @@ We ran **MMLU-style questions** and **quality tests** against each provider via
|
|
|
310
274
|
|
|
311
275
|
> **May 2026** — 15 MMLU questions + 8 quality questions per provider via real API. Run `node scripts/run-mmlu-benchmark.js` to replicate. Results in [`benchmark-results.json`](benchmark-results.json).
|
|
312
276
|
|
|
313
|
-
| Metric | A3M Router |
|
|
277
|
+
| Metric | A3M Router | LiteLLM |
|
|
314
278
|
|--------|:----------:|:--------:|
|
|
315
279
|
| ±1 tier accuracy | **99.5%** | N/A |
|
|
316
280
|
| Package size | **19.5 KB** | ~50 MB |
|
|
@@ -784,22 +748,20 @@ const modelWithTools = model.bindTools([searchTool, calculatorTool]);
|
|
|
784
748
|
|
|
785
749
|
## Comparison
|
|
786
750
|
|
|
787
|
-
| Feature | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) | [Portkey](https://github.com/Portkey-AI/gateway) | [
|
|
751
|
+
| Feature | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) | [Portkey](https://github.com/Portkey-AI/gateway) | [OpenRouter](https://openrouter.ai) |
|
|
788
752
|
|---------|:----------:|:-------:|:-------:|:-------:|
|
|
789
753
|
| **Routing accuracy published** | **Yes** (99.5% ±1) | No (manual) | No | No |
|
|
790
754
|
| **Intelligent routing** | Multi-signal per-query | Manual selection | Manual | Manual |
|
|
791
755
|
| **Zero ML / Zero GPU** | **Yes** | Yes | Yes | Yes |
|
|
792
|
-
| **Package size** | 19.5 KB | ~50 MB | ~30 MB |
|
|
793
|
-
| **OpenAI-compatible proxy** | **Yes** | No | Yes | Yes |
|
|
794
|
-
| **Adaptive memory** | **Yes** | No | No | No |
|
|
795
|
-
| **Semantic cache** | **Yes** (trigram) | No | No | No |
|
|
796
|
-
| **Prompt injection detection** | **Yes** (17 patterns) | No | No | No |
|
|
797
|
-
| **PII redaction** | **Yes** | No | No | No |
|
|
798
|
-
| **Hallucination checks** | **Yes** | No | No | No |
|
|
799
|
-
| **Cost analytics** | **Yes** | No | Yes |
|
|
800
|
-
| **Budget alerts** | **Yes** | No | No | No |
|
|
801
|
-
| **Circuit breaker** | **Yes** | No | No | No |
|
|
802
|
-
| **Multi-provider (36+)** | **Yes** | Yes | Yes | Yes |
|
|
756
|
+
| **Package size** | 19.5 KB | ~50 MB | ~30 MB | API-only |
|
|
757
|
+
| **OpenAI-compatible proxy** | **Yes** | No | Yes | Yes | Yes |
|
|
758
|
+
| **Adaptive memory** | **Yes** | No | No | No | No |
|
|
759
|
+
| **Semantic cache** | **Yes** (trigram) | No | No | Yes | No |
|
|
760
|
+
| **Prompt injection detection** | **Yes** (17 patterns) | No | No | Yes | No |
|
|
761
|
+
| **PII redaction** | **Yes** | No | No | Yes | No |
|
|
762
|
+
| **Hallucination checks** | **Yes** | No | No | No | No |
|
|
763
|
+
| **Cost analytics** | **Yes** | No | Yes | Yes | Yes |
|
|
764
|
+
| **Budget alerts** | **Yes** | No | No | Yes | No |
|
|
803
765
|
| **Circuit breaker** | **Yes** | No | No | Yes | No |
|
|
804
766
|
| **LangChain adapter** | **Yes** | No | Yes | Yes | No |
|
|
805
767
|
| **Python SDK** | **Yes** | Yes | Yes | Yes | Yes |
|
|
@@ -808,7 +770,7 @@ const modelWithTools = model.bindTools([searchTool, calculatorTool]);
|
|
|
808
770
|
| **Self-hosted** | **Yes** | Yes | Yes | Yes | No |
|
|
809
771
|
| **License** | MIT | Apache 2.0 | Custom | MIT | Proprietary |
|
|
810
772
|
|
|
811
|
-
Also
|
|
773
|
+
**Also consider:** [9router](https://github.com/decolua/9router), [ClawRouter](https://github.com/BlockRunAI/ClawRouter), [Plano](https://github.com/katanemo/plano), [Helicone](https://github.com/Helicone/helicone)
|
|
812
774
|
|
|
813
775
|
---
|
|
814
776
|
|