adaptive-memory-multi-model-router 2.2.8 → 2.3.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -62,42 +62,6 @@ For **generative engine optimization** — synthesizing multiple AI models into
62
62
  |:---|:---|:---|
63
63
  | Learns from your usage over time. Remembers which models work for your query types. Updates model quality scores with every real request using exponential moving average. No retraining. | 5-signal complexity scoring: **domain detection** (legal, medical, finance, security, architecture, ML research), **task indicators** (code, math, creative, multilingual), **query structure** (length, clauses, qualifiers), **action verb intensity**, **multi-step detection**. All regex + keyword. Zero ML weights. | **Semantic cache** — trigram Jaccard similarity skips duplicate LLM calls. **Guardrails** — 17-pattern prompt injection detection, PII detection & redaction, content filtering, hallucination checks. **Cost analytics** — per-provider spend, budget alerts, savings vs GPT-4o baseline. **Circuit breaker** — 3 failures → 60s cooldown, automatic provider failover. |
64
64
 
65
- ## 📊 Visual Overview
66
-
67
- ### Complete Routing Pipeline
68
- ![Routing Flow](assets/routing-flow-v3.png)
69
-
70
- ### Tier Distribution
71
- ![Tier Distribution](assets/tier-distribution.png)
72
-
73
- ### Benchmark Results
74
- ![Benchmark Results](assets/benchmark-results.png)
75
-
76
- ### Cost Comparison (10K queries/month)
77
- ![Cost Comparison](assets/cost-comparison-v2.png)
78
-
79
- ### Feature Comparison
80
- ![Feature Comparison](assets/feature-comparison-v3.png)
81
-
82
- ### Provider Health
83
- ![Provider Health](assets/provider-health-v2.png)
84
-
85
- ### Complexity Scoring
86
- ![Complexity Scoring](assets/complexity-scoring-v2.png)
87
-
88
- ### Key Metrics
89
-
90
- | Metric | Value | Notes |
91
- |--------|-------|-------|
92
- | Routing latency | <4ms | Guardrails + Cache + Classifier + Selection |
93
- | Cache hit rate | ~30% | Trigram Jaccard similarity |
94
- | ±1 tier accuracy | 99.5% | 200-query internal benchmark |
95
- | Cost savings | 74% vs GPT-4o | 10K queries/month |
96
- | Package size | 19.5 KB | gzipped |
97
- | Startup time | <100ms | No ML weights loading |
98
-
99
-
100
-
101
65
  ---
102
66
 
103
67
  ## Quick Start
@@ -254,7 +218,7 @@ LiteLLM ████████████████ ~500ms
254
218
 
255
219
  See full benchmark methodology at [`scripts/routing-benchmark-v2.js`](scripts/routing-benchmark-v2.js) or run it with `node scripts/routing-benchmark-v2.js`.
256
220
 
257
- | Metric | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) |
221
+ | Metric | A3M Router | LiteLLM |
258
222
  |--------|:----------:|:---------------:|
259
223
  | **±1 tier accuracy** | **99.5%** | N/A (manual) |
260
224
  | Exact tier match | 64.5% | N/A |
@@ -310,7 +274,7 @@ We ran **MMLU-style questions** and **quality tests** against each provider via
310
274
 
311
275
  > **May 2026** — 15 MMLU questions + 8 quality questions per provider via real API. Run `node scripts/run-mmlu-benchmark.js` to replicate. Results in [`benchmark-results.json`](benchmark-results.json).
312
276
 
313
- | Metric | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) |
277
+ | Metric | A3M Router | LiteLLM |
314
278
  |--------|:----------:|:--------:|
315
279
  | ±1 tier accuracy | **99.5%** | N/A |
316
280
  | Package size | **19.5 KB** | ~50 MB |
@@ -784,22 +748,20 @@ const modelWithTools = model.bindTools([searchTool, calculatorTool]);
784
748
 
785
749
  ## Comparison
786
750
 
787
- | Feature | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) | [Portkey](https://github.com/Portkey-AI/gateway) | [RouteLLM](https://github.com/Surfsol/RouteLLM) |
751
+ | Feature | A3M Router | [LiteLLM](https://github.com/BerriAI/litellm) | [Portkey](https://github.com/Portkey-AI/gateway) | [OpenRouter](https://openrouter.ai) |
788
752
  |---------|:----------:|:-------:|:-------:|:-------:|
789
753
  | **Routing accuracy published** | **Yes** (99.5% ±1) | No (manual) | No | No |
790
754
  | **Intelligent routing** | Multi-signal per-query | Manual selection | Manual | Manual |
791
755
  | **Zero ML / Zero GPU** | **Yes** | Yes | Yes | Yes |
792
- | **Package size** | 19.5 KB | ~50 MB | ~30 MB | ~15 MB |
793
- | **OpenAI-compatible proxy** | **Yes** | No | Yes | Yes |
794
- | **Adaptive memory** | **Yes** | No | No | No |
795
- | **Semantic cache** | **Yes** (trigram) | No | No | No |
796
- | **Prompt injection detection** | **Yes** (17 patterns) | No | No | No |
797
- | **PII redaction** | **Yes** | No | No | No |
798
- | **Hallucination checks** | **Yes** | No | No | No |
799
- | **Cost analytics** | **Yes** | No | Yes | No |
800
- | **Budget alerts** | **Yes** | No | No | No |
801
- | **Circuit breaker** | **Yes** | No | No | No |
802
- | **Multi-provider (36+)** | **Yes** | Yes | Yes | Yes |
756
+ | **Package size** | 19.5 KB | ~50 MB | ~30 MB | API-only |
757
+ | **OpenAI-compatible proxy** | **Yes** | No | Yes | Yes | Yes |
758
+ | **Adaptive memory** | **Yes** | No | No | No | No |
759
+ | **Semantic cache** | **Yes** (trigram) | No | No | Yes | No |
760
+ | **Prompt injection detection** | **Yes** (17 patterns) | No | No | Yes | No |
761
+ | **PII redaction** | **Yes** | No | No | Yes | No |
762
+ | **Hallucination checks** | **Yes** | No | No | No | No |
763
+ | **Cost analytics** | **Yes** | No | Yes | Yes | Yes |
764
+ | **Budget alerts** | **Yes** | No | No | Yes | No |
803
765
  | **Circuit breaker** | **Yes** | No | No | Yes | No |
804
766
  | **LangChain adapter** | **Yes** | No | Yes | Yes | No |
805
767
  | **Python SDK** | **Yes** | Yes | Yes | Yes | Yes |
@@ -808,7 +770,7 @@ const modelWithTools = model.bindTools([searchTool, calculatorTool]);
808
770
  | **Self-hosted** | **Yes** | Yes | Yes | Yes | No |
809
771
  | **License** | MIT | Apache 2.0 | Custom | MIT | Proprietary |
810
772
 
811
- Also: [9router](https://github.com/decolua/9router), [ClawRouter](https://github.com/BlockRunAI/ClawRouter), [Plano](https://github.com/katanemo/plano), [Helicone](https://github.com/Helicone/helicone)
773
+ **Also consider:** [9router](https://github.com/decolua/9router), [ClawRouter](https://github.com/BlockRunAI/ClawRouter), [Plano](https://github.com/katanemo/plano), [Helicone](https://github.com/Helicone/helicone)
812
774
 
813
775
  ---
814
776