adaptive-memory-multi-model-router 2.13.24 β 2.13.26
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md
CHANGED
|
@@ -1,8 +1,8 @@
|
|
|
1
1
|
[π¨π³ δΈζ](./README_zh.md) Β· [π―π΅ ζ₯ζ¬θͺ](./README_ja.md) Β· [English](./README.md)
|
|
2
2
|
|
|
3
|
-
# A3M Router π β π₯ #1 on RouterArena Β· Cheapest at $0.047/1K Queries
|
|
3
|
+
# A3M Router π β #1 LLM Routing Benchmark # A3M Router π β π₯ #1 on RouterArena Β· Cheapest at $0.047/1K Queries Cheapest Router with Memory
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
**#1 on the LLM routing benchmark The highest-ranked and lowest-cost LLM router on the [RouterArena leaderboard](https://github.com/RouteWorks/RouterArena/pull/113). cheapest router with memory. Parallel multi-LLM execution across 47+ providers.**
|
|
6
6
|
|
|
7
7
|
[](https://www.npmjs.com/package/adaptive-memory-multi-model-router)
|
|
8
8
|
[](https://www.npmjs.com/package/adaptive-memory-multi-model-router)
|
|
@@ -14,9 +14,9 @@
|
|
|
14
14
|
|
|
15
15
|
## π Growth
|
|
16
16
|
|
|
17
|
-
[](https://www.npmjs.com/package/adaptive-memory-multi-model-router)
|
|
18
18
|
|
|
19
|
-
> **The highest-ranked and lowest-cost LLM router on the RouterArena leaderboard** β #1 (76.43), cheapest at $0.047/1K queries. Parallel multi-LLM execution across 47+ providers. Open-source, 19.5KB, zero ML dependencies.
|
|
19
|
+
> **#1 on LLM routing benchmark > **The highest-ranked and lowest-cost LLM router on the RouterArena leaderboard** β #1 (76.43), cheapest at $0.047/1K queries. Parallel multi-LLM execution across 47+ providers. Open-source, 19.5KB, zero ML dependencies. cheapest router with memory** β RouterArena score 76.43, cost $0.047/1K queries. 47+ providers, 19.5KB, zero ML deps.
|
|
20
20
|
|
|
21
21
|
**One prompt in. The right model out.** An open-source **AI gateway** that auto-routes every query to the cheapest capable model across **47+ LLM providers**. Features **parallel ensemble execution**, **semantic cache**, **budget enforcement**, **intelligent failover**, and **independent benchmark validation**. Start in <100ms. Python SDK + TypeScript SDK.
|
|
22
22
|
|
|
@@ -32,7 +32,7 @@
|
|
|
32
32
|
node dist/tui/dashboard.js
|
|
33
33
|
```
|
|
34
34
|
|
|
35
|
-
|
|
35
|
+
Terminal overlay box with `/route`, `/cost`, `/health`, `/models`, `/model <provider>`. Type anything to auto-route through the cheapest model.
|
|
36
36
|
|
|
37
37
|
### π By the Numbers
|
|
38
38
|
|
|
@@ -0,0 +1,77 @@
|
|
|
1
|
+
# π A3M Router Press Kit β RouterArena #1
|
|
2
|
+
|
|
3
|
+
## One-Liner
|
|
4
|
+
> A3M Router is the #1 ranked and lowest-cost LLM router on the RouterArena leaderboard β beating Microsoft Azure, OpenAI GPT-5, and every competitor.
|
|
5
|
+
|
|
6
|
+
## Key Facts
|
|
7
|
+
- **RouterArena Score:** 76.43 (#1 of 19 routers)
|
|
8
|
+
- **Cost:** $0.047/1K queries (cheapest on the leaderboard)
|
|
9
|
+
- **Accuracy:** 76.28% (tied with Sqwish at 76.40%)
|
|
10
|
+
- **Savings:** 3.8x cheaper than #2 (Sqwish), 213x cheaper than GPT-5
|
|
11
|
+
- **Size:** 19.5 KB, zero ML dependencies
|
|
12
|
+
- **Install:** `npm install -g adaptive-memory-multi-model-router`
|
|
13
|
+
|
|
14
|
+
## Links
|
|
15
|
+
- GitHub: https://github.com/Das-rebel/a3m-router
|
|
16
|
+
- npm: https://www.npmjs.com/package/adaptive-memory-multi-model-router
|
|
17
|
+
- Benchmark: https://das-rebel.github.io/a3m-router/benchmark
|
|
18
|
+
- Press Release: https://das-rebel.github.io/a3m-router/blog/routerarena-number-one.html
|
|
19
|
+
- RouterArena PR: https://github.com/RouteWorks/RouterArena/pull/113
|
|
20
|
+
|
|
21
|
+
## Leaderboard
|
|
22
|
+
| Rank | Router | Score | Cost/1K | Open Source? |
|
|
23
|
+
|:----:|:-------|:-----:|:-------:|:------------:|
|
|
24
|
+
| π₯ | A3M Router | 76.43 | $0.047 | β
|
|
|
25
|
+
| π₯ | Sqwish | 75.27 | $0.18 | β |
|
|
26
|
+
| π₯ | Azure (Microsoft) | 71.87 | $0.22 | β |
|
|
27
|
+
| 4 | GPT-5 (OpenAI) | 64.32 | $10.02 | β |
|
|
28
|
+
| 5 | RouteLLM (Berkeley) | 48.07 | $0.27 | β
|
|
|
29
|
+
|
|
30
|
+
---
|
|
31
|
+
|
|
32
|
+
## Email Pitch Template
|
|
33
|
+
|
|
34
|
+
### To: AI Newsletters
|
|
35
|
+
**Subject:** Open-source LLM router tops RouterArena benchmark β beats Microsoft, OpenAI
|
|
36
|
+
|
|
37
|
+
A3M Router just became the #1 ranked router on the RouterArena leaderboard (76.43), the first open-source project to top the benchmark. It's also the cheapest at $0.047/1K queries β 213x cheaper than GPT-5.
|
|
38
|
+
|
|
39
|
+
RouterArena (arXiv:2510.00202) is the official standardized benchmark for LLM routing systems, evaluating 19 routers across 8,400 queries.
|
|
40
|
+
|
|
41
|
+
GitHub: https://github.com/Das-rebel/a3m-router
|
|
42
|
+
Benchmark results: https://github.com/RouteWorks/RouterArena/pull/113
|
|
43
|
+
|
|
44
|
+
Happy to provide more data or answer questions.
|
|
45
|
+
|
|
46
|
+
---
|
|
47
|
+
|
|
48
|
+
### To: Tech Blogs / Journalists
|
|
49
|
+
**Subject:** Story pitch: Open-source underdog beats Microsoft and OpenAI on LLM routing benchmark
|
|
50
|
+
|
|
51
|
+
Hi [Name],
|
|
52
|
+
|
|
53
|
+
A3M Router, an open-source LLM routing project I built, just achieved #1 on the RouterArena leaderboard β beating Microsoft Azure (ranked #3), OpenAI GPT-5 (#5), and 15 other commercial and academic routers.
|
|
54
|
+
|
|
55
|
+
What's notable:
|
|
56
|
+
- **First open-source project to top the leaderboard**
|
|
57
|
+
- **Cheapest at $0.047/1K queries** β 4x cheaper than the nearest competitor
|
|
58
|
+
- **Uses parallel multi-LLM execution** β a fundamentally different approach from every other router
|
|
59
|
+
- **Tiny footprint** β 19.5KB, zero ML dependencies, installs in seconds
|
|
60
|
+
|
|
61
|
+
Full press release: https://das-rebel.github.io/a3m-router/blog/routerarena-number-one.html
|
|
62
|
+
GitHub: https://github.com/Das-rebel/a3m-router
|
|
63
|
+
|
|
64
|
+
Would this be of interest?
|
|
65
|
+
|
|
66
|
+
---
|
|
67
|
+
|
|
68
|
+
## Newsletter Submission Targets
|
|
69
|
+
|
|
70
|
+
| Newsletter | Subs | Email/Form | Notes |
|
|
71
|
+
|:-----------|:----:|:-----------|:------|
|
|
72
|
+
| TLDR AI | 500K+ | sponsors@tldr.tech | Submit via web form |
|
|
73
|
+
| Ben's Bites | 200K+ | hello@bensbites.com | Reply to newsletter |
|
|
74
|
+
| AI Breakfast | 80K+ | hello@aibreakfast.com | Tip form on site |
|
|
75
|
+
| The Neuron | 500K+ | β | Submit via website |
|
|
76
|
+
| MLOps.community | 50K+ | β | Community post |
|
|
77
|
+
| DevDiscuss | 100K+ | β | dev.to tag |
|
|
@@ -0,0 +1,73 @@
|
|
|
1
|
+
<!DOCTYPE html>
|
|
2
|
+
<html lang="en">
|
|
3
|
+
<head>
|
|
4
|
+
<meta charset="UTF-8">
|
|
5
|
+
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
|
6
|
+
<title>A3M Router: #1 on RouterArena β Open-Source LLM Router Beats Microsoft, OpenAI, and Every Competitor</title>
|
|
7
|
+
<meta name="description" content="A3M Router scored 76.43 on the RouterArena leaderboard β the highest rank among 19 routers. At $0.047/1K queries, it's also the cheapest.">
|
|
8
|
+
<meta property="og:title" content="A3M Router Tops RouterArena Leaderboard">
|
|
9
|
+
<meta property="og:description" content="Open-source LLM router beats Azure, GPT-5, and all competitors on the standardized routing benchmark.">
|
|
10
|
+
<meta property="og:type" content="article">
|
|
11
|
+
<meta name="twitter:card" content="summary_large_image">
|
|
12
|
+
<style>
|
|
13
|
+
body { font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; max-width: 720px; margin: 0 auto; padding: 2rem 1.5rem; line-height: 1.7; color: #1a1a2e; background: #fafafa; }
|
|
14
|
+
h1 { font-size: 1.8rem; line-height: 1.3; margin-bottom: 0.5rem; }
|
|
15
|
+
.meta { color: #666; font-size: 0.9rem; margin-bottom: 2rem; }
|
|
16
|
+
.leaderboard { width: 100%; border-collapse: collapse; margin: 1.5rem 0; font-size: 0.9rem; }
|
|
17
|
+
.leaderboard th, .leaderboard td { padding: 8px 12px; text-align: left; border-bottom: 1px solid #e0e0e0; }
|
|
18
|
+
.leaderboard th { background: #1a1a2e; color: #fff; }
|
|
19
|
+
.leaderboard tr:nth-child(2) { background: #e8f5e9; font-weight: bold; }
|
|
20
|
+
code { background: #e8e8e8; padding: 2px 6px; border-radius: 3px; font-size: 0.85rem; }
|
|
21
|
+
pre { background: #1a1a2e; color: #e0e0e0; padding: 1rem; border-radius: 6px; overflow-x: auto; }
|
|
22
|
+
.cta { display: inline-block; background: #00c853; color: #fff; padding: 12px 24px; border-radius: 6px; text-decoration: none; font-weight: bold; margin: 1rem 0; }
|
|
23
|
+
.cta:hover { background: #00a844; }
|
|
24
|
+
</style>
|
|
25
|
+
</head>
|
|
26
|
+
<body>
|
|
27
|
+
|
|
28
|
+
<h1>π A3M Router Tops RouterArena Leaderboard β First Open-Source Router to Beat Commercial Competitors</h1>
|
|
29
|
+
|
|
30
|
+
<p class="meta">Published May 28, 2026 Β· <a href="https://github.com/Das-rebel/a3m-router">A3M Router</a> Β· <a href="https://github.com/RouteWorks/RouterArena/pull/113">RouterArena PR #113</a></p>
|
|
31
|
+
|
|
32
|
+
<p>A3M Router, an open-source LLM router with parallel multi-LLM execution, has achieved the <strong>#1 ranking on the RouterArena leaderboard</strong> β the first open-source project to top the benchmark, beating Microsoft Azure, OpenAI GPT-5, and every commercial routing service.</p>
|
|
33
|
+
|
|
34
|
+
<h2>The Results</h2>
|
|
35
|
+
|
|
36
|
+
<table class="leaderboard">
|
|
37
|
+
<tr><th>Rank</th><th>Router</th><th>Score</th><th>Cost/1K</th><th>Type</th></tr>
|
|
38
|
+
<tr><td>π₯</td><td><strong>A3M Router</strong></td><td><strong>76.43</strong></td><td><strong>$0.047</strong></td><td>Open-source</td></tr>
|
|
39
|
+
<tr><td>π₯</td><td>Sqwish</td><td>75.27</td><td>$0.18</td><td>Closed-source</td></tr>
|
|
40
|
+
<tr><td>π₯</td><td>Azure-Model-Router (Microsoft)</td><td>71.87</td><td>$0.22</td><td>Closed-source</td></tr>
|
|
41
|
+
<tr><td>4</td><td>R2-Router (UCF)</td><td>71.60</td><td>$0.06</td><td>Open-source</td></tr>
|
|
42
|
+
<tr><td>5</td><td>GPT-5 (OpenAI)</td><td>64.32</td><td>$10.02</td><td>Closed-source</td></tr>
|
|
43
|
+
<tr><td>6</td><td>NotDiamond</td><td>57.29</td><td>$4.10</td><td>Closed-source</td></tr>
|
|
44
|
+
<tr><td>7</td><td>RouteLLM (UC Berkeley)</td><td>48.07</td><td>$0.27</td><td>Open-source</td></tr>
|
|
45
|
+
</table>
|
|
46
|
+
|
|
47
|
+
<p>A3M is the <strong>highest-ranked</strong> and <strong>lowest-cost</strong> router on the leaderboard β $0.047/1K queries, 3.8x cheaper than the nearest competitor.</p>
|
|
48
|
+
|
|
49
|
+
<h2>About RouterArena</h2>
|
|
50
|
+
|
|
51
|
+
<p><a href="https://github.com/RouteWorks/RouterArena">RouterArena</a> (arXiv:2510.00202) is the standardized open benchmark for LLM routing systems. It evaluates routers on accuracy, cost efficiency, optimality, and robustness across 8,400 diverse queries spanning 9 domains. Results are independently verified by the RouterArena evaluation pipeline.</p>
|
|
52
|
+
|
|
53
|
+
<h2>What Makes A3M Different</h2>
|
|
54
|
+
|
|
55
|
+
<p>Unlike every other router on the leaderboard that uses <strong>sequential model selection</strong> (try one model, if it fails try the next), A3M runs providers simultaneously and scores responses by confidence β a technique called <strong>parallel ensemble execution</strong>. This is why it achieves the highest accuracy at the lowest cost.</p>
|
|
56
|
+
|
|
57
|
+
<h2>Try It</h2>
|
|
58
|
+
|
|
59
|
+
<pre>npx a3m-router route "Your query here"</pre>
|
|
60
|
+
|
|
61
|
+
<p>Or install globally:</p>
|
|
62
|
+
|
|
63
|
+
<pre>npm install -g adaptive-memory-multi-model-router</pre>
|
|
64
|
+
|
|
65
|
+
<a class="cta" href="https://github.com/Das-rebel/a3m-router">View on GitHub β</a>
|
|
66
|
+
<a class="cta" href="https://www.npmjs.com/package/adaptive-memory-multi-model-router" style="background:#cb3837">View on npm β</a>
|
|
67
|
+
|
|
68
|
+
<h2>Press Contact</h2>
|
|
69
|
+
|
|
70
|
+
<p>For media inquiries, open a discussion on <a href="https://github.com/Das-rebel/a3m-router/discussions">GitHub Discussions</a> or reach out via the repository.</p>
|
|
71
|
+
|
|
72
|
+
</body>
|
|
73
|
+
</html>
|
|
@@ -0,0 +1,43 @@
|
|
|
1
|
+
<svg xmlns="http://www.w3.org/2000/svg" width="800" height="300" viewBox="0 0 800 300">
|
|
2
|
+
<defs>
|
|
3
|
+
<linearGradient id="bg" x1="0" y1="0" x2="0" y2="1">
|
|
4
|
+
<stop offset="0%" stop-color="#1a1a2e"/>
|
|
5
|
+
<stop offset="100%" stop-color="#16213e"/>
|
|
6
|
+
</linearGradient>
|
|
7
|
+
<linearGradient id="lineGrad" x1="0" y1="0" x2="1" y2="0">
|
|
8
|
+
<stop offset="0%" stop-color="#4fc3f7"/>
|
|
9
|
+
<stop offset="100%" stop-color="#00e676"/>
|
|
10
|
+
</linearGradient>
|
|
11
|
+
<linearGradient id="areaGrad" x1="0" y1="0" x2="0" y2="1">
|
|
12
|
+
<stop offset="0%" stop-color="#4fc3f7" stop-opacity="0.3"/>
|
|
13
|
+
<stop offset="100%" stop-color="#4fc3f7" stop-opacity="0.02"/>
|
|
14
|
+
</linearGradient>
|
|
15
|
+
</defs>
|
|
16
|
+
|
|
17
|
+
<rect width="800" height="300" fill="url(#bg)" rx="12"/>
|
|
18
|
+
|
|
19
|
+
<text x="400.0" y="30" text-anchor="middle" fill="#e0e0e0" font-family="monospace" font-size="16" font-weight="bold">npm Downloads</text>
|
|
20
|
+
<text x="400.0" y="50" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="11">Total: 11,637 Β· v2.13.24 Β· π₯ RouterArena #1 (76.43) Β· Cheapest at $0.047/1K</text>
|
|
21
|
+
<line x1="60" y1="60.0" x2="740" y2="60.0" stroke="#2a2a4e" stroke-width="1"/>
|
|
22
|
+
<text x="52" y="64.0" text-anchor="end" fill="#90a4ae" font-family="monospace" font-size="10">11,637</text>
|
|
23
|
+
<line x1="60" y1="105.0" x2="740" y2="105.0" stroke="#2a2a4e" stroke-width="1"/>
|
|
24
|
+
<text x="52" y="109.0" text-anchor="end" fill="#90a4ae" font-family="monospace" font-size="10">8,727</text>
|
|
25
|
+
<line x1="60" y1="150.0" x2="740" y2="150.0" stroke="#2a2a4e" stroke-width="1"/>
|
|
26
|
+
<text x="52" y="154.0" text-anchor="end" fill="#90a4ae" font-family="monospace" font-size="10">5,818</text>
|
|
27
|
+
<line x1="60" y1="195.0" x2="740" y2="195.0" stroke="#2a2a4e" stroke-width="1"/>
|
|
28
|
+
<text x="52" y="199.0" text-anchor="end" fill="#90a4ae" font-family="monospace" font-size="10">2,909</text>
|
|
29
|
+
<line x1="60" y1="240.0" x2="740" y2="240.0" stroke="#2a2a4e" stroke-width="1"/>
|
|
30
|
+
<text x="52" y="244.0" text-anchor="end" fill="#90a4ae" font-family="monospace" font-size="10">0</text>
|
|
31
|
+
<text x="60.0" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-13</text>
|
|
32
|
+
<text x="157.14285714285714" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-15</text>
|
|
33
|
+
<text x="254.28571428571428" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-17</text>
|
|
34
|
+
<text x="351.4285714285714" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-19</text>
|
|
35
|
+
<text x="448.57142857142856" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-21</text>
|
|
36
|
+
<text x="545.7142857142858" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-23</text>
|
|
37
|
+
<text x="642.8571428571428" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-25</text>
|
|
38
|
+
<text x="740.0" y="258" text-anchor="middle" fill="#90a4ae" font-family="monospace" font-size="9">05-27</text>
|
|
39
|
+
<polygon points="60,240 60.0,240.0 108.6,240.0 157.1,231.5 205.7,226.5 254.3,197.1 302.9,174.7 351.4,168.0 400.0,165.2 448.6,145.6 497.1,114.9 545.7,112.2 594.3,109.0 642.9,100.9 691.4,84.9 740.0,60.0 740.0,240" fill="url(#areaGrad)"/>
|
|
40
|
+
<polyline points="60.0,240.0 108.6,240.0 157.1,231.5 205.7,226.5 254.3,197.1 302.9,174.7 351.4,168.0 400.0,165.2 448.6,145.6 497.1,114.9 545.7,112.2 594.3,109.0 642.9,100.9 691.4,84.9 740.0,60.0" fill="none" stroke="url(#lineGrad)" stroke-width="2.5" stroke-linecap="round" stroke-linejoin="round"/>
|
|
41
|
+
<circle cx="740.0" cy="60.0" r="4" fill="#00e676"/>
|
|
42
|
+
<text x="748.0" y="64.0" fill="#00e676" font-family="monospace" font-size="11" font-weight="bold">11,637 total</text>
|
|
43
|
+
</svg>
|
package/package.json
CHANGED
|
@@ -1,9 +1,9 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "adaptive-memory-multi-model-router",
|
|
3
|
-
"version": "2.13.
|
|
3
|
+
"version": "2.13.26",
|
|
4
4
|
"shortName": "A3M Router",
|
|
5
5
|
"displayName": "A3M Router - Adaptive Memory Multi-Model Router",
|
|
6
|
-
"description": "
|
|
6
|
+
"description": "π #1 on LLM routing benchmark & Cheapest LLM router with memory Β· Open-source AI gateway with parallel multi-LLM execution across 47+ providers, ensemble voting, semantic cache, and budget enforcement",
|
|
7
7
|
"main": "dist/index.js",
|
|
8
8
|
"bin": {
|
|
9
9
|
"a3m-router": "dist/cli.js",
|