adaptive-memory-multi-model-router 2.13.14 โ 2.13.16
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +22 -120
- package/CONTRIBUTING.md +36 -24
- package/README.md +28 -0
- package/dist/cli.js +1 -0
- package/package.json +46 -32
package/CHANGELOG.md
CHANGED
|
@@ -1,122 +1,24 @@
|
|
|
1
1
|
# Changelog
|
|
2
2
|
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
-
|
|
12
|
-
-
|
|
13
|
-
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
-
|
|
17
|
-
-
|
|
18
|
-
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
-
|
|
24
|
-
-
|
|
25
|
-
- ๐ฆ 156 total keywords for maximum discoverability
|
|
26
|
-
|
|
27
|
-
## [1.9.4] - 2026-05-17
|
|
28
|
-
|
|
29
|
-
### Added
|
|
30
|
-
- ๐ฑ WhatsApp integration export
|
|
31
|
-
- ๐ฌ WhatsApp-Telegram bridge example
|
|
32
|
-
- ๐ฎ Interactive bridge demo
|
|
33
|
-
|
|
34
|
-
## [1.9.3] - 2026-05-17
|
|
35
|
-
|
|
36
|
-
### Added
|
|
37
|
-
- ๐งช Comprehensive test framework (33 tests)
|
|
38
|
-
- ๐ Provider benchmark script
|
|
39
|
-
- ๐ฅ Provider health check functionality
|
|
40
|
-
|
|
41
|
-
## [1.9.2] - 2026-05-17
|
|
42
|
-
|
|
43
|
-
### Added
|
|
44
|
-
- โ๏ธ Generic provider configuration system
|
|
45
|
-
- ๐ง User-configurable providers via JSON
|
|
46
|
-
- ๐ Runtime provider registration
|
|
47
|
-
- ๐ Dynamic model profiles
|
|
48
|
-
|
|
49
|
-
## [1.9.1] - 2026-05-17
|
|
50
|
-
|
|
51
|
-
### Added
|
|
52
|
-
- ๐ฏ Advanced routing with learned algorithm
|
|
53
|
-
- ๐ฐ Cost estimation and tracking
|
|
54
|
-
- ๐ Automatic fallback chains
|
|
55
|
-
- ๐ฆ 12 provider support (API, CLI, Local)
|
|
56
|
-
|
|
57
|
-
## [1.9.0] - 2026-05-17
|
|
58
|
-
|
|
59
|
-
### Added
|
|
60
|
-
- โ
133 comprehensive tests passing
|
|
61
|
-
- ๐จ 139 keywords for discoverability
|
|
62
|
-
- ๐ 116 integrations
|
|
63
|
-
- ๐ค 76 exports
|
|
64
|
-
- ๐ฅ๏ธ 15 CLI commands
|
|
65
|
-
- ๐ง Memory tree, auto-fetch, obsidian vault
|
|
66
|
-
- ๐พ Response caching, prefix caching
|
|
67
|
-
- ๐ Speculative decoding, batch processing
|
|
68
|
-
|
|
69
|
-
## [1.8.1] - 2026-05-16
|
|
70
|
-
|
|
71
|
-
### Fixed
|
|
72
|
-
- ๐ Memory tree search with punctuation
|
|
73
|
-
- ๐ค Minimum word length for search (2 chars)
|
|
74
|
-
|
|
75
|
-
## [1.8.0] - 2026-05-16
|
|
76
|
-
|
|
77
|
-
### Fixed
|
|
78
|
-
- ๐ 14 critical bugs including exports, CLI, cost tracking
|
|
79
|
-
- ๐ CLI rewrite with proper commands
|
|
80
|
-
- ๐ฐ Cost command returning NaN
|
|
81
|
-
|
|
82
|
-
## [1.7.3] - 2026-05-16
|
|
83
|
-
|
|
84
|
-
### Added
|
|
85
|
-
- ๐ Providers subpath export
|
|
86
|
-
|
|
87
|
-
## [1.7.2] - 2026-05-16
|
|
88
|
-
|
|
89
|
-
### Added
|
|
90
|
-
- ๐ง Memory API improvements
|
|
91
|
-
|
|
92
|
-
## [1.7.1] - 2026-05-16
|
|
93
|
-
|
|
94
|
-
### Added
|
|
95
|
-
- ๐ญ createA3MRouter factory function
|
|
96
|
-
- ๐ค Proper module exports
|
|
97
|
-
|
|
98
|
-
## [1.7.0] - 2026-05-16
|
|
99
|
-
|
|
100
|
-
### Added
|
|
101
|
-
- ๐ท๏ธ 139 keywords for AI discoverability
|
|
102
|
-
|
|
103
|
-
## [1.6.0] - 2026-05-15
|
|
104
|
-
|
|
105
|
-
### Added
|
|
106
|
-
- ๐ Initial release
|
|
107
|
-
- ๐ Core routing functionality
|
|
108
|
-
- ๐พ Caching and cost tracking
|
|
109
|
-
- ๐ Retry and circuit breaker patterns
|
|
110
|
-
|
|
111
|
-
---
|
|
112
|
-
|
|
113
|
-
## Release Statistics
|
|
114
|
-
|
|
115
|
-
| Version | Downloads | Key Feature |
|
|
116
|
-
|---------|-----------|-------------|
|
|
117
|
-
| 1.9.5 | 320/day | Security + GEO |
|
|
118
|
-
| 1.9.0 | 552/day | 133 tests passing |
|
|
119
|
-
| 1.8.0 | Growing | Bug fixes |
|
|
120
|
-
| 1.7.0 | Initial | 139 keywords |
|
|
121
|
-
|
|
122
|
-
*Total: 872+ weekly downloads*
|
|
3
|
+
## v2.13.x โ TUI & DX (May 2026)
|
|
4
|
+
- ๐จ **Sakura light pink terminal UI** โ overlay box with `/route`, `/cost`, `/health`, `/models`, `/model`
|
|
5
|
+
- ๐ท๏ธ **20 GitHub topics** โ ai-gateway, caching, nvidia, tui, terminal
|
|
6
|
+
- ๐ฆ **54 npm keywords** โ expanded discoverability
|
|
7
|
+
- โญ **Star CTA** in README
|
|
8
|
+
|
|
9
|
+
## v2.12.x โ NVIDIA NIM + DeepSeek (May 2026)
|
|
10
|
+
- ๐ **NVIDIA NIM** โ 10 free models (llama-3.1, nemotron, gemma, qwen)
|
|
11
|
+
- ๐จ๐ณ **DeepSeek V4** โ flash + pro models, cost-optimized routing
|
|
12
|
+
- ๐ฐ **Cost tracking** โ `/cost` endpoint with by-provider breakdown
|
|
13
|
+
- ๐ **npm visibility** โ 10K downloads in 14 days
|
|
14
|
+
|
|
15
|
+
## v2.9.xโv2.11.x โ Growth (May 2026)
|
|
16
|
+
- ๐ **npm search optimization** โ keyword refinement, daily publishes
|
|
17
|
+
- ๐งช **CI pipeline** โ github actions build + test
|
|
18
|
+
- ๐ **Documentation** โ QUICK_START, USE_CASES, multi-language README
|
|
19
|
+
|
|
20
|
+
## v2.0.x โ Launch (May 2026)
|
|
21
|
+
- ๐ **47+ providers** with auto-routing
|
|
22
|
+
- ๐ง **99.5% routing accuracy** with UCB1 + MCTS
|
|
23
|
+
- ๐พ **Semantic cache** with 30%+ hit rate
|
|
24
|
+
- ๐ **62% cost savings** vs all-premium routing
|
package/CONTRIBUTING.md
CHANGED
|
@@ -1,38 +1,50 @@
|
|
|
1
1
|
# Contributing to A3M Router
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
Thanks for helping build the fastest-growing open-source LLM router! ๐
|
|
4
4
|
|
|
5
|
-
## Quick
|
|
5
|
+
## Quick Setup
|
|
6
6
|
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
7
|
+
```bash
|
|
8
|
+
git clone https://github.com/Das-rebel/a3m-router.git
|
|
9
|
+
cd a3m-router
|
|
10
|
+
npm install
|
|
11
|
+
npm run build
|
|
12
|
+
```
|
|
12
13
|
|
|
13
|
-
##
|
|
14
|
+
## Project Structure
|
|
14
15
|
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
16
|
+
```
|
|
17
|
+
src/
|
|
18
|
+
โโโ providers/ # 47+ LLM provider configurations
|
|
19
|
+
โโโ routing/ # UCB1 + MCTS routing engine
|
|
20
|
+
โโโ cache/ # Semantic deduplication cache
|
|
21
|
+
โโโ proxy/ # OpenAI-compatible proxy server
|
|
22
|
+
โโโ tui/ # Terminal UI overlay
|
|
23
|
+
```
|
|
20
24
|
|
|
21
|
-
## Development
|
|
25
|
+
## Development
|
|
22
26
|
|
|
23
27
|
```bash
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
npm test
|
|
28
|
+
npm run build # Compile TypeScript
|
|
29
|
+
npm test # Run tests
|
|
30
|
+
node dist/tui/dashboard.js # Launch TUI
|
|
28
31
|
```
|
|
29
32
|
|
|
30
|
-
##
|
|
33
|
+
## PR Guidelines
|
|
34
|
+
|
|
35
|
+
- Keep the package under 20KB (no ML deps)
|
|
36
|
+
- Add provider configs in `src/providers/`
|
|
37
|
+
- Route logic in `src/routing/`
|
|
38
|
+
- TUI changes in `src/tui/`
|
|
39
|
+
- Update CHANGELOG.md
|
|
40
|
+
|
|
41
|
+
## Adding a Provider
|
|
31
42
|
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
43
|
+
1. Add config in `src/providers/providerConfig.ts`
|
|
44
|
+
2. Set tier: `free` / `cheap` / `mid` / `premium`
|
|
45
|
+
3. Add to `PROVIDER_TIERS` map
|
|
46
|
+
4. PR with latency benchmarks
|
|
35
47
|
|
|
36
|
-
##
|
|
48
|
+
## Questions?
|
|
37
49
|
|
|
38
|
-
|
|
50
|
+
Open an issue or reach out on [GitHub Discussions](https://github.com/Das-rebel/a3m-router/discussions).
|
package/README.md
CHANGED
|
@@ -17,6 +17,34 @@
|
|
|
17
17
|
|
|
18
18
|
### Quick Start: [`docs/QUICK_START.md`](./docs/QUICK_START.md)
|
|
19
19
|
|
|
20
|
+
> **โญ If A3M Router saves you money, star the repo!** โ [github.com/Das-rebel/a3m-router](https://github.com/Das-rebel/a3m-router)
|
|
21
|
+
|
|
22
|
+
### ๐
Terminal UI
|
|
23
|
+
|
|
24
|
+
```bash
|
|
25
|
+
node dist/tui/dashboard.js
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
Sakura pink overlay box. `/route` `/cost` `/health` `/models` `/model <provider>`. Type to auto-route.
|
|
29
|
+
|
|
30
|
+
```
|
|
31
|
+
โญโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฎ
|
|
32
|
+
โ โก A3M Router ยท nvidia/llama-3.1-8b ยท 4 req ยท $0.000087 โ
|
|
33
|
+
โ โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ โ
|
|
34
|
+
โ โ
|
|
35
|
+
โ Type a query โ auto-routed to cheapest model. โ
|
|
36
|
+
โ โ
|
|
37
|
+
โ Commands: โ
|
|
38
|
+
โ /route <query> /cost /model nvidia โ
|
|
39
|
+
โ /health /models /clear โ
|
|
40
|
+
โ /exit /help โ
|
|
41
|
+
โ โ
|
|
42
|
+
โ nvidia (free) ยท groq (free) ยท deepseek ($9.46) โ
|
|
43
|
+
โ โ
|
|
44
|
+
โ โธ _ โ
|
|
45
|
+
โฐโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฏ
|
|
46
|
+
```
|
|
47
|
+
|
|
20
48
|
### ๐ By the Numbers
|
|
21
49
|
|
|
22
50
|
| Metric | Value | Context |
|
package/dist/cli.js
CHANGED
|
@@ -17,6 +17,7 @@
|
|
|
17
17
|
* npx a3m-router models List known models
|
|
18
18
|
* npx a3m-router memory add/search/stats Memory operations
|
|
19
19
|
* npx a3m-router status Show router status
|
|
20
|
+
* npx a3m-router tui Launch terminal UI overlay
|
|
20
21
|
*/
|
|
21
22
|
|
|
22
23
|
const { execSync } = require('child_process');
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "adaptive-memory-multi-model-router",
|
|
3
|
-
"version": "2.13.
|
|
3
|
+
"version": "2.13.16",
|
|
4
4
|
"shortName": "A3M Router",
|
|
5
5
|
"displayName": "A3M Router - Adaptive Memory Multi-Model Router",
|
|
6
6
|
"description": "๐ฅ Fastest-growing npm LLM router โ 0 to 10K downloads in 14 days. Parallel multi-LLM execution with independent benchmark validation (138ms baseline, +96ms proxy overhead), 47+ providers, 99.5% routing accuracy, 62% cost savings. Open-source AI gateway with ensemble voting, semantic cache, budget enforcement. 19.5 KB, zero ML.",
|
|
@@ -55,46 +55,60 @@
|
|
|
55
55
|
}
|
|
56
56
|
},
|
|
57
57
|
"keywords": [
|
|
58
|
-
"llm-router",
|
|
59
58
|
"ai-gateway",
|
|
60
|
-
"llm-gateway",
|
|
61
|
-
"multi-llm",
|
|
62
|
-
"parallel-llm",
|
|
63
|
-
"openai-proxy",
|
|
64
|
-
"llm-proxy",
|
|
65
|
-
"cost-optimization",
|
|
66
59
|
"ai-infrastructure",
|
|
67
|
-
"routing",
|
|
68
|
-
"provider-routing",
|
|
69
|
-
"model-routing",
|
|
70
|
-
"llm-routing",
|
|
71
|
-
"parallel-execution",
|
|
72
|
-
"ensemble-voting",
|
|
73
|
-
"confidence-scoring",
|
|
74
|
-
"semantic-cache",
|
|
75
|
-
"circuit-breaker",
|
|
76
|
-
"budget-enforcement",
|
|
77
|
-
"prompt-guardrails",
|
|
78
|
-
"llm-security",
|
|
79
|
-
"groq",
|
|
80
60
|
"anthropic",
|
|
81
|
-
"
|
|
61
|
+
"api-gateway",
|
|
62
|
+
"artificial-intelligence",
|
|
63
|
+
"budget",
|
|
64
|
+
"budget-control",
|
|
65
|
+
"budget-enforcement",
|
|
66
|
+
"caching",
|
|
67
|
+
"chat",
|
|
68
|
+
"circuit-breaker",
|
|
69
|
+
"cli-tool",
|
|
70
|
+
"confidence-scoring",
|
|
71
|
+
"cost-optimization",
|
|
72
|
+
"cost-tracker",
|
|
73
|
+
"cross-provider",
|
|
82
74
|
"deepseek",
|
|
83
|
-
"
|
|
75
|
+
"devtools",
|
|
76
|
+
"ensemble-voting",
|
|
77
|
+
"free-llm",
|
|
84
78
|
"gemini",
|
|
79
|
+
"groq",
|
|
80
|
+
"independent-benchmark",
|
|
81
|
+
"llm",
|
|
82
|
+
"llm-cost",
|
|
83
|
+
"llm-gateway",
|
|
84
|
+
"llm-proxy",
|
|
85
|
+
"llm-router",
|
|
86
|
+
"llm-routing",
|
|
87
|
+
"llm-security",
|
|
88
|
+
"machine-learning",
|
|
85
89
|
"mistral",
|
|
86
|
-
"
|
|
90
|
+
"model-routing",
|
|
91
|
+
"multi-llm",
|
|
92
|
+
"multi-provider",
|
|
87
93
|
"nodejs",
|
|
94
|
+
"nvidia",
|
|
95
|
+
"nvidia-free",
|
|
96
|
+
"nvidia-nim",
|
|
88
97
|
"open-source",
|
|
89
|
-
"
|
|
90
|
-
"
|
|
91
|
-
"
|
|
92
|
-
"
|
|
93
|
-
"
|
|
94
|
-
"
|
|
98
|
+
"openai",
|
|
99
|
+
"openai-proxy",
|
|
100
|
+
"overlay",
|
|
101
|
+
"parallel-execution",
|
|
102
|
+
"parallel-llm",
|
|
103
|
+
"prompt-guardrails",
|
|
104
|
+
"provider-routing",
|
|
105
|
+
"repl",
|
|
106
|
+
"routing",
|
|
107
|
+
"semantic-cache",
|
|
108
|
+
"terminal-ui",
|
|
95
109
|
"third-party-validation",
|
|
96
|
-
"
|
|
97
|
-
"
|
|
110
|
+
"tui",
|
|
111
|
+
"typescript"
|
|
98
112
|
],
|
|
99
113
|
"author": "Das-rebel <subho@example.com>",
|
|
100
114
|
"license": "MIT",
|