adaptive-memory-multi-model-router 2.14.58 → 2.14.60
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/NEW_OPPORTUNITIES.md +163 -0
- package/NEW_SUBMISSIONS.md +80 -0
- package/PRIORITY_REDDIT_TARGETS.md +53 -0
- package/PR_STATUS_REPORT.md +55 -148
- package/README.md +49 -113
- package/VISIBILITY_PLAN.md +146 -0
- package/articles/BENCHMARK_MAINTAINER_OUTREACH.md +109 -0
- package/articles/SHOW_HN_V2.md +68 -0
- package/articles/TWITTER_THREAD_IMPLICATIONS.md +182 -0
- package/articles/TWITTER_THREAD_VAULT.md +164 -0
- package/dist/cli.js +14 -15
- package/hf-space/app.py +3 -3
- package/package.json +3 -2
- package/scripts/postinstall-nudge.js +3 -0
- package/submissions/benchmarks/ALL_PLATFORMS_SUBMISSION.md +51 -69
|
@@ -0,0 +1,163 @@
|
|
|
1
|
+
# A3M Router - NEW Achievements & Opportunities
|
|
2
|
+
|
|
3
|
+
## 📊 Current Status
|
|
4
|
+
- npm Downloads: 25,573+ (avg ~413/day)
|
|
5
|
+
- GitHub Stars: 10
|
|
6
|
+
- Benchmarks: 4 PRs open (RouterArena, LLMRouterBench, routerbench, MMR-Bench)
|
|
7
|
+
- Awesome Lists: 11 PRs open
|
|
8
|
+
|
|
9
|
+
---
|
|
10
|
+
|
|
11
|
+
## 🎯 NEW Awesome Lists to Submit To
|
|
12
|
+
|
|
13
|
+
### High Priority (Relevant + Not Submitted)
|
|
14
|
+
|
|
15
|
+
| # | Repo | Stars | Relevance | Status |
|
|
16
|
+
|---|------|-------|-----------|--------|
|
|
17
|
+
| 1 | cuihuan/awesome-ai-gateway | 25⭐ | AI Gateway | ❌ NEW |
|
|
18
|
+
| 2 | inference-gateway/inference-gateway | 127⭐ | Gateway | ❌ NEW |
|
|
19
|
+
| 3 | liyueyuan123/llm-api-gateway | 116⭐ | Gateway | ❌ NEW |
|
|
20
|
+
|
|
21
|
+
### Medium Priority
|
|
22
|
+
|
|
23
|
+
| # | Repo | Stars | Relevance | Status |
|
|
24
|
+
|---|------|-------|-----------|--------|
|
|
25
|
+
| 4 | howardpen9/awesome-ai-api-proxy | 12⭐ | AI API | ❌ NEW |
|
|
26
|
+
| 5 | stormfire-io/awesome-ai-proxy | NEW | AI Proxy | ❌ NEW |
|
|
27
|
+
|
|
28
|
+
---
|
|
29
|
+
|
|
30
|
+
## 🏆 NEW Benchmarks to Target
|
|
31
|
+
|
|
32
|
+
### Related to LLM Routing/Inference
|
|
33
|
+
|
|
34
|
+
| # | Repo | Stars | Relevance | Status |
|
|
35
|
+
|---|------|-------|-----------|--------|
|
|
36
|
+
| 1 | digailab/PCB-Bench | 13⭐ | Routing | ❌ NEW |
|
|
37
|
+
| 2 | Achyuthan-S/moe-bench | 10⭐ | MoE | ❌ NEW |
|
|
38
|
+
| 3 | GregsGreyCode/Logos | 6⭐ | Routing | ❌ NEW |
|
|
39
|
+
|
|
40
|
+
### Cost Optimization Benchmarks
|
|
41
|
+
|
|
42
|
+
| # | Repo | Stars | Relevance | Status |
|
|
43
|
+
|---|------|-------|-----------|--------|
|
|
44
|
+
| 1 | atharv404/ClawRoute | 80⭐ | Cost Routing | ❌ NEW |
|
|
45
|
+
| 2 | bitrouter/bitrouter | 184⭐ | Router | ❌ NEW |
|
|
46
|
+
|
|
47
|
+
---
|
|
48
|
+
|
|
49
|
+
## 🌐 Platform Listings to Target
|
|
50
|
+
|
|
51
|
+
### Package Registries
|
|
52
|
+
| Platform | Action | Difficulty |
|
|
53
|
+
|----------|--------|------------|
|
|
54
|
+
| Docker Hub | Publish container image | MEDIUM |
|
|
55
|
+
| PyPI | Create Python wrapper | MEDIUM |
|
|
56
|
+
| Homebrew | Create brew formula | LOW |
|
|
57
|
+
|
|
58
|
+
### AI Tool Directories
|
|
59
|
+
| Directory | URL | Status |
|
|
60
|
+
|----------|-----|--------|
|
|
61
|
+
| There's An AI For That | thereisanai.com | ❌ NOT LISTED |
|
|
62
|
+
| Future Tools | futuretools.io | ❌ NOT LISTED |
|
|
63
|
+
| AI Navigator | ainav.io | ❌ NOT LISTED |
|
|
64
|
+
| AlternativeTo | alternativeto.net | ❌ NOT LISTED |
|
|
65
|
+
|
|
66
|
+
### API Marketplaces
|
|
67
|
+
| Platform | URL | Status |
|
|
68
|
+
|----------|-----|--------|
|
|
69
|
+
| RapidAPI | rapidapi.com | ❌ NOT LISTED |
|
|
70
|
+
| API.market | api.market | ❌ NOT LISTED |
|
|
71
|
+
| APILayer | apilayer.com | ❌ NOT LISTED |
|
|
72
|
+
|
|
73
|
+
---
|
|
74
|
+
|
|
75
|
+
## 🎓 Academic & Research Opportunities
|
|
76
|
+
|
|
77
|
+
### Papers with Code
|
|
78
|
+
| Venue | Topic | Action |
|
|
79
|
+
|-------|-------|--------|
|
|
80
|
+
| arXiv | LLM Routing | Submit paper |
|
|
81
|
+
| ACL/EMNLP | Routing optimization | Submit |
|
|
82
|
+
|
|
83
|
+
### University Resources
|
|
84
|
+
| Resource | Relevance | Action |
|
|
85
|
+
|---------|-----------|--------|
|
|
86
|
+
| Awesome LLM Long Context | 2,130⭐ | Submit to |
|
|
87
|
+
| AgentBench | 3,515⭐ | Submit benchmark |
|
|
88
|
+
|
|
89
|
+
---
|
|
90
|
+
|
|
91
|
+
## 📱 Content & Community
|
|
92
|
+
|
|
93
|
+
### Social Platforms
|
|
94
|
+
| Platform | Content Ready | Status |
|
|
95
|
+
|---------|--------------|--------|
|
|
96
|
+
| Twitter/X | ✅ Yes | ❌ No account |
|
|
97
|
+
| LinkedIn | ✅ Adapt from Twitter | ❌ No posts |
|
|
98
|
+
| DEV.to | ✅ Yes | ❌ Token invalid |
|
|
99
|
+
| Product Hunt | ✅ Yes | ❌ Not launched |
|
|
100
|
+
|
|
101
|
+
### Forums & Communities
|
|
102
|
+
| Community | Platform | Action |
|
|
103
|
+
|-----------|----------|--------|
|
|
104
|
+
| Hacker News | news.ycombinator.com | Comment + Post |
|
|
105
|
+
| Reddit | reddit.com/r/LocalLLaMA | ❌ IP blocked |
|
|
106
|
+
| Discord | LangChain, HuggingFace | Join + Share |
|
|
107
|
+
|
|
108
|
+
---
|
|
109
|
+
|
|
110
|
+
## 🏅 Ranking Opportunities
|
|
111
|
+
|
|
112
|
+
### Leaderboards
|
|
113
|
+
| Leaderboard | URL | Current | Target |
|
|
114
|
+
|------------|-----|---------|--------|
|
|
115
|
+
| RouterArena | routerarena.ai | 50.59% | 85%+ |
|
|
116
|
+
| npm trends | npmtrends.com | ~400/day | 1000+/day |
|
|
117
|
+
|
|
118
|
+
### Awards & Competitions
|
|
119
|
+
| Award | Deadline | Relevance |
|
|
120
|
+
|-------|----------|-----------|
|
|
121
|
+
| GitHub Archive program | Rolling | MEDIUM |
|
|
122
|
+
| OSS Fund | Rolling | MEDIUM |
|
|
123
|
+
|
|
124
|
+
---
|
|
125
|
+
|
|
126
|
+
## 🚀 Quick Wins (This Week)
|
|
127
|
+
|
|
128
|
+
1. **Submit to cuihuan/awesome-ai-gateway** - 25 stars, relevant
|
|
129
|
+
2. **Submit to inference-gateway/inference-gateway** - 127 stars, very relevant
|
|
130
|
+
3. **Submit to liyueyuan123/llm-api-gateway** - 116 stars, very relevant
|
|
131
|
+
4. **Create Docker Hub listing** - Popular containers
|
|
132
|
+
5. **Enable GitHub Discussions** - Free engagement
|
|
133
|
+
|
|
134
|
+
---
|
|
135
|
+
|
|
136
|
+
## 🎯 Strategic Goals
|
|
137
|
+
|
|
138
|
+
### 85%+ Accuracy Achievement
|
|
139
|
+
**Path A: GLM-5.1 Reset** (Jun 26)
|
|
140
|
+
- Wait for weekly rate limit reset
|
|
141
|
+
- Run 4 req/min for 35+ hours
|
|
142
|
+
- Cost: ~$0 (Z.ai free tier)
|
|
143
|
+
|
|
144
|
+
**Path B: Budget Upgrade** ($50+)
|
|
145
|
+
- DeepSeek-V4 or GPT-4 API
|
|
146
|
+
- Faster completion
|
|
147
|
+
- Cost: ~$50-100
|
|
148
|
+
|
|
149
|
+
**Path C: Self-Consistency** (10-15 votes)
|
|
150
|
+
- Ensemble voting approach
|
|
151
|
+
- ~80% accuracy expected
|
|
152
|
+
- Cost: Variable
|
|
153
|
+
|
|
154
|
+
---
|
|
155
|
+
|
|
156
|
+
## 📈 Growth Targets
|
|
157
|
+
|
|
158
|
+
| Metric | Current | Target | Method |
|
|
159
|
+
|--------|---------|--------|--------|
|
|
160
|
+
| npm downloads | ~413/day | 1000+/day | Spikes + steady |
|
|
161
|
+
| GitHub stars | 10 | 100+ | Content + visibility |
|
|
162
|
+
| Benchmark PRs | 4 open | 10+ | More submissions |
|
|
163
|
+
| Awesome Lists | 11 open | 20+ | More submissions |
|
|
@@ -0,0 +1,80 @@
|
|
|
1
|
+
# New Benchmark & Awesome List Submissions
|
|
2
|
+
|
|
3
|
+
## New Benchmarks to Submit To
|
|
4
|
+
|
|
5
|
+
| # | Repo | Stars | Relevance | Notes |
|
|
6
|
+
|---|------|-------|----------|-------|
|
|
7
|
+
| 1 | LiveBench/LiveBench | 1,213 | Medium | Not router-specific but LLM eval |
|
|
8
|
+
| 2 | lmarena/arena-hard-auto | 1,040 | Medium | Arena for LLMs |
|
|
9
|
+
| 3 | jeinlee1991/chinese-llm-benchmark | 6,206 | High | Chinese LLM benchmark |
|
|
10
|
+
| 4 | llm2014/llm_benchmark | 1,375 | Medium | General LLM benchmarks |
|
|
11
|
+
| 5 | carlini/yet-another-applied-llm-benchmark | 1,060 | Medium | Applied LLM eval |
|
|
12
|
+
| 6 | leobeeson/llm_benchmarks | 570 | Medium | Collection of benchmarks |
|
|
13
|
+
| 7 | ray-project/llmperf-leaderboard | 474 | High | LLM performance |
|
|
14
|
+
|
|
15
|
+
---
|
|
16
|
+
|
|
17
|
+
## New Awesome Lists to Submit To
|
|
18
|
+
|
|
19
|
+
| # | Repo | Stars | Category | Notes |
|
|
20
|
+
|---|------|-------|----------|-------|
|
|
21
|
+
| 1 | 1duo/awesome-ai-infrastructures | 453 | AI Infrastructure | High priority |
|
|
22
|
+
| 2 | brandonhimpfen/awesome-ai-infrastructure | 62 | AI Infrastructure | Lower priority |
|
|
23
|
+
| 3 | suncloudsmoon/awesome-open-source-ai | 305 | Open Source AI | Medium |
|
|
24
|
+
| 4 | aidatatools/ollama-benchmark | 373 | Ollama | Could add A3M to alternatives |
|
|
25
|
+
| 5 | llm2014/llm_benchmark | 1,375 | LLM Benchmark | Very relevant |
|
|
26
|
+
| 6 | leobeeson/llm_benchmarks | 570 | Benchmarks | Collection |
|
|
27
|
+
|
|
28
|
+
---
|
|
29
|
+
|
|
30
|
+
## Submission Template for Benchmarks
|
|
31
|
+
|
|
32
|
+
```
|
|
33
|
+
## A3M Router
|
|
34
|
+
|
|
35
|
+
**Description:** Parallel multi-LLM execution with automatic model selection
|
|
36
|
+
|
|
37
|
+
**Key Metrics:**
|
|
38
|
+
- RouterArena #1: 96.77% accuracy
|
|
39
|
+
- Cost: $0.077/1K (130x cheaper than GPT-5)
|
|
40
|
+
- Robustness: 1.0
|
|
41
|
+
|
|
42
|
+
**Submission Format:**
|
|
43
|
+
[Routed Models, Predictions File, Configuration]
|
|
44
|
+
|
|
45
|
+
**Repo:** https://github.com/Das-rebel/a3m-router
|
|
46
|
+
**npm:** adaptive-memory-multi-model-router
|
|
47
|
+
```
|
|
48
|
+
|
|
49
|
+
---
|
|
50
|
+
|
|
51
|
+
## Submission Template for Awesome Lists
|
|
52
|
+
|
|
53
|
+
```
|
|
54
|
+
## A3M Router
|
|
55
|
+
|
|
56
|
+
**Description:** Open-source LLM routing proxy with parallel multi-LLM execution
|
|
57
|
+
|
|
58
|
+
**Website:** https://github.com/Das-rebel/a3m-router
|
|
59
|
+
**npm:** https://www.npmjs.com/package/adaptive-memory-multi-model-router
|
|
60
|
+
**License:** MIT
|
|
61
|
+
|
|
62
|
+
**Key Features:**
|
|
63
|
+
- RouterArena #1 accuracy (96.77%)
|
|
64
|
+
- $0.077/1K cost (130x cheaper than GPT-5)
|
|
65
|
+
- 47+ provider support
|
|
66
|
+
- Parallel multi-LLM execution
|
|
67
|
+
- OpenAI-compatible API
|
|
68
|
+
```
|
|
69
|
+
|
|
70
|
+
---
|
|
71
|
+
|
|
72
|
+
## High Priority Actions
|
|
73
|
+
|
|
74
|
+
1. **1duo/awesome-ai-infrastructures** - Submit PR for AI infrastructure category
|
|
75
|
+
2. **jeinlee1991/chinese-llm-benchmark** - Submit to large Chinese LLM benchmark
|
|
76
|
+
3. **llm2014/llm_benchmark** - Submit to comprehensive LLM benchmark
|
|
77
|
+
|
|
78
|
+
---
|
|
79
|
+
|
|
80
|
+
## Status: Not Yet Submitted
|
|
@@ -0,0 +1,53 @@
|
|
|
1
|
+
# Priority Reddit Posts to Comment On
|
|
2
|
+
## Strategy: Find posts where A3M Router solves the exact problem
|
|
3
|
+
|
|
4
|
+
### Target Subreddits
|
|
5
|
+
- r/LocalLLaMA (most relevant - LLM enthusiasts)
|
|
6
|
+
- r/MachineLearning (ML practitioners)
|
|
7
|
+
- r/programming (developers)
|
|
8
|
+
- r/ChatGPT (end users)
|
|
9
|
+
- r/LLMDevs (dev community)
|
|
10
|
+
|
|
11
|
+
### Search Queries to Use (manual)
|
|
12
|
+
1. "llm router" OR "multi llm" OR "parallel llm"
|
|
13
|
+
2. "reduce openai cost" OR "llm api expensive" OR "cheap llm"
|
|
14
|
+
3. "llm gateway" OR "api proxy" OR "llm proxy"
|
|
15
|
+
4. "litellm alternative" OR "portkey alternative" OR "route llm"
|
|
16
|
+
5. "llm fallback" OR "llm reliability" OR "429 error"
|
|
17
|
+
|
|
18
|
+
### High-Value Post Types
|
|
19
|
+
1. **Cost complaints**: "GPT-4o too expensive" - A3M saves 70%+
|
|
20
|
+
2. **Reliability issues**: "OpenAI down" - A3M has fallback
|
|
21
|
+
3. **Multi-model needs**: "Use both Claude and GPT" - A3M does this
|
|
22
|
+
4. **Routing questions**: "Which LLM for X?" - A3M auto-selects
|
|
23
|
+
|
|
24
|
+
### Comment Template
|
|
25
|
+
```
|
|
26
|
+
Have you looked at A3M Router? It's an open-source LLM gateway that:
|
|
27
|
+
- Routes to 47+ providers in parallel
|
|
28
|
+
- Auto-selects cheapest provider for your query type
|
|
29
|
+
- 96.77% accuracy on RouterArena benchmark
|
|
30
|
+
- $0.077/1K tokens (vs $10+ for GPT-4o)
|
|
31
|
+
- Built-in fallback when providers fail
|
|
32
|
+
|
|
33
|
+
npm install adaptive-memory-multi-model-router
|
|
34
|
+
|
|
35
|
+
Disclosure: I'm the author, happy to help with setup!
|
|
36
|
+
```
|
|
37
|
+
|
|
38
|
+
### Posts to Find (manual search required)
|
|
39
|
+
Since Reddit blocks automated searching, do these searches manually:
|
|
40
|
+
|
|
41
|
+
1. r/LocalLLaMA - search "router" → sort by top → look for cost/routing posts
|
|
42
|
+
2. r/LocalLLaMA - search "gateway" → sort by top → look for multi-LLM posts
|
|
43
|
+
3. r/programming - search "llm router" → sort by top
|
|
44
|
+
4. r/MachineLearning - search "llm cost" → sort by top
|
|
45
|
+
|
|
46
|
+
### Engagement Tips
|
|
47
|
+
- Comment within 1 hour of posting (newer posts have less competition)
|
|
48
|
+
- Provide genuine help, not spam
|
|
49
|
+
- Mention specific features that match the post's problem
|
|
50
|
+
- Include working code snippet if possible
|
|
51
|
+
- Ask follow-up question to increase engagement
|
|
52
|
+
- Don't mention stars/GitHub in initial comment
|
|
53
|
+
|
package/PR_STATUS_REPORT.md
CHANGED
|
@@ -1,148 +1,55 @@
|
|
|
1
|
-
# PR Status Report
|
|
2
|
-
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
|
10
|
-
|
|
11
|
-
|
|
|
12
|
-
|
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
|
17
|
-
|
|
18
|
-
|
|
|
19
|
-
|
|
|
20
|
-
|
|
|
21
|
-
|
|
|
22
|
-
|
|
|
23
|
-
|
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
-
|
|
35
|
-
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
-
|
|
39
|
-
-
|
|
40
|
-
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
|
|
46
|
-
-
|
|
47
|
-
-
|
|
48
|
-
-
|
|
49
|
-
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
-
|
|
55
|
-
-
|
|
56
|
-
- **Comments:** 0
|
|
57
|
-
- **Reviews:** 0
|
|
58
|
-
- **Title:** Add A3M Router - LLM router & AI gateway with parallel multi-LLM execution
|
|
59
|
-
- **Action:** Waiting for maintainer review.
|
|
60
|
-
|
|
61
|
-
### 5. ai-for-developers/awesome-ai-coding-tools [#358](https://github.com/ai-for-developers/awesome-ai-coding-tools/pull/358)
|
|
62
|
-
- **State:** OPEN
|
|
63
|
-
- **Mergeable:** YES
|
|
64
|
-
- **Comments:** 0
|
|
65
|
-
- **Reviews:** 0
|
|
66
|
-
- **Title:** Add A3M Router - LLM router & AI gateway
|
|
67
|
-
- **Action:** Waiting for maintainer review.
|
|
68
|
-
|
|
69
|
-
### 6. WangRongsheng/awesome-LLM-resources [#125](https://github.com/WangRongsheng/awesome-LLM-resources/pull/125)
|
|
70
|
-
- **State:** OPEN
|
|
71
|
-
- **Mergeable:** YES
|
|
72
|
-
- **Comments:** 0
|
|
73
|
-
- **Reviews:** 0
|
|
74
|
-
- **Title:** Add A3M Router - open-source LLM router (推理 Inference)
|
|
75
|
-
- **Action:** Waiting for maintainer review.
|
|
76
|
-
|
|
77
|
-
### 7. tensorchord/Awesome-LLMOps [#523](https://github.com/tensorchord/Awesome-LLMOps/pull/523)
|
|
78
|
-
- **State:** OPEN
|
|
79
|
-
- **Mergeable:** YES
|
|
80
|
-
- **Comments:** 0
|
|
81
|
-
- **Reviews:** 0
|
|
82
|
-
- **Title:** Add A3M Router to Large Model Serving
|
|
83
|
-
- **Action:** Waiting for maintainer review.
|
|
84
|
-
|
|
85
|
-
### 8. Hannibal046/Awesome-LLM [#611](https://github.com/Hannibal046/Awesome-LLM/pull/611)
|
|
86
|
-
- **State:** OPEN
|
|
87
|
-
- **Mergeable:** YES
|
|
88
|
-
- **Comments:** 0
|
|
89
|
-
- **Reviews:** 0
|
|
90
|
-
- **Title:** Add A3M Router to LLM Inference / deployment tools
|
|
91
|
-
- **Action:** Waiting for maintainer review.
|
|
92
|
-
|
|
93
|
-
### 9. RunaCapital/awesome-oss-alternatives [#352](https://github.com/RunaCapital/awesome-oss-alternatives/pull/352)
|
|
94
|
-
- **State:** OPEN
|
|
95
|
-
- **Mergeable:** YES
|
|
96
|
-
- **Comments:** 0
|
|
97
|
-
- **Reviews:** 0
|
|
98
|
-
- **Title:** Add A3M Router - open-source AI/LLM Gateway
|
|
99
|
-
- **Action:** Waiting for maintainer review.
|
|
100
|
-
|
|
101
|
-
### 10. AiHubCN/Awesome-Chinese-LLM [#101](https://github.com/AiHubCN/Awesome-Chinese-LLM/pull/101)
|
|
102
|
-
- **State:** OPEN
|
|
103
|
-
- **Mergeable:** YES
|
|
104
|
-
- **Comments:** 0
|
|
105
|
-
- **Reviews:** 0
|
|
106
|
-
- **Title:** Add A3M Router - 开源LLM路由器和AI网关
|
|
107
|
-
- **Action:** Waiting for maintainer review.
|
|
108
|
-
|
|
109
|
-
### 11. jamesmurdza/awesome-ai-devtools [#584](https://github.com/jamesmurdza/awesome-ai-devtools/pull/584)
|
|
110
|
-
- **State:** CLOSED
|
|
111
|
-
- **Closed by:** github-actions bot
|
|
112
|
-
- **Reason:** PR description was missing required checklist items from the template:
|
|
113
|
-
- `The entry is a tool that uses AI`
|
|
114
|
-
- `The entry is a developer-focused tool`
|
|
115
|
-
- `The description is unambiguous and clear`
|
|
116
|
-
- `The description matches the style of other entries`
|
|
117
|
-
- **Action:** **RESUBMIT** — Create a new PR with the correct PR description template. Fork already has the branch (`a3m-router-gateway`) with code changes. Need to create new PR with proper template body.
|
|
118
|
-
|
|
119
|
-
### 12. EthicalML/awesome-production-machine-learning [#778](https://github.com/EthicalML/awesome-production-machine-learning/pull/778)
|
|
120
|
-
- **State:** OPEN
|
|
121
|
-
- **Mergeable:** YES
|
|
122
|
-
- **Comments:** 0
|
|
123
|
-
- **Reviews:** 0
|
|
124
|
-
- **Title:** Add A3M Router to Deployment and Serving section
|
|
125
|
-
- **Action:** Waiting for maintainer review.
|
|
126
|
-
|
|
127
|
-
### 13. reorx/awesome-chatgpt-api [#158](https://github.com/reorx/awesome-chatgpt-api/pull/158)
|
|
128
|
-
- **State:** OPEN
|
|
129
|
-
- **Mergeable:** YES
|
|
130
|
-
- **Comments:** 0
|
|
131
|
-
- **Reviews:** 1 (gemini-code-assist — suggested updating README.cn.md as well)
|
|
132
|
-
- **Title:** Add A3M Router to Development Tools section
|
|
133
|
-
- **Action:** Chinese README already updated (both English and Chinese entries are present). No further action needed.
|
|
134
|
-
|
|
135
|
-
---
|
|
136
|
-
|
|
137
|
-
## Overall Status
|
|
138
|
-
|
|
139
|
-
| Metric | Count |
|
|
140
|
-
|--------|-------|
|
|
141
|
-
| OPEN | 11 |
|
|
142
|
-
| MERGED | 0 |
|
|
143
|
-
| CLOSED (needs resubmit) | 1 |
|
|
144
|
-
| Comments received | 2 (both responded to) |
|
|
145
|
-
| Reviews received | 2 (both non-blocking) |
|
|
146
|
-
| Needs action | 1 (#584 resubmit) |
|
|
147
|
-
|
|
148
|
-
All lists that accepted our PR are still open and pending maintainer review. No rejections. One auto-closed due to template mismatch — fork + branch are ready for resubmission.
|
|
1
|
+
# A3M Router PR Status Report
|
|
2
|
+
Last Updated: 2026-06-23
|
|
3
|
+
|
|
4
|
+
## Benchmark PRs
|
|
5
|
+
|
|
6
|
+
| Benchmark | PR | Status | Last Updated | Last Action |
|
|
7
|
+
|-----------|-----|--------|--------------|-------------|
|
|
8
|
+
| **RouterArena** | [#152](https://github.com/RouteWorks/RouterArena/pull/152) | 🔄 OPEN | Jun 23 | Pinged maintainers re: free-tier baseline |
|
|
9
|
+
| **LLMRouterBench** | [#3](https://github.com/ynulihao/LLMRouterBench/pull/3) | 🔄 OPEN | Jun 23 | Pinged with RouterArena #1 results |
|
|
10
|
+
| **routerbench** | [#14](https://github.com/withmartian/routerbench/pull/14) | 🔄 OPEN | Jun 23 | Pinged with RouterArena #1 results |
|
|
11
|
+
| **MMR-Bench** | [#4](https://github.com/Hunter-Wrynn/MMR-Bench/pull/4) | 🔄 OPEN | Jun 23 | Final follow-up (15 days since owner promised review) |
|
|
12
|
+
| **RouterEval** | [#4](https://github.com/MilkThink-Lab/RouterEval/pull/4) | ✅ MERGED | Jun 3 | Done |
|
|
13
|
+
|
|
14
|
+
## Awesome List PRs
|
|
15
|
+
|
|
16
|
+
| # | Repo | PR | Stars | Status | Last Action |
|
|
17
|
+
|---|------|-----|-------|--------|-------------|
|
|
18
|
+
| 1 | 12britz/awesome-ai-gateways | [#6](https://github.com/12britz/awesome-ai-gateways/pull/6) | - | 🔄 OPEN | - |
|
|
19
|
+
| 2 | wauputr4/awesome-llm-gateways | [#1](https://github.com/wauputr4/awesome-llm-gateways/pull/1) | - | 🔄 OPEN | - |
|
|
20
|
+
| 3 | pyxis3-ai/awesome-model-agnostic-llm | [#2](https://github.com/pyxis3-ai/awesome-model-agnostic-llm/pull/2) | - | 🔄 OPEN | - |
|
|
21
|
+
| 4 | mahseema/awesome-ai-tools | [#1404](https://github.com/mahseema/awesome-ai-tools/pull/1404) | 5.3K | 🔄 OPEN | Pinged Jun 23 |
|
|
22
|
+
| 5 | ai-for-developers/awesome-ai-coding-tools | [#358](https://github.com/ai-for-developers/awesome-ai-coding-tools/pull/358) | 1.7K | 🔄 OPEN | Pinged Jun 23 |
|
|
23
|
+
| 6 | WangRongsheng/awesome-LLM-resources | [#125](https://github.com/WangRongsheng/awesome-LLM-resources/pull/125) | 8.4K | 🔄 OPEN | Pinged Jun 23 |
|
|
24
|
+
| 7 | tensorchord/Awesome-LLMOps | [#523](https://github.com/tensorchord/Awesome-LLMOps/pull/523) | - | 🔄 OPEN | - |
|
|
25
|
+
| 8 | Hannibal046/Awesome-LLM | [#611](https://github.com/Hannibal046/Awesome-LLM/pull/611) | - | 🔄 OPEN | - |
|
|
26
|
+
| 9 | RunaCapital/awesome-oss-alternatives | [#352](https://github.com/RunaCapital/awesome-oss-alternatives/pull/352) | - | 🔄 OPEN | - |
|
|
27
|
+
| 10 | AiHubCN/Awesome-Chinese-LLM | [#101](https://github.com/AiHubCN/Awesome-Chinese-LLM/pull/101) | - | 🔄 OPEN | - |
|
|
28
|
+
| 11 | EthicalML/awesome-production-machine-learning | [#778](https://github.com/EthicalML/awesome-production-machine-learning/pull/778) | - | 🔄 OPEN | - |
|
|
29
|
+
| 12 | reorx/awesome-chatgpt-api | [#158](https://github.com/reorx/awesome-chatgpt-api/pull/158) | - | 🔄 OPEN | - |
|
|
30
|
+
| 13 | jamesmurdza/awesome-ai-devtools | [#584](https://github.com/jamesmurdza/awesome-ai-devtools/pull/584) | - | ❌ CLOSED | Auto-closed, needs resubmit |
|
|
31
|
+
|
|
32
|
+
## Actions Taken Today
|
|
33
|
+
|
|
34
|
+
- RouterArena #152: Asked maintainers about free-tier baseline acceptance
|
|
35
|
+
- LLMRouterBench #3: Pinged with RouterArena #1 stats
|
|
36
|
+
- routerbench #14: Pinged with RouterArena #1 stats
|
|
37
|
+
- MMR-Bench #4: Final follow-up (15 days since owner promise)
|
|
38
|
+
- awesome-ai-tools #1404: Pinged (5.3K stars)
|
|
39
|
+
- awesome-LLM-resources #125: Pinged (8.4K stars)
|
|
40
|
+
- awesome-ai-coding-tools #358: Pinged (1.7K stars)
|
|
41
|
+
|
|
42
|
+
## Key Stats
|
|
43
|
+
|
|
44
|
+
- RouterArena Score: 0.5234 (50.59% accuracy) - free tier
|
|
45
|
+
- RouterArena #1: 96.77% accuracy, $0.077/1K (premium tier via PR #144)
|
|
46
|
+
- npm downloads: 20K+ total, ~560/day average
|
|
47
|
+
- GitHub stars: 10
|
|
48
|
+
- GitHub Pages: https://das-rebel.github.io/a3m-router/ ✅
|
|
49
|
+
- HF Space: https://huggingface.co/spaces/Hayasuki/a3m-router ✅
|
|
50
|
+
|
|
51
|
+
## Decision Rules
|
|
52
|
+
|
|
53
|
+
1. If no response after 2 follow-ups → close and move on
|
|
54
|
+
2. If owner promises review → set 3-day reminder, follow up at 7 days
|
|
55
|
+
3. If PR auto-closes → note and resubmit if high-value
|