adaptive-memory-multi-model-router 2.13.8 → 2.13.10

package/articles/POSTING_KIT_2026_05.md

@@ -1,152 +1,67 @@
 # 🌐 A3M Router — Cross-Platform Posting Kit (May 2026)
 
-Use the content below to post across platforms. Each has a tailored version.
+All posts focus on the **three pain points** developers actually told us about.
 
 ---
 
 ## 📺 dev.to
 
-**Title:** Fastest-Growing npm LLM Router Hits 10K Downloads in 14 Days — Here's What We Did Right
-
-**Tags:** llm, opensource, typescript, ai, devops
-
-**URL to post:** https://dev.to/new
-
-**Content file:** `articles/FRESH_devto_2026_05.md`
-
-**API method (if token available):**
-```bash
-curl -X POST https://dev.to/api/articles \
-  -H "Content-Type: application/json" \
-  -H "Authorization: Bearer $DEV_TO_API_KEY" \
-  -d "$(python3 -c "
-import json
-with open('articles/FRESH_devto_2026_05.md') as f:
-    body = f.read()
-print(json.dumps({
-    'article': {
-        'title': 'Fastest-Growing npm LLM Router Hits 10K Downloads in 14 Days',
-        'body_markdown': body,
-        'tags': ['llm', 'opensource', 'typescript', 'ai', 'devops'],
-        'published': true,
-        'main_image': 'https://raw.githubusercontent.com/Das-rebel/a3m-router/main/docs/benchmark-chart.png'
-    }
-}))
-")"
-```
+**Title:** Three LLM Infrastructure Problems That Shouldn't Exist in 2026
+
+**Tags:** llm, devops, infrastructure, ai, opensource
+
+**Content:** `articles/FRESH_devto_2026_05.md`
 
 ---
 
 ## 🐙 Hacker News (Show HN)
 
-**Title:** Show HN: A3M – Open-source LLM router, 10K downloads in 14 days, parallel ensemble
+**Title:** Show HN: A3M – Fixing three LLM infrastructure problems (10K downloads, 62% savings)
 
 **URL:** https://github.com/Das-rebel/a3m-router
 
-**Post at:** https://news.ycombinator.com/submit
-
-**Description (for HN comment):**
-```
-We built an open-source LLM router that does one thing no other router does: 
-run multiple providers in parallel and merge results with confidence scoring.
-
-Every other router (litellm, one-api, etc.) does sequential fallback — try A, fail, 
-try B, fail, try C. We run all providers at once, score every result, and return 
-the best answer with transparent reasoning.
-
-Numbers: 10K downloads in 14 days, 99.5% routing accuracy, 62% cost savings, 
-19.5 KB, zero ML dependencies. Independent benchmark published.
-
-npm install adaptive-memory-multi-model-router
-```
-
 ---
 
 ## 🔴 Reddit
 
-### r/javascript
-**Title:** I built an open-source LLM router that runs providers in parallel (not sequential fallback) — 10K downloads in 14 days
-**URL:** https://github.com/Das-rebel/a3m-router
-
-### r/typescript
-**Title:** A3M Router — 19.5 KB TypeScript LLM router with parallel ensemble and independent benchmarks
-**URL:** https://github.com/Das-rebel/a3m-router
-
-### r/opensource
-**Title:** A3M Router — fastest-growing npm LLM router, open-source, 19.5 KB, 47 providers
-**URL:** https://github.com/Das-rebel/a3m-router
-
-### r/LLMDevs
-**Title:** Parallel multi-LLM execution with confidence scoring — open-source router with independent benchmarks
-**URL:** https://github.com/Das-rebel/a3m-router
+**r/javascript**
+> Three LLM infrastructure problems that shouldn't exist:
+> 1. Bills 3x higher than needed (62% savings with smart routing)
+> 2. Sequential fallback (we run providers in parallel + score results)
+> 3. No real benchmarks (we published third-party latency data)
+>
+> Built in TypeScript, 19.5 KB, open-source. 10K downloads, zero marketing.
+> https://github.com/Das-rebel/a3m-router
+
+**r/typescript**
+> A3M Router — 19.5 KB TypeScript LLM router solving three real problems:
+> 62% cost savings, parallel ensemble (unique), independent benchmarks.
+> https://github.com/Das-rebel/a3m-router
+
+**r/opensource**
+> Open-source LLM router (MIT) that solves real pain points instead of imaginary ones.
+> 47 providers, 19.5 KB, zero ML. 10K downloads in 14 days.
+> https://github.com/Das-rebel/a3m-router
+
+**r/LLMDevs**
+> Three LLM infrastructure problems we fixed with an open-source router:
+> - Budget overruns (62% savings)
+> - Sequential fallback (parallel + scoring instead)
+> - Black box benchmarks (published independent latency data)
+> https://github.com/Das-rebel/a3m-router
 
 ---
 
 ## 🐦 Twitter / X
 
-Thread content in `articles/twitter-thread-cost-savings.md`
-
-Post at: https://twitter.com/compose/tweet
-
-Suggested thread:
-```
-1/7 We built an open-source LLM router that does one thing no competitor does.
-
-Every router uses sequential fallback (try A → B → C).
-
-We run ALL providers in PARALLEL, score every result, and return the best answer.
-
-Here's why this matters ↓
-
-2/7 The results so far:
-• 10,024 downloads in 14 days (zero marketing)
-• 99.5% routing accuracy
-• 62% cost savings
-• 19.5 KB — no GPU, no ML model
-
-3/7 Independent benchmark (llm-gateway-bench):
-Direct to Groq: 138ms
-Through A3M: 374ms
-
-236ms overhead saves $2,604/year at scale.
-
-4/7 The feature everyone asks for: parallel ensemble.
-
-Run NVIDIA + Groq + OpenAI at the same time. Score results. Pick the best.
-
-No other router does this.
-
-5/7 npm install adaptive-memory-multi-model-router
-npx a3m-router serve
-
-Point any OpenAI SDK at localhost:8787 with model: "auto"
-
-6/7 What's included:
-• 47 providers
-• Parallel ensemble
-• RouteLLM routing (99.5% accuracy)
-• Budget enforcement
-• Semantic cache (30%+ hit rate)
-• Persistent memory
-
-7/7 GitHub: github.com/Das-rebel/a3m-router
-npm: adaptive-memory-multi-model-router
-
-Built by developers, for developers. Star if you find it useful ⭐
-```
+Thread in `articles/twitter-thread-cost-savings.md`
 
 ---
 
-## 📧 Email Newsletters
-
-### TLDR Newsletter
-Submit at: https://tldr.tech/submit
-
-### Python Weekly
-Submit at: https://www.pythonweekly.com/submit
-
-### Node Weekly
-Submit at: https://nodeweekly.com/submit
+## 📧 Newsletters
 
-### JavaScript Weekly
-Submit at: https://javascriptweekly.com/submit
+| Newsletter | Submit URL | Title |
+|:-----------|:-----------|:------|
+| TLDR | https://tldr.tech/submit | Three LLM Infrastructure Problems That Shouldn't Exist in 2026 |
+| Node Weekly | https://nodeweekly.com/submit | A3M Router — 19.5 KB LLM router with parallel ensemble |
+| JavaScript Weekly | https://javascriptweekly.com/submit | Three LLM infrastructure problems solved with 19.5 KB of TypeScript |

package/articles/hn_show_2026_05.md

@@ -1,24 +1,14 @@
-show: A3M — Open-source LLM router, 10K downloads in 14 days, parallel ensemble
+We built an open-source LLM router that solves three real problems developers keep hitting:
 
-We built an open-source LLM router that does one thing no other router does: run multiple providers in parallel and merge results with confidence scoring.
+**Problem 1 — LLM bills are 3x higher than they should be.**
+Every query goes to GPT-4 because nobody has time to configure per-query routing. A3M classifies queries by complexity (12 signals) and routes to the cheapest capable model. 62% cost savings.
 
-**Why this matters:** Every other router (litellm, one-api, etc.) does sequential fallback — try A, fail, try B, fail, try C. We run all providers at once, score every result, and return the best answer with transparent reasoning.
+**Problem 2 — Sequential fallback gives you one provider's answer, not the best one.**
+Every other router does try-A-fail-try-B-fail-try-C. A3M runs providers in parallel, scores results on specificity/structure/relevance, and returns the best answer with reasoning.
 
-**The numbers:**
-- 10,024 downloads in 14 days (zero marketing)
-- 99.5% ±1 tier routing accuracy
-- 62% cost savings vs all-premium routing
-- 19.5 KB — zero ML dependencies
-- Provider latency: 138ms direct → 374ms through router (+236ms for full intelligence)
+**Problem 3 — Every gateway claims "negligible overhead" without publishing numbers.**
+We ran ours through llm-gateway-bench (third-party tool) and published everything: 138ms baseline → 374ms through full routing. 236ms overhead saves 62% on API costs.
 
-**Independent benchmark:** We published third-party benchmark results using llm-gateway-bench — not fabricated numbers.
-
-**Stack:** TypeScript, 47 providers, RouteLLM-style routing (12 signals → tier → model), parallel ensemble, semantic cache, circuit breaker, cost tracking, persistent memory.
-
-```bash
-npm install adaptive-memory-multi-model-router
-npx a3m-router serve
-# Point any OpenAI SDK at localhost:8787 with model: "auto"
-```
+19.5 KB. Zero ML dependencies. 47 providers. 10K downloads in 14 days.
 
 https://github.com/Das-rebel/a3m-router

package/articles/twitter-thread-cost-savings.md

@@ -1,84 +1,64 @@
-# Twitter Thread: 30x Efficiency — We Matched a GPU-Trained Router With Zero ML
+1/7 Three LLM infrastructure problems that shouldn't exist in 2026:
 
-## T1/7 — Hook
-We matched a GPU-trained BERT router's accuracy with zero ML.
+• Your bill is 3x higher than it should be
+• Sequential fallback gives you one provider's answer, not the best one
+• Every gateway claims "negligible overhead" without publishing numbers
 
-82.5% accuracy. No PyTorch. No GPU. No 500MB model.
+We built something that fixes all three.
 
-RouteLLM (Berkeley) gets 85% with BERT. We get 82.5% with keyword matching.
+2/7 Problem 1: Your LLM bill is 3x higher than it should be.
 
-That's 97% of the accuracy at 3% of the compute.
+Every query goes to GPT-4 because configuring per-query routing is a pain.
 
-30x more efficient. Thread.
+A3M classifies every query by complexity (12 signals) and routes to the cheapest capable model.
 
-## T2/7 — The Benchmark Numbers
-The only two LLM routers with published benchmarks:
+Simple Q&A → free ($0)
+Code → cheap ($0.20/M)
+Expert → premium ($2.50/M)
 
-RouteLLM: 85% (±1 tier) — PyTorch + BERT + GPU + 500MB model
-A3M Router: 82.5% (±1 tier) — Node.js + keywords + 0 bytes model
+62% cost savings.
 
-LiteLLM (47,000 GitHub stars): publishes ZERO routing accuracy data.
+3/7 Problem 2: Sequential fallback is a design flaw.
 
-Benchmark or GTFO.
+Every gateway does: try A → fail → try B → fail → try C.
 
-## T3/7 — RouteLLM Comparison
-RouteLLM needs:
-- Python + PyTorch + CUDA
-- ~500MB BERT model download
-- GPU for inference
-- ~3s cold start
-- ~2GB install
+You always get one provider's answer. Never the best across all.
 
-A3M Router needs:
-- Node.js
-- 3MB install
-- No GPU
-- 50ms cold start
+A3M runs ALL providers in parallel, scores every result, and returns the best answer with reasoning.
 
-2.5% accuracy difference. You decide if the GPU is worth it.
+We call it parallel ensemble. No other router does this.
 
-## T4/7 — Cost Savings
-63.7% average cost reduction.
+4/7 Problem 3: "Negligible overhead" with zero data.
 
-Before: everything goes to GPT-4 at $0.03/query
-After: queries routed to cheapest capable provider
+Every gateway claims this. None publish numbers.
 
-Simple Q&A: $0.03 -> $0.00 (free provider)
-Code gen: $0.05 -> $0.0004 (Groq)
-Complex reasoning: $0.03 -> $0.03 (stays premium)
+We ran ours through a third-party benchmarking tool (llm-gateway-bench) and published everything:
 
-Drop-in proxy. Point any OpenAI SDK at localhost:8787. Zero code changes.
+Direct: 138ms
+Through A3M: 374ms
 
-## T5/7 — Growth Story
-Day 1: 552 downloads
-Day 2: 320 downloads
-Day 3: 1,903 downloads
+236ms overhead saves 62% on API costs. Reproducible by anyone.
 
-245% growth. Zero marketing budget. No blog post. No HN. No Twitter thread. Just developers telling developers.
+5/7 Why 10K developers downloaded it in 14 days (zero marketing):
 
-## T6/7 — Code Example
-```javascript
-const { createA3MRouter } = require('adaptive-memory-multi-model-router');
-const router = createA3MRouter();
+They told us they were hacking these solutions together manually — running prompts through multiple providers in separate browser tabs, comparing outputs by hand.
 
-// Auto-routes to cheapest capable provider
-await router.route("What is 2+2?");
-// -> free provider ($0.00)
+We automated what they were already doing.
 
-await router.route("Write Python to sort an array");
-// -> Groq ($0.0004, 0.4s)
-```
+6/7 What's inside the 19.5 KB package:
 
-40 providers. Semantic cache. Circuit breakers. 3MB.
+• Parallel ensemble (the unique feature)
+• RouteLLM-style routing (99.5% accuracy)
+• 47 providers
+• Budget enforcement with alerts
+• Semantic cache (30%+ hit rate)
+• Circuit breaker + auto failover
+• Persistent memory
 
-## T7/7 — CTA
-npm install adaptive-memory-multi-model-router
+7/7 npm install adaptive-memory-multi-model-router
+npx a3m-router serve
 
-GitHub: github.com/Das-rebel/a3m-router
-NPM: npmjs.com/package/adaptive-memory-multi-model-router
-
-82.5% accuracy. Zero ML. Zero GPU. Matches BERT within 2.5%. 63.7% cost savings. 40 providers.
+Point any OpenAI SDK at localhost:8787.
 
-30x more efficient.
-
-#LLM #AI #RouteLLM #BenchmarkOrGTFO #OpenSource #JavaScript #CostOptimization
+GitHub: github.com/Das-rebel/a3m-router
+Docs: github.com/Das-rebel/a3m-router#benchmark-results-real-api-calls

package/dist/tui/dashboard.d.ts

@@ -1,9 +1,8 @@
 #!/usr/bin/env node
 /**
- * A3M Router CLI — Inline REPL (no fullscreen)
- * Like PI's /search — prints inline, no terminal takeover.
- *
- * Usage: node dist/tui/dashboard.js
- *        Then type queries or /slash commands.
+ * A3M Router — Terminal Overlay Box
+ * Draws a centered overlay ON TOP of existing terminal content.
+ * Does NOT clear the screen. Restores terminal when done.
+ * Pure ANSI — no fullscreen, no alt-buffer.
  */
 export {};