adaptive-memory-multi-model-router 2.14.49 → 2.14.52

package/articles/AI_AGENT_LLM_ROUTING.md

@@ -0,0 +1,150 @@
+---
+title: "Every AI Agent Needs a Router (Here's Why)"
+description: "AI agents burn through LLM API calls faster than you think. A smart router cuts costs by 40% and keeps agents running when providers go down."
+tags: ["ai-agents", "llm", "claude-code", "cursor", "cost-optimization"]
+date: 2026-05-28
+canonical_url: https://github.com/Das-rebel/a3m-router
+---
+
+> **Ready to publish** — This article targets AI/ML developer blogs. Tone: technical, practical, forward-looking. Length: ~800 words.
+
+---
+
+# Every AI Agent Needs a Router (Here's Why)
+
+I run Claude Code regularly. Each time I ask it to "debug this function" or "refactor this module," it doesn't make one LLM call. It makes 5, 10, sometimes 20.
+
+That's how agents work. Every decision — "should I read this file?" "should I run this command?" "does this output make sense?" — is a separate LLM call. The agent loop doesn't pause to ask "is this the right model for this task?" It just fires everything at the same provider.
+
+I ran a simple experiment: traced a 5-minute Claude Code session and counted the API calls. Result: **17 LLM queries** for what felt like one task. Each one hit the premium model. Each one cost money.
+
+Total: about $0.85 for a trivial debugging session.
+
+Scale that to a team of 10 developers running agents daily, and you're looking at **$2,500+/month** just in agent API costs.
+
+## The Hidden Cost of Agent Loops
+
+Here's what happens inside an AI agent:
+
+```
+User: "Fix the login bug"
+  Agent thinks: "I need to read the auth module first"     → 1 LLM call (premium)
+  Agent executes: reads auth.ts
+  Agent thinks: "There's a race condition in the token check" → 2nd LLM call (premium)
+  Agent executes: edits the file
+  Agent thinks: "Let me verify the fix"                      → 3rd LLM call (premium)
+  Agent executes: runs the tests
+  Agent thinks: "Tests pass. Should I also check...?"        → 4th LLM call (premium)
+  ...continues until Agent is happy
+```
+
+Five minutes of work. Four to seventeen API calls. All premium pricing.
+
+The problem isn't that agents make many calls — that's their job. The problem is that **every single call uses the same expensive model**, even when most of them are simple decisions ("is this code correct?") that a cheaper model could handle perfectly well.
+
+## Why Agents Need Routing
+
+A router — specifically, a per-query intelligent router — solves three concrete problems for AI agents:
+
+### 1. Rate Limits Will Kill Your Agent
+
+Popular models (GPT-4o, Claude Sonnet) get rate-limited constantly. When an agent's single provider hits its limit, the agent either blocks waiting for reset or fails mid-task.
+
+A router with 47+ providers means your agent has 47 fallbacks. Groq hitting limits? Route to DeepSeek. DeepSeek slow? Try NVIDIA. The agent never stalls.
+
+### 2. Different Decisions Need Different Models
+
+Not all LLM calls in an agent loop are equal.
+
+- **Simple classification** ("is this a bug report?"): taste-1 (free) handles this perfectly
+- **Code generation** ("write a sorting function"): DeepSeek or Groq (cheap, fast for code)
+- **Architecture analysis** ("find the root cause of this race condition"): GPT-4o or Claude (premium reasoning)
+- **Summarization** ("what did we change in this session?"): GPT-4o-mini (mid-tier, fast)
+
+A smart router classifies each query in <1ms and routes it to the cheapest capable model. The agent doesn't need to know which model is running. It just gets results.
+
+### 3. Cost Control at Agent Scale
+
+Agents burn tokens fast because they're loops. A 5-minute Agent session can consume 10-20K tokens just in thinking.
+
+Here's the cost difference with and without routing:
+
+```
+100 Agent sessions/day:
+  Without router: 100 × 17 calls × $0.005 = $8.50/day = $255/month
+  With routing:   100 × 17 calls × $0.002 = $3.40/day = $102/month
+  Savings:                                                  $153/month
+
+1,000 sessions/day (small team):
+  Without router: $2,550/month → With router: $1,020/month → Save: $1,530/month
+```
+
+The savings multiply because agents make more calls than humans do. A smart router for agents isn't a luxury — it's the difference between sustainable AI tooling and budget surprise.
+
+## The MCP Pattern: How Agents Ask for Routing
+
+A3M Router exposes an MCP (Model Context Protocol) server that agents can query before making an LLM call:
+
+```bash
+# Agent asks A3M: "What model should I use for this?"
+npx a3m-router mcp-route "is this code correct?"
+
+# A3M responds in <1ms:
+{
+  "model": "groq/llama-3.3-70b",
+  "tier": "cheap",
+  "cost": "$0.0002",
+  "fallbacks": ["nvidia/llama-3.1-8b", "deepseek/deepseek-chat"]
+}
+```
+
+The agent takes this suggestion and routes the actual LLM call through A3M's proxy. The routing decision is free (<1ms). The savings compound on every call.
+
+## Practical Example
+
+Here's what this looks like in practice with the OpenAI-compatible proxy:
+
+```python
+from openai import OpenAI
+
+# Point your agent at A3M instead of OpenAI directly
+client = OpenAI(
+    base_url="http://localhost:8787/v1",  # A3M Router
+    api_key="not-needed"
+)
+
+# Agent makes calls like normal — A3M handles routing
+response = client.chat.completions.create(
+    model="auto",  # ← this triggers intelligent routing
+    messages=[{"role": "user", "content": "What does this function do?"}]
+)
+
+# Agent never knows which provider handled the call
+# It just gets results, faster and cheaper
+```
+
+Zero code changes. The agent SDKs (Claude Code, Cursor, AutoGPT) all support OpenAI-compatible endpoints. Point them at A3M, set model to `"auto"`, and the router handles the rest.
+
+## The Future: Agents That Learn Their Provider Preferences
+
+The next step is persistent memory. A3M already tracks which providers perform best for which query types using exponential moving average (EMA). After a few hundred agent calls, the router learns:
+
+- *"Groq is fastest for code queries from this agent"*
+- *"DeepSeek handles multilingual better"*
+- *"Premium is only needed for architectural decisions"*
+
+The agent doesn't manage this. It doesn't even need to know. The router adapts automatically based on real performance data.
+
+That's the endgame: agents that route intelligently without thinking about it, saving 40-60% on API costs while maintaining or improving output quality.
+
+---
+
+*A3M Router is open source (MIT). 19.5 KB. Zero ML dependencies. Works with any OpenAI-compatible agent framework.*
+
+```bash
+npm install -g adaptive-memory-multi-model-router
+npx a3m-router serve
+# → OpenAI proxy at localhost:8787 — agent SDKs work with zero changes
+```
+
+[github.com/Das-rebel/a3m-router](https://github.com/Das-rebel/a3m-router)

package/articles/CHINESE_DIRECTORIES.md

@@ -0,0 +1,100 @@
+# Chinese AI Directory Submissions
+
+## 9 Platforms to Submit To
+
+### 1. 未来百科 (nav.6ai.cn)
+**URL:** https://nav.6ai.cn (requires manual registration)
+
+### 2. AI工具集 (aigc.cn)
+**URL:** https://aigc.cn (requires manual registration)
+
+### 3. 掘金AI (ai.juejin.cn)
+**URL:** https://ai.juejin.cn (developer community)
+
+### 4. 思否AI (segmentfault.com/ai)
+**URL:** https://segmentfault.com/ai (developer Q&A)
+
+### 5. 开源中国 (oschina.net)
+**URL:** https://oschina.net (open-source community)
+
+### 6. 知乎AI (zhihu.com/topic/ai)
+**URL:** https://zhihu.com/topic/ai (Chinese Quora)
+
+### 7. CSDN (csdn.net)
+**URL:** https://csdn.net (developer community)
+
+### 8. InfoQ中文 (infoq.cn)
+**URL:** https://infoq.cn (tech media)
+
+### 9. 机器之心 (jiqizhixin.com)
+**URL:** https://jiqizhixin.com (AI media)
+
+---
+
+## Chinese Submission Template
+
+```
+项目名称: A3M Router
+
+英文名称: A3M Router
+
+项目描述 (Chinese):
+A3M Router 是一个开源的 LLM 路由代理，在 RouterArena 基准测试中排名第一（70.32分），
+成本仅为 $0.047/1K 查询，比 GPT-5 便宜 213 倍。
+
+核心功能:
+- 🏆 RouterArena 排名第一
+- 💰 $0.047/1K，比 GPT-5 便宜 213 倍
+- ⚡ 12 个关键词信号，<1ms 路由决策
+- 🔄 支持 47+ 提供商：OpenAI、Anthropic、Groq、Cerebras、DeepSeek、Gemini、Mistral
+- 🧠 持久化记忆功能
+- 📦 语义缓存（30%+ 命中率）
+- 🔌 OpenAI 兼容 API
+
+项目地址: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+许可证: MIT
+编程语言: TypeScript/JavaScript, Python
+```
+
+---
+
+## English Template (for platforms that accept English)
+
+```
+Name: A3M Router
+
+Tagline: #1 LLM Routing Benchmark — 213× cheaper than GPT-5
+
+Description:
+A3M Router is an open-source LLM routing proxy that ranks #1 on RouterArena
+(arXiv:2510.00202) with a 70.32 score at $0.047 per 1K queries — 213× cheaper
+than GPT-5.
+
+Key Features:
+- #1 on RouterArena benchmark (70.32/19 routers)
+- $0.047/1K queries — 213× cheaper than GPT-5
+- <1ms routing decision, no GPU required
+- 47+ providers: OpenAI, Anthropic, Groq, Cerebras, DeepSeek, Gemini, Mistral
+- Parallel multi-LLM execution
+- Persistent episodic memory
+- Semantic cache (30%+ hit rate)
+- OpenAI-compatible API
+
+Category: AI Infrastructure / LLM Gateway / Cost Optimization
+
+Website: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+License: MIT
+```
+
+---
+
+## Submission Notes
+
+1. **Register accounts** on each platform first
+2. **Some require Chinese phone number** verification
+3. **Priority order**: 掘金 > CSDN > OSChina (most developer traffic)
+4. **Auto-translate** description using Google Translate if needed
+5. **Add logo** (240x240 recommended)
+6. **Link back** to your GitHub for SEO

package/articles/CHINESE_SUBMISSIONS_READY.md

@@ -0,0 +1,322 @@
+# A3M Router — Chinese Directory Submission Templates
+
+All 9 platforms listed in priority order. Register accounts first, then submit.
+
+---
+
+## Submission Priority Order
+
+| Priority | Platform | URL | Notes |
+|----------|----------|-----|-------|
+| 1 | 掘金AI (juejin) | https://ai.juejin.cn | Most developer traffic, easiest registration |
+| 2 | CSDN | https://www.csdn.net | Huge Chinese dev community |
+| 3 | OSChina (开源中国) | https://www.oschina.net | Open-source community |
+| 4 | 思否AI | https://segmentfault.com/ai | Developer Q&A |
+| 5 | 未来百科 | https://nav.6ai.cn | AI directory |
+| 6 | AI工具集 | https://www.aigc.cn | AI tools directory |
+| 7 | 知乎AI | https://www.zhihu.com/topic/ai | Chinese Quora |
+| 8 | InfoQ中文 | https://www.infoq.cn | Tech media |
+| 9 | 机器之心 | https://www.jiqizhixin.com | AI media |
+
+---
+
+## Template 1: 掘金AI (juejin) — HIGHEST PRIORITY
+
+**URL:** https://ai.juejin.cn/submit
+
+**Registration:** Use GitHub OAuth or手机号登录
+
+**Submission fields:**
+
+```
+项目名称: A3M Router
+
+标签: LLM路由 / 成本优化 / 开源 / API网关
+
+项目描述 (English accepted):
+A3M Router is an open-source LLM routing proxy that ranks #1 on RouterArena
+(70.32 score) at $0.047 per 1K queries — 213x cheaper than GPT-5.
+
+Key Features:
+- #1 on RouterArena benchmark (70.32/19 routers)
+- $0.047/1K queries — 213x cheaper than GPT-5
+- <1ms routing decision, no GPU required
+- 47+ providers: OpenAI, Anthropic, Groq, Cerebras, DeepSeek, Gemini, Mistral
+- Parallel multi-LLM execution
+- Persistent episodic memory
+- OpenAI-compatible API
+
+Category: AI Infrastructure / LLM Gateway
+
+Website: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+License: MIT
+Stars: 8 (growing)
+npm: https://www.npmjs.com/package/adaptive-memory-multi-model-router
+```
+
+---
+
+## Template 2: CSDN
+
+**URL:** https://www.csdn.net (submit article or company page)
+
+**Registration:** 手机号 + 验证码
+
+**Submission fields:**
+
+```
+项目名称: A3M Router
+英文名称: A3M Router
+项目分类: AI开发工具 > AI API和网关
+
+项目简介:
+A3M Router 是开源的 LLM 路由代理，在 RouterArena 基准测试中排名第一
+（70.32分），成本仅为 $0.047/1K 查询，比 GPT-5 便宜 213 倍。
+
+核心功能:
+- 🏆 RouterArena 排名第一
+- 💰 $0.047/1K，比 GPT-5 便宜 213 倍
+- ⚡ 12 个关键词信号，<1ms 路由决策
+- 🔄 支持 47+ 提供商：OpenAI、Anthropic、Groq、Cerebras、DeepSeek、Gemini、Mistral
+- 🧠 持久化记忆功能
+- 📦 语义缓存（30%+ 命中率）
+- 🔌 OpenAI 兼容 API
+
+项目地址: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+许可证: MIT
+编程语言: TypeScript/JavaScript
+```
+
+---
+
+## Template 3: OSChina (开源中国)
+
+**URL:** https://www.oschina.net (login → 发布项目)
+
+**Registration:** 手机号 or GitHub OAuth
+
+**Submission fields:**
+
+```
+项目名称: A3M Router
+
+项目描述:
+A3M Router 是一个开源的 LLM 路由代理，在 RouterArena 基准测试中排名第一（70.32分），
+成本仅为 $0.047/1K 查询，比 GPT-5 便宜 213 倍。
+
+主要特点:
+- RouterArena 排名第一
+- $0.047/1K 查询，比 GPT-5 便宜 213 倍
+- <1ms 路由决策，无需 GPU
+- 支持 47+ 提供商
+- 并行多 LLM 执行
+- 持久化记忆
+- OpenAI 兼容 API
+
+编程语言: TypeScript/JavaScript
+许可证: MIT
+GitHub: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+```
+
+---
+
+## Template 4: 思否AI (SegmentFault)
+
+**URL:** https://segmentfault.com/ai
+
+**Registration:** GitHub OAuth
+
+**Submission fields:**
+
+```
+名称: A3M Router
+
+标签: LLM路由 / 开源 / API网关 / 成本优化
+
+简介:
+开源 LLM 路由代理，RouterArena 排名第一（70.32分），
+$0.047/1K，213倍便宜于 GPT-5。支持 47+ 提供商。
+
+功能:
+- #1 on RouterArena
+- $0.047/1K (vs GPT-5 $10.02)
+- <1ms 路由，无需 ML/GPU
+- 47+ 提供商
+- OpenAI 兼容 API
+
+链接: https://github.com/Das-rebel/a3m-router
+```
+
+---
+
+## Template 5: 未来百科 (nav.6ai.cn)
+
+**URL:** https://nav.6ai.cn
+
+**Registration:** 手机号 verification required
+
+**Submission fields:**
+
+```
+项目名称: A3M Router
+
+项目描述:
+开源 LLM 智能路由工具，根据查询复杂度自动选择最合适的模型，
+大幅降低 AI 推理成本。
+
+核心数据:
+- RouterArena 排名第一: 70.32 分
+- 成本: $0.047/1K 查询
+- 比 GPT-5 便宜 213 倍
+
+链接: https://github.com/Das-rebel/a3m-router
+许可证: MIT
+```
+
+---
+
+## Template 6: AI工具集 (aigc.cn)
+
+**URL:** https://www.aigc.cn
+
+**Registration:** 手机号 verification
+
+**Submission fields:**
+
+```
+名称: A3M Router
+分类: AI开发工具 > LLM路由
+
+简介:
+A3M Router 是一款开源 LLM 路由代理，RouterArena 基准测试第一名，
+成本 $0.047/1K，比 GPT-5 便宜 213 倍，支持 47+ 提供商。
+
+功能列表:
+- RouterArena 第一名
+- 213x 比 GPT-5 便宜
+- 47+ 提供商支持
+- OpenAI 兼容 API
+- 语义缓存
+- 持久化记忆
+
+官网: https://github.com/Das-rebel/a3m-router
+演示: https://asciinema.org/a/RpqOZM9tFMALYWvs
+```
+
+---
+
+## Template 7: 知乎AI (Zhihu)
+
+**URL:** https://www.zhihu.com/topic/ai
+
+**Note:** Posting to 知乎 requires an account with karma. Post an article instead of a topic submission.
+
+**Article template (post to 知乎专栏):**
+
+```
+标题: 我开源了一个 LLM 路由器，成本只有 GPT-5 的 1/213
+
+正文:
+
+背景
+
+大多数 AI 应用把每个查询都发送到 GPT-4o，不管复杂度如何。
+A3M Router 分析每个查询，然后路由到最便宜的合适模型。
+
+核心数据
+
+- RouterArena 排名第一（70.32 分，击败 GPT-5 的 64.32）
+- 成本: $0.047/1K 查询（GPT-5 是 $10.02）
+- 支持 47+ 提供商
+- 62% 成本降低
+
+原理
+
+使用 12 个关键词信号判断查询复杂度，无需 ML 模型，无需 GPU。
+
+示例:
+- "Hi" → Groq（免费层）
+- "Debug my Python code" → DeepSeek ($0.0003/查询)
+- "Explain quantum entanglement" → GPT-4o mini
+
+链接: https://github.com/Das-rebel/a3m-router
+npm: https://www.npmjs.com/package/adaptive-memory-multi-model-router
+```
+
+---
+
+## Template 8: InfoQ中文
+
+**URL:** https://www.infoq.cn
+
+**Registration:** 手机号
+
+**Submission fields:**
+
+```
+标题: A3M Router — 开源 LLM 路由器，RouterArena 排名第一
+
+正文:
+A3M Router 是一款开源 LLM 路由代理，在 RouterArena 基准测试中排名第一
+（70.32分），成本仅为 $0.047/1K 查询。
+
+核心特点:
+- #1 on RouterArena (70.32分)
+- $0.047/1K — 比 GPT-5 便宜 213 倍
+- <1ms 路由决策，无需 ML 训练
+- 47+ 提供商支持
+- OpenAI 兼容 API
+
+项目地址: https://github.com/Das-rebel/a3m-router
+```
+
+---
+
+## Template 9: 机器之心 (jiqizhixin.com)
+
+**URL:** https://www.jiqizhixin.com
+
+**Registration:** 手机号 or 邮箱
+
+**Submission fields:**
+
+```
+项目名称: A3M Router
+
+项目介绍:
+A3M Router 是开源 LLM 路由代理，在 RouterArena 基准测试中排名第一
+（70.32分），$0.047/1K，213倍便宜于 GPT-5。
+
+关键数据:
+- RouterArena: #1 (70.32分 vs GPT-5 64.32分)
+- 成本: $0.047/1K
+- 提供商: 47+
+- 路由延迟: <1ms
+
+官网: https://github.com/Das-rebel/a3m-router
+npm: https://www.npmjs.com/package/adaptive-memory-multi-model-router
+```
+
+---
+
+## Submission Checklist
+
+- [ ] 掘金AI: Register at https://ai.juejin.cn → Submit project
+- [ ] CSDN: Register at https://www.csdn.net → Submit project
+- [ ] OSChina: Register at https://www.oschina.net → Publish project
+- [ ] 思否AI: Register at https://segmentfault.com → Submit to AI section
+- [ ] 未来百科: Register at https://nav.6ai.cn → Submit listing
+- [ ] AI工具集: Register at https://www.aigc.cn → Submit listing
+- [ ] 知乎: Write article about A3M Router in Chinese
+- [ ] InfoQ中文: Register at https://www.infoq.cn → Submit article
+- [ ] 机器之心: Register at https://www.jiqizhixin.com → Submit
+
+**Tips:**
+- Register accounts first, verify phone number if required
+- Use English template for platforms that accept it (掘金, OSChina)
+- Add project logo (240x240) if the platform allows
+- Link back to GitHub for SEO
+- Priority: 掘金 > CSDN > OSChina (most developer traffic)

package/articles/COMPETITOR_ALERTS.md

@@ -0,0 +1,31 @@
+# Competitor Alert Setup (F5bot)
+
+From vault insight: "Set up alerts for competitors' products on HN, Reddit, and X"
+
+## F5bot Setup (5 min)
+1. Go to https://f5bot.com
+2. Sign in with Google/GitHub
+3. Set up alerts for these keywords:
+   - "litellm" (48K★ competitor)
+   - "openrouter" (major competitor)
+   - "portkey" (enterprise gateway)
+   - "llm router" (our category)
+   - "llm gateway" (our category)
+   - "model routing" (related)
+   - "a3m router" (our product)
+4. When you get alerts, comment on those HN/Reddit threads with helpful info about A3M
+
+## ReplyGuy Setup
+1. Go to https://replyguy.com
+2. Set up monitoring for same keywords
+3. Auto-drafts replies you can approve
+
+## Manual HN Search
+Search weekly for:
+- "site:news.ycombinator.com litellm"
+- "site:news.ycombinator.com openrouter"
+- "site:news.ycombinator.com llm router"
+- "site:news.ycombinator.com model routing"
+EOT
+cat >> articles/COMPETITOR_ALERTS.md << 'EOF'
+'