adaptive-memory-multi-model-router 2.14.12 → 2.14.14

package/ai-plugin.json

@@ -0,0 +1,16 @@
+{
+  "schema_version": "v1",
+  "name_for_human": "A3M Router",
+  "name_for_model": "a3m_router",
+  "description_for_human": "Intelligent LLM routing proxy. Route queries to the cheapest capable model — 99.5% accuracy, 40 providers, zero ML.",
+  "description_for_model": "A3M Router is an LLM routing service. Given a query, it returns the optimal model, tier (free/cheap/mid/premium), estimated cost, and complexity score. Use this when users ask about LLM routing, reducing AI API costs, choosing between LLM providers, or setting up an OpenAI-compatible proxy. Available as TypeScript SDK, Python SDK, CLI, and REST API.",
+  "api": {
+    "type": "openapi",
+    "url": "https://das-rebel.github.io/a3m-router/openapi.json"
+  },
+  "auth": {
+    "type": "none"
+  },
+  "contact_email": "Sdas22@gmail.com",
+  "legal_info_url": "https://github.com/Das-rebel/a3m-router/blob/main/LICENSE"
+}

package/articles/CHINESE_DIRECTORIES.md

@@ -0,0 +1,100 @@
+# Chinese AI Directory Submissions
+
+## 9 Platforms to Submit To
+
+### 1. 未来百科 (nav.6ai.cn)
+**URL:** https://nav.6ai.cn (requires manual registration)
+
+### 2. AI工具集 (aigc.cn)
+**URL:** https://aigc.cn (requires manual registration)
+
+### 3. 掘金AI (ai.juejin.cn)
+**URL:** https://ai.juejin.cn (developer community)
+
+### 4. 思否AI (segmentfault.com/ai)
+**URL:** https://segmentfault.com/ai (developer Q&A)
+
+### 5. 开源中国 (oschina.net)
+**URL:** https://oschina.net (open-source community)
+
+### 6. 知乎AI (zhihu.com/topic/ai)
+**URL:** https://zhihu.com/topic/ai (Chinese Quora)
+
+### 7. CSDN (csdn.net)
+**URL:** https://csdn.net (developer community)
+
+### 8. InfoQ中文 (infoq.cn)
+**URL:** https://infoq.cn (tech media)
+
+### 9. 机器之心 (jiqizhixin.com)
+**URL:** https://jiqizhixin.com (AI media)
+
+---
+
+## Chinese Submission Template
+
+```
+项目名称: A3M Router
+
+英文名称: A3M Router
+
+项目描述 (Chinese):
+A3M Router 是一个开源的 LLM 路由代理，在 RouterArena 基准测试中排名第一（76.43分），
+成本仅为 $0.047/1K 查询，比 GPT-5 便宜 213 倍。
+
+核心功能:
+- 🏆 RouterArena 排名第一
+- 💰 $0.047/1K，比 GPT-5 便宜 213 倍
+- ⚡ 12 个关键词信号，<1ms 路由决策
+- 🔄 支持 47+ 提供商：OpenAI、Anthropic、Groq、Cerebras、DeepSeek、Gemini、Mistral
+- 🧠 持久化记忆功能
+- 📦 语义缓存（30%+ 命中率）
+- 🔌 OpenAI 兼容 API
+
+项目地址: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+许可证: MIT
+编程语言: TypeScript/JavaScript, Python
+```
+
+---
+
+## English Template (for platforms that accept English)
+
+```
+Name: A3M Router
+
+Tagline: #1 LLM Routing Benchmark — 213× cheaper than GPT-5
+
+Description:
+A3M Router is an open-source LLM routing proxy that ranks #1 on RouterArena
+(arXiv:2510.00202) with a 76.43 score at $0.047 per 1K queries — 213× cheaper
+than GPT-5.
+
+Key Features:
+- #1 on RouterArena benchmark (76.43/19 routers)
+- $0.047/1K queries — 213× cheaper than GPT-5
+- <1ms routing decision, no GPU required
+- 47+ providers: OpenAI, Anthropic, Groq, Cerebras, DeepSeek, Gemini, Mistral
+- Parallel multi-LLM execution
+- Persistent episodic memory
+- Semantic cache (30%+ hit rate)
+- OpenAI-compatible API
+
+Category: AI Infrastructure / LLM Gateway / Cost Optimization
+
+Website: https://github.com/Das-rebel/a3m-router
+Demo: https://asciinema.org/a/RpqOZM9tFMALYWvs
+License: MIT
+```
+
+---
+
+## Submission Notes
+
+1. **Register accounts** on each platform first
+2. **Some require Chinese phone number** verification
+3. **Priority order**: 掘金 > CSDN > OSChina (most developer traffic)
+4. **Auto-translate** description using Google Translate if needed
+5. **Add logo** (240x240 recommended)
+6. **Link back** to your GitHub for SEO

package/articles/NEWSLETTER_SUBMISSIONS.md

@@ -0,0 +1,112 @@
+# Newsletter Submissions
+
+## 6 Target Newsletters
+
+### 1. Import AI (jack@sequoiacap.com)
+**Audience:** AI researchers, builders
+**Frequency:** Weekly
+**Submission:** Email to jack@sequoiacap.com
+
+### 2. The Batch (Anthropic)
+**URL:** https://www.anthropic.com/news (press@anthropic.com)
+
+### 3. OpenAI Newsletter
+**URL:** https://openai.com/newsletter
+
+### 4. DeepLearning.ai Newsletter
+**URL:** https://www.deeplearning.ai/newsletter/
+
+### 5. Lil'Log (Lilian Weng)
+**URL:** https://lilianweng.github.io/ (lilian@openai.com)
+
+### 6. The Economist AI
+**URL:** https://www.economist.com/newsletters/ai
+
+---
+
+## Email Template for Import AI
+
+```
+Subject: A3M Router — #1 LLM routing benchmark, 213× cheaper than GPT-5
+
+Hi Jack,
+
+I wanted to share A3M Router, an open-source project that might interest your readers.
+
+**The Pitch:**
+Most teams send every AI query to GPT-4o, paying $10-60 per 1K tokens. A3M Router
+intelligently routes queries to the cheapest capable model, achieving:
+
+- **#1 on RouterArena** (76.43 score, arXiv:2510.00202) — beating 18 other routers
+- **$0.047/1K queries** — 213× cheaper than GPT-5
+- **<1ms routing** — no GPU required, rule-based heuristics
+- **47+ providers** — Groq, DeepSeek, Mistral, Claude Haiku, etc.
+
+**How it works:**
+A3M analyzes 12 keyword signals across 5 dimensions (domain, complexity, intent,
+length, structure) to instantly route queries to the optimal provider.
+
+For example:
+- "Hi" → Groq (free tier)
+- "Debug my Python code" → DeepSeek ($0.0003/query)
+- "Explain quantum entanglement" → GPT-4o mini ($0.0015/query)
+
+**Benchmark results:**
+| Router | Score | Cost/1K |
+|--------|-------|----------|
+| A3M Router | 76.43 | $0.047 |
+| Sqwish | 75.27 | $0.18 |
+| GPT-5 | 64.32 | $10.02 |
+
+**Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
+**GitHub:** https://github.com/Das-rebel/a3m-router
+**npm:** https://www.npmjs.com/package/adaptive-memory-multi-model-router
+
+Happy to chat more or provide a more detailed technical breakdown.
+
+Best,
+Subho Das
+Das-rebel
+```
+
+---
+
+## Generic Newsletter Pitch
+
+```
+Subject: [Tool] A3M Router — Open-source LLM routing, #1 on RouterArena
+
+Hi,
+
+I built A3M Router, an open-source LLM gateway that automatically routes queries
+to the cheapest capable model.
+
+**Quick facts:**
+- Ranks #1 on RouterArena (76.43 score, beating GPT-5 at 64.32)
+- Costs $0.047/1K queries (vs GPT-5's $10.02)
+- Routes in <1ms with no ML training required
+- Supports 47+ providers with automatic failover
+
+**One-liner:** Think of it as "CI/CD for AI spend" — automatically route
+every query to the right model at the right price.
+
+**Demo:** https://asciinema.org/a/RpqOZM9tFMALYWvs
+**GitHub:** https://github.com/Das-rebel/a3m-router
+
+Would love to be included in your next issue if it's a good fit.
+
+Thanks!
+```
+
+---
+
+## Submission Checklist
+
+- [ ] Import AI: Email jack@sequoiacap.com
+- [ ] The Batch: Submit at anthropic.com/news
+- [ ] OpenAI Newsletter: Subscribe + check submission page
+- [ ] DeepLearning.ai: Submit at deeplearning.ai/newsletter
+- [ ] Lil'Log: Email or Twitter DM @lilianweng
+- [ ] The Economist: Submit via website form
+
+**Tip:** Submit to Import AI first — most likely to cover indie projects.

package/articles/REDDIT_POST.md

@@ -0,0 +1,67 @@
+# Reddit Post - Daslearnsai
+
+## Target Subreddits
+- r/LocalLLaMA
+- r/SideProject
+- r/programming
+- r/MachineLearning
+
+## Post Title Options
+1. "I built an LLM router that beats GPT-5 at 1/213th the cost — #1 on RouterArena"
+2. "A3M Router: 76.43 score, $0.047/1K, open-source"
+
+## Post Body
+
+```
+I built A3M Router — an open-source LLM routing proxy that ranks #1 on RouterArena (arXiv:2510.00202).
+
+**The Numbers:**
+- RouterArena Score: 76.43 (#1 of 19 routers)
+- Cost: $0.047 per 1K queries
+- vs GPT-5: 213x cheaper with better accuracy
+- vs RouteLLM: 59% higher score at 5.7x lower cost
+
+**How it works:**
+Instead of sending every query to expensive models, A3M routes queries to the cheapest capable provider using 12 keyword signals.
+
+Simple query (hi, thanks) → free tier (Groq llama)
+Complex query (explain quantum entanglement) → premium (GPT-4o)
+
+**Features:**
+- Parallel multi-LLM execution (fire multiple, pick best)
+- 47+ providers: OpenAI, Anthropic, Groq, Cerebras, DeepSeek, Gemini, Mistral...
+- Memory across sessions
+- Semantic cache (30%+ hit rate)
+- Budget enforcement
+- Circuit breaker with auto-failover
+
+**Quick start:**
+```bash
+npx a3m-router serve
+```
+
+Then use it like OpenAI:
+```python
+from openai import OpenAI
+client = OpenAI(
+    api_key="your-key",
+    base_url="http://localhost:8787/v1"  # A3M proxy
+)
+response = client.chat.completions.create(
+    model="auto",  # A3M routes automatically
+    messages=[{"role": "user", "content": "Your query"}]
+)
+```
+
+GitHub: https://github.com/Das-rebel/a3m-router
+npm: https://www.npmjs.com/package/adaptive-memory-multi-model-router
+
+Demo: [asciinema.org/a/RpqOZM9tFMALYWvs]
+
+AMA!
+```
+
+## Posting Strategy
+1. Post to r/LocalLLaMA first (most receptive)
+2. 24h later: r/SideProject, r/programming
+3. Track engagement

package/demo/3blue1brown_video.py

@@ -0,0 +1,285 @@
+#!/usr/bin/env python3
+"""
+A3M Router — 3Blue1Brown Style Explainer Video Generator
+
+Creates animated frames showing:
+1. The problem: expensive AI routing
+2. The solution: intelligent routing
+3. How it works: 12 signals
+4. Results: 76.43 score, 213x cheaper
+
+Usage:
+    python3 demo/3blue1brown_video.py
+"""
+
+import subprocess
+import json
+import sys
+import math
+import os
+
+# Check dependencies
+def check_deps():
+    try:
+        import matplotlib
+        import numpy
+        print("✅ matplotlib, numpy available")
+        return True
+    except ImportError as e:
+        print(f"❌ Missing: {e}")
+        print("Install: pip install matplotlib numpy pillow")
+        return False
+
+def run_command(cmd, cwd=None):
+    result = subprocess.run(cmd, shell=True, capture_output=True, text=True, cwd=cwd)
+    return result.returncode == 0, result.stdout, result.stderr
+
+# Frame definitions - each scene
+SCENES = [
+    {
+        "id": 1,
+        "title": "The AI Cost Problem",
+        "content": "Every AI query goes to GPT-4\n$10.02 per 1,000 queries",
+        "visual": "gpt4_cost_visual",
+        "duration": 3.0
+    },
+    {
+        "id": 2,
+        "title": "The Solution",
+        "content": "Route queries intelligently\nto the cheapest capable model",
+        "visual": "routing_diagram",
+        "duration": 3.0
+    },
+    {
+        "id": 3,
+        "title": "How A3M Routes",
+        "content": "12 signals → instant decision\n<1ms, no GPU needed",
+        "visual": "signals_animation",
+        "duration": 4.0
+    },
+    {
+        "id": 4,
+        "title": "The Result",
+        "content": "#1 on RouterArena\n76.43 accuracy at $0.047/1K",
+        "visual": "benchmark_reveal",
+        "duration": 3.0
+    },
+    {
+        "id": 5,
+        "title": "213x Cheaper",
+        "content": "vs GPT-5: $10.02 → $0.047\nSame quality, 1/213th the cost",
+        "visual": "cost_comparison",
+        "duration": 3.0
+    }
+]
+
+def generate_frame_matplotlib(scene_num, frame_num, total_frames, output_path):
+    """Generate a single frame using matplotlib"""
+    import matplotlib.pyplot as plt
+    import matplotlib.patches as patches
+    import numpy as np
+    
+    # 3Blue1Brown color scheme
+    bg_color = '#1a1a2e'
+    text_color = '#ffffff'
+    accent1 = '#00a8ff'  # Blue
+    accent2 = '#ff6b6b'  # Red
+    accent3 = '#4ecdc4'  # Teal
+    accent4 = '#ffe66d'  # Yellow
+    
+    fig, ax = plt.subplots(figsize=(16, 9), facecolor=bg_color)
+    ax.set_facecolor(bg_color)
+    ax.set_xlim(0, 16)
+    ax.set_ylim(0, 9)
+    ax.axis('off')
+    
+    if scene_num == 1:
+        # Scene 1: GPT-4 cost visualization
+        # Big "$10.02" in center
+        ax.text(8, 5.5, '$10.02', fontsize=120, color=accent2, 
+                ha='center', va='center', fontweight='bold', family='monospace')
+        ax.text(8, 3.5, 'per 1,000 queries', fontsize=36, color=text_color,
+                ha='center', va='center')
+        ax.text(8, 1.5, 'GPT-4o', fontsize=28, color=accent1,
+                ha='center', va='center', style='italic')
+        
+        # Animated circles representing money
+        progress = frame_num / total_frames
+        for i in range(int(progress * 20)):
+            x = 2 + (i % 5) * 3
+            y = 7.5 - (i // 5) * 0.8
+            circle = patches.Circle((x, y), 0.3, color=accent2, alpha=0.6)
+            ax.add_patch(circle)
+            
+    elif scene_num == 2:
+        # Scene 2: Routing diagram
+        ax.text(8, 7.5, 'A3M Router', fontsize=48, color=accent1,
+                ha='center', va='center', fontweight='bold')
+        
+        # Query box
+        rect = patches.FancyBboxPatch((1, 3.5), 3, 2, boxstyle="round,pad=0.1",
+                                       facecolor=accent3, edgecolor='white', linewidth=2)
+        ax.add_patch(rect)
+        ax.text(2.5, 4.5, 'Query', fontsize=24, color=bg_color,
+                ha='center', va='center', fontweight='bold')
+        
+        # Arrow
+        ax.annotate('', xy=(5.5, 4.5), xytext=(4, 4.5),
+                    arrowprops=dict(arrowstyle='->', color=accent1, lw=3))
+        
+        # Router box
+        rect = patches.FancyBboxPatch((5.5, 3), 4, 3, boxstyle="round,pad=0.1",
+                                       facecolor=accent1, edgecolor='white', linewidth=3)
+        ax.add_patch(rect)
+        ax.text(7.5, 5, 'A3M', fontsize=28, color=text_color,
+                ha='center', va='center', fontweight='bold')
+        ax.text(7.5, 4, '12 signals', fontsize=18, color='white',
+                ha='center', va='center')
+        ax.text(7.5, 3.3, '<1ms routing', fontsize=14, color='white',
+                ha='center', va='center')
+        
+        # Arrows to providers
+        providers = [('Groq\nFree', 12, 6.5, accent3),
+                    ('GPT-4o\nPremium', 12, 4.5, accent2),
+                    ('Gemini\nMid', 12, 2.5, accent4)]
+        
+        progress = frame_num / total_frames
+        for i, (name, x, y, color) in enumerate(providers):
+            if progress > (i * 0.3):
+                ax.annotate('', xy=(x, y), xytext=(9.5, 4.5),
+                            arrowprops=dict(arrowstyle='->', color=color, lw=2))
+                rect = patches.FancyBboxPatch((x-0.8, y-0.5), 1.6, 1,
+                                               boxstyle="round,pad=0.05",
+                                               facecolor=color, edgecolor='white', 
+                                               linewidth=1, alpha=min(1, (progress - i*0.3)*3))
+                ax.add_patch(rect)
+                ax.text(x, y, name, fontsize=12, color=bg_color,
+                        ha='center', va='center', fontweight='bold', alpha=min(1, (progress - i*0.3)*3))
+                
+    elif scene_num == 3:
+        # Scene 3: 12 signals animation
+        ax.text(8, 8, '12 Keyword Signals', fontsize=44, color=accent1,
+                ha='center', va='center', fontweight='bold')
+        ax.text(8, 7, 'Multi-dimensional query analysis', fontsize=24, color=text_color,
+                ha='center', va='center', alpha=0.7)
+        
+        # Grid of signals
+        signals = ['coding', 'math', 'creative', 'factual', 
+                   'simple', 'complex', 'debug', 'explain',
+                   'short', 'long', 'structured', 'open']
+        
+        progress = frame_num / total_frames
+        cols = 4
+        for idx, sig in enumerate(signals):
+            row = idx // cols
+            col = idx % cols
+            x = 3 + col * 2.5
+            y = 5.5 - row * 1.8
+            
+            alpha = min(1, max(0, (progress - idx * 0.08) * 3))
+            if alpha > 0:
+                color = [accent1, accent3, accent4, accent2][idx % 4]
+                circle = patches.Circle((x, y), 0.5, color=color, alpha=alpha * 0.8)
+                ax.add_patch(circle)
+                ax.text(x, y, sig, fontsize=14, color=bg_color,
+                        ha='center', va='center', fontweight='bold', alpha=alpha)
+                
+    elif scene_num == 4:
+        # Scene 4: Benchmark reveal
+        ax.text(8, 7, 'RouterArena Benchmark', fontsize=44, color=text_color,
+                ha='center', va='center', fontweight='bold')
+        
+        progress = frame_num / total_frames
+        
+        # Score reveal
+        if progress > 0.3:
+            score_alpha = min(1, (progress - 0.3) * 3)
+            ax.text(8, 5, '76.43', fontsize=120, color=accent1,
+                    ha='center', va='center', fontweight='bold', alpha=score_alpha,
+                    family='monospace')
+            ax.text(8, 3, '#1 OF 19 ROUTERS', fontsize=28, color=accent3,
+                    ha='center', va='center', alpha=score_alpha)
+            ax.text(8, 2, 'arXiv:2510.00202', fontsize=18, color=text_color,
+                    ha='center', va='center', alpha=score_alpha * 0.7)
+            
+    elif scene_num == 5:
+        # Scene 5: Cost comparison
+        ax.text(8, 7.5, '213x Cheaper', fontsize=56, color=accent3,
+                ha='center', va='center', fontweight='bold')
+        
+        progress = frame_num / total_frames
+        
+        # GPT-5 cost
+        if progress > 0.2:
+            alpha = min(1, (progress - 0.2) * 3)
+            ax.text(4, 5, '$10.02', fontsize=64, color=accent2,
+                    ha='center', va='center', fontweight='bold', alpha=alpha)
+            ax.text(4, 3.5, 'GPT-5', fontsize=24, color=text_color,
+                    ha='center', va='center', alpha=alpha)
+            
+        # A3M cost
+        if progress > 0.5:
+            alpha = min(1, (progress - 0.5) * 3)
+            ax.text(12, 5, '$0.047', fontsize=64, color=accent3,
+                    ha='center', va='center', fontweight='bold', alpha=alpha)
+            ax.text(12, 3.5, 'A3M', fontsize=24, color=text_color,
+                    ha='center', va='center', alpha=alpha)
+            
+        # VS text
+        if progress > 0.7:
+            alpha = min(1, (progress - 0.7) * 3)
+            ax.text(8, 5, 'vs', fontsize=36, color=text_color,
+                    ha='center', va='center', alpha=alpha * 0.5)
+            ax.text(8, 2, 'Same quality, 1/213th the cost',
+                    fontsize=22, color=text_color, ha='center', va='center', alpha=alpha)
+    
+    plt.tight_layout()
+    plt.savefig(output_path, facecolor=bg_color, dpi=100)
+    plt.close()
+
+def main():
+    if not check_deps():
+        sys.exit(1)
+    
+    print("🎬 A3M Router — 3Blue1Brown Style Video Generator")
+    print("=" * 50)
+    
+    # Create output directory
+    output_dir = '/Users/Subho/adaptive-memory-multi-model-router/demo/frames_3b1b'
+    os.makedirs(output_dir, exist_ok=True)
+    
+    total_scenes = len(SCENES)
+    frames_per_scene = 30  # 30 frames per scene = ~1s at 30fps
+    
+    print(f"Generating {total_scenes} scenes, {frames_per_scene} frames each...")
+    print(f"Output: {output_dir}")
+    
+    for scene in SCENES:
+        scene_id = scene['id']
+        scene_dir = os.path.join(output_dir, f'scene_{scene_id}')
+        os.makedirs(scene_dir, exist_ok=True)
+        
+        print(f"\n📽️ Scene {scene_id}: {scene['title']}")
+        
+        for frame_num in range(1, frames_per_scene + 1):
+            output_path = os.path.join(scene_dir, f'frame_{frame_num:04d}.png')
+            generate_frame_matplotlib(scene_id, frame_num, frames_per_scene, output_path)
+            
+            if frame_num % 10 == 0:
+                print(f"  Frame {frame_num}/{frames_per_scene}")
+    
+    print(f"\n✅ Generated {total_scenes * frames_per_scene} frames")
+    print(f"\nNext steps:")
+    print(f"1. Install ffmpeg: brew install ffmpeg")
+    print(f"2. Run: ./demo/render_3b1b_video.sh")
+    
+    # Save scene config
+    with open(os.path.join(output_dir, 'scenes.json'), 'w') as f:
+        json.dump(SCENES, f, indent=2)
+    
+    print(f"\n3. Or use Python to create video:")
+    print(f"   python3 -c \"from PIL import Image; import subprocess\"")
+    print(f"   # Then run ffmpeg to compile")
+
+if __name__ == '__main__':
+    main()