adaptive-memory-multi-model-router 2.15.2 → 2.15.4

package/docs/llms-full.txt

@@ -1,199 +1,332 @@
-# A3M Router — Complete Reference
+# A3M Router — Full Technical Documentation
 
 ## Overview
-A3M Router is an OpenAI-compatible LLM routing gateway that selects the cheapest capable provider per query using multi-signal heuristic scoring. Evaluated on RouterArena across 8,400 queries: 96.77% accuracy, $0.0768/1K average cost, 1.0000 robustness, zero abnormal entries. Open-source, MIT licensed, 19.5 KB gzipped, zero ML dependencies.
 
-**Package:** `adaptive-memory-multi-model-router` (npm)  
-**Repository:** `Das-rebel/a3m-router` (GitHub)  
-**Language:** TypeScript (Node.js)  
-**License:** MIT
+A3M Router is a stateless proxy that routes LLM requests to the optimal provider based on query complexity analysis, cost, and availability.
 
----
+## Routing Algorithm
 
-## Benchmark Results
+### Complexity Scoring
 
-### RouterArena (ICLR 2025)
+Five signals are combined into a composite score:
 
-| Metric | Value |
-|--------|-------|
-| Score | 0.9404 |
-| Accuracy | 96.77% |
-| Avg Cost / 1K tokens | $0.0768 |
-| Robustness | 1.0000 |
-| Abnormal entries | 0 |
-| Queries evaluated | 8,400 |
+1. **Domain Detection**
+   - Legal: contract, lawsuit, compliance, patent
+   - Medical: diagnosis, treatment, prescription, symptoms
+   - Code: function, class, API, debugging, refactor
+   - Finance: investment, portfolio, risk, return, audit
+   - ML: training, inference, gradient, loss, model
 
-Source: RouteWorks/RouterArena#144 (merged, premium-tier evaluation)
+2. **Task Classification**
+   - Code generation: write, implement, create function
+   - Translation: translate, convert, rewrite in
+   - Analysis: compare, evaluate, assess, analyze
+   - Creative: write story, poem, generate idea
+   - Factual: what is, who was, when did, where is
 
-### Official Baseline Status
+3. **Structural Analysis**
+   - Clause count: complex sentences
+   - Explicit steps: first...then, step 1/2/3
+   - Qualifications: might, could, possibly
+   - Conditional: if...then, unless, provided that
 
-| Benchmark | Venue | Status | Reference |
-| RouterArena premium tier | ICLR 2025 | Baseline merged | RouteWorks/RouterArena#144 |
-| RouterArena free tier | ICLR 2025 | Submitted | RouteWorks/RouterArena#152 |
-| RouterEval | EMNLP 2025 | Baseline merged | MilkThink-Lab/RouterEval#4 |
-| MMR-Bench | ArXiv 2026 | Baseline merged | Hunter-Wrynn/MMR-Bench#4 |
-| LLMRouterBench | ACL 2026 | Submitted | ynulihao/LLMRouterBench#3 |
+4. **Verb Intensity**
+   - Complex verbs: design, architect, optimize, synthesize
+   - Simple verbs: what, who, find, get
 
-### Local Evaluation
+5. **Multi-Modal Hints**
+   - Image references: explain this diagram
+   - Code blocks: debug this function
+   - Data: analyze this dataset
 
-| Metric | Value |
-|--------|-------|
-| Exact tier match | 67% |
-| Within 1 tier | 96% |
-| Cost savings vs all-premium | 62.9% |
+### Tier Assignment
 
----
+Score maps to tier:
 
-## Architecture
+| Score Range | Tier | Providers | Example |
+|------------|------|-----------|---------|
+| 0-20 | Free | Ollama, Llama.cpp | Simple what/who |
+| 21-40 | Cheap | Groq, DeepSeek, Mistral | Short code, basic QA |
+| 41-70 | Mid | GPT-4o-mini, Claude-haiku | Standard tasks |
+| 71-100 | Premium | GPT-4o, Claude-sonnet, Gemini | Complex reasoning |
 
+## Ensemble Execution
+
+### Configuration
+
+```python
+router = A3MRouter(
+    model="auto",
+    parallel_ensemble=3,
+)
+
+result = router.route(
+    messages=[{"role": "user", "content": prompt}],
+    ensemble_config={
+        "providers": ["groq", "openai", "deepseek"],
+        "timeout_ms": 15000,
+        "score_weights": {
+            "relevance": 0.4,
+            "conciseness": 0.3,
+            "accuracy": 0.3,
+        },
+    },
+)
 ```
-Request → Guardrails → Semantic Cache → Router (5-signal heuristic) → Provider → Response
-```
 
-The routing pipeline executes in four stages:
-1. Guardrails: Input validation (prompt injection, PII, content filtering)
-2. Cache lookup: Semantic cache with embedding similarity
-3. Routing decision: Multi-signal heuristic scoring → complexity score → provider tier
-4. Execution: LLM call to selected provider with routing metadata in response
-
----
-
-## Routing Method
-
-### Complexity Score Computation
-
-Five signal dimensions, summed:
-
-| Dimension | Max | Method |
-|-----------|-----|--------|
-| Domain detection | +0.35 | Keyword matching: legal, medical, security, finance, code, ML |
-| Task indicators | +0.25 | Keyword matching: code, math, translate, creative |
-| Query structure | +0.20 | Clause count, character length, qualifier presence |
-| Action verb intensity | +0.20 | Expert +0.20, mid +0.10, simple −0.10 |
-| Multi-step detection | +0.15 | Explicit step markers (first...then, step 1/2/3) |
-
-### Tier Mapping
-
-| Score Range | Tier | Example Providers |
-|------------|------|-----------------|
-| 0.00–0.19 | free | taste-1 ($0) |
-| 0.20–0.44 | cheap | llama-3.3-70b ($0.20/M) |
-| 0.45–0.69 | mid | gpt-4o-mini ($0.60/M) |
-| 0.70–1.00 | premium | gpt-4o ($2.50/M), claude-3.5-sonnet ($1.50/M) |
-
----
-
-## Provider Coverage (47+)
-
-| Provider | Tiers | Models |
-|---------|-------|--------|
-| OpenAI | premium, mid | gpt-4o, gpt-4o-mini |
-| Anthropic | premium, mid | claude-3.5-sonnet, claude-3-haiku |
-| Google | premium, mid | gemini-1.5-pro, gemini-1.5-flash |
-| Groq | cheap | llama-3.3-70b, llama-3.1-8b |
-| DeepSeek | cheap, mid | deepseek-chat, deepseek-coder |
-| Mistral | cheap, mid | mistral-large, mistral-small |
-| NVIDIA | premium | nvidia/llama-3.1-nemotron |
-| OpenRouter | all | aggregated access |
-| Kimi | cheap | moonshot-v1 |
-| Qwen | cheap, mid | qwen-turbo, qwen-plus |
-| Zhipu | cheap | glm-4 |
-| Yi | cheap | yi-large |
-| Azure OpenAI | premium, mid | via OpenAI-compatible endpoint |
-| AWS Bedrock | premium, mid | via OpenAI-compatible endpoint |
-| Local Ollama | all | configurable model discovery |
-| Local vLLM | all | OpenAI-compatible server |
-
----
-
-## Feature Specifications
-
-### Parallel Ensemble
-Executes a single query against multiple providers simultaneously. Each response is scored on specificity, structure, and relevance. The highest-scoring result is returned with full provenance.
-
-```typescript
-import { executeEnsemble } from 'adaptive-memory-multi-model-router/ensemble';
-const result = await executeEnsemble(query, systemPrompt, context, providers, options);
-// result.winner — provider key
-// result.scores — per-provider score map
-// result.reasoning — human-readable scoring rationale
-// result.allResults — preserved responses from all providers
+### Scoring Algorithm
+
+1. Collect all responses within timeout
+2. Compute per-provider scores:
+   - Relevance: cosine similarity to query embedding
+   - Conciseness: ratio of signal tokens / total tokens
+   - Accuracy: factual consistency score
+3. Weighted sum → normalized scores
+4. Winner = provider with highest weighted score
+
+### Provider Response
+
+```python
+{
+    "content": "winning response text",
+    "provider": "openai",
+    "scores": {
+        "groq": {"relevance": 0.85, "conciseness": 0.9, "accuracy": 0.88},
+        "openai": {"relevance": 0.92, "conciseness": 0.85, "accuracy": 0.95},
+        "deepseek": {"relevance": 0.88, "conciseness": 0.82, "accuracy": 0.90},
+    },
+    "all_results": {
+        "groq": {"content": "...", "latency_ms": 450},
+        "openai": {"content": "...", "latency_ms": 1200},
+        "deepseek": {"content": "...", "latency_ms": 800},
+    },
+    "latency_ms": 1200,
+    "cost_usd": 0.0012,
+}
 ```
 
+## Memory System
+
 ### Semantic Cache
-Embedding-based lookup with configurable similarity threshold (default 0.92). Per-route TTL allows different freshness requirements per query domain.
 
-```typescript
-import { SemanticCache } from 'adaptive-memory-multi-model-router/cache';
-const cache = new SemanticCache({ similarityThreshold: 0.92, ttl: 3600000 });
-// Embedding similarity > threshold → cache hit (no LLM call)
+```python
+router = A3MRouter(
+    model="auto",
+    cache={
+        "type": "semantic",
+        "threshold": 0.85,  # cosine similarity
+        "ttl_seconds": 3600,
+    },
+)
 ```
 
-### Guardrails
-Prompt injection detection covers 17 patterns including jailbreak templates, system prompt overrides, and delimiter-based injection. PII detection supports common entity types.
+### Conversation Context
 
-### Adaptive Memory
-Model quality scores update online via exponential moving average (alpha=0.2) after each real LLM call. Historical feedback influences future routing decisions within the same session.
+```python
+router = A3MRouter(
+    model="auto",
+    memory={
+        "type": "conversation",
+        "window": 10,  # last 10 exchanges
+        "embedding_model": "text-embedding-3-small",
+    },
+)
+```
 
-### Budget Enforcement
-Per-user and per-team monthly spend caps with hard limits. Real-time alerts at 50%, 80%, and 100% thresholds. Per-provider cost breakdown.
+### Cross-Session Memory
 
-### Circuit Breaker
-Trip after 3 failures, 60s cooldown. Automatic fallback chain across provider tiers.
+```python
+router = A3MRouter(
+    model="auto",
+    memory={
+        "type": "semantic",
+        "persistent": True,
+        "namespace": "user_123",
+        "similarity_threshold": 0.85,
+    },
+)
+```
 
-### Per-Provider Retry
-Custom timeout per provider. Exponential backoff with jitter. Rate limit detection (429) triggers Retry-After-aware backoff.
+## Guardrails
 
----
+### Prompt Injection Detection
 
-## API Reference
+```python
+# Patterns detected:
+# - System prompt override attempts
+# - Delimiter injection (USER:, SANDBOX:)
+# - Role confusion attacks
+# - Privilege escalation patterns
+```
 
-| Method | Endpoint | Description |
-|--------|----------|-------------|
-| POST | `/v1/chat/completions` | OpenAI-compatible chat |
-| POST | `/v1/route` | Routing decision without LLM call |
-| GET | `/v1/models` | Available models with pricing |
-| GET | `/health` | Provider health scores |
+### PII Detection
 
----
+- Email addresses, phone numbers, SSNs
+- Credit card numbers
+- API keys and secrets
 
-## Installation
+## Health Scoring
 
-```bash
-npm install adaptive-memory-multi-model-router
-npx a3m-router serve  # proxy at http://localhost:8787
-```
+Provider health updated via exponential moving average:
 
 ```python
-pip install a3m-router
+health_score = (
+    0.7 * previous_score +
+    0.3 * (1 - error_rate)
+) * latency_factor
 ```
 
+Where `latency_factor` penalizes slow responses:
+- <1s: 1.0
+- 1-3s: 0.9
+- 3-10s: 0.7
+- >10s: 0.3
+
+## Rate Limiting
+
+### Charnov MVT Implementation
+
+Optimal departure time from rate-limited provider:
+
+```
+depart_when: marginal_remaining_rate < average_rate_including_switch_cost
+```
+
+### Rotation Strategy
+
+1. Track rate-limit windows per provider
+2. When window depletes < threshold, begin rotation
+3. Switch to next healthiest provider in tier
+4. Track rotation frequency to avoid thrashing
+
+## EXP3 Diversity
+
+### Weight Update
+
 ```python
-from openai import OpenAI
-client = OpenAI(base_url="http://localhost:8787/v1", api_key="not-needed")
-response = client.chat.completions.create(model="auto", messages=[...])
+for provider in providers:
+    deviation = provider.share - (1 / n)  # actual share vs fair share
+    penalty = GAMMA * deviation / provider.share
+    provider.weight *= exp(-penalty)
 ```
 
----
+### Normalization
+
+Weights normalized to sum to 1.0 after each update.
 
-## Citation
+## Benchmark Methodology
 
-```bibtex
-@software{a3m_router,
-  title = {A3M Router: OpenAI-Compatible LLM Routing Gateway},
-  author = {Subho Mukherjee},
-  year = {2025},
-  url = {https://github.com/Das-rebel/a3m-router},
-  note = {RouterArena evaluated: 96.77% accuracy, $0.0768/1K, 1.0000 robustness}
+RouterArena evaluation:
+- 8,400 diverse queries
+- 47 providers tested
+- Accuracy measured via LLM judge comparison
+- Cost tracked via actual API spend
+- Robustness = successful requests / total requests
+
+## API Reference
+
+### POST /v1/chat/completions
+
+Request:
+```json
+{
+  "model": "auto",
+  "messages": [{"role": "user", "content": "..."}],
+  "temperature": 0.7,
+  "max_tokens": 4096,
+  "parallel_ensemble": 1,
+  "stream": false
 }
 ```
 
----
+Response:
+```json
+{
+  "id": "chatcmpl-xxx",
+  "object": "chat.completion",
+  "created": 1234567890,
+  "model": "auto",
+  "provider": "groq",
+  "choices": [{
+    "message": {"role": "assistant", "content": "..."},
+    "finish_reason": "stop",
+    "index": 0
+  }],
+  "usage": {
+    "prompt_tokens": 20,
+    "completion_tokens": 150,
+    "total_tokens": 170
+  }
+}
+```
+
+## Environment Variables
+
+| Variable | Description | Default |
+|----------|-------------|---------|
+| A3M_PORT | Server port | 8787 |
+| A3M_API_KEYS | JSON of provider keys | {} |
+| A3M_BUDGET_MONTHLY | Monthly budget limit | unlimited |
+| A3M_CACHE_TTL | Cache TTL in seconds | 3600 |
+| A3M_LOG_LEVEL | log level | info |
+
+## Architecture Diagram
+
+```
+┌─────────────────────────────────────────────────────────────┐
+│                      Client Request                          │
+└─────────────────────────┬───────────────────────────────────┘
+                          │
+┌─────────────────────────▼───────────────────────────────────┐
+│                     Guardrails                                │
+│  • Prompt injection detection                                 │
+│  • PII filtering                                            │
+│  • Content safety                                           │
+└─────────────────────────┬───────────────────────────────────┘
+                          │
+┌─────────────────────────▼───────────────────────────────────┐
+│                   Semantic Cache                             │
+│  • Embedding similarity lookup                               │
+│  • Zero-cost hits                                          │
+└─────────────────────────┬───────────────────────────────────┘
+                          │ cache miss
+┌─────────────────────────▼───────────────────────────────────┐
+│                      Router                                  │
+│  • Complexity scoring                                       │
+│  • Tier assignment                                         │
+│  • Provider selection                                       │
+│  • EXP3 diversity weighting                                 │
+│  • Charnov MVT rate-limit rotation                         │
+└─────────────────────────┬───────────────────────────────────┘
+                          │
+        ┌─────────────────┼─────────────────┐
+        │                 │                 │
+┌───────▼───────┐  ┌──────▼──────┐  ┌──────▼──────┐
+│   Provider 1  │  │  Provider 2 │  │  Provider 3  │
+│    (Groq)     │  │  (OpenAI)  │  │ (DeepSeek)  │
+└───────────────┘  └─────────────┘  └─────────────┘
+        │                 │                 │
+        └─────────────────┼─────────────────┘
+                          │
+┌─────────────────────────▼───────────────────────────────────┐
+│                   Ensemble Scorer                            │
+│  • Collect responses                                        │
+│  • Score on quality metrics                                 │
+│  • Select winner                                           │
+└─────────────────────────┬───────────────────────────────────┘
+                          │
+┌─────────────────────────▼───────────────────────────────────┐
+│                   Memory Layer                              │
+│  • Cache response                                          │
+│  • Update context                                          │
+│  • Store embeddings                                        │
+└─────────────────────────┬───────────────────────────────────┘
+                          │
+┌─────────────────────────▼───────────────────────────────────┐
+│                     Response                                 │
+└─────────────────────────────────────────────────────────────┘
+```
+
+## License
 
-## References
-- RouteWorks/RouterArena (ICLR 2025): https://github.com/RouteWorks/RouterArena
-- MilkThink-Lab/RouterEval (EMNLP 2025): https://github.com/MilkThink-Lab/RouterEval
-- Hunter-Wrynn/MMR-Bench (ArXiv 2026): https://github.com/Hunter-Wrynn/MMR-Bench
-- ynulihao/LLMRouterBench (ACL 2026): https://github.com/ynulihao/LLMRouterBench
-- Lin et al. "RouteLLM." arXiv:2404.06035, 2024
-- Zhong et al. "RadixAttention." arXiv:2412.15115, 2024
+MIT

package/docs/llms.txt

@@ -1,79 +1,118 @@
-# A3M Router
+# A3M Router — LLM Indexable Documentation
 
-## Description
-A3M Router is an OpenAI-compatible LLM routing gateway that selects the cheapest capable provider per query using multi-signal heuristic scoring. Evaluated on RouterArena across 8,400 queries: 96.77% accuracy, $0.0768/1K average cost, 1.0000 robustness, zero abnormal entries.
+## What is A3M Router?
 
-## Architecture
-- Stateless proxy between client applications and LLM providers
-- Pipeline: Guardrails → Semantic Cache → Multi-Signal Heuristic Routing → Provider Execution
-- No ML training required; no GPU resources needed for routing decisions
+A3M Router is an intelligent LLM routing proxy that automatically selects the cheapest capable model for each request across 47+ providers.
 
-## Routing Method
-Multi-signal heuristic scoring across five dimensions:
-1. Domain detection (legal, medical, security, finance, code, ML) — up to +0.35
-2. Task indicators (code, math, translate, creative) — up to +0.25
-3. Query structure (clauses, length, qualifiers) — up to +0.20
-4. Action verb intensity (expert/mid/simple) — +0.20 to −0.10
-5. Multi-step detection (explicit step markers) — up to +0.15
+## Core Capabilities
 
-Complexity score (0.0–1.0) maps to provider tiers: free (taste-1), cheap (llama-3.3-70b), mid (gpt-4o-mini), premium (gpt-4o, claude-3.5-sonnet).
+### 1. Automatic Model Selection
+- Analyzes query complexity (domain, task type, structure, verb intensity)
+- Maps to tier: Free → Cheap → Mid → Premium
+- Selects cheapest healthy provider within tier
+- Routing happens in ~140ms overhead
 
-## Benchmark Results
+### 2. Parallel Ensemble Execution
+- Call multiple providers simultaneously
+- Score responses on quality metrics
+- Return best answer with full provenance
+- Use case: "best answer regardless of cost" mode
+
+### 3. Biology-Inspired Routing
+- EXP3: Prevents provider monoculture (negative frequency-dependent selection)
+- Charnov MVT: Optimal rate-limit rotation timing
+- ODT Shadow Verification: Probabilistic verification for high-stakes queries
+
+### 4. Semantic Memory
+- Embedding-based conversation context
+- Cross-session fact retention
+- Adaptive forgetting of stale info
+- Semantic cache for zero-cost repeated queries
+
+## Supported Providers (47+)
+
+| Provider | Tier | Example Models |
+|----------|------|---------------|
+| OpenAI | Premium, Mid | gpt-4o, gpt-4o-mini |
+| Anthropic | Premium, Mid | claude-3.5-sonnet, claude-3-haiku |
+| Google | Premium, Mid | gemini-1.5-pro, gemini-1.5-flash |
+| Groq | Cheap | llama-3.3-70b, llama-3.1-8b |
+| DeepSeek | Cheap, Mid | deepseek-chat, deepseek-coder |
+| Mistral | Cheap, Mid | mistral-large, mistral-small |
+| NVIDIA | Premium | nemotron |
+| Ollama | All | Local models |
+| vLLM | All | Self-hosted |
+
+## API Endpoints
+
+- `POST /v1/chat/completions` — OpenAI-compatible chat
+- `POST /v1/completions` — Text completions
+- `POST /v1/embeddings` — Embeddings
+- `GET /v1/models` — Available models
+- `GET /health` — Provider health
+- `GET /metrics` — Prometheus metrics
+
+## Integration Patterns
+
+### OpenAI SDK
+```python
+from openai import OpenAI
+client = OpenAI(base_url="http://localhost:8787/v1", api_key="not-needed")
+response = client.chat.completions.create(model="auto", messages=[...])
+```
+
+### LangChain
+```python
+from a3m_adapter import A3MLangChainAdapter
+llm = A3MLangChainAdapter(model="auto", parallel_ensemble=2)
+```
+
+### LlamaIndex
+```python
+from a3m_adapter import A3MLlamaIndexAdapter
+llm = A3MLlamaIndexAdapter(model="auto")
+```
 
-| Metric | Value |
-|--------|-------|
-| RouterArena Score | 0.9404 |
-| Accuracy | 96.77% |
-| Avg Cost / 1K tokens | $0.0768 |
-| Robustness | 1.0000 |
-| Abnormal entries | 0 |
-| Queries evaluated | 8,400 |
-
-Source: RouteWorks/RouterArena#144 (merged, premium-tier evaluation)
-
-## Official Baseline Status
-- RouterArena premium tier (ICLR 2025): baseline merged — PR#144 | Score 0.9404, Accuracy 96.77%
-- RouterArena free tier (ICLR 2025): baseline submitted — PR#152 | 50.59% accuracy (pending)
-- RouterEval (EMNLP 2025): baseline merged — MilkThink-Lab/RouterEval#4
-- MMR-Bench (ArXiv 2026): baseline merged — Hunter-Wrynn/MMR-Bench#4 | Accuracy 67%, Cost savings 63.5%
-- LLMRouterBench (ACL 2026): baseline submitted — ynulihao/LLMRouterBench#3
-
-## Local Evaluation
-
-| Metric | Value |
-|--------|-------|
-| Exact tier match | 67% |
-| Within 1 tier | 96% |
-| Cost savings vs all-premium | 62.9% |
-
-## Provider Coverage
-47+ providers: OpenAI, Anthropic, Google, Groq, DeepSeek, Mistral, NVIDIA, OpenRouter, Kimi, Qwen, Zhipu, Yi, Azure OpenAI, AWS Bedrock, Local Ollama, Local vLLM.
-
-## Features
-- Parallel ensemble execution (multiple providers simultaneously, confidence-weighted scoring)
-- Semantic cache (embedding-based, configurable similarity threshold, per-route TTL)
-- Budget enforcement (per-user/team caps, real-time alerts at 50%/80%/100%)
-- Circuit breaker (3-failure trigger, 60s cooldown)
-- Per-provider retry with exponential backoff and 429 detection
-- Guardrails (prompt injection detection, PII detection)
-- Adaptive memory (EMA-based model quality scoring, no retraining)
-
-## API
-OpenAI-compatible proxy at localhost:8787. Model selection via `model="auto"` invokes heuristic routing.
-
-## Citation
+### CrewAI
+```python
+from crewai.llms import A3MCompletion
+agent = Agent(llm=A3MCompletion(model="auto"))
 ```
-@software{a3m_router,
-  title = {A3M Router: OpenAI-Compatible LLM Routing Gateway},
-  author = {Subho Mukherjee},
-  year = {2025},
-  url = {https://github.com/Das-rebel/a3m-router},
-  note = {RouterArena evaluated: 96.77% accuracy, $0.0768/1K, 1.0000 robustness}
-}
+
+## Cost Savings
+
+| Query | GPT-4o | A3M | Savings |
+|-------|---------|-----|---------|
+| Simple Q&A | $0.03 | $0.0001 | 99.7% |
+| Code generation | $0.05 | $0.002 | 96% |
+| Complex reasoning | $0.15 | $0.15 | 0% (correct) |
+
+## Memory Features
+
+- **Semantic Cache**: Instant responses for similar queries
+- **Conversation Context**: Maintains chat history
+- **Cross-Session Memory**: Remembers important facts
+- **Adaptive Forgetting**: Auto-evicts stale info
+
+## Benchmark Results
+
+RouterArena (8,400 queries):
+- Accuracy: 96.77%
+- Cost: $0.0768/1K
+- Robustness: 1.0000
+
+## Installation
+
+```bash
+npm install adaptive-memory-multi-model-router
+pip install adaptive-memory-multi-model-router
+docker run -p 8787:8787 ghcr.io/das-rebel/a3m-router
 ```
 
-## References
-- RouteWorks/RouterArena (ICLR 2025): https://github.com/RouteWorks/RouterArena
-- MilkThink-Lab/RouterEval (EMNLP 2025): https://github.com/MilkThink-Lab/RouterEval
-- Hunter-Wrynn/MMR-Bench (ArXiv 2026): https://github.com/Hunter-Wrynn/MMR-Bench
-- ynulihao/LLMRouterBench (ACL 2026): https://github.com/ynulihao/LLMRouterBench
+## Keywords
+
+llm-router, ai-gateway, model-routing, cost-optimization, multi-provider, openai-compatible, langchain, llamaindex, crewai, parallel-execution, semantic-cache, adaptive-routing, failover, guardrails, cache, budget-alerts, streaming, retries, circuit-breaker
+
+## License
+
+MIT