agentic-flow 1.9.3 → 1.10.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +298 -0
- package/dist/cli-proxy.js +19 -1
- package/dist/core/long-running-agent.js +219 -0
- package/dist/core/provider-manager.js +434 -0
- package/dist/examples/use-provider-fallback.js +176 -0
- package/dist/proxy/adaptive-proxy.js +224 -0
- package/dist/proxy/anthropic-to-gemini.js +2 -2
- package/dist/proxy/http2-proxy-optimized.js +191 -0
- package/dist/proxy/http2-proxy.js +381 -0
- package/dist/proxy/http3-proxy-old.js +331 -0
- package/dist/proxy/http3-proxy.js +51 -0
- package/dist/proxy/websocket-proxy.js +406 -0
- package/dist/utils/auth.js +52 -0
- package/dist/utils/compression-middleware.js +149 -0
- package/dist/utils/connection-pool.js +184 -0
- package/dist/utils/rate-limiter.js +48 -0
- package/dist/utils/response-cache.js +211 -0
- package/dist/utils/streaming-optimizer.js +141 -0
- package/docs/.claude-flow/metrics/performance.json +3 -3
- package/docs/.claude-flow/metrics/task-metrics.json +3 -3
- package/docs/ISSUE-55-VALIDATION.md +152 -0
- package/docs/OPTIMIZATIONS.md +460 -0
- package/docs/README.md +217 -0
- package/docs/issues/ISSUE-xenova-transformers-dependency.md +380 -0
- package/docs/providers/LANDING-PAGE-PROVIDER-CONTENT.md +204 -0
- package/docs/providers/PROVIDER-FALLBACK-GUIDE.md +619 -0
- package/docs/providers/PROVIDER-FALLBACK-SUMMARY.md +418 -0
- package/package.json +1 -1
- package/scripts/claude +31 -0
- package/validation/test-gemini-exclusiveMinimum-fix.ts +142 -0
- package/validation/test-provider-fallback.ts +285 -0
- package/validation/validate-v1.10.0-docker.sh +296 -0
- package/wasm/reasoningbank/reasoningbank_wasm_bg.js +2 -2
- package/wasm/reasoningbank/reasoningbank_wasm_bg.wasm +0 -0
- package/docs/INDEX.md +0 -279
- package/docs/guides/.claude-flow/metrics/agent-metrics.json +0 -1
- package/docs/guides/.claude-flow/metrics/performance.json +0 -9
- package/docs/guides/.claude-flow/metrics/task-metrics.json +0 -10
- package/docs/router/.claude-flow/metrics/agent-metrics.json +0 -1
- package/docs/router/.claude-flow/metrics/performance.json +0 -9
- package/docs/router/.claude-flow/metrics/task-metrics.json +0 -10
- /package/docs/{TEST-V1.7.8.Dockerfile → docker-tests/TEST-V1.7.8.Dockerfile} +0 -0
- /package/docs/{TEST-V1.7.9-NODE20.Dockerfile → docker-tests/TEST-V1.7.9-NODE20.Dockerfile} +0 -0
- /package/docs/{TEST-V1.7.9.Dockerfile → docker-tests/TEST-V1.7.9.Dockerfile} +0 -0
- /package/docs/{v1.7.1-QUICK-START.md → guides/QUICK-START-v1.7.1.md} +0 -0
- /package/docs/{INTEGRATION-COMPLETE.md → integration-docs/INTEGRATION-COMPLETE.md} +0 -0
- /package/docs/{QUIC_FINAL_STATUS.md → quic/QUIC_FINAL_STATUS.md} +0 -0
- /package/docs/{README_QUIC_PHASE1.md → quic/README_QUIC_PHASE1.md} +0 -0
- /package/docs/{AGENTDB_TESTING.md → testing/AGENTDB_TESTING.md} +0 -0
|
@@ -0,0 +1,204 @@
|
|
|
1
|
+
# Provider Integration Content for Landing Page
|
|
2
|
+
|
|
3
|
+
**Suggested Section**: Add this content to https://ruv.io/agentic-flow as a new "Provider Support" section
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
## 🔌 Multi-Provider LLM Support
|
|
8
|
+
|
|
9
|
+
**agentic-flow** works with multiple LLM providers through intelligent proxy architecture that automatically converts requests to provider-specific formats while maintaining full compatibility with Claude Agent SDK.
|
|
10
|
+
|
|
11
|
+
### Supported Providers
|
|
12
|
+
|
|
13
|
+
| Provider | Models | Cost vs Claude | Speed | Setup Required |
|
|
14
|
+
|----------|--------|----------------|-------|----------------|
|
|
15
|
+
| **Anthropic** | Claude 3.5 Sonnet, Opus, Haiku | Baseline | Fast | `ANTHROPIC_API_KEY` |
|
|
16
|
+
| **Gemini** (NEW v1.9.3) | Gemini 2.0 Flash, Pro | **70% cheaper** | **2-5x faster** | `GOOGLE_GEMINI_API_KEY` |
|
|
17
|
+
| **OpenRouter** | 100+ models (GPT-4, Llama, DeepSeek) | Varies | Varies | `OPENROUTER_API_KEY` |
|
|
18
|
+
| **ONNX** | Phi-4 (runs locally) | **100% FREE** | Medium | No key needed |
|
|
19
|
+
|
|
20
|
+
### Quick Provider Examples
|
|
21
|
+
|
|
22
|
+
```bash
|
|
23
|
+
# Anthropic (default, highest quality)
|
|
24
|
+
npx agentic-flow --agent coder --task "Build REST API"
|
|
25
|
+
|
|
26
|
+
# Gemini (fastest, cheapest - NEW in v1.9.3!)
|
|
27
|
+
npx agentic-flow --agent coder --task "Build REST API" --provider gemini
|
|
28
|
+
|
|
29
|
+
# OpenRouter (access 100+ models)
|
|
30
|
+
npx agentic-flow --agent coder --task "Build REST API" --provider openrouter
|
|
31
|
+
|
|
32
|
+
# ONNX (100% free, runs locally)
|
|
33
|
+
npx agentic-flow --agent coder --task "Build REST API" --provider onnx
|
|
34
|
+
```
|
|
35
|
+
|
|
36
|
+
### Gemini Provider - Fully Functional (v1.9.3)
|
|
37
|
+
|
|
38
|
+
The **Gemini provider is now production-ready** with complete streaming support. Three critical bugs were fixed in v1.9.3:
|
|
39
|
+
|
|
40
|
+
✅ **Model Selection** - Correctly uses Gemini models instead of Claude model names
|
|
41
|
+
✅ **Streaming Responses** - Full Server-Sent Events (SSE) support with `&alt=sse` parameter
|
|
42
|
+
✅ **Provider Selection** - Respects `--provider` flag and doesn't auto-select incorrectly
|
|
43
|
+
|
|
44
|
+
**Gemini Benefits:**
|
|
45
|
+
- ⚡ **2-5x faster response times** compared to Anthropic
|
|
46
|
+
- 💰 **70% cost reduction** - great for high-volume tasks
|
|
47
|
+
- 🎯 **Excellent for** code generation, code analysis, refactoring, simple tasks
|
|
48
|
+
- ✅ **Full streaming support** for real-time responses
|
|
49
|
+
- 🔄 **Zero code changes** - drop-in replacement via proxy architecture
|
|
50
|
+
|
|
51
|
+
**Setup:**
|
|
52
|
+
```bash
|
|
53
|
+
# Get your free Gemini API key from https://ai.google.dev/
|
|
54
|
+
export GOOGLE_GEMINI_API_KEY=your_key_here
|
|
55
|
+
|
|
56
|
+
# Use Gemini with streaming
|
|
57
|
+
npx agentic-flow --agent coder --task "Create function" --provider gemini --stream
|
|
58
|
+
```
|
|
59
|
+
|
|
60
|
+
### How Provider Proxies Work
|
|
61
|
+
|
|
62
|
+
**Intelligent Request Conversion:**
|
|
63
|
+
|
|
64
|
+
1. **User makes request** → Claude Agent SDK format (Anthropic Messages API)
|
|
65
|
+
2. **Proxy intercepts** → Converts to provider-specific format
|
|
66
|
+
3. **Provider responds** → Native format (Gemini, OpenRouter, etc.)
|
|
67
|
+
4. **Proxy converts back** → Claude Agent SDK format
|
|
68
|
+
5. **User receives** → Standard response, no code changes needed
|
|
69
|
+
|
|
70
|
+
**Architecture Benefits:**
|
|
71
|
+
- ✅ **Single codebase** works with all providers
|
|
72
|
+
- ✅ **Provider-agnostic** agent development
|
|
73
|
+
- ✅ **Easy switching** between providers via CLI flags
|
|
74
|
+
- ✅ **Cost optimization** - use cheap providers for simple tasks, Claude for complex ones
|
|
75
|
+
- ✅ **Automatic failover** - switch providers if one is down
|
|
76
|
+
|
|
77
|
+
### Configuration
|
|
78
|
+
|
|
79
|
+
**Environment Variables:**
|
|
80
|
+
```bash
|
|
81
|
+
# Provider API Keys (set only what you need)
|
|
82
|
+
export ANTHROPIC_API_KEY=sk-ant-... # Anthropic Claude
|
|
83
|
+
export GOOGLE_GEMINI_API_KEY=AIza... # Google Gemini
|
|
84
|
+
export OPENROUTER_API_KEY=sk-or-... # OpenRouter
|
|
85
|
+
|
|
86
|
+
# Model Selection (optional)
|
|
87
|
+
export COMPLETION_MODEL=claude-sonnet-4-5-20250929 # Anthropic model
|
|
88
|
+
export REASONING_MODEL=gemini-2.0-flash-exp # Gemini model
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
**CLI Flags:**
|
|
92
|
+
```bash
|
|
93
|
+
--provider <name> # anthropic, gemini, openrouter, onnx
|
|
94
|
+
--model <model-id> # Override default model
|
|
95
|
+
--stream # Enable streaming responses
|
|
96
|
+
```
|
|
97
|
+
|
|
98
|
+
### Cost Optimization Strategy
|
|
99
|
+
|
|
100
|
+
**Smart Provider Selection:**
|
|
101
|
+
|
|
102
|
+
```bash
|
|
103
|
+
# Simple tasks → Use Gemini (70% cheaper, 5x faster)
|
|
104
|
+
npx agentic-flow --agent coder --task "Add comments" --provider gemini
|
|
105
|
+
|
|
106
|
+
# Complex reasoning → Use Claude (highest quality)
|
|
107
|
+
npx agentic-flow --agent researcher --task "Analyze architecture" --provider anthropic
|
|
108
|
+
|
|
109
|
+
# Experimentation → Use ONNX (100% free)
|
|
110
|
+
npx agentic-flow --agent tester --task "Generate tests" --provider onnx
|
|
111
|
+
|
|
112
|
+
# Access specific models → Use OpenRouter
|
|
113
|
+
npx agentic-flow --agent coder --task "Optimize code" --provider openrouter --model meta-llama/llama-3.2-3b-instruct
|
|
114
|
+
```
|
|
115
|
+
|
|
116
|
+
### Production Deployment
|
|
117
|
+
|
|
118
|
+
**High-Volume Applications:**
|
|
119
|
+
```bash
|
|
120
|
+
# Use Gemini for 80% of requests (fast, cheap)
|
|
121
|
+
export DEFAULT_PROVIDER=gemini
|
|
122
|
+
export GOOGLE_GEMINI_API_KEY=...
|
|
123
|
+
|
|
124
|
+
# Fall back to Claude for complex tasks
|
|
125
|
+
export ANTHROPIC_API_KEY=...
|
|
126
|
+
|
|
127
|
+
# Run with automatic provider selection
|
|
128
|
+
npx agentic-flow --agent coder --task "..." # Uses Gemini by default
|
|
129
|
+
npx agentic-flow --agent architect --task "..." --provider anthropic # Override for complex tasks
|
|
130
|
+
```
|
|
131
|
+
|
|
132
|
+
**Monitoring:**
|
|
133
|
+
- Track token usage per provider
|
|
134
|
+
- Monitor response quality
|
|
135
|
+
- Measure cost savings
|
|
136
|
+
- Analyze performance metrics
|
|
137
|
+
|
|
138
|
+
---
|
|
139
|
+
|
|
140
|
+
## Why This Matters for Consulting Clients
|
|
141
|
+
|
|
142
|
+
**Cost Savings:**
|
|
143
|
+
- **70% reduction** in LLM costs using Gemini for appropriate tasks
|
|
144
|
+
- **100% free** local inference with ONNX for development/testing
|
|
145
|
+
- **Flexible budgeting** - scale up/down providers based on needs
|
|
146
|
+
|
|
147
|
+
**Performance:**
|
|
148
|
+
- **2-5x faster** responses with Gemini for code generation
|
|
149
|
+
- **Real-time streaming** for better user experience
|
|
150
|
+
- **Local inference** option eliminates API latency
|
|
151
|
+
|
|
152
|
+
**Flexibility:**
|
|
153
|
+
- **100+ models** available via OpenRouter
|
|
154
|
+
- **Zero vendor lock-in** - switch providers anytime
|
|
155
|
+
- **Multi-provider strategies** - use best tool for each job
|
|
156
|
+
|
|
157
|
+
---
|
|
158
|
+
|
|
159
|
+
## Technical Specifications
|
|
160
|
+
|
|
161
|
+
**Proxy Architecture:**
|
|
162
|
+
- Located in `src/proxy/` directory
|
|
163
|
+
- `anthropic-to-gemini.ts` - Gemini proxy (v1.9.3 - fully functional)
|
|
164
|
+
- `anthropic-to-openrouter.ts` - OpenRouter proxy
|
|
165
|
+
- Automatic request/response format conversion
|
|
166
|
+
- Full MCP tool support via function calling conversion
|
|
167
|
+
- Streaming and non-streaming modes
|
|
168
|
+
|
|
169
|
+
**Supported Features:**
|
|
170
|
+
- ✅ Text generation
|
|
171
|
+
- ✅ Streaming responses (SSE)
|
|
172
|
+
- ✅ Tool calling / Function calling
|
|
173
|
+
- ✅ System prompts
|
|
174
|
+
- ✅ Multi-turn conversations
|
|
175
|
+
- ✅ Temperature control
|
|
176
|
+
- ✅ Token limits
|
|
177
|
+
|
|
178
|
+
**Verified Compatibility:**
|
|
179
|
+
- Claude Agent SDK
|
|
180
|
+
- Claude Code CLI
|
|
181
|
+
- MCP (Model Context Protocol) tools
|
|
182
|
+
- All 66 specialized agents
|
|
183
|
+
- Multi-agent swarm orchestration
|
|
184
|
+
|
|
185
|
+
---
|
|
186
|
+
|
|
187
|
+
## Get Started
|
|
188
|
+
|
|
189
|
+
```bash
|
|
190
|
+
# Install agentic-flow
|
|
191
|
+
npm install -g agentic-flow@1.9.3
|
|
192
|
+
|
|
193
|
+
# Setup your preferred provider
|
|
194
|
+
export GOOGLE_GEMINI_API_KEY=your_key_here
|
|
195
|
+
|
|
196
|
+
# Run your first agent with Gemini
|
|
197
|
+
npx agentic-flow --agent coder --task "Write a hello world function" --provider gemini --stream
|
|
198
|
+
|
|
199
|
+
# See the cost and speed difference yourself!
|
|
200
|
+
```
|
|
201
|
+
|
|
202
|
+
**Documentation:** https://github.com/ruvnet/agentic-flow#readme
|
|
203
|
+
**Full Provider Guide:** https://github.com/ruvnet/agentic-flow#-provider-support
|
|
204
|
+
**Latest Release:** v1.9.3 - Gemini Provider Fully Functional
|