agentic-flow 1.9.2 → 1.9.4

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,204 @@
1
+ # Provider Integration Content for Landing Page
2
+
3
+ **Suggested Section**: Add this content to https://ruv.io/agentic-flow as a new "Provider Support" section
4
+
5
+ ---
6
+
7
+ ## 🔌 Multi-Provider LLM Support
8
+
9
+ **agentic-flow** works with multiple LLM providers through intelligent proxy architecture that automatically converts requests to provider-specific formats while maintaining full compatibility with Claude Agent SDK.
10
+
11
+ ### Supported Providers
12
+
13
+ | Provider | Models | Cost vs Claude | Speed | Setup Required |
14
+ |----------|--------|----------------|-------|----------------|
15
+ | **Anthropic** | Claude 3.5 Sonnet, Opus, Haiku | Baseline | Fast | `ANTHROPIC_API_KEY` |
16
+ | **Gemini** (NEW v1.9.3) | Gemini 2.0 Flash, Pro | **70% cheaper** | **2-5x faster** | `GOOGLE_GEMINI_API_KEY` |
17
+ | **OpenRouter** | 100+ models (GPT-4, Llama, DeepSeek) | Varies | Varies | `OPENROUTER_API_KEY` |
18
+ | **ONNX** | Phi-4 (runs locally) | **100% FREE** | Medium | No key needed |
19
+
20
+ ### Quick Provider Examples
21
+
22
+ ```bash
23
+ # Anthropic (default, highest quality)
24
+ npx agentic-flow --agent coder --task "Build REST API"
25
+
26
+ # Gemini (fastest, cheapest - NEW in v1.9.3!)
27
+ npx agentic-flow --agent coder --task "Build REST API" --provider gemini
28
+
29
+ # OpenRouter (access 100+ models)
30
+ npx agentic-flow --agent coder --task "Build REST API" --provider openrouter
31
+
32
+ # ONNX (100% free, runs locally)
33
+ npx agentic-flow --agent coder --task "Build REST API" --provider onnx
34
+ ```
35
+
36
+ ### Gemini Provider - Fully Functional (v1.9.3)
37
+
38
+ The **Gemini provider is now production-ready** with complete streaming support. Three critical bugs were fixed in v1.9.3:
39
+
40
+ ✅ **Model Selection** - Correctly uses Gemini models instead of Claude model names
41
+ ✅ **Streaming Responses** - Full Server-Sent Events (SSE) support with `&alt=sse` parameter
42
+ ✅ **Provider Selection** - Respects `--provider` flag and doesn't auto-select incorrectly
43
+
44
+ **Gemini Benefits:**
45
+ - ⚡ **2-5x faster response times** compared to Anthropic
46
+ - 💰 **70% cost reduction** - great for high-volume tasks
47
+ - 🎯 **Excellent for** code generation, code analysis, refactoring, simple tasks
48
+ - ✅ **Full streaming support** for real-time responses
49
+ - 🔄 **Zero code changes** - drop-in replacement via proxy architecture
50
+
51
+ **Setup:**
52
+ ```bash
53
+ # Get your free Gemini API key from https://ai.google.dev/
54
+ export GOOGLE_GEMINI_API_KEY=your_key_here
55
+
56
+ # Use Gemini with streaming
57
+ npx agentic-flow --agent coder --task "Create function" --provider gemini --stream
58
+ ```
59
+
60
+ ### How Provider Proxies Work
61
+
62
+ **Intelligent Request Conversion:**
63
+
64
+ 1. **User makes request** → Claude Agent SDK format (Anthropic Messages API)
65
+ 2. **Proxy intercepts** → Converts to provider-specific format
66
+ 3. **Provider responds** → Native format (Gemini, OpenRouter, etc.)
67
+ 4. **Proxy converts back** → Claude Agent SDK format
68
+ 5. **User receives** → Standard response, no code changes needed
69
+
70
+ **Architecture Benefits:**
71
+ - ✅ **Single codebase** works with all providers
72
+ - ✅ **Provider-agnostic** agent development
73
+ - ✅ **Easy switching** between providers via CLI flags
74
+ - ✅ **Cost optimization** - use cheap providers for simple tasks, Claude for complex ones
75
+ - ✅ **Automatic failover** - switch providers if one is down
76
+
77
+ ### Configuration
78
+
79
+ **Environment Variables:**
80
+ ```bash
81
+ # Provider API Keys (set only what you need)
82
+ export ANTHROPIC_API_KEY=sk-ant-... # Anthropic Claude
83
+ export GOOGLE_GEMINI_API_KEY=AIza... # Google Gemini
84
+ export OPENROUTER_API_KEY=sk-or-... # OpenRouter
85
+
86
+ # Model Selection (optional)
87
+ export COMPLETION_MODEL=claude-sonnet-4-5-20250929 # Anthropic model
88
+ export REASONING_MODEL=gemini-2.0-flash-exp # Gemini model
89
+ ```
90
+
91
+ **CLI Flags:**
92
+ ```bash
93
+ --provider <name> # anthropic, gemini, openrouter, onnx
94
+ --model <model-id> # Override default model
95
+ --stream # Enable streaming responses
96
+ ```
97
+
98
+ ### Cost Optimization Strategy
99
+
100
+ **Smart Provider Selection:**
101
+
102
+ ```bash
103
+ # Simple tasks → Use Gemini (70% cheaper, 5x faster)
104
+ npx agentic-flow --agent coder --task "Add comments" --provider gemini
105
+
106
+ # Complex reasoning → Use Claude (highest quality)
107
+ npx agentic-flow --agent researcher --task "Analyze architecture" --provider anthropic
108
+
109
+ # Experimentation → Use ONNX (100% free)
110
+ npx agentic-flow --agent tester --task "Generate tests" --provider onnx
111
+
112
+ # Access specific models → Use OpenRouter
113
+ npx agentic-flow --agent coder --task "Optimize code" --provider openrouter --model meta-llama/llama-3.2-3b-instruct
114
+ ```
115
+
116
+ ### Production Deployment
117
+
118
+ **High-Volume Applications:**
119
+ ```bash
120
+ # Use Gemini for 80% of requests (fast, cheap)
121
+ export DEFAULT_PROVIDER=gemini
122
+ export GOOGLE_GEMINI_API_KEY=...
123
+
124
+ # Fall back to Claude for complex tasks
125
+ export ANTHROPIC_API_KEY=...
126
+
127
+ # Run with automatic provider selection
128
+ npx agentic-flow --agent coder --task "..." # Uses Gemini by default
129
+ npx agentic-flow --agent architect --task "..." --provider anthropic # Override for complex tasks
130
+ ```
131
+
132
+ **Monitoring:**
133
+ - Track token usage per provider
134
+ - Monitor response quality
135
+ - Measure cost savings
136
+ - Analyze performance metrics
137
+
138
+ ---
139
+
140
+ ## Why This Matters for Consulting Clients
141
+
142
+ **Cost Savings:**
143
+ - **70% reduction** in LLM costs using Gemini for appropriate tasks
144
+ - **100% free** local inference with ONNX for development/testing
145
+ - **Flexible budgeting** - scale up/down providers based on needs
146
+
147
+ **Performance:**
148
+ - **2-5x faster** responses with Gemini for code generation
149
+ - **Real-time streaming** for better user experience
150
+ - **Local inference** option eliminates API latency
151
+
152
+ **Flexibility:**
153
+ - **100+ models** available via OpenRouter
154
+ - **Zero vendor lock-in** - switch providers anytime
155
+ - **Multi-provider strategies** - use best tool for each job
156
+
157
+ ---
158
+
159
+ ## Technical Specifications
160
+
161
+ **Proxy Architecture:**
162
+ - Located in `src/proxy/` directory
163
+ - `anthropic-to-gemini.ts` - Gemini proxy (v1.9.3 - fully functional)
164
+ - `anthropic-to-openrouter.ts` - OpenRouter proxy
165
+ - Automatic request/response format conversion
166
+ - Full MCP tool support via function calling conversion
167
+ - Streaming and non-streaming modes
168
+
169
+ **Supported Features:**
170
+ - ✅ Text generation
171
+ - ✅ Streaming responses (SSE)
172
+ - ✅ Tool calling / Function calling
173
+ - ✅ System prompts
174
+ - ✅ Multi-turn conversations
175
+ - ✅ Temperature control
176
+ - ✅ Token limits
177
+
178
+ **Verified Compatibility:**
179
+ - Claude Agent SDK
180
+ - Claude Code CLI
181
+ - MCP (Model Context Protocol) tools
182
+ - All 66 specialized agents
183
+ - Multi-agent swarm orchestration
184
+
185
+ ---
186
+
187
+ ## Get Started
188
+
189
+ ```bash
190
+ # Install agentic-flow
191
+ npm install -g agentic-flow@1.9.3
192
+
193
+ # Setup your preferred provider
194
+ export GOOGLE_GEMINI_API_KEY=your_key_here
195
+
196
+ # Run your first agent with Gemini
197
+ npx agentic-flow --agent coder --task "Write a hello world function" --provider gemini --stream
198
+
199
+ # See the cost and speed difference yourself!
200
+ ```
201
+
202
+ **Documentation:** https://github.com/ruvnet/agentic-flow#readme
203
+ **Full Provider Guide:** https://github.com/ruvnet/agentic-flow#-provider-support
204
+ **Latest Release:** v1.9.3 - Gemini Provider Fully Functional