insforge 0.3.2 → 1.2.10

package/docs/core-concepts/ai/architecture.mdx

@@ -0,0 +1,373 @@
+---
+title: Architecture
+description: OpenRouter integration for chat completions and image generation
+---
+
+## Overview
+
+InsForge provides unified AI capabilities through OpenRouter, giving you access to multiple LLM providers with a single API and consistent pricing model.
+
+## Technology Stack
+
+```mermaid
+graph TB
+    Client[Client Application] --> SDK[InsForge SDK]
+    SDK --> AIAPI[AI API]
+    
+    AIAPI --> OpenRouter[OpenRouter API]
+    AIAPI --> DB[(PostgreSQL)]
+    
+    OpenRouter --> Anthropic[Anthropic<br/>Claude Models]
+    OpenRouter --> OpenAI[OpenAI<br/>GPT Models]
+    OpenRouter --> Google[Google<br/>Gemini]
+    
+    DB --> Config[AI Configurations]
+    DB --> Usage[Usage Tracking]
+    
+    AIAPI --> Stream[SSE Streaming]
+    
+    style Client fill:#1e293b,stroke:#475569,color:#e2e8f0
+    style SDK fill:#1e40af,stroke:#3b82f6,color:#dbeafe
+    style AIAPI fill:#166534,stroke:#22c55e,color:#dcfce7
+    style OpenRouter fill:#c2410c,stroke:#fb923c,color:#fed7aa
+    style DB fill:#0e7490,stroke:#06b6d4,color:#cffafe
+    style Anthropic fill:#6b21a8,stroke:#a855f7,color:#f3e8ff
+    style OpenAI fill:#be185d,stroke:#ec4899,color:#fce7f3
+    style Google fill:#a16207,stroke:#facc15,color:#fef3c7
+    style Config fill:#0e7490,stroke:#22d3ee,color:#cffafe
+    style Usage fill:#0e7490,stroke:#22d3ee,color:#cffafe
+    style Stream fill:#166534,stroke:#4ade80,color:#dcfce7
+```
+
+## Core Components
+
+| Component | Technology | Purpose |
+|-----------|------------|---------|
+| **AI Gateway** | OpenRouter | Unified access to multiple AI providers |
+| **Chat Service** | Node.js + SSE | Handle chat completions with streaming |
+| **Image Service** | Async processing | Generate images via AI models |
+| **Configuration** | PostgreSQL | Store system prompts per project |
+| **Usage Tracking** | PostgreSQL | Monitor token usage |
+| **Response Format** | JSON/SSE | Standard and streaming responses |
+
+## OpenRouter Integration
+
+### Why OpenRouter?
+
+- **Single API**: One integration for multiple providers
+- **Unified Billing**: Consistent pricing across models
+- **Automatic Failover**: Fallback to alternative models
+- **Rate Limiting**: Built-in rate limit handling
+
+### Request Flow
+
+```mermaid
+sequenceDiagram
+    participant Client
+    participant InsForge
+    participant OpenRouter
+    participant Provider
+    
+    Client->>InsForge: Chat/Image Request
+    InsForge->>InsForge: Add system prompt
+    InsForge->>OpenRouter: Forward with API key
+    OpenRouter->>Provider: Route to model
+    Provider-->>OpenRouter: Model response
+    OpenRouter-->>InsForge: Unified response
+    InsForge->>InsForge: Track usage
+    InsForge-->>Client: Formatted response
+```
+
+## Available Models
+
+### Chat Models
+
+| Provider | Model | ID | Best For |
+|----------|-------|----|---------| 
+| **Anthropic** | Claude Sonnet 4 | `anthropic/claude-sonnet-4` | Complex reasoning |
+| **Anthropic** | Claude 3.5 Haiku | `anthropic/claude-3.5-haiku` | Fast responses |
+| **Anthropic** | Claude Opus 4.1 | `anthropic/claude-opus-4.1` | Highest quality |
+| **OpenAI** | GPT-5 | `openai/gpt-5` | Most advanced |
+| **OpenAI** | GPT-5 Mini | `openai/gpt-5-mini` | Fast & efficient |
+| **OpenAI** | GPT-4o | `openai/gpt-4o` | General purpose |
+| **Google** | Gemini 2.5 Pro | `google/gemini-2.5-pro` | Advanced reasoning |
+| **xAI** | Grok 4 | `x-ai/grok-4` | Advanced reasoning |
+
+### Image Models
+
+| Provider | Model | ID | Capabilities |
+|----------|-------|----|--------------| 
+| **Google** | Gemini 2.5 Flash Image | `google/gemini-2.5-flash-image-preview` | Text-to-image generation |
+| **Google** | Gemini 3 Pro Image | `google/gemini-3-pro-image-preview` | Advanced text-to-image generation |
+
+## Chat Completions
+
+### Request Processing
+
+1. **Authentication**: Verify JWT token
+2. **Configuration**: Load project AI settings
+3. **System Prompt**: Prepend configured prompt
+4. **Model Selection**: Use specified or default model
+5. **OpenRouter Call**: Forward to OpenRouter
+6. **Response Handling**: Stream or batch response
+7. **Usage Tracking**: Record token usage
+
+### Streaming Architecture
+
+```javascript
+// Server-Sent Events (SSE) for streaming
+async function* streamChat(messages, options) {
+  const stream = await openRouter.chat.completions.create({
+    model: options.model,
+    messages: messages,
+    stream: true,
+    temperature: options.temperature,
+    max_tokens: options.maxTokens
+  });
+
+  for await (const chunk of stream) {
+    if (chunk.choices[0]?.delta?.content) {
+      yield { chunk: chunk.choices[0].delta.content };
+    }
+  }
+  
+  yield { done: true, tokenUsage: {...} };
+}
+```
+
+### Response Formats
+
+**Non-streaming Response:**
+```json
+{
+  "response": "AI generated response text",
+  "model": "anthropic/claude-3.5-haiku",
+  "usage": {
+    "promptTokens": 150,
+    "completionTokens": 200,
+    "totalTokens": 350
+  }
+}
+```
+
+**Streaming Response (SSE):**
+```
+data: {"chunk": "The "}
+data: {"chunk": "answer "}
+data: {"chunk": "is..."}
+data: {"done": true, "tokenUsage": {...}}
+```
+
+## Image Generation
+
+### Generation Flow
+
+1. **Prompt Processing**: Validate and enhance prompt
+2. **Model Selection**: Choose appropriate image model
+3. **Size Configuration**: Set dimensions and quality
+4. **OpenRouter Request**: Send generation request
+5. **URL Generation**: Receive image URLs
+6. **Storage Integration**: Optional save to storage
+7. **Response Delivery**: Return URLs to client
+
+### Image Parameters
+
+| Parameter | Options | Description |
+|-----------|---------|-------------|
+| `model` | Model IDs | AI model to use |
+| `prompt` | String | Text description |
+| `size` | `512x512`, `1024x1024`, etc. | Image dimensions |
+| `quality` | `standard`, `hd` | Image quality |
+| `numImages` | 1-4 | Number of variations |
+| `style` | `vivid`, `natural` | Style preference |
+
+## Configuration Management
+
+### Database Schema
+
+```sql
+CREATE TABLE _ai_configs (
+  id UUID DEFAULT gen_random_uuid() PRIMARY KEY,
+  modality VARCHAR(255) NOT NULL,     -- 'text' or 'image'
+  provider VARCHAR(255) NOT NULL,      -- 'openrouter'
+  model_id VARCHAR(255) UNIQUE NOT NULL,
+  system_prompt TEXT,
+  created_at TIMESTAMPTZ DEFAULT NOW(),
+  updated_at TIMESTAMPTZ DEFAULT NOW()
+);
+```
+
+### System Prompts
+
+- Configured per project
+- Applied to all chat requests
+- Cannot be overridden by client
+- Support for multiple configurations
+
+## Usage Tracking
+
+### Metrics Collected
+
+```sql
+CREATE TABLE _ai_usage (
+  id UUID DEFAULT gen_random_uuid() PRIMARY KEY,
+  config_id UUID NOT NULL,
+  input_tokens INT,
+  output_tokens INT,
+  image_count INT,
+  image_resolution TEXT,
+  created_at TIMESTAMPTZ DEFAULT NOW(),
+  FOREIGN KEY (config_id) REFERENCES _ai_configs(id) ON DELETE NO ACTION
+);
+```
+
+## Security & Rate Limiting
+
+<CardGroup cols={2}>
+  <Card title="API Key Security" icon="key">
+    OpenRouter key stored server-side only
+  </Card>
+  
+  <Card title="Request Validation" icon="shield-check">
+    Input sanitization and size limits
+  </Card>
+  
+  <Card title="Rate Limiting" icon="gauge">
+    Per-user and per-project limits
+  </Card>
+  
+  <Card title="Usage Quotas" icon="chart-pie">
+    Configurable token limits
+  </Card>
+  
+  <Card title="Content Filtering" icon="filter">
+    Optional content moderation
+  </Card>
+  
+  <Card title="Audit Logging" icon="file-lines">
+    Track all AI operations
+  </Card>
+</CardGroup>
+
+## Error Handling
+
+### Error Types
+
+| Error | Code | Description |
+|-------|------|-------------|
+| **Model Not Found** | 400 | Invalid model ID |
+| **Rate Limited** | 429 | Too many requests |
+| **Token Limit** | 400 | Exceeds max tokens |
+| **OpenRouter Error** | 502 | Upstream provider issue |
+| **Quota Exceeded** | 402 | Usage limit reached |
+| **Invalid Input** | 400 | Malformed request |
+
+### Retry Strategy
+
+```javascript
+async function retryableRequest(fn, maxRetries = 3) {
+  for (let i = 0; i < maxRetries; i++) {
+    try {
+      return await fn();
+    } catch (error) {
+      if (error.status === 429) { // Rate limited
+        await sleep(Math.pow(2, i) * 1000); // Exponential backoff
+        continue;
+      }
+      throw error;
+    }
+  }
+}
+```
+
+## Performance Optimizations
+
+### Streaming Optimizations
+
+- **Server-Sent Events**: Real-time response streaming
+- **Chunked Transfer**: Efficient data streaming
+- **Keep-Alive**: Persistent connections for SSE
+- **Low Latency**: Direct OpenRouter integration
+
+### Future Optimizations
+
+- **Response Caching**: Cache for identical requests (coming soon)
+- **Batch Processing**: Multiple requests in parallel (coming soon)
+- **Embeddings Cache**: Store computed embeddings (coming soon)
+
+## API Endpoints
+
+### Chat Endpoints
+| Method | Endpoint | Auth | Description |
+|--------|----------|------|-------------|
+| POST | `/api/ai/chat/completion` | User | Send chat messages, supports streaming |
+
+### Image Endpoints
+| Method | Endpoint | Auth | Description |
+|--------|----------|------|-------------|
+| POST | `/api/ai/image/generation` | User | Generate images from text prompts |
+
+### Configuration Endpoints
+| Method | Endpoint | Auth | Description |
+|--------|----------|------|-------------|
+| GET | `/api/ai/models` | Admin | List available models |
+| GET | `/api/ai/configurations` | Admin | List AI configurations |
+| POST | `/api/ai/configurations` | Admin | Create AI configuration |
+| PATCH | `/api/ai/configurations/:id` | Admin | Update AI configuration |
+| DELETE | `/api/ai/configurations/:id` | Admin | Delete AI configuration |
+
+### Usage Tracking Endpoints
+| Method | Endpoint | Auth | Description |
+|--------|----------|------|-------------|
+| GET | `/api/ai/usage` | Admin | Get usage records with pagination |
+| GET | `/api/ai/usage/summary` | Admin | Get usage summary statistics |
+| GET | `/api/ai/usage/config/:configId` | Admin | Get usage by configuration |
+
+## Environment Variables
+
+| Variable | Description | Required |
+|----------|-------------|----------|
+| `OPENROUTER_API_KEY` | OpenRouter API key (local dev only) | Yes (local) |
+
+**Note**: 
+- In cloud environments, the API key is fetched dynamically from the cloud API
+- Model configuration is stored in the database (`_ai_configs` table)
+- No other AI-related environment variables are used
+
+## Best Practices
+
+<CardGroup cols={2}>
+  <Card title="Model Selection" icon="brain">
+    Choose models based on speed vs quality needs
+  </Card>
+  
+  <Card title="Prompt Engineering" icon="pencil">
+    Craft clear, specific prompts for better results
+  </Card>
+  
+  <Card title="Token Management" icon="coins">
+    Monitor token usage
+  </Card>
+  
+  <Card title="Streaming UX" icon="stream">
+    Use streaming for better perceived performance
+  </Card>
+  
+  <Card title="Error Recovery" icon="rotate">
+    Implement retry logic for transient failures
+  </Card>
+  
+  <Card title="Context Windows" icon="window">
+    Manage conversation history within limits
+  </Card>
+</CardGroup>
+
+## Comparison with Direct Integration
+
+| Aspect | InsForge + OpenRouter | Direct Provider APIs |
+|--------|----------------------|---------------------|
+| **Integration Effort** | Single API | Multiple integrations |
+| **Billing** | Unified through OpenRouter | Separate per provider |
+| **Model Access** | 100+ models | Limited to one provider |
+| **Failover** | Automatic | Manual implementation |
+| **Rate Limiting** | Handled by OpenRouter | Per-provider limits |

package/docs/core-concepts/ai/sdk.mdx

@@ -0,0 +1,213 @@
+---
+title: AI SDK Reference
+description: AI chat completions and image generation with the InsForge SDK
+---
+
+import Installation from '/snippets/sdk-installation.mdx';
+
+<Installation />
+
+## chat.completions.create()
+
+Create AI chat completions with streaming support.
+
+### Parameters
+
+- `model` (string, required) - AI model (e.g., 'anthropic/claude-3.5-haiku', 'openai/gpt-4'), call `mcp__insforge__get-backend-metadata` tool to get available models
+- `messages` (array, required) - Array of message objects: `{role: "user"|"system"|"assistant", content: string}`
+- `temperature` (number, optional) - Sampling temperature 0-2
+- `maxTokens` (number, optional) - Max tokens to generate
+- `topP` (number, optional) - Top-p sampling 0-1
+- `stream` (boolean, optional) - Enable streaming mode
+
+### Returns (non-streaming)
+
+```typescript
+{
+  id: string,
+  object: 'chat.completion',
+  created: number,
+  model: string,
+  choices: [{
+    index: number,
+    message: { role: "system"|"user"|"assistant", content: string },
+    finish_reason: string
+  }],
+  usage: { prompt_tokens: number, completion_tokens: number, total_tokens: number }
+}
+```
+
+### Returns (streaming)
+
+```typescript
+AsyncIterableIterator<{
+  id: string;
+  object: 'chat.completion.chunk';
+  choices: [
+    {
+      delta: { content: string };
+      finish_reason: string | null;
+    },
+  ];
+}>;
+```
+
+### Example (non-streaming)
+
+```javascript
+const completion = await insforge.ai.chat.completions.create({
+  model: 'anthropic/claude-3.5-haiku',
+  messages: [
+    {
+      role: 'user',
+      content: [
+        { type: 'text', text: 'What do you see in this image?' },
+        {
+          type: 'image_url',
+          image_url: {
+            url: 'https://example.com/photo.jpg', // or base64: 'data:image/jpeg;base64,...'
+          },
+        },
+      ],
+    },
+  ],
+});
+
+console.log(completion.choices[0].message.content);
+```
+
+### Output (non-streaming)
+
+```json
+{
+  "id": "chatcmpl-1705315200000",
+  "object": "chat.completion",
+  "created": 1705315200,
+  "model": "anthropic/claude-3.5-haiku",
+  "choices": [
+    {
+      "index": 0,
+      "message": {
+        "role": "assistant",
+        "content": "The capital of France is Paris."
+      },
+      "finish_reason": "stop"
+    }
+  ],
+  "usage": {
+    "prompt_tokens": 15,
+    "completion_tokens": 8,
+    "total_tokens": 23
+  }
+}
+```
+
+### Example (streaming)
+
+```javascript
+const stream = await insforge.ai.chat.completions.create({
+  model: 'openai/gpt-4',
+  messages: [{ role: 'user', content: 'Tell me a story' }],
+  stream: true,
+});
+
+for await (const chunk of stream) {
+  if (chunk.choices[0]?.delta?.content) {
+    process.stdout.write(chunk.choices[0].delta.content);
+  }
+}
+```
+
+### Output (streaming)
+
+```json
+{
+  "id": "chatcmpl-1705315200000",
+  "object": "chat.completion.chunk",
+  "choices": [
+    {
+      "delta": { "content": "Once upon" },
+      "finish_reason": null
+    }
+  ]
+}
+```
+
+---
+
+## images.generate()
+
+Generate images using AI models.
+
+### Parameters
+
+- `model` (string, required) - Image model (e.g., 'google/gemini-2.5-flash-image-preview')
+- `prompt` (string, required) - Text description of image
+- `images` (array, optional) - Input images for image-to-image (url or base64)
+- `width` (number, optional) - Image width in pixels
+- `height` (number, optional) - Image height in pixels
+- `size` (string, optional) - Predefined size ('1024x1024', '512x512')
+- `numImages` (number, optional) - Number of images to generate
+- `quality` ('standard' | 'hd', optional) - Image quality
+- `style` ('vivid' | 'natural', optional) - Image style
+
+### Returns
+
+```typescript
+{
+  created: number,
+  data: Array<{
+    b64_json?: string,  // Base64 encoded image
+    content?: string    // Text response from model
+  }>,
+  usage?: {
+    total_tokens: number,
+    input_tokens: number,
+    output_tokens: number
+  }
+}
+```
+
+### Example
+
+```javascript
+const response = await insforge.ai.images.generate({
+  model: 'google/gemini-2.5-flash-image-preview',
+  prompt: 'A serene mountain landscape at sunset',
+  size: '1024x1024',
+});
+
+// Get base64 image and upload to storage
+const base64Image = response.data[0].b64_json;
+const buffer = Buffer.from(base64Image, 'base64');
+const blob = new Blob([buffer], { type: 'image/png' });
+
+const { data: uploadData } = await insforge.storage.from('ai-images').uploadAuto(blob);
+
+// Save URL to database
+await insforge.database.from('generated_images').insert([
+  {
+    prompt: 'A serene mountain landscape',
+    image_url: uploadData.url,
+  },
+]);
+```
+
+### Output
+
+```json
+{
+  "created": 1705315200,
+  "data": [
+    {
+      "b64_json": "iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNk+M9QDwADhgGAWjR9awAAAABJRU5ErkJggg==",
+      "content": "A beautiful mountain landscape at sunset with orange and purple hues."
+    }
+  ],
+  "usage": {
+    "total_tokens": 150,
+    "input_tokens": 20,
+    "output_tokens": 130
+  }
+}
+```