adk-llm-bridge 0.1.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 PAI
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,247 @@
+# adk-llm-bridge
+
+[![npm version](https://img.shields.io/npm/v/adk-llm-bridge.svg)](https://www.npmjs.com/package/adk-llm-bridge)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+Connect [Google ADK](https://github.com/google/adk-typescript) to [Vercel AI Gateway](https://vercel.com/ai-gateway) and 100+ LLM models.
+
+## Why?
+
+Google ADK is great for building AI agents, but it only supports Gemini models natively. This package lets you use **any model** from Vercel AI Gateway (Claude, GPT-4, Llama, Mistral, etc.) while keeping all ADK features like multi-agent orchestration, tool calling, and streaming.
+
+## Installation
+
+```bash
+bun add adk-llm-bridge @google/adk
+```
+
+```bash
+pnpm add adk-llm-bridge @google/adk
+```
+
+```bash
+npm install adk-llm-bridge @google/adk
+```
+
+## Quick Start
+
+```typescript
+import { LlmAgent } from '@google/adk';
+import { AIGateway } from 'adk-llm-bridge';
+
+const agent = new LlmAgent({
+  name: 'assistant',
+  model: AIGateway('anthropic/claude-sonnet-4'),
+  instruction: 'You are a helpful assistant.',
+});
+
+const response = await agent.run('Hello!');
+```
+
+## Configuration
+
+### Environment Variables (Recommended)
+
+```bash
+AI_GATEWAY_API_KEY=your-api-key
+AI_GATEWAY_URL=https://ai-gateway.vercel.sh/v1  # optional
+```
+
+### With Options
+
+```typescript
+import { AIGateway } from 'adk-llm-bridge';
+
+const agent = new LlmAgent({
+  name: 'assistant',
+  model: AIGateway('openai/gpt-4o', {
+    apiKey: process.env.OPENAI_API_KEY,
+    timeout: 30000,
+    maxRetries: 3,
+  }),
+  instruction: 'You are helpful.',
+});
+```
+
+### Multiple Agents with Different Configs
+
+Each agent can have its own API key or configuration:
+
+```typescript
+import { LlmAgent } from '@google/adk';
+import { AIGateway } from 'adk-llm-bridge';
+
+// Agent with production API key
+const prodAgent = new LlmAgent({
+  name: 'prod-assistant',
+  model: AIGateway('anthropic/claude-sonnet-4', { 
+    apiKey: process.env.PROD_API_KEY 
+  }),
+  instruction: 'You are a production assistant.',
+});
+
+// Agent with development API key
+const devAgent = new LlmAgent({
+  name: 'dev-assistant',
+  model: AIGateway('openai/gpt-4o', { 
+    apiKey: process.env.DEV_API_KEY 
+  }),
+  instruction: 'You are a development assistant.',
+});
+```
+
+### Using with adk-devtools
+
+When using `adk-devtools` (CLI or web interface), you must register with `LLMRegistry` due to how the tool bundles dependencies:
+
+```typescript
+import { LlmAgent, LLMRegistry } from '@google/adk';
+import { AIGatewayLlm } from 'adk-llm-bridge';
+
+// Required for adk-devtools
+LLMRegistry.register(AIGatewayLlm);
+
+export const rootAgent = new LlmAgent({
+  name: 'assistant',
+  model: 'anthropic/claude-sonnet-4', // Use string, not AIGateway()
+  instruction: 'You are helpful.',
+});
+```
+
+### Using String Model Names (Alternative)
+
+If you prefer string-based model names, register once at startup:
+
+```typescript
+import { LlmAgent } from '@google/adk';
+import { registerAIGateway } from 'adk-llm-bridge';
+
+// Register once (uses AI_GATEWAY_API_KEY from env)
+registerAIGateway();
+
+const agent = new LlmAgent({
+  name: 'assistant',
+  model: 'anthropic/claude-sonnet-4', // String works after registration
+  instruction: 'You are helpful.',
+});
+```
+
+## Model Format
+
+Use the `provider/model` format supported by AI Gateway:
+
+```typescript
+AIGateway('anthropic/claude-sonnet-4')
+AIGateway('openai/gpt-4o')
+AIGateway('google/gemini-2.0-flash')
+AIGateway('zai/glm-4.6')
+AIGateway('xai/grok-2')
+AIGateway('deepseek/deepseek-chat')
+```
+
+**Any model available in [Vercel AI Gateway](https://sdk.vercel.ai/docs/ai-sdk-core/ai-gateway#supported-models) will work** - no code changes needed when new providers are added.
+
+### Popular Providers
+
+| Provider | Examples |
+|----------|----------|
+| Anthropic | `anthropic/claude-sonnet-4`, `anthropic/claude-haiku` |
+| OpenAI | `openai/gpt-4o`, `openai/gpt-4o-mini` |
+| Google | `google/gemini-2.0-flash` |
+| Meta | `meta/llama-3.1-70b-instruct` |
+| Mistral | `mistral/mistral-large` |
+| xAI | `xai/grok-2` |
+| DeepSeek | `deepseek/deepseek-chat` |
+| Zhipu AI | `zai/glm-4.6`, `zai/glm-4.5` |
+| Groq | `groq/llama-3.1-70b` |
+| Perplexity | `perplexity/sonar-pro` |
+
+Browse all models at [Vercel AI Gateway Models](https://sdk.vercel.ai/docs/ai-sdk-core/ai-gateway#supported-models).
+
+## Features
+
+- **Text generation** - Simple prompt/response
+- **Streaming** - Real-time token streaming
+- **Tool calling** - Function calling with automatic conversion
+- **Multi-turn** - Full conversation history support
+- **Usage metadata** - Token counts for monitoring
+
+## Tool Calling Example
+
+```typescript
+import { LlmAgent } from '@google/adk';
+import { AIGateway } from 'adk-llm-bridge';
+
+const getWeather = {
+  name: 'get_weather',
+  description: 'Get current weather for a city',
+  parameters: {
+    type: 'object',
+    properties: {
+      city: { type: 'string', description: 'City name' },
+    },
+    required: ['city'],
+  },
+};
+
+const agent = new LlmAgent({
+  name: 'weather-assistant',
+  model: AIGateway('anthropic/claude-sonnet-4'),
+  instruction: 'You help users check the weather.',
+  tools: [getWeather],
+});
+```
+
+## API Reference
+
+### `AIGateway(model, options?)`
+
+Creates an LLM instance for use with ADK agents.
+
+```typescript
+AIGateway('anthropic/claude-sonnet-4')
+AIGateway('openai/gpt-4o', { apiKey: 'sk-...' })
+```
+
+| Parameter | Type | Description |
+|-----------|------|-------------|
+| `model` | `string` | Model identifier (e.g., `anthropic/claude-sonnet-4`) |
+| `options.apiKey` | `string` | API key (default: `process.env.AI_GATEWAY_API_KEY`) |
+| `options.baseURL` | `string` | Gateway URL (default: `https://ai-gateway.vercel.sh/v1`) |
+| `options.timeout` | `number` | Request timeout in ms (default: `60000`) |
+| `options.maxRetries` | `number` | Max retry attempts (default: `2`) |
+
+### `registerAIGateway(options?)`
+
+Registers AI Gateway with ADK's LLM registry for string-based model names.
+
+```typescript
+registerAIGateway()
+registerAIGateway({ apiKey: 'sk-...' })
+```
+
+### `AIGatewayLlm`
+
+Direct LLM class for advanced usage (same options as `AIGateway`).
+
+```typescript
+import { AIGatewayLlm } from 'adk-llm-bridge';
+
+const llm = new AIGatewayLlm({
+  model: 'anthropic/claude-sonnet-4',
+  apiKey: 'sk-...',
+});
+```
+
+## Requirements
+
+- Node.js >= 18.0.0
+- `@google/adk` >= 0.2.0
+
+## Contributing
+
+See [CONTRIBUTING.md](CONTRIBUTING.md) for development setup and guidelines.
+
+## License
+
+[MIT](LICENSE)

package/dist/AIGatewayLlm.d.ts

@@ -0,0 +1,14 @@
+import { BaseLlm } from "@google/adk";
+import type { LlmRequest, LlmResponse, BaseLlmConnection } from "@google/adk";
+import type { AIGatewayConfig } from "./types";
+export declare class AIGatewayLlm extends BaseLlm {
+    private readonly client;
+    static readonly supportedModels: (string | RegExp)[];
+    constructor(config: AIGatewayConfig);
+    generateContentAsync(llmRequest: LlmRequest, stream?: boolean): AsyncGenerator<LlmResponse, void>;
+    connect(_: LlmRequest): Promise<BaseLlmConnection>;
+    private singleResponse;
+    private streamResponse;
+    private errorResponse;
+}
+//# sourceMappingURL=AIGatewayLlm.d.ts.map

package/dist/AIGatewayLlm.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"AIGatewayLlm.d.ts","sourceRoot":"","sources":["../src/AIGatewayLlm.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,OAAO,EAAE,MAAM,aAAa,CAAC;AACtC,OAAO,KAAK,EAAE,UAAU,EAAE,WAAW,EAAE,iBAAiB,EAAE,MAAM,aAAa,CAAC;AAe9E,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAE/C,qBAAa,YAAa,SAAQ,OAAO;IACvC,OAAO,CAAC,QAAQ,CAAC,MAAM,CAAS;IAChC,MAAM,CAAC,QAAQ,CAAC,eAAe,sBAAkB;gBAErC,MAAM,EAAE,eAAe;IAuB5B,oBAAoB,CACzB,UAAU,EAAE,UAAU,EACtB,MAAM,UAAQ,GACb,cAAc,CAAC,WAAW,EAAE,IAAI,CAAC;IAc9B,OAAO,CAAC,CAAC,EAAE,UAAU,GAAG,OAAO,CAAC,iBAAiB,CAAC;YAI1C,cAAc;YAYb,cAAc;IAoB7B,OAAO,CAAC,aAAa;CAQtB"}

package/dist/ai-gateway-llm.d.ts

@@ -0,0 +1,14 @@
+import { BaseLlm } from "@google/adk";
+import type { LlmRequest, LlmResponse, BaseLlmConnection } from "@google/adk";
+import type { AIGatewayConfig } from "./types";
+export declare class AIGatewayLlm extends BaseLlm {
+    private readonly client;
+    static readonly supportedModels: (string | RegExp)[];
+    constructor(config: AIGatewayConfig);
+    generateContentAsync(llmRequest: LlmRequest, stream?: boolean): AsyncGenerator<LlmResponse, void>;
+    connect(_: LlmRequest): Promise<BaseLlmConnection>;
+    private singleResponse;
+    private streamResponse;
+    private errorResponse;
+}
+//# sourceMappingURL=ai-gateway-llm.d.ts.map

package/dist/ai-gateway-llm.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"ai-gateway-llm.d.ts","sourceRoot":"","sources":["../src/ai-gateway-llm.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,OAAO,EAAE,MAAM,aAAa,CAAC;AACtC,OAAO,KAAK,EAAE,UAAU,EAAE,WAAW,EAAE,iBAAiB,EAAE,MAAM,aAAa,CAAC;AAgB9E,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAE/C,qBAAa,YAAa,SAAQ,OAAO;IACvC,OAAO,CAAC,QAAQ,CAAC,MAAM,CAAS;IAChC,MAAM,CAAC,QAAQ,CAAC,eAAe,sBAAkB;gBAErC,MAAM,EAAE,eAAe;IA2B5B,oBAAoB,CACzB,UAAU,EAAE,UAAU,EACtB,MAAM,UAAQ,GACb,cAAc,CAAC,WAAW,EAAE,IAAI,CAAC;IAc9B,OAAO,CAAC,CAAC,EAAE,UAAU,GAAG,OAAO,CAAC,iBAAiB,CAAC;YAI1C,cAAc;YAYb,cAAc;IAoB7B,OAAO,CAAC,aAAa;CAQtB"}

package/dist/ai-gateway.d.ts

@@ -0,0 +1,6 @@
+import { AIGatewayLlm } from "./ai-gateway-llm";
+import type { AIGatewayConfig } from "./types";
+type AIGatewayOptions = Omit<AIGatewayConfig, "model">;
+export declare function AIGateway(model: string, options?: AIGatewayOptions): AIGatewayLlm;
+export {};
+//# sourceMappingURL=ai-gateway.d.ts.map

package/dist/ai-gateway.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"ai-gateway.d.ts","sourceRoot":"","sources":["../src/ai-gateway.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,MAAM,kBAAkB,CAAC;AAChD,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAE/C,KAAK,gBAAgB,GAAG,IAAI,CAAC,eAAe,EAAE,OAAO,CAAC,CAAC;AAEvD,wBAAgB,SAAS,CACvB,KAAK,EAAE,MAAM,EACb,OAAO,CAAC,EAAE,gBAAgB,GACzB,YAAY,CAEd"}

package/dist/auto-register.d.ts

@@ -0,0 +1,2 @@
+export {};
+//# sourceMappingURL=auto-register.d.ts.map

package/dist/auto-register.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"auto-register.d.ts","sourceRoot":"","sources":["../src/auto-register.ts"],"names":[],"mappings":""}

package/dist/auto-register.js

@@ -0,0 +1,331 @@
+// src/register.ts
+import { LLMRegistry } from "@google/adk";
+
+// src/ai-gateway-llm.ts
+import { BaseLlm } from "@google/adk";
+import OpenAI from "openai";
+
+// src/converters/request.ts
+function convertRequest(llmRequest) {
+  const messages = [];
+  const systemContent = extractSystemInstruction(llmRequest);
+  if (systemContent) {
+    messages.push({ role: "system", content: systemContent });
+  }
+  for (const content of llmRequest.contents ?? []) {
+    processContent(content, messages);
+  }
+  return { messages, tools: convertTools(llmRequest) };
+}
+function extractSystemInstruction(req) {
+  const sys = req.config?.systemInstruction;
+  if (!sys)
+    return null;
+  if (typeof sys === "string")
+    return sys;
+  if ("parts" in sys)
+    return extractText(sys.parts ?? []);
+  return null;
+}
+function extractText(parts) {
+  return parts.map((p) => p.text).filter(Boolean).join(`
+`);
+}
+function processContent(content, messages) {
+  if (!content.parts?.length)
+    return;
+  const texts = [];
+  const calls = [];
+  const responses = [];
+  for (const part of content.parts) {
+    if (part.text)
+      texts.push(part.text);
+    if (part.functionCall) {
+      calls.push({
+        id: part.functionCall.id ?? `call_${Date.now()}`,
+        name: part.functionCall.name ?? "",
+        arguments: JSON.stringify(part.functionCall.args ?? {})
+      });
+    }
+    if (part.functionResponse) {
+      responses.push({
+        id: part.functionResponse.id ?? "",
+        content: JSON.stringify(part.functionResponse.response ?? {})
+      });
+    }
+  }
+  if (content.role === "user") {
+    if (texts.length)
+      messages.push({ role: "user", content: texts.join(`
+`) });
+    for (const r of responses) {
+      messages.push({ role: "tool", tool_call_id: r.id, content: r.content });
+    }
+  } else if (content.role === "model") {
+    if (texts.length || calls.length) {
+      const msg = {
+        role: "assistant",
+        content: texts.length ? texts.join(`
+`) : null
+      };
+      if (calls.length) {
+        msg.tool_calls = calls.map((c) => ({
+          id: c.id,
+          type: "function",
+          function: { name: c.name, arguments: c.arguments }
+        }));
+      }
+      messages.push(msg);
+    }
+  }
+}
+function convertTools(req) {
+  const adkTools = req.config?.tools;
+  if (!adkTools?.length)
+    return;
+  const tools = [];
+  for (const group of adkTools) {
+    if ("functionDeclarations" in group && Array.isArray(group.functionDeclarations)) {
+      for (const fn of group.functionDeclarations) {
+        tools.push({
+          type: "function",
+          function: {
+            name: fn.name ?? "",
+            description: fn.description ?? "",
+            parameters: normalizeSchema(fn.parameters) ?? {
+              type: "object",
+              properties: {}
+            }
+          }
+        });
+      }
+    }
+  }
+  return tools.length ? tools : undefined;
+}
+function normalizeSchema(schema) {
+  if (!schema || typeof schema !== "object")
+    return;
+  const result = {};
+  const input = schema;
+  for (const [key, value] of Object.entries(input)) {
+    if (key === "type" && typeof value === "string") {
+      result[key] = value.toLowerCase();
+    } else if (typeof value === "object" && value !== null && !Array.isArray(value)) {
+      result[key] = normalizeSchema(value);
+    } else if (Array.isArray(value)) {
+      result[key] = value;
+    } else {
+      result[key] = value;
+    }
+  }
+  return result;
+}
+
+// src/converters/response.ts
+function convertResponse(response) {
+  const choice = response.choices[0];
+  if (!choice) {
+    return {
+      errorCode: "NO_CHOICE",
+      errorMessage: "No response choice",
+      turnComplete: true
+    };
+  }
+  const parts = [];
+  if (choice.message.content) {
+    parts.push({ text: choice.message.content });
+  }
+  for (const tc of choice.message.tool_calls ?? []) {
+    parts.push({
+      functionCall: {
+        id: tc.id,
+        name: tc.function.name,
+        args: safeJsonParse(tc.function.arguments)
+      }
+    });
+  }
+  return {
+    content: parts.length ? { role: "model", parts } : undefined,
+    turnComplete: true,
+    usageMetadata: response.usage ? {
+      promptTokenCount: response.usage.prompt_tokens,
+      candidatesTokenCount: response.usage.completion_tokens,
+      totalTokenCount: response.usage.total_tokens
+    } : undefined
+  };
+}
+function convertStreamChunk(chunk, acc) {
+  const choice = chunk.choices[0];
+  if (!choice)
+    return { isComplete: false };
+  const delta = choice.delta;
+  if (delta?.content) {
+    acc.text += delta.content;
+    return {
+      response: {
+        content: { role: "model", parts: [{ text: delta.content }] },
+        partial: true
+      },
+      isComplete: false
+    };
+  }
+  if (delta?.tool_calls) {
+    for (const tc of delta.tool_calls) {
+      const idx = tc.index ?? 0;
+      let a = acc.toolCalls.get(idx);
+      if (!a) {
+        a = { id: "", name: "", arguments: "" };
+        acc.toolCalls.set(idx, a);
+      }
+      if (tc.id)
+        a.id = tc.id;
+      if (tc.function?.name)
+        a.name += tc.function.name;
+      if (tc.function?.arguments)
+        a.arguments += tc.function.arguments;
+    }
+  }
+  if (choice.finish_reason) {
+    const parts = [];
+    if (acc.text)
+      parts.push({ text: acc.text });
+    for (const tc of Array.from(acc.toolCalls.values())) {
+      if (tc.name) {
+        parts.push({
+          functionCall: {
+            id: tc.id,
+            name: tc.name,
+            args: safeJsonParse(tc.arguments)
+          }
+        });
+      }
+    }
+    acc.text = "";
+    acc.toolCalls.clear();
+    return {
+      response: {
+        content: parts.length ? { role: "model", parts } : undefined,
+        turnComplete: true
+      },
+      isComplete: true
+    };
+  }
+  return { isComplete: false };
+}
+function createStreamAccumulator() {
+  return { text: "", toolCalls: new Map };
+}
+function safeJsonParse(str) {
+  try {
+    return JSON.parse(str);
+  } catch {
+    return {};
+  }
+}
+
+// src/config.ts
+var config = {};
+function setConfig(options) {
+  config = { ...options };
+}
+function getConfig() {
+  return config;
+}
+
+// src/constants.ts
+var DEFAULT_BASE_URL = "https://ai-gateway.vercel.sh/v1";
+var DEFAULT_TIMEOUT = 60000;
+var DEFAULT_MAX_RETRIES = 2;
+var MODEL_PATTERNS = [/^.+\/.+$/];
+var ENV = {
+  AI_GATEWAY_URL: "AI_GATEWAY_URL",
+  AI_GATEWAY_API_KEY: "AI_GATEWAY_API_KEY",
+  OPENAI_BASE_URL: "OPENAI_BASE_URL",
+  OPENAI_API_KEY: "OPENAI_API_KEY"
+};
+
+// src/ai-gateway-llm.ts
+class AIGatewayLlm extends BaseLlm {
+  client;
+  static supportedModels = MODEL_PATTERNS;
+  constructor(config2) {
+    super({ model: config2.model });
+    const globalConfig = getConfig();
+    const baseURL = config2.baseURL ?? globalConfig.baseURL ?? process.env[ENV.AI_GATEWAY_URL] ?? process.env[ENV.OPENAI_BASE_URL] ?? DEFAULT_BASE_URL;
+    const apiKey = config2.apiKey ?? globalConfig.apiKey ?? process.env[ENV.AI_GATEWAY_API_KEY] ?? process.env[ENV.OPENAI_API_KEY] ?? "";
+    this.client = new OpenAI({
+      baseURL,
+      apiKey,
+      timeout: config2.timeout ?? DEFAULT_TIMEOUT,
+      maxRetries: config2.maxRetries ?? DEFAULT_MAX_RETRIES
+    });
+  }
+  async* generateContentAsync(llmRequest, stream = false) {
+    try {
+      const { messages, tools } = convertRequest(llmRequest);
+      if (stream) {
+        yield* this.streamResponse(messages, tools);
+      } else {
+        yield await this.singleResponse(messages, tools);
+      }
+    } catch (error) {
+      yield this.errorResponse(error);
+    }
+  }
+  async connect(_) {
+    throw new Error("AIGatewayLlm does not support bidirectional streaming");
+  }
+  async singleResponse(messages, tools) {
+    const response = await this.client.chat.completions.create({
+      model: this.model,
+      messages,
+      ...tools?.length ? { tools } : {}
+    });
+    return convertResponse(response);
+  }
+  async* streamResponse(messages, tools) {
+    const stream = await this.client.chat.completions.create({
+      model: this.model,
+      messages,
+      stream: true,
+      ...tools?.length ? { tools } : {}
+    });
+    const acc = createStreamAccumulator();
+    for await (const chunk of stream) {
+      const { response, isComplete } = convertStreamChunk(chunk, acc);
+      if (response)
+        yield response;
+      if (isComplete)
+        break;
+    }
+  }
+  errorResponse(error) {
+    const isApiError = error instanceof OpenAI.APIError;
+    return {
+      errorCode: isApiError ? `API_ERROR_${error.status}` : "AI_GATEWAY_ERROR",
+      errorMessage: error instanceof Error ? error.message : String(error),
+      turnComplete: true
+    };
+  }
+}
+
+// src/register.ts
+var registered = false;
+function registerAIGateway(options) {
+  if (registered) {
+    console.warn("[adk-llm-bridge] Already registered");
+    return;
+  }
+  if (options) {
+    setConfig(options);
+  }
+  LLMRegistry.register(AIGatewayLlm);
+  registered = true;
+}
+function isAIGatewayRegistered() {
+  return registered;
+}
+
+// src/auto-register.ts
+registerAIGateway();

package/dist/config.d.ts

@@ -0,0 +1,5 @@
+import type { RegisterOptions } from "./types";
+export declare function setConfig(options: RegisterOptions): void;
+export declare function getConfig(): Readonly<RegisterOptions>;
+export declare function resetConfig(): void;
+//# sourceMappingURL=config.d.ts.map

package/dist/config.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"config.d.ts","sourceRoot":"","sources":["../src/config.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAI/C,wBAAgB,SAAS,CAAC,OAAO,EAAE,eAAe,GAAG,IAAI,CAExD;AAED,wBAAgB,SAAS,IAAI,QAAQ,CAAC,eAAe,CAAC,CAErD;AAED,wBAAgB,WAAW,IAAI,IAAI,CAElC"}

package/dist/constants.d.ts

@@ -0,0 +1,11 @@
+export declare const DEFAULT_BASE_URL = "https://ai-gateway.vercel.sh/v1";
+export declare const DEFAULT_TIMEOUT = 60000;
+export declare const DEFAULT_MAX_RETRIES = 2;
+export declare const MODEL_PATTERNS: (string | RegExp)[];
+export declare const ENV: {
+    readonly AI_GATEWAY_URL: "AI_GATEWAY_URL";
+    readonly AI_GATEWAY_API_KEY: "AI_GATEWAY_API_KEY";
+    readonly OPENAI_BASE_URL: "OPENAI_BASE_URL";
+    readonly OPENAI_API_KEY: "OPENAI_API_KEY";
+};
+//# sourceMappingURL=constants.d.ts.map

package/dist/constants.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"constants.d.ts","sourceRoot":"","sources":["../src/constants.ts"],"names":[],"mappings":"AAAA,eAAO,MAAM,gBAAgB,oCAAoC,CAAC;AAClE,eAAO,MAAM,eAAe,QAAS,CAAC;AACtC,eAAO,MAAM,mBAAmB,IAAI,CAAC;AAIrC,eAAO,MAAM,cAAc,EAAE,CAAC,MAAM,GAAG,MAAM,CAAC,EAAiB,CAAC;AAEhE,eAAO,MAAM,GAAG;;;;;CAKN,CAAC"}

package/dist/converters/index.d.ts

@@ -0,0 +1,3 @@
+export { convertRequest } from "./request";
+export { convertResponse, convertStreamChunk, createStreamAccumulator, } from "./response";
+//# sourceMappingURL=index.d.ts.map

package/dist/converters/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/converters/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,cAAc,EAAE,MAAM,WAAW,CAAC;AAC3C,OAAO,EACL,eAAe,EACf,kBAAkB,EAClB,uBAAuB,GACxB,MAAM,YAAY,CAAC"}

package/dist/converters/request.d.ts

@@ -0,0 +1,8 @@
+import type { LlmRequest } from "@google/adk";
+import type OpenAI from "openai";
+export interface ConvertedRequest {
+    messages: OpenAI.ChatCompletionMessageParam[];
+    tools?: OpenAI.ChatCompletionTool[];
+}
+export declare function convertRequest(llmRequest: LlmRequest): ConvertedRequest;
+//# sourceMappingURL=request.d.ts.map

package/dist/converters/request.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"request.d.ts","sourceRoot":"","sources":["../../src/converters/request.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,UAAU,EAAE,MAAM,aAAa,CAAC;AAE9C,OAAO,KAAK,MAAM,MAAM,QAAQ,CAAC;AAEjC,MAAM,WAAW,gBAAgB;IAC/B,QAAQ,EAAE,MAAM,CAAC,0BAA0B,EAAE,CAAC;IAC9C,KAAK,CAAC,EAAE,MAAM,CAAC,kBAAkB,EAAE,CAAC;CACrC;AAED,wBAAgB,cAAc,CAAC,UAAU,EAAE,UAAU,GAAG,gBAAgB,CAavE"}

package/dist/converters/response.d.ts

@@ -0,0 +1,7 @@
+import type { LlmResponse } from "@google/adk";
+import type OpenAI from "openai";
+import type { StreamAccumulator, StreamChunkResult } from "../types";
+export declare function convertResponse(response: OpenAI.ChatCompletion): LlmResponse;
+export declare function convertStreamChunk(chunk: OpenAI.ChatCompletionChunk, acc: StreamAccumulator): StreamChunkResult;
+export declare function createStreamAccumulator(): StreamAccumulator;
+//# sourceMappingURL=response.d.ts.map

package/dist/converters/response.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"response.d.ts","sourceRoot":"","sources":["../../src/converters/response.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,aAAa,CAAC;AAE/C,OAAO,KAAK,MAAM,MAAM,QAAQ,CAAC;AACjC,OAAO,KAAK,EAAE,iBAAiB,EAAE,iBAAiB,EAAE,MAAM,UAAU,CAAC;AAErE,wBAAgB,eAAe,CAAC,QAAQ,EAAE,MAAM,CAAC,cAAc,GAAG,WAAW,CAqC5E;AAED,wBAAgB,kBAAkB,CAChC,KAAK,EAAE,MAAM,CAAC,mBAAmB,EACjC,GAAG,EAAE,iBAAiB,GACrB,iBAAiB,CA2DnB;AAED,wBAAgB,uBAAuB,IAAI,iBAAiB,CAE3D"}

package/dist/index.d.ts

@@ -0,0 +1,6 @@
+export { AIGatewayLlm } from "./ai-gateway-llm";
+export { AIGateway } from "./ai-gateway";
+export { registerAIGateway, isAIGatewayRegistered } from "./register";
+export type { AIGatewayConfig, RegisterOptions } from "./types";
+export { MODEL_PATTERNS, DEFAULT_BASE_URL } from "./constants";
+//# sourceMappingURL=index.d.ts.map

package/dist/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,YAAY,EAAE,MAAM,kBAAkB,CAAC;AAChD,OAAO,EAAE,SAAS,EAAE,MAAM,cAAc,CAAC;AACzC,OAAO,EAAE,iBAAiB,EAAE,qBAAqB,EAAE,MAAM,YAAY,CAAC;AACtE,YAAY,EAAE,eAAe,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAChE,OAAO,EAAE,cAAc,EAAE,gBAAgB,EAAE,MAAM,aAAa,CAAC"}

package/dist/index.js

@@ -0,0 +1,337 @@
+// src/ai-gateway-llm.ts
+import { BaseLlm } from "@google/adk";
+import OpenAI from "openai";
+
+// src/converters/request.ts
+function convertRequest(llmRequest) {
+  const messages = [];
+  const systemContent = extractSystemInstruction(llmRequest);
+  if (systemContent) {
+    messages.push({ role: "system", content: systemContent });
+  }
+  for (const content of llmRequest.contents ?? []) {
+    processContent(content, messages);
+  }
+  return { messages, tools: convertTools(llmRequest) };
+}
+function extractSystemInstruction(req) {
+  const sys = req.config?.systemInstruction;
+  if (!sys)
+    return null;
+  if (typeof sys === "string")
+    return sys;
+  if ("parts" in sys)
+    return extractText(sys.parts ?? []);
+  return null;
+}
+function extractText(parts) {
+  return parts.map((p) => p.text).filter(Boolean).join(`
+`);
+}
+function processContent(content, messages) {
+  if (!content.parts?.length)
+    return;
+  const texts = [];
+  const calls = [];
+  const responses = [];
+  for (const part of content.parts) {
+    if (part.text)
+      texts.push(part.text);
+    if (part.functionCall) {
+      calls.push({
+        id: part.functionCall.id ?? `call_${Date.now()}`,
+        name: part.functionCall.name ?? "",
+        arguments: JSON.stringify(part.functionCall.args ?? {})
+      });
+    }
+    if (part.functionResponse) {
+      responses.push({
+        id: part.functionResponse.id ?? "",
+        content: JSON.stringify(part.functionResponse.response ?? {})
+      });
+    }
+  }
+  if (content.role === "user") {
+    if (texts.length)
+      messages.push({ role: "user", content: texts.join(`
+`) });
+    for (const r of responses) {
+      messages.push({ role: "tool", tool_call_id: r.id, content: r.content });
+    }
+  } else if (content.role === "model") {
+    if (texts.length || calls.length) {
+      const msg = {
+        role: "assistant",
+        content: texts.length ? texts.join(`
+`) : null
+      };
+      if (calls.length) {
+        msg.tool_calls = calls.map((c) => ({
+          id: c.id,
+          type: "function",
+          function: { name: c.name, arguments: c.arguments }
+        }));
+      }
+      messages.push(msg);
+    }
+  }
+}
+function convertTools(req) {
+  const adkTools = req.config?.tools;
+  if (!adkTools?.length)
+    return;
+  const tools = [];
+  for (const group of adkTools) {
+    if ("functionDeclarations" in group && Array.isArray(group.functionDeclarations)) {
+      for (const fn of group.functionDeclarations) {
+        tools.push({
+          type: "function",
+          function: {
+            name: fn.name ?? "",
+            description: fn.description ?? "",
+            parameters: normalizeSchema(fn.parameters) ?? {
+              type: "object",
+              properties: {}
+            }
+          }
+        });
+      }
+    }
+  }
+  return tools.length ? tools : undefined;
+}
+function normalizeSchema(schema) {
+  if (!schema || typeof schema !== "object")
+    return;
+  const result = {};
+  const input = schema;
+  for (const [key, value] of Object.entries(input)) {
+    if (key === "type" && typeof value === "string") {
+      result[key] = value.toLowerCase();
+    } else if (typeof value === "object" && value !== null && !Array.isArray(value)) {
+      result[key] = normalizeSchema(value);
+    } else if (Array.isArray(value)) {
+      result[key] = value;
+    } else {
+      result[key] = value;
+    }
+  }
+  return result;
+}
+
+// src/converters/response.ts
+function convertResponse(response) {
+  const choice = response.choices[0];
+  if (!choice) {
+    return {
+      errorCode: "NO_CHOICE",
+      errorMessage: "No response choice",
+      turnComplete: true
+    };
+  }
+  const parts = [];
+  if (choice.message.content) {
+    parts.push({ text: choice.message.content });
+  }
+  for (const tc of choice.message.tool_calls ?? []) {
+    parts.push({
+      functionCall: {
+        id: tc.id,
+        name: tc.function.name,
+        args: safeJsonParse(tc.function.arguments)
+      }
+    });
+  }
+  return {
+    content: parts.length ? { role: "model", parts } : undefined,
+    turnComplete: true,
+    usageMetadata: response.usage ? {
+      promptTokenCount: response.usage.prompt_tokens,
+      candidatesTokenCount: response.usage.completion_tokens,
+      totalTokenCount: response.usage.total_tokens
+    } : undefined
+  };
+}
+function convertStreamChunk(chunk, acc) {
+  const choice = chunk.choices[0];
+  if (!choice)
+    return { isComplete: false };
+  const delta = choice.delta;
+  if (delta?.content) {
+    acc.text += delta.content;
+    return {
+      response: {
+        content: { role: "model", parts: [{ text: delta.content }] },
+        partial: true
+      },
+      isComplete: false
+    };
+  }
+  if (delta?.tool_calls) {
+    for (const tc of delta.tool_calls) {
+      const idx = tc.index ?? 0;
+      let a = acc.toolCalls.get(idx);
+      if (!a) {
+        a = { id: "", name: "", arguments: "" };
+        acc.toolCalls.set(idx, a);
+      }
+      if (tc.id)
+        a.id = tc.id;
+      if (tc.function?.name)
+        a.name += tc.function.name;
+      if (tc.function?.arguments)
+        a.arguments += tc.function.arguments;
+    }
+  }
+  if (choice.finish_reason) {
+    const parts = [];
+    if (acc.text)
+      parts.push({ text: acc.text });
+    for (const tc of Array.from(acc.toolCalls.values())) {
+      if (tc.name) {
+        parts.push({
+          functionCall: {
+            id: tc.id,
+            name: tc.name,
+            args: safeJsonParse(tc.arguments)
+          }
+        });
+      }
+    }
+    acc.text = "";
+    acc.toolCalls.clear();
+    return {
+      response: {
+        content: parts.length ? { role: "model", parts } : undefined,
+        turnComplete: true
+      },
+      isComplete: true
+    };
+  }
+  return { isComplete: false };
+}
+function createStreamAccumulator() {
+  return { text: "", toolCalls: new Map };
+}
+function safeJsonParse(str) {
+  try {
+    return JSON.parse(str);
+  } catch {
+    return {};
+  }
+}
+
+// src/config.ts
+var config = {};
+function setConfig(options) {
+  config = { ...options };
+}
+function getConfig() {
+  return config;
+}
+
+// src/constants.ts
+var DEFAULT_BASE_URL = "https://ai-gateway.vercel.sh/v1";
+var DEFAULT_TIMEOUT = 60000;
+var DEFAULT_MAX_RETRIES = 2;
+var MODEL_PATTERNS = [/^.+\/.+$/];
+var ENV = {
+  AI_GATEWAY_URL: "AI_GATEWAY_URL",
+  AI_GATEWAY_API_KEY: "AI_GATEWAY_API_KEY",
+  OPENAI_BASE_URL: "OPENAI_BASE_URL",
+  OPENAI_API_KEY: "OPENAI_API_KEY"
+};
+
+// src/ai-gateway-llm.ts
+class AIGatewayLlm extends BaseLlm {
+  client;
+  static supportedModels = MODEL_PATTERNS;
+  constructor(config2) {
+    super({ model: config2.model });
+    const globalConfig = getConfig();
+    const baseURL = config2.baseURL ?? globalConfig.baseURL ?? process.env[ENV.AI_GATEWAY_URL] ?? process.env[ENV.OPENAI_BASE_URL] ?? DEFAULT_BASE_URL;
+    const apiKey = config2.apiKey ?? globalConfig.apiKey ?? process.env[ENV.AI_GATEWAY_API_KEY] ?? process.env[ENV.OPENAI_API_KEY] ?? "";
+    this.client = new OpenAI({
+      baseURL,
+      apiKey,
+      timeout: config2.timeout ?? DEFAULT_TIMEOUT,
+      maxRetries: config2.maxRetries ?? DEFAULT_MAX_RETRIES
+    });
+  }
+  async* generateContentAsync(llmRequest, stream = false) {
+    try {
+      const { messages, tools } = convertRequest(llmRequest);
+      if (stream) {
+        yield* this.streamResponse(messages, tools);
+      } else {
+        yield await this.singleResponse(messages, tools);
+      }
+    } catch (error) {
+      yield this.errorResponse(error);
+    }
+  }
+  async connect(_) {
+    throw new Error("AIGatewayLlm does not support bidirectional streaming");
+  }
+  async singleResponse(messages, tools) {
+    const response = await this.client.chat.completions.create({
+      model: this.model,
+      messages,
+      ...tools?.length ? { tools } : {}
+    });
+    return convertResponse(response);
+  }
+  async* streamResponse(messages, tools) {
+    const stream = await this.client.chat.completions.create({
+      model: this.model,
+      messages,
+      stream: true,
+      ...tools?.length ? { tools } : {}
+    });
+    const acc = createStreamAccumulator();
+    for await (const chunk of stream) {
+      const { response, isComplete } = convertStreamChunk(chunk, acc);
+      if (response)
+        yield response;
+      if (isComplete)
+        break;
+    }
+  }
+  errorResponse(error) {
+    const isApiError = error instanceof OpenAI.APIError;
+    return {
+      errorCode: isApiError ? `API_ERROR_${error.status}` : "AI_GATEWAY_ERROR",
+      errorMessage: error instanceof Error ? error.message : String(error),
+      turnComplete: true
+    };
+  }
+}
+// src/ai-gateway.ts
+function AIGateway(model, options) {
+  return new AIGatewayLlm({ model, ...options });
+}
+// src/register.ts
+import { LLMRegistry } from "@google/adk";
+var registered = false;
+function registerAIGateway(options) {
+  if (registered) {
+    console.warn("[adk-llm-bridge] Already registered");
+    return;
+  }
+  if (options) {
+    setConfig(options);
+  }
+  LLMRegistry.register(AIGatewayLlm);
+  registered = true;
+}
+function isAIGatewayRegistered() {
+  return registered;
+}
+export {
+  registerAIGateway,
+  isAIGatewayRegistered,
+  MODEL_PATTERNS,
+  DEFAULT_BASE_URL,
+  AIGatewayLlm,
+  AIGateway
+};

package/dist/register.d.ts

@@ -0,0 +1,6 @@
+import type { RegisterOptions } from "./types";
+export declare function registerAIGateway(options?: RegisterOptions): void;
+export declare function isAIGatewayRegistered(): boolean;
+/** @internal */
+export declare function _resetRegistration(): void;
+//# sourceMappingURL=register.d.ts.map

package/dist/register.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"register.d.ts","sourceRoot":"","sources":["../src/register.ts"],"names":[],"mappings":"AAGA,OAAO,KAAK,EAAE,eAAe,EAAE,MAAM,SAAS,CAAC;AAI/C,wBAAgB,iBAAiB,CAAC,OAAO,CAAC,EAAE,eAAe,GAAG,IAAI,CAYjE;AAED,wBAAgB,qBAAqB,IAAI,OAAO,CAE/C;AAED,gBAAgB;AAChB,wBAAgB,kBAAkB,IAAI,IAAI,CAGzC"}

package/dist/types.d.ts

@@ -0,0 +1,26 @@
+import type { LlmResponse } from "@google/adk";
+export interface AIGatewayConfig {
+    model: string;
+    baseURL?: string;
+    apiKey?: string;
+    timeout?: number;
+    maxRetries?: number;
+}
+export interface RegisterOptions {
+    baseURL?: string;
+    apiKey?: string;
+}
+export interface ToolCallAccumulator {
+    id: string;
+    name: string;
+    arguments: string;
+}
+export interface StreamAccumulator {
+    text: string;
+    toolCalls: Map<number, ToolCallAccumulator>;
+}
+export interface StreamChunkResult {
+    response?: LlmResponse;
+    isComplete: boolean;
+}
+//# sourceMappingURL=types.d.ts.map

package/dist/types.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"types.d.ts","sourceRoot":"","sources":["../src/types.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,aAAa,CAAC;AAE/C,MAAM,WAAW,eAAe;IAC9B,KAAK,EAAE,MAAM,CAAC;IACd,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,MAAM,CAAC,EAAE,MAAM,CAAC;IAChB,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,UAAU,CAAC,EAAE,MAAM,CAAC;CACrB;AAED,MAAM,WAAW,eAAe;IAC9B,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,MAAM,CAAC,EAAE,MAAM,CAAC;CACjB;AAED,MAAM,WAAW,mBAAmB;IAClC,EAAE,EAAE,MAAM,CAAC;IACX,IAAI,EAAE,MAAM,CAAC;IACb,SAAS,EAAE,MAAM,CAAC;CACnB;AAED,MAAM,WAAW,iBAAiB;IAChC,IAAI,EAAE,MAAM,CAAC;IACb,SAAS,EAAE,GAAG,CAAC,MAAM,EAAE,mBAAmB,CAAC,CAAC;CAC7C;AAED,MAAM,WAAW,iBAAiB;IAChC,QAAQ,CAAC,EAAE,WAAW,CAAC;IACvB,UAAU,EAAE,OAAO,CAAC;CACrB"}

package/package.json

@@ -0,0 +1,65 @@
+{
+  "name": "adk-llm-bridge",
+  "version": "0.1.0",
+  "description": "Connect Google ADK TypeScript to Vercel AI Gateway and 100+ LLM models",
+  "keywords": [
+    "adk",
+    "google-adk",
+    "ai-gateway",
+    "vercel",
+    "llm",
+    "agents"
+  ],
+  "license": "MIT",
+  "author": "PAI",
+  "repository": {
+    "type": "git",
+    "url": "https://github.com/pailat/adk-llm-bridge"
+  },
+  "homepage": "https://github.com/pailat/adk-llm-bridge#readme",
+  "bugs": {
+    "url": "https://github.com/pailat/adk-llm-bridge/issues"
+  },
+  "type": "module",
+  "main": "./dist/index.js",
+  "types": "./dist/index.d.ts",
+  "exports": {
+    ".": {
+      "types": "./dist/index.d.ts",
+      "import": "./dist/index.js"
+    }
+  },
+  "files": [
+    "dist"
+  ],
+  "engines": {
+    "node": ">=18.0.0"
+  },
+  "scripts": {
+    "build": "bun build ./src/index.ts --outdir ./dist --target node --external '@google/adk' --external '@google/genai' --external 'openai' && bun run build:types",
+    "build:types": "tsc --emitDeclarationOnly --outDir dist",
+    "test": "bun test",
+    "typecheck": "tsc --noEmit",
+    "typecheck:all": "tsc --noEmit -p tsconfig.test.json",
+    "lint": "biome lint ./src ./tests",
+    "lint:fix": "biome lint --write ./src ./tests",
+    "format": "biome format ./src ./tests",
+    "format:fix": "biome format --write ./src ./tests",
+    "check": "biome check ./src ./tests",
+    "check:fix": "biome check --write ./src ./tests",
+    "ci": "bun run typecheck:all && bun run lint && bun test && bun run build",
+    "prepublishOnly": "bun run build"
+  },
+  "peerDependencies": {
+    "@google/adk": ">=0.2.0"
+  },
+  "dependencies": {
+    "openai": "^4.73.0"
+  },
+  "devDependencies": {
+    "@biomejs/biome": "^2.3.10",
+    "@google/adk": "^0.2.1",
+    "@types/bun": "latest",
+    "typescript": "^5.3.0"
+  }
+}