kimi-proxy 0.0.1

package/LICENSE

@@ -0,0 +1,24 @@
+MIT License
+
+Copyright (c) 2025 Solomon
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+
+For more information, see https://opensource.org/licenses/MIT
+

package/README.md

@@ -0,0 +1,177 @@
+# Kimi Proxy
+
+> [!WARNING] ⚠️
+> **Experimental**: This project is still in development. Use with caution in production.
+
+Makes `kimi-k2-thinking` usable across multiple LLM providers by normalizing API formats, fixing tool call and thinking format issues, and optionally ensuring the model always uses a tool call for agentic workflows.
+
+The proxy and transformation pipelines are built generically and can be easily extended to support any model and any provider.
+
+## Features
+
+<details>
+<summary><strong>Multi-provider proxy</strong> for <code>kimi-k2-thinking</code> and other models</summary>
+
+Seamlessly route requests to OpenAI-compatible APIs, OpenRouter, or Vertex AI using a unified client model name.
+
+</details>
+
+<details>
+<summary><strong>Format fixes</strong> for tool calls and thinking blocks</summary>
+
+For some providers, kimi-k2-thinking returns tool calls and thinking content in non-standard formats. The proxy normalizes these to the standard Anthropic format that clients expect.
+
+**Example: Tool call normalization from content**
+
+What the kimi-k2 provider returns (tool calls embedded in content with `<|tool_call_begin|>` markers):
+
+```json
+{
+  "content": "Let me search for that.     <|tool_call_begin|>    functions.lookup:42  <|tool_call_argument_begin|>   {\"term\":\"express\"}   <|tool_call_begin|>  "
+}
+```
+
+What clients receive (normalized):
+
+```json
+{
+  "content": "Let me search for that.",
+  "tool_calls": [
+    {
+      "id": "42",
+      "type": "function",
+      "function": {
+        "name": "lookup",
+        "arguments": "{\"term\":\"express\"}"
+      }
+    }
+  ],
+  "finish_reason": "tool_calls"
+}
+```
+
+**Example: Thinking tags extraction and cleanup**
+
+What kimi-k2 returns:
+
+```
+(no content)(no content)  Let me break down... </think>   The answer is 42.
+```
+
+What clients receive:
+
+```json
+{
+  "content": "The answer is 42.",
+  "thinking": "Let me break down..."
+}
+```
+
+</details>
+
+<details>
+<summary><strong>Tool call enforcement (optional)</strong> for reliable agentic workflows</summary>
+
+Enable with `ensure_tool_call: true` in model config. The proxy detects missing tool calls and re-prompts the model with a reminder.
+
+**Example enforcement flow:**
+
+```
+System: You are a helpful assistant with access to tools.
+        Always reply with at least one tool call so the client can continue.
+
+User: What's the weather in SF?
+
+Assistant: Let me check that for you.
+
+System: Reminder: The client will not continue unless you reply with a tool call.
+
+Assistant: {
+  "tool_calls": [{
+    "id": "get_weather:0",
+    "type": "function",
+    "function": {
+      "name": "get_weather",
+      "arguments": "{\"location\": \"SF\"}"
+    }
+  }]
+}
+```
+
+</details>
+
+<details>
+<summary><strong>Request/response logging</strong> with web dashboard</summary>
+
+All requests and responses are logged to SQLite and viewable through a built-in web dashboard at the root path.
+
+</details>
+
+<details>
+<summary><strong>Load balancing</strong> with multiple strategies</summary>
+
+Distribute traffic across providers using round-robin, weighted random, random, or first strategies.
+
+</details>
+
+- **Extensible architecture** for adding new models and providers
+- **Provider support**: OpenAI-compatible APIs, OpenRouter, Vertex AI
+
+## Quick Start
+
+```bash
+pnpm install
+cp .env.example .env
+cp model-config.example.yaml model-config.yaml
+# Edit .env and model-config.yaml with your provider keys and models
+pnpm run dev
+```
+
+The API runs on `http://127.0.0.1:8000` and serves the dashboard at `/`.
+
+## Configuration
+
+### Providers
+
+Set environment variables in `.env`:
+
+- **Generic OpenAI**: `OPENAI_BASE_URL`, `OPENAI_API_KEY`
+- **OpenRouter**: `OPENROUTER_API_KEY`, `OPENROUTER_PROVIDERS` (optional), `OPENROUTER_ORDER` (optional)
+- **Vertex AI**: `VERTEX_PROJECT_ID`, `VERTEX_LOCATION`, `GOOGLE_APPLICATION_CREDENTIALS`
+
+### Models
+
+Edit `model-config.yaml` to map client model names to upstream providers:
+
+```yaml
+default_strategy: round_robin
+models:
+  - name: kimi-k2-thinking
+    provider: vertex
+    model: moonshotai/kimi-k2-thinking-maas
+    # Optional: enforce tool call consistency for reliable agentic workflows
+    ensure_tool_call: true
+  - name: kimi-k2-thinking
+    provider: openrouter
+    model: moonshot-ai/kimi-k2-thinking
+    weight: 2
+```
+
+## Dashboard
+
+The web dashboard shows request/response logs and metrics. Access it at the root path when running the proxy.
+
+## Development
+
+```bash
+pnpm run dev      # Run with hot reload
+pnpm run test     # Run unit tests
+pnpm run build    # TypeScript build
+```
+
+## Docker
+
+```bash
+docker compose up --build -d  # Production stack with web dashboard
+docker compose -f docker-compose.dev.yml watch  # Development with hot reload
+```

package/dist/adapters/anthropicAdapter.d.ts

@@ -0,0 +1,138 @@
+import type { JsonObject, JsonValue } from "../core/types.js";
+export interface AnthropicContentBlock extends JsonObject {
+    type: "thinking" | "text" | "tool_use" | "tool_result";
+    thinking?: string;
+    text?: string;
+    signature?: string;
+    id?: string;
+    name?: string;
+    input?: JsonObject;
+    tool_use_id?: string;
+    content?: string | Array<JsonObject>;
+    is_error?: boolean;
+}
+export interface AnthropicToolDefinition extends JsonObject {
+    name: string;
+    description?: string;
+    input_schema: JsonObject;
+}
+export interface AnthropicCustomToolChoice extends JsonObject {
+    type: string;
+    name?: string;
+}
+export type AnthropicToolChoice = {
+    type: "auto";
+} | {
+    type: "tool";
+    name: string;
+} | AnthropicCustomToolChoice;
+export interface AnthropicMessageRequest extends JsonObject {
+    model: string;
+    messages: Array<{
+        role: string;
+        content: string | AnthropicContentBlock[];
+    }>;
+    system?: string | AnthropicContentBlock[];
+    tools?: AnthropicToolDefinition[];
+    tool_choice?: AnthropicToolChoice;
+    stream?: boolean;
+    temperature?: number;
+    max_tokens?: number;
+}
+export interface AnthropicMessageResponse extends JsonObject {
+    id: string;
+    type: "message";
+    role: "assistant";
+    content: AnthropicContentBlock[];
+    model: string;
+    stop_reason: string | null;
+    stop_sequence: string | null;
+    usage: {
+        input_tokens: number;
+        output_tokens: number;
+    };
+}
+export interface OpenAIChatMessagePart extends JsonObject {
+    type: string;
+    text?: string;
+}
+export interface OpenAIChatRequest extends JsonObject {
+    model: string;
+    messages: Array<{
+        role: string;
+        content: string | OpenAIChatMessagePart[];
+        tool_calls?: OpenAIToolCall[];
+        tool_call_id?: string;
+    }>;
+    stream?: boolean;
+    temperature?: number;
+    max_tokens?: number;
+    tools?: OpenAIToolDefinition[];
+    tool_choice?: OpenAIToolChoice;
+}
+export interface OpenAIUsage extends JsonObject {
+    prompt_tokens?: number;
+    completion_tokens?: number;
+    total_tokens?: number;
+}
+export interface OpenAIReasoningBlock extends JsonObject {
+    text?: string;
+    thinking?: string;
+    signature?: string;
+}
+export interface OpenAIFunctionCall extends JsonObject {
+    name: string;
+    arguments: string;
+}
+export interface OpenAIToolCall extends JsonObject {
+    id?: string;
+    type: "function";
+    function?: OpenAIFunctionCall;
+}
+export interface OpenAIChatMessage extends JsonObject {
+    role?: string;
+    content?: string | OpenAIChatMessagePart[];
+    reasoning_content?: string | OpenAIReasoningBlock[];
+    tool_calls?: OpenAIToolCall[];
+    tool_call_id?: string;
+    reasoning_summary?: Array<{
+        type: string;
+        text: string;
+    }> | string;
+    metadata?: JsonObject;
+    refusal?: {
+        text?: string;
+        reason?: string;
+        content?: JsonValue;
+    };
+}
+export interface OpenAIToolDefinition extends JsonObject {
+    type: "function";
+    function: {
+        name: string;
+        description?: string;
+        parameters?: JsonObject;
+    };
+    strict?: boolean;
+    format?: string;
+}
+export type OpenAIToolChoice = "auto" | {
+    type: "function";
+    function: {
+        name: string;
+    };
+};
+export interface OpenAIChatResponse extends JsonObject {
+    id: string;
+    object: string;
+    created: number;
+    model: string;
+    choices: Array<{
+        message: OpenAIChatMessage;
+        finish_reason: string;
+        index: number;
+    }>;
+    usage?: OpenAIUsage;
+}
+export declare function anthropicToOpenAIRequest(request: AnthropicMessageRequest): OpenAIChatRequest;
+export declare function openaiToAnthropicResponse(openaiResp: OpenAIChatResponse): AnthropicMessageResponse;

package/dist/adapters/anthropicAdapter.js

@@ -0,0 +1,184 @@
+import { Buffer } from "node:buffer";
+export function anthropicToOpenAIRequest(request) {
+    const openaiMessages = [];
+    if (request.system) {
+        if (typeof request.system === "string") {
+            openaiMessages.push({ role: "system", content: request.system });
+        }
+        else if (Array.isArray(request.system)) {
+            const content = request.system
+                .filter((block) => block.type === "text")
+                .map((block) => block.text ?? "")
+                .join("\n");
+            openaiMessages.push({ role: "system", content });
+        }
+    }
+    for (const msg of request.messages ?? []) {
+        const { role, content } = msg;
+        if (Array.isArray(content)) {
+            const textBlocks = content.filter((b) => b.type === "text");
+            const textContent = textBlocks.map((b) => b.text ?? "").join("");
+            if (role === "assistant") {
+                const toolUses = content.filter((b) => b.type === "tool_use");
+                const toolCalls = toolUses.map((u) => ({
+                    id: u.id,
+                    type: "function",
+                    function: {
+                        name: u.name ?? "",
+                        arguments: JSON.stringify(u.input ?? {}),
+                    },
+                }));
+                const message = {
+                    role,
+                    content: textContent,
+                };
+                if (toolCalls.length > 0) {
+                    message.tool_calls = toolCalls;
+                }
+                openaiMessages.push(message);
+            }
+            else if (role === "user") {
+                const toolResults = content.filter((b) => b.type === "tool_result");
+                // 1. Emit tool results as separate 'tool' messages
+                for (const res of toolResults) {
+                    let resultContent = "";
+                    if (typeof res.content === "string") {
+                        resultContent = res.content;
+                    }
+                    else if (Array.isArray(res.content)) {
+                        resultContent = res.content
+                            .map((b) => typeof b.text === "string" ? b.text : JSON.stringify(b))
+                            .join("");
+                    }
+                    openaiMessages.push({
+                        role: "tool", // OpenAI uses 'tool' role for function results
+                        content: resultContent,
+                        tool_call_id: res.tool_use_id,
+                    });
+                }
+                // 2. Emit the user text as a 'user' message
+                if (textContent || toolResults.length === 0) {
+                    if (textContent) {
+                        openaiMessages.push({ role, content: textContent });
+                    }
+                }
+            }
+            else {
+                openaiMessages.push({ role, content: textContent });
+            }
+        }
+        else {
+            openaiMessages.push({ role, content });
+        }
+    }
+    const tools = (request.tools ?? []).map((tool) => ({
+        type: "function",
+        function: {
+            name: tool.name,
+            ...(tool.description ? { description: tool.description } : {}),
+            parameters: tool.input_schema,
+        },
+    }));
+    const openaiReq = {
+        model: request.model,
+        messages: openaiMessages,
+        stream: request.stream ?? false,
+        temperature: request.temperature ?? 1,
+        max_tokens: request.max_tokens ?? 4096,
+    };
+    if (tools.length) {
+        openaiReq.tools = tools;
+        if (request.tool_choice) {
+            if (request.tool_choice.type === "auto") {
+                openaiReq.tool_choice = "auto";
+            }
+            else if (request.tool_choice.type === "tool" &&
+                typeof request.tool_choice.name === "string") {
+                openaiReq.tool_choice = {
+                    type: "function",
+                    function: { name: request.tool_choice.name },
+                };
+            }
+        }
+    }
+    return openaiReq;
+}
+export function openaiToAnthropicResponse(openaiResp) {
+    const [choice] = openaiResp.choices;
+    const message = choice.message ?? {};
+    const contentBlocks = [];
+    const reasoning = message.reasoning_content;
+    const reasoningSignature = Buffer.from("signature_placeholder").toString("base64");
+    if (typeof reasoning === "string" && reasoning.trim()) {
+        contentBlocks.push({
+            type: "thinking",
+            thinking: reasoning,
+            signature: reasoningSignature,
+        });
+    }
+    else if (Array.isArray(reasoning)) {
+        for (const block of reasoning) {
+            const thought = typeof block.thinking === "string"
+                ? block.thinking
+                : typeof block.text === "string"
+                    ? block.text
+                    : undefined;
+            if (thought) {
+                contentBlocks.push({
+                    type: "thinking",
+                    thinking: thought,
+                    signature: block.signature ?? reasoningSignature,
+                });
+            }
+        }
+    }
+    const textContent = message.content;
+    if (typeof textContent === "string" && textContent.trim()) {
+        contentBlocks.push({ type: "text", text: textContent.trim() });
+    }
+    else if (Array.isArray(textContent)) {
+        for (const part of textContent) {
+            if (part.type === "text" && typeof part.text === "string") {
+                contentBlocks.push({ type: "text", text: part.text });
+            }
+        }
+    }
+    const toolCalls = message.tool_calls;
+    let stopReason = "end_turn";
+    if (Array.isArray(toolCalls) && toolCalls.length) {
+        stopReason = "tool_use";
+        for (const toolCall of toolCalls) {
+            let parsedArgs;
+            try {
+                parsedArgs = JSON.parse(toolCall.function?.arguments ?? "{}");
+            }
+            catch {
+                parsedArgs = { raw_arguments: toolCall.function?.arguments };
+            }
+            contentBlocks.push({
+                type: "tool_use",
+                id: toolCall.id,
+                name: toolCall.function?.name,
+                input: parsedArgs,
+            });
+        }
+    }
+    let responseId = openaiResp.id ?? "";
+    if (!responseId.startsWith("msg_")) {
+        responseId = `msg_${responseId}`;
+    }
+    return {
+        id: responseId,
+        type: "message",
+        role: "assistant",
+        content: contentBlocks,
+        model: openaiResp.model,
+        stop_reason: stopReason,
+        stop_sequence: null,
+        usage: {
+            input_tokens: openaiResp.usage?.prompt_tokens ?? 0,
+            output_tokens: openaiResp.usage?.completion_tokens ?? 0,
+        },
+    };
+}
+//# sourceMappingURL=anthropicAdapter.js.map

package/dist/adapters/anthropicAdapter.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"anthropicAdapter.js","sourceRoot":"","sources":["../../src/adapters/anthropicAdapter.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,MAAM,EAAE,MAAM,aAAa,CAAC;AA8IrC,MAAM,UAAU,wBAAwB,CACtC,OAAgC;IAEhC,MAAM,cAAc,GAAkC,EAAE,CAAC;IAEzD,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;QACnB,IAAI,OAAO,OAAO,CAAC,MAAM,KAAK,QAAQ,EAAE,CAAC;YACvC,cAAc,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,OAAO,EAAE,OAAO,CAAC,MAAM,EAAE,CAAC,CAAC;QACnE,CAAC;aAAM,IAAI,KAAK,CAAC,OAAO,CAAC,OAAO,CAAC,MAAM,CAAC,EAAE,CAAC;YACzC,MAAM,OAAO,GAAG,OAAO,CAAC,MAAM;iBAC3B,MAAM,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,KAAK,CAAC,IAAI,KAAK,MAAM,CAAC;iBACxC,GAAG,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,KAAK,CAAC,IAAI,IAAI,EAAE,CAAC;iBAChC,IAAI,CAAC,IAAI,CAAC,CAAC;YACd,cAAc,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,OAAO,EAAE,CAAC,CAAC;QACnD,CAAC;IACH,CAAC;IAED,KAAK,MAAM,GAAG,IAAI,OAAO,CAAC,QAAQ,IAAI,EAAE,EAAE,CAAC;QACzC,MAAM,EAAE,IAAI,EAAE,OAAO,EAAE,GAAG,GAAG,CAAC;QAE9B,IAAI,KAAK,CAAC,OAAO,CAAC,OAAO,CAAC,EAAE,CAAC;YAC3B,MAAM,UAAU,GAAG,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,MAAM,CAAC,CAAC;YAC5D,MAAM,WAAW,GAAG,UAAU,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,IAAI,EAAE,CAAC,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;YAEjE,IAAI,IAAI,KAAK,WAAW,EAAE,CAAC;gBACzB,MAAM,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,UAAU,CAAC,CAAC;gBAC9D,MAAM,SAAS,GAAqB,QAAQ,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;oBACvD,EAAE,EAAE,CAAC,CAAC,EAAE;oBACR,IAAI,EAAE,UAAU;oBAChB,QAAQ,EAAE;wBACR,IAAI,EAAE,CAAC,CAAC,IAAI,IAAI,EAAE;wBAClB,SAAS,EAAE,IAAI,CAAC,SAAS,CAAC,CAAC,CAAC,KAAK,IAAI,EAAE,CAAC;qBACzC;iBACF,CAAC,CAAC,CAAC;gBAEJ,MAAM,OAAO,GAAqC;oBAChD,IAAI;oBACJ,OAAO,EAAE,WAAW;iBACrB,CAAC;gBACF,IAAI,SAAS,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;oBACxB,OAA6B,CAAC,UAAU,GAAG,SAAS,CAAC;gBACxD,CAAC;gBACD,cAAc,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;YAC/B,CAAC;iBAAM,IAAI,IAAI,KAAK,MAAM,EAAE,CAAC;gBAC3B,MAAM,WAAW,GAAG,OAAO,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,aAAa,CAAC,CAAC;gBAEpE,mDAAmD;gBACnD,KAAK,MAAM,GAAG,IAAI,WAAW,EAAE,CAAC;oBAC9B,IAAI,aAAa,GAAG,EAAE,CAAC;oBACvB,IAAI,OAAO,GAAG,CAAC,OAAO,KAAK,QAAQ,EAAE,CAAC;wBACpC,aAAa,GAAG,GAAG,CAAC,OAAO,CAAC;oBAC9B,CAAC;yBAAM,IAAI,KAAK,CAAC,OAAO,CAAC,GAAG,CAAC,OAAO,CAAC,EAAE,CAAC;wBACtC,aAAa,GAAG,GAAG,CAAC,OAAO;6BACxB,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CACT,OAAO,CAAC,CAAC,IAAI,KAAK,QAAQ,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,SAAS,CAAC,CAAC,CAAC,CACxD;6BACA,IAAI,CAAC,EAAE,CAAC,CAAC;oBACd,CAAC;oBAED,cAAc,CAAC,IAAI,CAAC;wBAClB,IAAI,EAAE,MAAM,EAAE,+CAA+C;wBAC7D,OAAO,EAAE,aAAa;wBACtB,YAAY,EAAE,GAAG,CAAC,WAAW;qBAC9B,CAAC,CAAC;gBACL,CAAC;gBAED,4CAA4C;gBAC5C,IAAI,WAAW,IAAI,WAAW,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;oBAC5C,IAAI,WAAW,EAAE,CAAC;wBAChB,cAAc,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,OAAO,EAAE,WAAW,EAAE,CAAC,CAAC;oBACtD,CAAC;gBACH,CAAC;YACH,CAAC;iBAAM,CAAC;gBACN,cAAc,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,OAAO,EAAE,WAAW,EAAE,CAAC,CAAC;YACtD,CAAC;QACH,CAAC;aAAM,CAAC;YACN,cAAc,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,OAAO,EAAE,CAAC,CAAC;QACzC,CAAC;IACH,CAAC;IAED,MAAM,KAAK,GAA2B,CAAC,OAAO,CAAC,KAAK,IAAI,EAAE,CAAC,CAAC,GAAG,CAC7D,CAAC,IAAI,EAAwB,EAAE,CAAC,CAAC;QAC/B,IAAI,EAAE,UAAU;QAChB,QAAQ,EAAE;YACR,IAAI,EAAE,IAAI,CAAC,IAAI;YACf,GAAG,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC,CAAC,EAAE,WAAW,EAAE,IAAI,CAAC,WAAW,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;YAC9D,UAAU,EAAE,IAAI,CAAC,YAAY;SAC9B;KACF,CAAC,CACH,CAAC;IAEF,MAAM,SAAS,GAAsB;QACnC,KAAK,EAAE,OAAO,CAAC,KAAK;QACpB,QAAQ,EAAE,cAAc;QACxB,MAAM,EAAE,OAAO,CAAC,MAAM,IAAI,KAAK;QAC/B,WAAW,EAAE,OAAO,CAAC,WAAW,IAAI,CAAC;QACrC,UAAU,EAAE,OAAO,CAAC,UAAU,IAAI,IAAI;KACvC,CAAC;IAEF,IAAI,KAAK,CAAC,MAAM,EAAE,CAAC;QACjB,SAAS,CAAC,KAAK,GAAG,KAAK,CAAC;QACxB,IAAI,OAAO,CAAC,WAAW,EAAE,CAAC;YACxB,IAAI,OAAO,CAAC,WAAW,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;gBACxC,SAAS,CAAC,WAAW,GAAG,MAAM,CAAC;YACjC,CAAC;iBAAM,IACL,OAAO,CAAC,WAAW,CAAC,IAAI,KAAK,MAAM;gBACnC,OAAO,OAAO,CAAC,WAAW,CAAC,IAAI,KAAK,QAAQ,EAC5C,CAAC;gBACD,SAAS,CAAC,WAAW,GAAG;oBACtB,IAAI,EAAE,UAAU;oBAChB,QAAQ,EAAE,EAAE,IAAI,EAAE,OAAO,CAAC,WAAW,CAAC,IAAI,EAAE;iBAC7C,CAAC;YACJ,CAAC;QACH,CAAC;IACH,CAAC;IAED,OAAO,SAAS,CAAC;AACnB,CAAC;AAED,MAAM,UAAU,yBAAyB,CACvC,UAA8B;IAE9B,MAAM,CAAC,MAAM,CAAC,GAAG,UAAU,CAAC,OAAO,CAAC;IACpC,MAAM,OAAO,GAAsB,MAAM,CAAC,OAAO,IAAI,EAAE,CAAC;IACxD,MAAM,aAAa,GAA4B,EAAE,CAAC;IAElD,MAAM,SAAS,GAAG,OAAO,CAAC,iBAAiB,CAAC;IAC5C,MAAM,kBAAkB,GAAG,MAAM,CAAC,IAAI,CAAC,uBAAuB,CAAC,CAAC,QAAQ,CACtE,QAAQ,CACT,CAAC;IACF,IAAI,OAAO,SAAS,KAAK,QAAQ,IAAI,SAAS,CAAC,IAAI,EAAE,EAAE,CAAC;QACtD,aAAa,CAAC,IAAI,CAAC;YACjB,IAAI,EAAE,UAAU;YAChB,QAAQ,EAAE,SAAS;YACnB,SAAS,EAAE,kBAAkB;SAC9B,CAAC,CAAC;IACL,CAAC;SAAM,IAAI,KAAK,CAAC,OAAO,CAAC,SAAS,CAAC,EAAE,CAAC;QACpC,KAAK,MAAM,KAAK,IAAI,SAAS,EAAE,CAAC;YAC9B,MAAM,OAAO,GACX,OAAO,KAAK,CAAC,QAAQ,KAAK,QAAQ;gBAChC,CAAC,CAAC,KAAK,CAAC,QAAQ;gBAChB,CAAC,CAAC,OAAO,KAAK,CAAC,IAAI,KAAK,QAAQ;oBAC9B,CAAC,CAAC,KAAK,CAAC,IAAI;oBACZ,CAAC,CAAC,SAAS,CAAC;YAClB,IAAI,OAAO,EAAE,CAAC;gBACZ,aAAa,CAAC,IAAI,CAAC;oBACjB,IAAI,EAAE,UAAU;oBAChB,QAAQ,EAAE,OAAO;oBACjB,SAAS,EAAE,KAAK,CAAC,SAAS,IAAI,kBAAkB;iBACjD,CAAC,CAAC;YACL,CAAC;QACH,CAAC;IACH,CAAC;IAED,MAAM,WAAW,GAAG,OAAO,CAAC,OAAO,CAAC;IACpC,IAAI,OAAO,WAAW,KAAK,QAAQ,IAAI,WAAW,CAAC,IAAI,EAAE,EAAE,CAAC;QAC1D,aAAa,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,MAAM,EAAE,IAAI,EAAE,WAAW,CAAC,IAAI,EAAE,EAAE,CAAC,CAAC;IACjE,CAAC;SAAM,IAAI,KAAK,CAAC,OAAO,CAAC,WAAW,CAAC,EAAE,CAAC;QACtC,KAAK,MAAM,IAAI,IAAI,WAAW,EAAE,CAAC;YAC/B,IAAI,IAAI,CAAC,IAAI,KAAK,MAAM,IAAI,OAAO,IAAI,CAAC,IAAI,KAAK,QAAQ,EAAE,CAAC;gBAC1D,aAAa,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,MAAM,EAAE,IAAI,EAAE,IAAI,CAAC,IAAI,EAAE,CAAC,CAAC;YACxD,CAAC;QACH,CAAC;IACH,CAAC;IAED,MAAM,SAAS,GAAG,OAAO,CAAC,UAAU,CAAC;IACrC,IAAI,UAAU,GAAG,UAAU,CAAC;IAC5B,IAAI,KAAK,CAAC,OAAO,CAAC,SAAS,CAAC,IAAI,SAAS,CAAC,MAAM,EAAE,CAAC;QACjD,UAAU,GAAG,UAAU,CAAC;QACxB,KAAK,MAAM,QAAQ,IAAI,SAAS,EAAE,CAAC;YACjC,IAAI,UAAsB,CAAC;YAC3B,IAAI,CAAC;gBACH,UAAU,GAAG,IAAI,CAAC,KAAK,CACrB,QAAQ,CAAC,QAAQ,EAAE,SAAS,IAAI,IAAI,CACvB,CAAC;YAClB,CAAC;YAAC,MAAM,CAAC;gBACP,UAAU,GAAG,EAAE,aAAa,EAAE,QAAQ,CAAC,QAAQ,EAAE,SAAS,EAAE,CAAC;YAC/D,CAAC;YACD,aAAa,CAAC,IAAI,CAAC;gBACjB,IAAI,EAAE,UAAU;gBAChB,EAAE,EAAE,QAAQ,CAAC,EAAE;gBACf,IAAI,EAAE,QAAQ,CAAC,QAAQ,EAAE,IAAI;gBAC7B,KAAK,EAAE,UAAU;aAClB,CAAC,CAAC;QACL,CAAC;IACH,CAAC;IAED,IAAI,UAAU,GAAG,UAAU,CAAC,EAAE,IAAI,EAAE,CAAC;IACrC,IAAI,CAAC,UAAU,CAAC,UAAU,CAAC,MAAM,CAAC,EAAE,CAAC;QACnC,UAAU,GAAG,OAAO,UAAU,EAAE,CAAC;IACnC,CAAC;IAED,OAAO;QACL,EAAE,EAAE,UAAU;QACd,IAAI,EAAE,SAAS;QACf,IAAI,EAAE,WAAW;QACjB,OAAO,EAAE,aAAa;QACtB,KAAK,EAAE,UAAU,CAAC,KAAK;QACvB,WAAW,EAAE,UAAU;QACvB,aAAa,EAAE,IAAI;QACnB,KAAK,EAAE;YACL,YAAY,EAAE,UAAU,CAAC,KAAK,EAAE,aAAa,IAAI,CAAC;YAClD,aAAa,EAAE,UAAU,CAAC,KAAK,EAAE,iBAAiB,IAAI,CAAC;SACxD;KACF,CAAC;AACJ,CAAC"}

package/dist/config.d.ts

@@ -0,0 +1,27 @@
+import { OpenAIConfig } from "./core/providers/openaiProvider.js";
+import { OpenRouterConfig } from "./core/providers/openRouterProvider.js";
+import { VertexConfig } from "./core/providers/vertexProvider.js";
+import { LoadBalancingStrategy, ModelDefinition } from "./core/modelRegistry.js";
+export interface AppConfig {
+    server: {
+        host: string;
+        port: number;
+    };
+    logging: {
+        dbPath: string;
+    };
+    streaming: {
+        delay: number;
+        chunkSize: number;
+    };
+    providers: {
+        openai?: OpenAIConfig;
+        openrouter?: OpenRouterConfig;
+        vertex?: VertexConfig;
+    };
+    models: {
+        definitions: ModelDefinition[];
+        defaultStrategy: LoadBalancingStrategy;
+    };
+}
+export declare function loadConfig(): AppConfig;