openai-router 0.1.0__tar.gz

openai_router-0.1.0/LICENSE.txt

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 Astral Software Inc.
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

openai_router-0.1.0/PKG-INFO

@@ -0,0 +1,127 @@
+Metadata-Version: 2.4
+Name: openai-router
+Version: 0.1.0
+Summary: openai-router
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: fastapi>=0.120.3
+Requires-Dist: gradio>=5.49.1
+Requires-Dist: httpx>=0.28.1
+Requires-Dist: loguru>=0.7.3
+Requires-Dist: sqlmodel>=0.0.27
+Requires-Dist: uvicorn>=0.38.0
+Dynamic: license-file
+
+
+<!-- markdownlint-disable MD033 -->
+<h1 align="center">
+🚀 OpenAI Router 
+</h1>
+ 
+<p align="center">
+<b>轻量级、持久化、零配置的 OpenAI API 统一网关</b><br>
+一键聚合 vLLM、SGLang、lmdeploy、Ollama…  
+</p>
+ 
+<p align="center">
+<a href="#"><img src="https://img.shields.io/badge/license-MIT-blue?style=flat-square"></a>
+<a href="https://fastapi.tiangolo.com"><img src="https://img.shields.io/badge/FastAPI-v0.115+-teal?style=flat-square"></a>
+<a href="https://gradio.app"><img src="https://img.shields.io/badge/Gradio-v5+-orange?style=flat-square"></a>
+<a href="#"><img src="https://img.shields.io/badge/SQLite-内置存储-lightgrey?style=flat-square"></a>
+</p>
+ 
+---
+ 
+## ✨ Features 
+| Feature | Description |
+|---------|-------------|
+| 🌍 统一入口 | `/chat/completions`、`/embeddings`、`/images/generations`… 全部转发 |
+| 🧩 多后端 | vLLM、SGLang、lmdeploy、Ollama… 任意组合 |
+| 💾 持久化 | SQLite + SQLModel 零配置存储路由 |
+| ⚡ 实时流 | SSE & Chunked Transfer 全双工支持 |
+| 🎨 Web UI | Gradio 即用的管理面板 |
+| 🔍 兼容 OpenAI | SDK / LangChain / AutoGen 等无需改动一行代码 |
+ 
+---
+ 
+### 📦 Quick Start 
+Step-1：安装 
+```bash 
+uv sync
+```
+
+ 
+Step-2：启动 
+```bash 
+python -m openai_router.main --host localhost --port 8000 
+```
+浏览器自动打开  
+📍 UI：`http://localhost:8000`  
+📍 API：`http://localhost:8000/v1`
+ 
+Step-3：添加后端 
+在 Web UI 「添加 / 更新」填入：
+- 模型名：`gpt-4`
+- 后端 URL：`http://localhost:8080/v1`
+ 
+<img src="static/ui.png" width="800">
+ 
+---
+ 
+## 🔧 API Usage 
+### **像官方 OpenAI SDK一样调用**
+```python 
+from openai import OpenAI 
+client = OpenAI(
+      base_url="http://localhost:8000/v1",
+      api_key="sk-dummy"
+)
+resp = client.chat.completions.create(
+      model="gpt-4",
+      messages=[{"role":"user","content":"hello"}],
+      stream=True 
+)
+for chunk in resp:
+      print(chunk.choices[0].delta.content or "", end="")
+```
+ 
+cURL 
+```bash 
+curl http://localhost:8000/v1/chat/completions \
+     -H "Content-Type: application/json" \
+     -d '{"model":"gpt-4","messages":[{"role":"user","content":"hi"}],"stream":true}'
+```
+ 
+---
+ 
+## 🗂️ Endpoints 
+| Method | Path | Description |
+|--------|------|-------------|
+| `GET` | `/` | Gradio Admin UI |
+| `GET` | `/docs` | OpenAPI Swagger |
+| `GET` | `/v1/models` | List available models |
+ `POST` | `/v1/responses` | Responses API |
+| `POST` | `/v1/chat/completions` | Chat completion |
+| `POST` | `/v1/embeddings` | Text embeddings |
+| `POST` | `/v1/images/generations` | DALL·E style |
+| `POST` | `/v1/audio/transcriptions` | Whisper |
+| … | … | All OpenAI endpoints supported |
+ 
+---
+ 
+## ⚙️ Configuration 
+CLI Options 
+```bash 
+python -m openai_router.main --help 
+```
+| Flag | Default | Description |
+|------|---------|-------------|
+| `--host` | `localhost` | Bind address |
+| `--port` | `8000` | Bind port |
+ 
+
+---
+ 
+## 🏗️ Architecture 
+<img src="static/arch.png" width="800">

openai_router-0.1.0/README.md

@@ -0,0 +1,112 @@
+
+<!-- markdownlint-disable MD033 -->
+<h1 align="center">
+🚀 OpenAI Router 
+</h1>
+ 
+<p align="center">
+<b>轻量级、持久化、零配置的 OpenAI API 统一网关</b><br>
+一键聚合 vLLM、SGLang、lmdeploy、Ollama…  
+</p>
+ 
+<p align="center">
+<a href="#"><img src="https://img.shields.io/badge/license-MIT-blue?style=flat-square"></a>
+<a href="https://fastapi.tiangolo.com"><img src="https://img.shields.io/badge/FastAPI-v0.115+-teal?style=flat-square"></a>
+<a href="https://gradio.app"><img src="https://img.shields.io/badge/Gradio-v5+-orange?style=flat-square"></a>
+<a href="#"><img src="https://img.shields.io/badge/SQLite-内置存储-lightgrey?style=flat-square"></a>
+</p>
+ 
+---
+ 
+## ✨ Features 
+| Feature | Description |
+|---------|-------------|
+| 🌍 统一入口 | `/chat/completions`、`/embeddings`、`/images/generations`… 全部转发 |
+| 🧩 多后端 | vLLM、SGLang、lmdeploy、Ollama… 任意组合 |
+| 💾 持久化 | SQLite + SQLModel 零配置存储路由 |
+| ⚡ 实时流 | SSE & Chunked Transfer 全双工支持 |
+| 🎨 Web UI | Gradio 即用的管理面板 |
+| 🔍 兼容 OpenAI | SDK / LangChain / AutoGen 等无需改动一行代码 |
+ 
+---
+ 
+### 📦 Quick Start 
+Step-1：安装 
+```bash 
+uv sync
+```
+
+ 
+Step-2：启动 
+```bash 
+python -m openai_router.main --host localhost --port 8000 
+```
+浏览器自动打开  
+📍 UI：`http://localhost:8000`  
+📍 API：`http://localhost:8000/v1`
+ 
+Step-3：添加后端 
+在 Web UI 「添加 / 更新」填入：
+- 模型名：`gpt-4`
+- 后端 URL：`http://localhost:8080/v1`
+ 
+<img src="static/ui.png" width="800">
+ 
+---
+ 
+## 🔧 API Usage 
+### **像官方 OpenAI SDK一样调用**
+```python 
+from openai import OpenAI 
+client = OpenAI(
+      base_url="http://localhost:8000/v1",
+      api_key="sk-dummy"
+)
+resp = client.chat.completions.create(
+      model="gpt-4",
+      messages=[{"role":"user","content":"hello"}],
+      stream=True 
+)
+for chunk in resp:
+      print(chunk.choices[0].delta.content or "", end="")
+```
+ 
+cURL 
+```bash 
+curl http://localhost:8000/v1/chat/completions \
+     -H "Content-Type: application/json" \
+     -d '{"model":"gpt-4","messages":[{"role":"user","content":"hi"}],"stream":true}'
+```
+ 
+---
+ 
+## 🗂️ Endpoints 
+| Method | Path | Description |
+|--------|------|-------------|
+| `GET` | `/` | Gradio Admin UI |
+| `GET` | `/docs` | OpenAPI Swagger |
+| `GET` | `/v1/models` | List available models |
+ `POST` | `/v1/responses` | Responses API |
+| `POST` | `/v1/chat/completions` | Chat completion |
+| `POST` | `/v1/embeddings` | Text embeddings |
+| `POST` | `/v1/images/generations` | DALL·E style |
+| `POST` | `/v1/audio/transcriptions` | Whisper |
+| … | … | All OpenAI endpoints supported |
+ 
+---
+ 
+## ⚙️ Configuration 
+CLI Options 
+```bash 
+python -m openai_router.main --help 
+```
+| Flag | Default | Description |
+|------|---------|-------------|
+| `--host` | `localhost` | Bind address |
+| `--port` | `8000` | Bind port |
+ 
+
+---
+ 
+## 🏗️ Architecture 
+<img src="static/arch.png" width="800">

openai_router-0.1.0/pyproject.toml

@@ -0,0 +1,29 @@
+[project]
+name = "openai-router"
+version = "0.1.0"
+description = "openai-router"
+readme = "README.md"
+requires-python = ">=3.11"
+dependencies = [
+    "fastapi>=0.120.3",
+    "gradio>=5.49.1",
+    "httpx>=0.28.1",
+    "loguru>=0.7.3",
+    "sqlmodel>=0.0.27",
+    "uvicorn>=0.38.0",
+]
+
+[project.scripts]
+openai_router = "openai_router.main:cli_app"
+
+[[tool.uv.index]]
+url = "https://pypi.org/simple/"
+default = true
+
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[build-system]
+requires = ["setuptools", "wheel"]
+build-backend = "setuptools.build_meta"

openai_router-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

openai_router-0.1.0/src/openai_router/main.py

@@ -0,0 +1,474 @@
+from typing import Annotated
+from fastapi import FastAPI, HTTPException, Request
+from fastapi.responses import Response, StreamingResponse
+from starlette.concurrency import run_in_threadpool
+import httpx
+from loguru import logger
+from contextlib import asynccontextmanager
+import gradio as gr
+import pandas as pd
+from datetime import datetime, timezone
+import typer
+import uvicorn
+import webbrowser
+import time
+
+# --- 导入 SQLModel 和同步组件 ---
+# 切换到同步 Session 和 Engine
+from sqlmodel import Field, SQLModel, create_engine, Session, select
+from sqlalchemy.engine import Engine  # 导入同步 Engine
+
+# --- 数据库配置 ---
+SQLITE_DB_FILE = "routes.db"
+# 使用同步 SQLite URL
+SQLITE_URL = f"sqlite:///{SQLITE_DB_FILE}"
+
+# --- 全局变量 ---
+client: httpx.AsyncClient = None
+# 同步 Engine
+engine: Engine = None
+
+
+# --- SQLModel 数据模型 ---
+class ModelRoute(SQLModel, table=True):
+    """
+    一个 SQLModel 模型，用于存储模型名称到后端 URL 的路由。
+    'model_name' 是主键，确保了唯一性。
+    """
+
+    model_name: str = Field(primary_key=True, index=True)
+    model_url: str
+    created: datetime = Field(
+        default_factory=lambda: datetime.now(timezone.utc), nullable=False
+    )
+
+
+# --- 同步数据库辅助函数 (将在线程池中执行) ---
+
+
+def create_db_and_tables_sync():
+    """同步创建数据库和表"""
+    SQLModel.metadata.create_all(engine)
+
+
+def get_all_model_names_sync():
+    """同步地从数据库中查询所有可用的模型名称"""
+    with Session(engine) as session:
+        statement = select(ModelRoute.model_name)
+        results = session.exec(statement)
+        available_models = results.all()
+    return available_models
+
+
+def get_all_routes_sync():
+    """同步地从数据库中查询所有可用的 ModelRoute 记录"""
+    with Session(engine) as session:
+        # 查询 ModelRoute 的所有记录
+        statement = select(ModelRoute)
+        results = session.exec(statement)
+        # 返回 ModelRoute 对象的列表
+        all_routes = results.all()
+    return all_routes
+
+
+def get_routing_info_sync(model: str):
+    """同步地从数据库中查询模型和所有可用模型"""
+    with Session(engine) as session:
+        # 1. 获取特定模型
+        db_route = session.get(ModelRoute, model)
+
+        # 2. 获取所有可用模型
+        available_models = get_all_model_names_sync()
+        server = db_route.model_url if db_route else None
+
+        return server, available_models
+
+
+# --- FastAPI 生命周期 ---
+
+
+@asynccontextmanager
+async def lifespan(app: FastAPI):
+    global client, engine
+
+    # --- 启动时的逻辑 ---
+
+    # 1. 初始化数据库引擎 (同步)
+    engine = create_engine(SQLITE_URL, echo=False)
+
+    # 2. 创建数据库和表 (使用 run_in_threadpool 执行同步代码)
+    await run_in_threadpool(create_db_and_tables_sync)
+
+    # 3. **移除环境变量同步逻辑**
+
+    # 4. 初始化 httpx 客户端
+    timeout = httpx.Timeout(10.0, connect=60.0, read=None, write=60.0)
+    client = httpx.AsyncClient(timeout=timeout)
+
+    yield  # 应用运行期间
+
+    # --- 关闭时的逻辑 ---
+
+    if client:
+        await client.aclose()
+        logger.info("HTTPX client closed.")
+
+    if engine:
+        engine.dispose()
+        logger.info("Database engine disposed.")
+
+
+# --- FastAPI 核心应用 ---
+
+# 使用 lifespan 创建 FastAPI 实例
+app = FastAPI(lifespan=lifespan)
+
+
+async def _get_routing_info(request: Request):
+    """
+    异步辅助函数：解析请求体，并在线程池中执行同步数据库查询。
+    """
+    try:
+        json_body = await request.json()
+    except Exception as e:
+        logger.error(f"Failed to parse request body: {e}")
+        raise HTTPException(status_code=400, detail="Invalid JSON body")
+
+    model = json_body.get("model")
+    if model is None:
+        raise HTTPException(
+            status_code=400, detail="'model' field is required in request body"
+        )
+
+    # 在线程池中执行同步查询
+    server, available_models = await run_in_threadpool(get_routing_info_sync, model)
+
+    if server is None:
+        raise HTTPException(
+            status_code=400,
+            detail=f"Invalid model: {model}. Available models: {available_models}",
+        )
+
+    backend_url = server + request.url.path
+    logger.info(f"Routing to backend_url: {backend_url} for model {model}")
+
+    return backend_url, json_body
+
+
+async def _stream_proxy(backend_url: str, request: Request, json_body: dict):
+    """
+    这是一个异步生成器，用于代理流式响应。
+    """
+    headers = {
+        h: v
+        for h, v in request.headers.items()
+        if h.lower() not in ["host", "content-length"]
+    }
+
+    try:
+        async with client.stream(
+            request.method,
+            backend_url,
+            params=request.query_params,
+            json=json_body,
+            headers=headers,
+        ) as response:
+            if response.status_code >= 400:
+                error_content = await response.aread()
+                logger.warning(
+                    f"Backend error: {response.status_code} - {error_content.decode()}"
+                )
+                raise HTTPException(
+                    status_code=response.status_code, detail=error_content.decode()
+                )
+
+            async for chunk in response.aiter_bytes():
+                yield chunk
+
+    except httpx.ConnectError as e:
+        logger.error(f"Connection error to backend {backend_url}: {e}")
+        raise HTTPException(status_code=503, detail="Backend service unavailable")
+    except Exception as e:
+        logger.error(f"An error occurred during streaming proxy: {e}")
+        logger.error("Streaming interrupted due to an error.")
+
+
+async def _non_stream_proxy(backend_url: str, request: Request, json_body: dict):
+    """
+    处理非流式请求的代理逻辑。
+    """
+    headers = {
+        h: v
+        for h, v in request.headers.items()
+        if h.lower() not in ["host", "content-length"]
+    }
+
+    try:
+        response = await client.post(
+            backend_url, params=request.query_params, json=json_body, headers=headers
+        )
+        return Response(
+            content=response.content,
+            media_type=response.headers.get("Content-Type"),
+            status_code=response.status_code,
+        )
+
+    except httpx.ConnectError as e:
+        logger.error(f"Connection error to backend {backend_url}: {e}")
+        raise HTTPException(status_code=503, detail="Backend service unavailable")
+    except httpx.ReadTimeout as e:
+        logger.error(f"Read timeout from backend {backend_url}: {e}")
+        raise HTTPException(status_code=504, detail="Backend request timed out")
+    except Exception as e:
+        logger.error(f"An error occurred during non-streaming proxy: {e}")
+        raise HTTPException(status_code=500, detail=f"Internal proxy error: {e}")
+
+
+@app.get("/v1/models", summary="List available models")
+async def list_models():
+    """
+    OpenAI 兼容接口: 列出所有可用的模型。
+    """
+    try:
+        all_routes: list[ModelRoute] = await run_in_threadpool(get_all_routes_sync)
+
+        models_data = []
+        for route in all_routes:
+            created_timestamp = int(route.created.timestamp())
+
+            models_data.append(
+                {
+                    "id": route.model_name,
+                    "object": "model",
+                    # 3. 使用数据库中的 created 时间戳
+                    "created": created_timestamp,
+                    "owned_by": "openai_router",
+                    "permission": [],
+                }
+            )
+
+        response_data = {"object": "list", "data": models_data}
+
+        logger.info(f"Returning {len(all_routes)} available models for /v1/models.")
+
+        return response_data
+
+    except Exception as e:
+        logger.error(f"Failed to list models: {e}")
+        raise HTTPException(
+            status_code=500, detail=f"Internal server error when retrieving models: {e}"
+        )
+
+
+@app.post("/v1/responses", summary="/v1/responses ")
+@app.post("/v1/completions", summary="/v1/completions")
+@app.post("/v1/chat/completions", summary="/v1/chat/completions")
+@app.post("/v1/embeddings", summary="/v1/embeddings")
+@app.post("/v1/moderations", summary="/v1/moderations")
+@app.post("/v1/images/generations", summary="/v1/images/generations")
+@app.post("/v1/images/edits", summary="/v1/images/edits")
+@app.post("/v1/images/variations", summary="/v1/images/variations")
+@app.post("/v1/audio/transcriptions", summary="/v1/audio/transcriptions")
+@app.post("/v1/audio/speech", summary="/v1/audio/speech")
+@app.post("/v1/rerank", summary="/v1/rerank")
+async def router(request: Request):
+    backend_url, json_body = await _get_routing_info(request)
+    if json_body.get("stream", False):
+        return StreamingResponse(
+            _stream_proxy(backend_url, request, json_body),
+            media_type="text/event-stream",
+        )
+    else:
+        return await _non_stream_proxy(backend_url, request, json_body)
+
+
+# --- Gradio 管理界面逻辑 (同步数据库操作) ---
+
+
+def get_current_routes_sync():
+    """同步获取当前路由表"""
+    with Session(engine) as session:
+        statement = select(ModelRoute)
+        routes_db = session.exec(statement)
+        routes = [[route.model_name, route.model_url] for route in routes_db.all()]
+    return routes
+
+
+def add_or_update_route_sync(model_name: str, model_url: str):
+    """同步添加或更新一个路由到数据库"""
+    status_message = ""
+    with Session(engine) as session:
+        db_route = session.get(ModelRoute, model_name)
+
+        if db_route:
+            db_route.model_url = model_url
+            status_message = f"路由 '{model_name}' 已更新。"
+        else:
+            db_route = ModelRoute(model_name=model_name, model_url=model_url)
+            status_message = f"路由 '{model_name}' 已添加。"
+
+        session.add(db_route)
+        session.commit()
+
+    logger.info(f"[Admin] {status_message}")
+    return status_message
+
+
+def delete_route_sync(model_name: str):
+    """同步从数据库删除一个路由"""
+    status_message = ""
+    with Session(engine) as session:
+        db_route = session.get(ModelRoute, model_name)
+
+        if db_route:
+            session.delete(db_route)
+            session.commit()
+            status_message = f"路由 '{model_name}' 已删除。"
+            logger.info(f"[Admin] Route deleted: {model_name}")
+        else:
+            status_message = f"错误: 未找到路由 '{model_name}'。"
+
+    return status_message
+
+
+# Gradio 异步事件处理函数 (使用 run_in_threadpool 调用同步函数)
+
+
+async def get_current_routes():
+    """异步调用同步函数获取当前路由表"""
+    return await run_in_threadpool(get_current_routes_sync)
+
+
+async def add_or_update_route(model_name: str, model_url: str):
+    """异步调用同步函数添加或更新路由"""
+    if not model_name or not model_url:
+        return "模型名称和 URL 不能为空", await get_current_routes()
+
+    status_message = await run_in_threadpool(
+        add_or_update_route_sync, model_name, model_url
+    )
+    return status_message, await get_current_routes()
+
+
+async def delete_route(model_name: str):
+    """异步调用同步函数删除路由"""
+    if not model_name:
+        return "要删除的模型名称不能为空", await get_current_routes()
+
+    status_message = await run_in_threadpool(delete_route_sync, model_name)
+    return status_message, await get_current_routes()
+
+
+def on_select_route(routes_data: pd.DataFrame, evt: gr.SelectData):
+    """
+    Gradio: 当用户点击表格中的一行时，填充输入框。
+    """
+    if evt.index is None:
+        return "", ""
+
+    selected_row = routes_data.iloc[evt.index[0]]
+    model_name = selected_row.iloc[0]
+    model_url = selected_row.iloc[1]
+
+    return model_name, model_url
+
+
+def create_admin_ui():
+    """创建 Gradio Blocks 界面"""
+    with gr.Blocks(
+        title="模型路由管理器", css="footer {display: none !important}"
+    ) as admin_ui:
+        gr.Markdown(
+            "<h1 style='text-align:center;'>模型路由管理器</h1>", elem_id="title"
+        )
+        gr.Markdown(
+            """**将不同端口、不同服务的`openAI`的接口通过统一的url进行路由！兼容 `vLLM`、`SGLang`、`lmdeoply`、`Ollama`等。**\n
+**注意：** 所有路由配置都持久化到 `routes.db` 数据库中。您需要手动添加初始路由。"""
+        )
+
+        with gr.Row():
+            refresh_button = gr.Button("刷新路由列表")
+
+        with gr.Row():
+            with gr.Column(scale=2):
+                routes_datagrid = gr.DataFrame(
+                    headers=["模型名称 (Model Name)", "后端 URL (Backend URL)"],
+                    label="当前路由表",
+                    row_count=(1, "fixed"),
+                    col_count=(2, "fixed"),
+                    interactive=False,
+                )
+            with gr.Column(scale=1):
+                gr.Markdown("### 管理路由")
+                status_output = gr.Textbox(
+                    label="操作状态",
+                    interactive=False,
+                    value="这里用于显示上一次的操作状态",
+                )
+                model_name_input = gr.Textbox(label="模型名称", value="gpt4")
+                model_url_input = gr.Textbox(
+                    label="后端 URL", value="http://localhost:8082"
+                )
+                with gr.Row():
+                    add_update_button = gr.Button("添加 / 更新")
+                    delete_button = gr.Button(
+                        "删除",
+                        variant="stop",
+                    )
+
+        # --- 绑定 Gradio 事件 ---
+        admin_ui.load(get_current_routes, outputs=routes_datagrid)
+        refresh_button.click(get_current_routes, outputs=routes_datagrid)
+
+        add_update_button.click(
+            add_or_update_route,
+            inputs=[model_name_input, model_url_input],
+            outputs=[status_output, routes_datagrid],
+        )
+
+        delete_button.click(
+            delete_route,
+            inputs=[model_name_input],
+            outputs=[status_output, routes_datagrid],
+        )
+
+        routes_datagrid.select(
+            on_select_route,
+            inputs=[routes_datagrid],
+            outputs=[model_name_input, model_url_input],
+        )
+
+    return admin_ui
+
+
+# --- 挂载 Gradio 应用 ---
+admin_interface = create_admin_ui()
+app = gr.mount_gradio_app(app, admin_interface, path="/")
+
+cli_app = typer.Typer()
+
+
+@cli_app.command()
+def main(
+    host: Annotated[
+        str, typer.Option(help="指定监听的主机地址", show_default=True)
+    ] = "localhost",
+    port: Annotated[
+        int, typer.Option(help="指定监听的主机端口", show_default=True)
+    ] = 8000,
+):
+    base_url = f"http://{host}:{port}"
+    logger.info(f"UI 界面: http://{host}:{port}")
+    logger.info(f"openAI API 文档: http://{host}:{port}/docs")
+    time.sleep(1)
+    try:
+        if "0.0.0.0" in base_url:
+            base_url = f"http://localhost:{port}"
+        webbrowser.open_new_tab(base_url)
+    except Exception as e:
+        logger.warning(f"无法自动打开浏览器: {e}")
+    uvicorn.run(app, host=host, port=port)
+
+
+if __name__ == "__main__":
+    cli_app()

openai_router-0.1.0/src/openai_router.egg-info/PKG-INFO

@@ -0,0 +1,127 @@
+Metadata-Version: 2.4
+Name: openai-router
+Version: 0.1.0
+Summary: openai-router
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: fastapi>=0.120.3
+Requires-Dist: gradio>=5.49.1
+Requires-Dist: httpx>=0.28.1
+Requires-Dist: loguru>=0.7.3
+Requires-Dist: sqlmodel>=0.0.27
+Requires-Dist: uvicorn>=0.38.0
+Dynamic: license-file
+
+
+<!-- markdownlint-disable MD033 -->
+<h1 align="center">
+🚀 OpenAI Router 
+</h1>
+ 
+<p align="center">
+<b>轻量级、持久化、零配置的 OpenAI API 统一网关</b><br>
+一键聚合 vLLM、SGLang、lmdeploy、Ollama…  
+</p>
+ 
+<p align="center">
+<a href="#"><img src="https://img.shields.io/badge/license-MIT-blue?style=flat-square"></a>
+<a href="https://fastapi.tiangolo.com"><img src="https://img.shields.io/badge/FastAPI-v0.115+-teal?style=flat-square"></a>
+<a href="https://gradio.app"><img src="https://img.shields.io/badge/Gradio-v5+-orange?style=flat-square"></a>
+<a href="#"><img src="https://img.shields.io/badge/SQLite-内置存储-lightgrey?style=flat-square"></a>
+</p>
+ 
+---
+ 
+## ✨ Features 
+| Feature | Description |
+|---------|-------------|
+| 🌍 统一入口 | `/chat/completions`、`/embeddings`、`/images/generations`… 全部转发 |
+| 🧩 多后端 | vLLM、SGLang、lmdeploy、Ollama… 任意组合 |
+| 💾 持久化 | SQLite + SQLModel 零配置存储路由 |
+| ⚡ 实时流 | SSE & Chunked Transfer 全双工支持 |
+| 🎨 Web UI | Gradio 即用的管理面板 |
+| 🔍 兼容 OpenAI | SDK / LangChain / AutoGen 等无需改动一行代码 |
+ 
+---
+ 
+### 📦 Quick Start 
+Step-1：安装 
+```bash 
+uv sync
+```
+
+ 
+Step-2：启动 
+```bash 
+python -m openai_router.main --host localhost --port 8000 
+```
+浏览器自动打开  
+📍 UI：`http://localhost:8000`  
+📍 API：`http://localhost:8000/v1`
+ 
+Step-3：添加后端 
+在 Web UI 「添加 / 更新」填入：
+- 模型名：`gpt-4`
+- 后端 URL：`http://localhost:8080/v1`
+ 
+<img src="static/ui.png" width="800">
+ 
+---
+ 
+## 🔧 API Usage 
+### **像官方 OpenAI SDK一样调用**
+```python 
+from openai import OpenAI 
+client = OpenAI(
+      base_url="http://localhost:8000/v1",
+      api_key="sk-dummy"
+)
+resp = client.chat.completions.create(
+      model="gpt-4",
+      messages=[{"role":"user","content":"hello"}],
+      stream=True 
+)
+for chunk in resp:
+      print(chunk.choices[0].delta.content or "", end="")
+```
+ 
+cURL 
+```bash 
+curl http://localhost:8000/v1/chat/completions \
+     -H "Content-Type: application/json" \
+     -d '{"model":"gpt-4","messages":[{"role":"user","content":"hi"}],"stream":true}'
+```
+ 
+---
+ 
+## 🗂️ Endpoints 
+| Method | Path | Description |
+|--------|------|-------------|
+| `GET` | `/` | Gradio Admin UI |
+| `GET` | `/docs` | OpenAPI Swagger |
+| `GET` | `/v1/models` | List available models |
+ `POST` | `/v1/responses` | Responses API |
+| `POST` | `/v1/chat/completions` | Chat completion |
+| `POST` | `/v1/embeddings` | Text embeddings |
+| `POST` | `/v1/images/generations` | DALL·E style |
+| `POST` | `/v1/audio/transcriptions` | Whisper |
+| … | … | All OpenAI endpoints supported |
+ 
+---
+ 
+## ⚙️ Configuration 
+CLI Options 
+```bash 
+python -m openai_router.main --help 
+```
+| Flag | Default | Description |
+|------|---------|-------------|
+| `--host` | `localhost` | Bind address |
+| `--port` | `8000` | Bind port |
+ 
+
+---
+ 
+## 🏗️ Architecture 
+<img src="static/arch.png" width="800">

openai_router-0.1.0/src/openai_router.egg-info/SOURCES.txt

@@ -0,0 +1,11 @@
+LICENSE.txt
+README.md
+pyproject.toml
+src/openai_router/__init__.py
+src/openai_router/main.py
+src/openai_router.egg-info/PKG-INFO
+src/openai_router.egg-info/SOURCES.txt
+src/openai_router.egg-info/dependency_links.txt
+src/openai_router.egg-info/entry_points.txt
+src/openai_router.egg-info/requires.txt
+src/openai_router.egg-info/top_level.txt

openai_router-0.1.0/src/openai_router.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

openai_router-0.1.0/src/openai_router.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+openai_router = openai_router.main:cli_app

openai_router-0.1.0/src/openai_router.egg-info/requires.txt

@@ -0,0 +1,6 @@
+fastapi>=0.120.3
+gradio>=5.49.1
+httpx>=0.28.1
+loguru>=0.7.3
+sqlmodel>=0.0.27
+uvicorn>=0.38.0

openai_router-0.1.0/src/openai_router.egg-info/top_level.txt

@@ -0,0 +1 @@
+openai_router