infinity_llm_client 0.1.0__tar.gz

infinity_llm_client-0.1.0/LICENSE.md

@@ -0,0 +1,21 @@
+# MIT License
+
+Copyright (c) 2025 infinity_system
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

infinity_llm_client-0.1.0/PKG-INFO

@@ -0,0 +1,110 @@
+Metadata-Version: 2.4
+Name: infinity_llm_client
+Version: 0.1.0
+Summary: 强类型、可扩展的 LLM 异步客户端库，支持 OpenAI 兼容 API、流式对话、工具调用与多模型消息格式
+Author: infinity_system: yin_bailiang
+License: MIT
+Project-URL: Repository, https://github.com/yinbailiang/infinity_llm
+Keywords: llm,openai,async,asyncio,function-calling,tool-calling,streaming,chat
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Framework :: AsyncIO
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE.md
+Requires-Dist: pydantic
+Requires-Dist: aiohttp
+Provides-Extra: test
+Requires-Dist: pytest; extra == "test"
+Requires-Dist: pytest-cov; extra == "test"
+Requires-Dist: pytest-asyncio; extra == "test"
+Provides-Extra: dev
+Requires-Dist: interrogate; extra == "dev"
+Requires-Dist: ruff; extra == "dev"
+Requires-Dist: pyright; extra == "dev"
+Requires-Dist: pre-commit; extra == "dev"
+Requires-Dist: infinity_llm_client[test]; extra == "dev"
+Dynamic: license-file
+
+# InfinityLLM — Async LLM Client
+
+[![Test](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml/badge.svg)](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml)
+[![Pyright](https://img.shields.io/badge/pyright-strict-blue)](ENGINEERING.md)
+[![License](https://img.shields.io/badge/license-MIT-green)](LICENSE.md)
+[![Supported Python](https://img.shields.io/badge/python-3.12%2B-blue)](https://pypi.org/project/infinity_llm/)
+
+**强类型、可扩展的 LLM 异步客户端库 — 支持 OpenAI 兼容 API、流式对话、工具调用。**
+
+## ✨ Features
+
+| 类别 | 能力 |
+| - | - |
+| 类型安全 | Pydantic 负载校验 · pyright **strict** |
+| 多 Provider | 工厂注册模式，轻松扩展新 LLM 服务商 |
+| OpenAI 兼容 | 完整实现 OpenAI Chat Completions 流式 API |
+| 工具调用 | ToolRegistry 自动从 Python 函数推断 Tool Schema |
+| 流式对话 | `stream_chat()` 异步生成器，支持 Text / ToolCall / Usage chunk |
+| 多模态消息 | 文本 + 图片 URL 混合内容 |
+| 连接管理 | 指数退避重试 + 抖动 + 连接池复用 |
+
+## 📦 Installation
+
+```bash
+pip install infinity_llm
+```
+
+## 🚀 Quick Start
+
+```python
+from llm import (
+    Message, Messages,
+    OpenAIConfig, create_client,
+    ToolRegistry,
+)
+
+# 创建客户端
+config = OpenAIConfig(
+    model="gpt-4o-mini",
+    api_key="sk-...",
+)
+client = create_client(config)
+
+# 流式对话
+messages = Messages([
+    Message.system("你是一个有用的助手"),
+    Message.user("你好"),
+])
+
+async with client:
+    async for chunk in client.stream_chat(messages):
+        print(chunk)
+```
+
+## 🧱 Architecture
+
+```
+llm/
+├── clients/          # 客户端抽象 + provider 实现
+│   ├── base.py       #   LLMClient 抽象基类
+│   ├── config.py     #   ConnectionConfig / LLMConfig
+│   ├── exceptions.py #   异常层级
+│   ├── provider.py   #   工厂注册表
+│   └── open_ai/      #   OpenAI 兼容实现
+├── models/           # 消息 / Chunk / 工具定义
+│   ├── messages.py   #   Message, Messages, ToolCall
+│   ├── chunks.py     #   StreamChunk 子类
+│   └── tools.py      #   ToolDefinition, ParameterProperty
+└── tools/            # 工具注册与类型推断
+    ├── registry.py   #   ToolRegistry
+    └── introspection.py  #   函数 → ToolDefinition 自动推断
+```
+
+## 📄 License
+
+MIT

infinity_llm_client-0.1.0/README.md

@@ -0,0 +1,76 @@
+# InfinityLLM — Async LLM Client
+
+[![Test](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml/badge.svg)](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml)
+[![Pyright](https://img.shields.io/badge/pyright-strict-blue)](ENGINEERING.md)
+[![License](https://img.shields.io/badge/license-MIT-green)](LICENSE.md)
+[![Supported Python](https://img.shields.io/badge/python-3.12%2B-blue)](https://pypi.org/project/infinity_llm/)
+
+**强类型、可扩展的 LLM 异步客户端库 — 支持 OpenAI 兼容 API、流式对话、工具调用。**
+
+## ✨ Features
+
+| 类别 | 能力 |
+| - | - |
+| 类型安全 | Pydantic 负载校验 · pyright **strict** |
+| 多 Provider | 工厂注册模式，轻松扩展新 LLM 服务商 |
+| OpenAI 兼容 | 完整实现 OpenAI Chat Completions 流式 API |
+| 工具调用 | ToolRegistry 自动从 Python 函数推断 Tool Schema |
+| 流式对话 | `stream_chat()` 异步生成器，支持 Text / ToolCall / Usage chunk |
+| 多模态消息 | 文本 + 图片 URL 混合内容 |
+| 连接管理 | 指数退避重试 + 抖动 + 连接池复用 |
+
+## 📦 Installation
+
+```bash
+pip install infinity_llm
+```
+
+## 🚀 Quick Start
+
+```python
+from llm import (
+    Message, Messages,
+    OpenAIConfig, create_client,
+    ToolRegistry,
+)
+
+# 创建客户端
+config = OpenAIConfig(
+    model="gpt-4o-mini",
+    api_key="sk-...",
+)
+client = create_client(config)
+
+# 流式对话
+messages = Messages([
+    Message.system("你是一个有用的助手"),
+    Message.user("你好"),
+])
+
+async with client:
+    async for chunk in client.stream_chat(messages):
+        print(chunk)
+```
+
+## 🧱 Architecture
+
+```
+llm/
+├── clients/          # 客户端抽象 + provider 实现
+│   ├── base.py       #   LLMClient 抽象基类
+│   ├── config.py     #   ConnectionConfig / LLMConfig
+│   ├── exceptions.py #   异常层级
+│   ├── provider.py   #   工厂注册表
+│   └── open_ai/      #   OpenAI 兼容实现
+├── models/           # 消息 / Chunk / 工具定义
+│   ├── messages.py   #   Message, Messages, ToolCall
+│   ├── chunks.py     #   StreamChunk 子类
+│   └── tools.py      #   ToolDefinition, ParameterProperty
+└── tools/            # 工具注册与类型推断
+    ├── registry.py   #   ToolRegistry
+    └── introspection.py  #   函数 → ToolDefinition 自动推断
+```
+
+## 📄 License
+
+MIT

infinity_llm_client-0.1.0/pyproject.toml

@@ -0,0 +1,114 @@
+[project]
+name = "infinity_llm_client"
+version = "0.1.0"
+description = "强类型、可扩展的 LLM 异步客户端库，支持 OpenAI 兼容 API、流式对话、工具调用与多模型消息格式"
+readme = "README.md"
+license = { text = "MIT" }
+authors = [
+    { name = "infinity_system: yin_bailiang" }
+]
+keywords = [
+    "llm",
+    "openai",
+    "async",
+    "asyncio",
+    "function-calling",
+    "tool-calling",
+    "streaming",
+    "chat",
+]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Intended Audience :: Developers",
+    "License :: OSI Approved :: MIT License",
+    "Operating System :: OS Independent",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Topic :: Scientific/Engineering :: Artificial Intelligence",
+    "Framework :: AsyncIO",
+]
+requires-python = ">=3.12"
+
+dependencies = [
+    "pydantic",
+    "aiohttp",
+]
+
+[project.urls]
+Repository = "https://github.com/yinbailiang/infinity_llm"
+
+[project.optional-dependencies]
+test = [
+    "pytest",
+    "pytest-cov",
+    "pytest-asyncio",
+]
+dev = [
+    "interrogate",
+    "ruff",
+    "pyright",
+    "pre-commit",
+    "infinity_llm_client[test]",
+]
+
+[tool.pytest.ini_options]
+asyncio_mode = "auto"
+addopts = "-m 'not slow'"
+markers = [
+    "slow: long-running stress / stability tests",
+]
+
+[build-system]
+requires = ["setuptools>=61.0"]
+build-backend = "setuptools.build_meta"
+
+[tool.setuptools]
+package-dir = {"" = "src"}
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[tool.ruff]
+line-length = 120
+target-version = "py312"
+exclude = ["tests"]
+
+[tool.ruff.lint]
+select = [
+    "E",      # pycodestyle errors
+    "F",      # pyflakes
+    "I",      # isort
+    "ASYNC",  # async/await best practices
+    "PLE",    # pylint errors
+]
+ignore = [
+    "E501",     # line too long (handled by formatter)
+    "ASYNC109", # async function with timeout parameter (intentional API design)
+]
+
+[tool.ruff.lint.isort]
+known-first-party = ["llm"]
+
+[tool.ruff.format]
+indent-style = "space"
+quote-style = "single"
+line-ending = "lf"
+
+[tool.pyright]
+typeCheckingMode = "strict"
+reportMissingTypeStubs = false
+reportMissingImports = "error"
+exclude = ["tests", "**/node_modules", "**/__pycache__", "**/.*", ".venv"]
+venvPath = "."
+venv = ".venv"
+
+[tool.interrogate]
+fail-under = 60
+ignore-init-method = true
+ignore-init-module = true
+ignore-magic = true
+ignore-private = true
+ignore-semiprivate = true
+ignore-nested-functions = true
+exclude = ["tests", "benchmarks", "experimental", "docs"]

infinity_llm_client-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

infinity_llm_client-0.1.0/src/infinity_llm_client.egg-info/PKG-INFO

@@ -0,0 +1,110 @@
+Metadata-Version: 2.4
+Name: infinity_llm_client
+Version: 0.1.0
+Summary: 强类型、可扩展的 LLM 异步客户端库，支持 OpenAI 兼容 API、流式对话、工具调用与多模型消息格式
+Author: infinity_system: yin_bailiang
+License: MIT
+Project-URL: Repository, https://github.com/yinbailiang/infinity_llm
+Keywords: llm,openai,async,asyncio,function-calling,tool-calling,streaming,chat
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Framework :: AsyncIO
+Requires-Python: >=3.12
+Description-Content-Type: text/markdown
+License-File: LICENSE.md
+Requires-Dist: pydantic
+Requires-Dist: aiohttp
+Provides-Extra: test
+Requires-Dist: pytest; extra == "test"
+Requires-Dist: pytest-cov; extra == "test"
+Requires-Dist: pytest-asyncio; extra == "test"
+Provides-Extra: dev
+Requires-Dist: interrogate; extra == "dev"
+Requires-Dist: ruff; extra == "dev"
+Requires-Dist: pyright; extra == "dev"
+Requires-Dist: pre-commit; extra == "dev"
+Requires-Dist: infinity_llm_client[test]; extra == "dev"
+Dynamic: license-file
+
+# InfinityLLM — Async LLM Client
+
+[![Test](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml/badge.svg)](https://github.com/yinbailiang/infinity_llm/actions/workflows/test.yml)
+[![Pyright](https://img.shields.io/badge/pyright-strict-blue)](ENGINEERING.md)
+[![License](https://img.shields.io/badge/license-MIT-green)](LICENSE.md)
+[![Supported Python](https://img.shields.io/badge/python-3.12%2B-blue)](https://pypi.org/project/infinity_llm/)
+
+**强类型、可扩展的 LLM 异步客户端库 — 支持 OpenAI 兼容 API、流式对话、工具调用。**
+
+## ✨ Features
+
+| 类别 | 能力 |
+| - | - |
+| 类型安全 | Pydantic 负载校验 · pyright **strict** |
+| 多 Provider | 工厂注册模式，轻松扩展新 LLM 服务商 |
+| OpenAI 兼容 | 完整实现 OpenAI Chat Completions 流式 API |
+| 工具调用 | ToolRegistry 自动从 Python 函数推断 Tool Schema |
+| 流式对话 | `stream_chat()` 异步生成器，支持 Text / ToolCall / Usage chunk |
+| 多模态消息 | 文本 + 图片 URL 混合内容 |
+| 连接管理 | 指数退避重试 + 抖动 + 连接池复用 |
+
+## 📦 Installation
+
+```bash
+pip install infinity_llm
+```
+
+## 🚀 Quick Start
+
+```python
+from llm import (
+    Message, Messages,
+    OpenAIConfig, create_client,
+    ToolRegistry,
+)
+
+# 创建客户端
+config = OpenAIConfig(
+    model="gpt-4o-mini",
+    api_key="sk-...",
+)
+client = create_client(config)
+
+# 流式对话
+messages = Messages([
+    Message.system("你是一个有用的助手"),
+    Message.user("你好"),
+])
+
+async with client:
+    async for chunk in client.stream_chat(messages):
+        print(chunk)
+```
+
+## 🧱 Architecture
+
+```
+llm/
+├── clients/          # 客户端抽象 + provider 实现
+│   ├── base.py       #   LLMClient 抽象基类
+│   ├── config.py     #   ConnectionConfig / LLMConfig
+│   ├── exceptions.py #   异常层级
+│   ├── provider.py   #   工厂注册表
+│   └── open_ai/      #   OpenAI 兼容实现
+├── models/           # 消息 / Chunk / 工具定义
+│   ├── messages.py   #   Message, Messages, ToolCall
+│   ├── chunks.py     #   StreamChunk 子类
+│   └── tools.py      #   ToolDefinition, ParameterProperty
+└── tools/            # 工具注册与类型推断
+    ├── registry.py   #   ToolRegistry
+    └── introspection.py  #   函数 → ToolDefinition 自动推断
+```
+
+## 📄 License
+
+MIT

infinity_llm_client-0.1.0/src/infinity_llm_client.egg-info/SOURCES.txt

@@ -0,0 +1,29 @@
+LICENSE.md
+README.md
+pyproject.toml
+src/infinity_llm_client.egg-info/PKG-INFO
+src/infinity_llm_client.egg-info/SOURCES.txt
+src/infinity_llm_client.egg-info/dependency_links.txt
+src/infinity_llm_client.egg-info/requires.txt
+src/infinity_llm_client.egg-info/top_level.txt
+src/llm/__init__.py
+src/llm/py.typed
+src/llm/clients/__init__.py
+src/llm/clients/base.py
+src/llm/clients/config.py
+src/llm/clients/exceptions.py
+src/llm/clients/provider.py
+src/llm/clients/open_ai/__init__.py
+src/llm/clients/open_ai/aggregation.py
+src/llm/clients/open_ai/client.py
+src/llm/clients/open_ai/config.py
+src/llm/clients/open_ai/connection.py
+src/llm/clients/open_ai/open_ai_models.py
+src/llm/clients/open_ai/response_format.py
+src/llm/models/__init__.py
+src/llm/models/chunks.py
+src/llm/models/messages.py
+src/llm/models/tools.py
+src/llm/tools/__init__.py
+src/llm/tools/introspection.py
+src/llm/tools/registry.py

infinity_llm_client-0.1.0/src/infinity_llm_client.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

infinity_llm_client-0.1.0/src/infinity_llm_client.egg-info/requires.txt

@@ -0,0 +1,14 @@
+pydantic
+aiohttp
+
+[dev]
+interrogate
+ruff
+pyright
+pre-commit
+infinity_llm_client[test]
+
+[test]
+pytest
+pytest-cov
+pytest-asyncio

infinity_llm_client-0.1.0/src/infinity_llm_client.egg-info/top_level.txt

@@ -0,0 +1 @@
+llm

infinity_llm_client-0.1.0/src/llm/__init__.py

@@ -0,0 +1,60 @@
+"""LLM 模块公共 API"""
+
+__version__ = '0.1.0'
+
+from .models.chunks import (
+    DoneChunk,
+    FinishChunk,
+    StreamChunk,
+    TextChunk,
+    ToolCallCompleteChunk,
+    UsageChunk,
+    UsageStats,
+)
+from .models.messages import (
+    ContentType,
+    FunctionCall,
+    ImageUrl,
+    Message,
+    MessageContent,
+    MessageRole,
+    Messages,
+    MultiModalContent,
+    ToolCall,
+)
+from .models.tools import (
+    ParameterProperty,
+    ToolDefinition,
+    ToolDefinitions,
+    ToolFunction,
+    ToolParameters,
+)
+
+__all__ = [
+    '__version__',
+    # -- 消息 --
+    'Message',
+    'MessageRole',
+    'Messages',
+    'MessageContent',
+    'ContentType',
+    'MultiModalContent',
+    'ImageUrl',
+    # -- 工具调用 --
+    'ToolCall',
+    'FunctionCall',
+    # -- 工具定义 --
+    'ToolDefinition',
+    'ToolDefinitions',
+    'ToolFunction',
+    'ToolParameters',
+    'ParameterProperty',
+    # -- 流式 Chunk --
+    'StreamChunk',
+    'TextChunk',
+    'ToolCallCompleteChunk',
+    'UsageChunk',
+    'FinishChunk',
+    'DoneChunk',
+    'UsageStats',
+]

infinity_llm_client-0.1.0/src/llm/clients/__init__.py

@@ -0,0 +1,63 @@
+from ..models import (
+    DoneChunk,
+    FinishChunk,
+    StreamChunk,
+    TextChunk,
+    ToolCallCompleteChunk,
+    UsageChunk,
+    UsageStats,
+)
+from .base import LLMClient
+from .config import ConnectionConfig, LLMConfig
+from .exceptions import (
+    LLMAuthError,
+    LLMConfigError,
+    LLMContentFilterError,
+    LLMContextLengthError,
+    LLMError,
+    LLMHTTPError,
+    LLMInsufficientBalanceError,
+    LLMNetworkError,
+    LLMRateLimitError,
+    LLMRequestError,
+    LLMServerError,
+    LLMStreamError,
+    build_http_error,
+)
+from .open_ai import OpenAIConfig
+from .provider import create_client, register_client
+
+__all__: list[str] = [
+    # -- 客户端 --
+    'LLMClient',
+    # -- 配置 --
+    'ConnectionConfig',
+    'LLMConfig',
+    'create_client',
+    'register_client',
+    # -- provider 配置 --
+    'OpenAIConfig',
+    # -- 流式 Chunk --
+    'StreamChunk',
+    'TextChunk',
+    'ToolCallCompleteChunk',
+    'UsageChunk',
+    'FinishChunk',
+    'DoneChunk',
+    'UsageStats',
+    # -- 异常 --
+    'LLMError',
+    'LLMConfigError',
+    'LLMRequestError',
+    'LLMNetworkError',
+    'LLMHTTPError',
+    'LLMAuthError',
+    'LLMInsufficientBalanceError',
+    'LLMRateLimitError',
+    'LLMServerError',
+    'LLMContentFilterError',
+    'LLMContextLengthError',
+    'LLMStreamError',
+    # -- 工具函数 --
+    'build_http_error',
+]

infinity_llm_client-0.1.0/src/llm/clients/base.py

@@ -0,0 +1,78 @@
+"""LLM 客户端抽象基类"""
+
+import types
+from abc import ABC, abstractmethod
+from typing import AsyncGenerator, Optional
+
+from ..models import (
+    Message,
+    Messages,
+    StreamChunk,
+    TextChunk,
+    ToolCall,
+    ToolCallCompleteChunk,
+    ToolDefinitions,
+)
+
+
+class LLMClient(ABC):
+    """LLM 客户端抽象基类"""
+
+    @abstractmethod
+    async def __aenter__(self) -> 'LLMClient':
+        """支持 async with 资源管理"""
+        ...
+
+    @abstractmethod
+    async def __aexit__(
+        self,
+        exc_type: Optional[type[BaseException]],
+        exc_val: Optional[BaseException],
+        exc_tb: Optional[types.TracebackType],
+    ) -> Optional[bool]: ...
+
+    # ---------- 核心对话接口 ----------
+
+    @abstractmethod
+    def stream_chat(
+        self,
+        messages: Messages,
+        tools: Optional[ToolDefinitions] = None,
+    ) -> AsyncGenerator[StreamChunk, None]:
+        """
+        流式对话接口
+
+        :param messages: 消息列表
+        :param tools: 工具列表
+        :yield: StreamChunk 子类实例，调用方通过 isinstance 分支处理
+        :raise: LLMError
+        """
+        ...
+
+    # ---------- 工具方法 ----------
+
+    @staticmethod
+    def chunks_to_message(chunks: list[StreamChunk]) -> Message:
+        """
+        将流式 chunks 聚合为一条完整的 assistant Message
+
+        遍历所有 chunk，拼接文本内容并收集工具调用，
+        最终产出一条可直接追加到对话历史的 assistant 消息。
+
+        :param chunks: 完整的流式 chunk 列表
+        :return: role=assistant 的 Message
+        """
+        text_parts: list[str] = []
+        tool_calls: list[ToolCall] = []
+
+        for chunk in chunks:
+            if isinstance(chunk, TextChunk):
+                text_parts.append(chunk.text)
+            elif isinstance(chunk, ToolCallCompleteChunk):
+                tool_calls.extend(chunk.tool_calls)
+
+        content = ''.join(text_parts) if text_parts else None
+        return Message.assistant(
+            content=content,
+            tool_calls=tool_calls if tool_calls else None,
+        )