aient 1.0.29__tar.gz

aient-1.0.29/LICENSE

@@ -0,0 +1,7 @@
+Copyright (c) 2024 yym68686
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

aient-1.0.29/MANIFEST.in

@@ -0,0 +1 @@
+recursive-include src/aient/core *

aient-1.0.29/PKG-INFO

@@ -0,0 +1,119 @@
+Metadata-Version: 2.4
+Name: aient
+Version: 1.0.29
+Summary: Aient: The Awakening of Agent.
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: pytz
+Requires-Dist: httpx
+Requires-Dist: pillow
+Requires-Dist: msgspec
+Requires-Dist: fastapi
+Requires-Dist: PyExecJS
+Requires-Dist: requests
+Requires-Dist: html2text
+Requires-Dist: fake-useragent
+Requires-Dist: beautifulsoup4
+Requires-Dist: tiktoken==0.6.0
+Requires-Dist: lxml-html-clean
+Requires-Dist: pdfminer.six==20240706
+Requires-Dist: duckduckgo-search==5.3.1
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: license-file
+Dynamic: requires-dist
+Dynamic: summary
+
+# aient
+
+[English](./README.md) | [Chinese](./README_CN.md)
+
+aient is a powerful library designed to simplify and unify the use of different large language models, including GPT-3.5/4/4 Turbo/4o, o1-preview/o1-mini, DALL-E 3, Claude2/3/3.5, Gemini1.5 Pro/Flash, Vertex AI (Claude, Gemini), DuckDuckGo, and Groq. The library supports GPT format function calls and has built-in Google search and URL summarization features, greatly enhancing the practicality and flexibility of the models.
+
+## ✨ Features
+
+- **Multi-model support**: Integrate various latest large language models.
+- **Real-time Interaction**: Supports real-time query streams, real-time model response retrieval.
+- **Function Expansion**: With built-in function calling support, the model's functions can be easily expanded, currently supporting plugins such as DuckDuckGo and Google search, content summarization, Dalle-3 drawing, arXiv paper summaries, current time, code interpreter, and more.
+- **Simple Interface**: Provides a concise and unified API interface, making it easy to call and manage the model.
+
+## Quick Start
+
+The following is a guide on how to quickly integrate and use aient in your Python project.
+
+### Install
+
+First, you need to install aient. It can be installed directly via pip:
+
+```bash
+pip install aient
+```
+
+### Usage example
+
+The following is a simple example demonstrating how to use aient to request the GPT-4 model and handle the returned streaming data:
+
+```python
+from aient import chatgpt
+
+# Initialize the model, set the API key and the selected model
+bot = chatgpt(api_key="{YOUR_API_KEY}", engine="gpt-4o")
+
+# Get response
+result = bot.ask("python list use")
+
+# Send request and get streaming response in real-time
+for text in bot.ask_stream("python list use"):
+    print(text, end="")
+
+# Disable all plugins
+bot = chatgpt(api_key="{YOUR_API_KEY}", engine="gpt-4o", use_plugins=False)
+```
+
+## 🍃 Environment Variables
+
+The following is a list of environment variables related to plugin settings:
+
+| Variable Name | Description | Required? |
+|---------------|-------------|-----------|
+| get_search_results | Enable search plugin. Default value is `False`. | No |
+| get_url_content | Enable URL summary plugin. The default value is `False`. | No |
+| download_read_arxiv_pdf | Whether to enable the arXiv paper abstract plugin. The default value is `False`. | No |
+| run_python_script | Whether to enable the code interpreter plugin. The default value is `False`. | No |
+| generate_image | Whether to enable the image generation plugin. The default value is `False`. | No |
+| get_date_time_weekday | Whether to enable the date plugin. The default value is `False`. | No |
+
+## Supported models
+
+- GPT-3.5/4/4 Turbo/4o
+- o1-preview/o1-mini
+- DALL-E 3
+- Claude2/3/3.5
+- Gemini1.5 Pro/Flash
+- Vertex AI (Claude, Gemini)
+- Groq
+- DuckDuckGo(gpt-4o-mini, claude-3-haiku, Meta-Llama-3.1-70B, Mixtral-8x7B)
+
+## 🧩 Plugin
+
+This project supports multiple plugins, including: DuckDuckGo and Google search, URL summary, ArXiv paper summary, DALLE-3 drawing, and code interpreter, etc. You can enable or disable these plugins by setting environment variables.
+
+- How to develop a plugin?
+
+The plugin-related code is all in the aient git submodule of this repository. aient is an independent repository I developed for handling API requests, conversation history management, and other functionality. When you clone this repository with the `--recurse-submodules` parameter, aient will be automatically downloaded. All plugin code is located in the relative path `aient/src/aient/plugins` in this repository. You can add your own plugin code in this directory. The plugin development process is as follows:
+
+1. Create a new Python file in the `aient/src/aient/plugins` directory, for example, `myplugin.py`. Register the plugin by adding the `@register_tool()` decorator above the function. Import `register_tool` with `from .registry import register_tool`.
+
+After completing the above steps, your plugin is ready to use. 🎉
+
+## License
+
+This project is licensed under the MIT License.
+
+## Contribution
+
+Welcome to contribute improvements by submitting issues or pull requests through GitHub.
+
+## Contact Information
+
+If you have any questions or need assistance, please contact us at [yym68686@outlook.com](mailto:yym68686@outlook.com).

aient-1.0.29/README.md

@@ -0,0 +1,93 @@
+# aient
+
+[English](./README.md) | [Chinese](./README_CN.md)
+
+aient is a powerful library designed to simplify and unify the use of different large language models, including GPT-3.5/4/4 Turbo/4o, o1-preview/o1-mini, DALL-E 3, Claude2/3/3.5, Gemini1.5 Pro/Flash, Vertex AI (Claude, Gemini), DuckDuckGo, and Groq. The library supports GPT format function calls and has built-in Google search and URL summarization features, greatly enhancing the practicality and flexibility of the models.
+
+## ✨ Features
+
+- **Multi-model support**: Integrate various latest large language models.
+- **Real-time Interaction**: Supports real-time query streams, real-time model response retrieval.
+- **Function Expansion**: With built-in function calling support, the model's functions can be easily expanded, currently supporting plugins such as DuckDuckGo and Google search, content summarization, Dalle-3 drawing, arXiv paper summaries, current time, code interpreter, and more.
+- **Simple Interface**: Provides a concise and unified API interface, making it easy to call and manage the model.
+
+## Quick Start
+
+The following is a guide on how to quickly integrate and use aient in your Python project.
+
+### Install
+
+First, you need to install aient. It can be installed directly via pip:
+
+```bash
+pip install aient
+```
+
+### Usage example
+
+The following is a simple example demonstrating how to use aient to request the GPT-4 model and handle the returned streaming data:
+
+```python
+from aient import chatgpt
+
+# Initialize the model, set the API key and the selected model
+bot = chatgpt(api_key="{YOUR_API_KEY}", engine="gpt-4o")
+
+# Get response
+result = bot.ask("python list use")
+
+# Send request and get streaming response in real-time
+for text in bot.ask_stream("python list use"):
+    print(text, end="")
+
+# Disable all plugins
+bot = chatgpt(api_key="{YOUR_API_KEY}", engine="gpt-4o", use_plugins=False)
+```
+
+## 🍃 Environment Variables
+
+The following is a list of environment variables related to plugin settings:
+
+| Variable Name | Description | Required? |
+|---------------|-------------|-----------|
+| get_search_results | Enable search plugin. Default value is `False`. | No |
+| get_url_content | Enable URL summary plugin. The default value is `False`. | No |
+| download_read_arxiv_pdf | Whether to enable the arXiv paper abstract plugin. The default value is `False`. | No |
+| run_python_script | Whether to enable the code interpreter plugin. The default value is `False`. | No |
+| generate_image | Whether to enable the image generation plugin. The default value is `False`. | No |
+| get_date_time_weekday | Whether to enable the date plugin. The default value is `False`. | No |
+
+## Supported models
+
+- GPT-3.5/4/4 Turbo/4o
+- o1-preview/o1-mini
+- DALL-E 3
+- Claude2/3/3.5
+- Gemini1.5 Pro/Flash
+- Vertex AI (Claude, Gemini)
+- Groq
+- DuckDuckGo(gpt-4o-mini, claude-3-haiku, Meta-Llama-3.1-70B, Mixtral-8x7B)
+
+## 🧩 Plugin
+
+This project supports multiple plugins, including: DuckDuckGo and Google search, URL summary, ArXiv paper summary, DALLE-3 drawing, and code interpreter, etc. You can enable or disable these plugins by setting environment variables.
+
+- How to develop a plugin?
+
+The plugin-related code is all in the aient git submodule of this repository. aient is an independent repository I developed for handling API requests, conversation history management, and other functionality. When you clone this repository with the `--recurse-submodules` parameter, aient will be automatically downloaded. All plugin code is located in the relative path `aient/src/aient/plugins` in this repository. You can add your own plugin code in this directory. The plugin development process is as follows:
+
+1. Create a new Python file in the `aient/src/aient/plugins` directory, for example, `myplugin.py`. Register the plugin by adding the `@register_tool()` decorator above the function. Import `register_tool` with `from .registry import register_tool`.
+
+After completing the above steps, your plugin is ready to use. 🎉
+
+## License
+
+This project is licensed under the MIT License.
+
+## Contribution
+
+Welcome to contribute improvements by submitting issues or pull requests through GitHub.
+
+## Contact Information
+
+If you have any questions or need assistance, please contact us at [yym68686@outlook.com](mailto:yym68686@outlook.com).

aient-1.0.29/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

aient-1.0.29/setup.py

@@ -0,0 +1,15 @@
+from pathlib import Path
+
+from setuptools import setup, find_packages
+
+setup(
+    name="aient",
+    version="1.0.29",
+    description="Aient: The Awakening of Agent.",
+    long_description=Path.open(Path("README.md"), encoding="utf-8").read(),
+    long_description_content_type="text/markdown",
+    packages=find_packages("src"),
+    package_dir={"": "src"},
+    install_requires=Path.open(Path("requirements.txt"), encoding="utf-8").read().splitlines(),
+    include_package_data=True,
+)

aient-1.0.29/src/aient/__init__.py

@@ -0,0 +1 @@
+from .models import *

aient-1.0.29/src/aient/core/.git

@@ -0,0 +1 @@
+gitdir: ../../../.git/modules/src/aient/core

aient-1.0.29/src/aient/core/__init__.py

@@ -0,0 +1 @@
+# core package initialization file

aient-1.0.29/src/aient/core/log_config.py

@@ -0,0 +1,6 @@
+import logging
+logging.basicConfig(level=logging.INFO, format="%(asctime)s - %(name)s - %(levelname)s - %(message)s")
+logger = logging.getLogger("uni-api")
+
+logging.getLogger("httpx").setLevel(logging.CRITICAL)
+logging.getLogger("watchfiles.main").setLevel(logging.CRITICAL)

aient-1.0.29/src/aient/core/models.py

@@ -0,0 +1,227 @@
+from io import IOBase
+from pydantic import BaseModel, Field, model_validator, ConfigDict
+from typing import List, Dict, Optional, Union, Tuple, Literal, Any
+
+class FunctionParameter(BaseModel):
+    type: str
+    properties: Dict[str, Dict[str, Any]]
+    required: List[str] = None
+    defs: Dict[str, Any] = Field(default=None, alias="$defs")
+
+    class Config:
+        population_by_name = True
+
+class Function(BaseModel):
+    name: str
+    description: str = Field(default=None)
+    parameters: Optional[FunctionParameter] = Field(default=None, exclude=None)
+
+class Tool(BaseModel):
+    type: str
+    function: Function
+
+    @classmethod
+    def parse_raw(cls, json_str: str) -> 'Tool':
+        """从JSON字符串解析Tool对象"""
+        return cls.model_validate_json(json_str)
+
+class FunctionCall(BaseModel):
+    name: str
+    arguments: str
+
+class ToolCall(BaseModel):
+    id: str
+    type: str
+    function: FunctionCall
+
+class ImageUrl(BaseModel):
+    url: str
+
+class ContentItem(BaseModel):
+    type: str
+    text: Optional[str] = None
+    image_url: Optional[ImageUrl] = None
+
+class Message(BaseModel):
+    role: str
+    name: Optional[str] = None
+    arguments: Optional[str] = None
+    content: Optional[Union[str, List[ContentItem]]] = None
+    tool_calls: Optional[List[ToolCall]] = None
+
+class Message(BaseModel):
+    role: str
+    name: Optional[str] = None
+    content: Optional[Union[str, List[ContentItem]]] = None
+    tool_calls: Optional[List[ToolCall]] = None
+    tool_call_id: Optional[str] = None
+
+    class Config:
+        extra = "allow"  # 允许额外的字段
+
+class FunctionChoice(BaseModel):
+    name: str
+
+class ToolChoice(BaseModel):
+    type: str
+    function: Optional[FunctionChoice] = None
+
+class BaseRequest(BaseModel):
+    request_type: Optional[Literal["chat", "image", "audio", "moderation"]] = Field(default=None, exclude=True)
+
+import warnings
+warnings.filterwarnings("ignore", category=UserWarning, message=".*shadows an attribute.*")
+
+class JsonSchema(BaseModel):
+    name: str
+    schema: Dict[str, Any] = Field(validation_alias='schema')
+
+    model_config = ConfigDict(protected_namespaces=())
+
+class ResponseFormat(BaseModel):
+    type: Literal["text", "json_object", "json_schema"]
+    json_schema: Optional[JsonSchema] = None
+
+class Thinking(BaseModel):
+    budget_tokens: Optional[int] = None
+    type: Optional[Literal["enabled", "disabled"]] = None
+
+class RequestModel(BaseRequest):
+    model: str
+    messages: List[Message]
+    logprobs: Optional[bool] = None
+    top_logprobs: Optional[int] = None
+    stream: Optional[bool] = None
+    include_usage: Optional[bool] = None
+    temperature: Optional[float] = 0.5
+    top_p: Optional[float] = 1.0
+    max_tokens: Optional[int] = None
+    max_completion_tokens: Optional[int] = None
+    presence_penalty: Optional[float] = 0.0
+    frequency_penalty: Optional[float] = 0.0
+    n: Optional[int] = 1
+    user: Optional[str] = None
+    tool_choice: Optional[Union[str, ToolChoice]] = None
+    tools: Optional[List[Tool]] = None
+    response_format: Optional[ResponseFormat] = None
+    thinking: Optional[Thinking] = None
+
+    def get_last_text_message(self) -> Optional[str]:
+        for message in reversed(self.messages):
+            if message.content:
+                if isinstance(message.content, str):
+                    return message.content
+                elif isinstance(message.content, list):
+                    for item in reversed(message.content):
+                        if item.type == "text" and item.text:
+                            return item.text
+        return ""
+
+    def model_dump(self, **kwargs):
+        data = super().model_dump(**kwargs)
+
+        # 检查并处理 tools 字段
+        if 'tools' in data and data['tools']:
+            for tool in data['tools']:
+                if 'function' in tool:
+                    function_data = tool['function']
+                    # 如果 parameters 为空或没有 properties，则移除
+                    if 'parameters' in function_data and (
+                        function_data['parameters'] is None or
+                        not function_data['parameters'].get('properties')
+                    ):
+                        function_data.pop('parameters', None)
+
+        return data
+
+class ImageGenerationRequest(BaseRequest):
+    prompt: str
+    model: Optional[str] = "dall-e-3"
+    n:  Optional[int] = 1
+    response_format: Optional[str] = "url"
+    size: Optional[str] = "1024x1024"
+    stream: bool = False
+
+class EmbeddingRequest(BaseRequest):
+    input: Union[str, List[Union[str, int, List[int]]]]  # 支持字符串或数组
+    model: str
+    encoding_format: Optional[str] = "float"
+    dimensions: Optional[int] = None
+    user: Optional[str] = None
+    stream: bool = False
+
+class AudioTranscriptionRequest(BaseRequest):
+    file: Tuple[str, IOBase, str]
+    model: str
+    language: Optional[str] = None
+    prompt: Optional[str] = None
+    response_format: Optional[str] = None
+    temperature: Optional[float] = None
+    stream: bool = False
+
+    class Config:
+        arbitrary_types_allowed = True
+
+class ModerationRequest(BaseRequest):
+    input: Union[str, List[str]]
+    model: Optional[str] = "text-moderation-latest"
+    stream: bool = False
+
+class TextToSpeechRequest(BaseRequest):
+    model: str
+    input: str
+    voice: str
+    response_format: Optional[str] = "mp3"
+    speed: Optional[float] = 1.0
+    stream: Optional[bool] = False  # Add this line
+
+class UnifiedRequest(BaseModel):
+    data: Union[RequestModel, ImageGenerationRequest, AudioTranscriptionRequest, ModerationRequest, EmbeddingRequest, TextToSpeechRequest]
+
+    @model_validator(mode='before')
+    @classmethod
+    def set_request_type(cls, values):
+        if isinstance(values, dict):
+            if "messages" in values:
+                values["data"] = RequestModel(**values)
+                values["data"].request_type = "chat"
+            elif "prompt" in values:
+                values["data"] = ImageGenerationRequest(**values)
+                values["data"].request_type = "image"
+            elif "file" in values:
+                values["data"] = AudioTranscriptionRequest(**values)
+                values["data"].request_type = "audio"
+            elif "tts" in values.get("model", ""):
+                values["data"] = TextToSpeechRequest(**values)
+                values["data"].request_type = "tts"
+            elif "text-embedding" in values.get("model", ""):
+                values["data"] = EmbeddingRequest(**values)
+                values["data"].request_type = "embedding"
+            elif "input" in values:
+                values["data"] = ModerationRequest(**values)
+                values["data"].request_type = "moderation"
+            else:
+                raise ValueError("无法确定请求类型")
+        return values
+
+if __name__ == "__main__":
+    # 示例JSON字符串
+    json_str = '''
+    {
+        "type": "function",
+        "function": {
+            "name": "clock-time____getCurrentTime____standalone",
+            "description": "获取当前时间",
+            "parameters": {
+                "type": "object",
+                "properties": {}
+            }
+        }
+    }
+    '''
+
+    # 解析JSON字符串为Tool对象
+    tool = Tool.parse_raw(json_str)
+
+    # parameters 字段将被自动排除
+    print(tool.model_dump(exclude_unset=True))