cua-agent 0.4.14__py3-none-any.whl → 0.7.16__py3-none-any.whl

cua_agent-0.4.14.dist-info/METADATA

@@ -1,436 +0,0 @@
-Metadata-Version: 2.1
-Name: cua-agent
-Version: 0.4.14
-Summary: CUA (Computer Use) Agent for AI-driven computer interaction
-Author-Email: TryCua <gh@trycua.com>
-Requires-Python: >=3.12
-Requires-Dist: httpx>=0.27.0
-Requires-Dist: aiohttp>=3.9.3
-Requires-Dist: asyncio
-Requires-Dist: anyio>=4.4.1
-Requires-Dist: typing-extensions>=4.12.2
-Requires-Dist: pydantic>=2.6.4
-Requires-Dist: rich>=13.7.1
-Requires-Dist: python-dotenv>=1.0.1
-Requires-Dist: cua-computer<0.5.0,>=0.4.0
-Requires-Dist: cua-core<0.2.0,>=0.1.8
-Requires-Dist: certifi>=2024.2.2
-Requires-Dist: litellm>=1.74.12
-Provides-Extra: openai
-Provides-Extra: anthropic
-Provides-Extra: omni
-Requires-Dist: ultralytics>=8.0.0; extra == "omni"
-Requires-Dist: cua-som<0.2.0,>=0.1.0; extra == "omni"
-Provides-Extra: uitars
-Provides-Extra: uitars-mlx
-Requires-Dist: mlx-vlm>=0.1.27; sys_platform == "darwin" and extra == "uitars-mlx"
-Provides-Extra: uitars-hf
-Requires-Dist: accelerate; extra == "uitars-hf"
-Requires-Dist: torch; extra == "uitars-hf"
-Requires-Dist: transformers>=4.54.0; extra == "uitars-hf"
-Provides-Extra: glm45v-hf
-Requires-Dist: accelerate; extra == "glm45v-hf"
-Requires-Dist: torch; extra == "glm45v-hf"
-Requires-Dist: transformers-v4.55.0-GLM-4.5V-preview; extra == "glm45v-hf"
-Provides-Extra: ui
-Requires-Dist: gradio>=5.23.3; extra == "ui"
-Requires-Dist: python-dotenv>=1.0.1; extra == "ui"
-Provides-Extra: cli
-Requires-Dist: yaspin>=3.1.0; extra == "cli"
-Provides-Extra: hud
-Requires-Dist: hud-python==0.2.10; extra == "hud"
-Provides-Extra: all
-Requires-Dist: ultralytics>=8.0.0; extra == "all"
-Requires-Dist: cua-som<0.2.0,>=0.1.0; extra == "all"
-Requires-Dist: mlx-vlm>=0.1.27; sys_platform == "darwin" and extra == "all"
-Requires-Dist: accelerate; extra == "all"
-Requires-Dist: torch; extra == "all"
-Requires-Dist: transformers>=4.54.0; extra == "all"
-Requires-Dist: gradio>=5.23.3; extra == "all"
-Requires-Dist: python-dotenv>=1.0.1; extra == "all"
-Requires-Dist: yaspin>=3.1.0; extra == "all"
-Requires-Dist: hud-python==0.2.10; extra == "all"
-Description-Content-Type: text/markdown
-
-<div align="center">
-<h1>
-  <div class="image-wrapper" style="display: inline-block;">
-    <picture>
-      <source media="(prefers-color-scheme: dark)" alt="logo" height="150" srcset="../../../img/logo_white.png" style="display: block; margin: auto;">
-      <source media="(prefers-color-scheme: light)" alt="logo" height="150" srcset="../../../img/logo_black.png" style="display: block; margin: auto;">
-      <img alt="Shows my svg">
-    </picture>
-  </div>
-
-  [![Python](https://img.shields.io/badge/Python-333333?logo=python&logoColor=white&labelColor=333333)](#)
-  [![macOS](https://img.shields.io/badge/macOS-000000?logo=apple&logoColor=F0F0F0)](#)
-  [![Discord](https://img.shields.io/badge/Discord-%235865F2.svg?&logo=discord&logoColor=white)](https://discord.com/invite/mVnXXpdE85)
-  [![PyPI](https://img.shields.io/pypi/v/cua-computer?color=333333)](https://pypi.org/project/cua-computer/)
-</h1>
-</div>
-
-**cua-agent** is a general Computer-Use framework with liteLLM integration for running agentic workflows on macOS, Windows, and Linux sandboxes. It provides a unified interface for computer-use agents across multiple LLM providers with advanced callback system for extensibility.
-
-## Features
-
-- **Safe Computer-Use/Tool-Use**: Using Computer SDK for sandboxed desktops
-- **Multi-Agent Support**: Anthropic Claude, OpenAI computer-use-preview, UI-TARS, Omniparser + any LLM
-- **Multi-API Support**: Take advantage of liteLLM supporting 100+ LLMs / model APIs, including local models (`huggingface-local/`, `ollama_chat/`, `mlx/`)
-- **Cross-Platform**: Works on Windows, macOS, and Linux with cloud and local computer instances
-- **Extensible Callbacks**: Built-in support for image retention, cache control, PII anonymization, budget limits, and trajectory tracking
-
-## Install
-
-```bash
-pip install "cua-agent[all]"
-
-# or install specific providers
-pip install "cua-agent[openai]"        # OpenAI computer-use-preview support
-pip install "cua-agent[anthropic]"     # Anthropic Claude support
-pip install "cua-agent[omni]"          # Omniparser + any LLM support
-pip install "cua-agent[uitars]"        # UI-TARS
-pip install "cua-agent[uitars-mlx]"    # UI-TARS + MLX support
-pip install "cua-agent[uitars-hf]"     # UI-TARS + Huggingface support
-pip install "cua-agent[glm45v-hf]"     # GLM-4.5V + Huggingface support
-pip install "cua-agent[ui]"            # Gradio UI support
-```
-
-## Quick Start
-
-```python
-import asyncio
-import os
-from agent import ComputerAgent
-from computer import Computer
-
-async def main():
-    # Set up computer instance
-    async with Computer(
-        os_type="linux",
-        provider_type="cloud",
-        name=os.getenv("CUA_CONTAINER_NAME"),
-        api_key=os.getenv("CUA_API_KEY")
-    ) as computer:
-        
-        # Create agent
-        agent = ComputerAgent(
-            model="anthropic/claude-3-5-sonnet-20241022",
-            tools=[computer],
-            only_n_most_recent_images=3,
-            trajectory_dir="trajectories",
-            max_trajectory_budget=5.0  # $5 budget limit
-        )
-        
-        # Run agent
-        messages = [{"role": "user", "content": "Take a screenshot and tell me what you see"}]
-        
-        async for result in agent.run(messages):
-            for item in result["output"]:
-                if item["type"] == "message":
-                    print(item["content"][0]["text"])
-
-if __name__ == "__main__":
-    asyncio.run(main())
-```
-
-## Supported Models
-
-### Anthropic Claude (Computer Use API)
-```python
-model="anthropic/claude-3-5-sonnet-20241022"
-model="anthropic/claude-3-5-sonnet-20240620"
-model="anthropic/claude-opus-4-20250514"
-model="anthropic/claude-sonnet-4-20250514"
-```
-
-### OpenAI Computer Use Preview
-```python
-model="openai/computer-use-preview"
-```
-
-### UI-TARS (Local or Huggingface Inference)
-```python
-model="huggingface-local/ByteDance-Seed/UI-TARS-1.5-7B"
-model="ollama_chat/0000/ui-tars-1.5-7b"
-```
-
-### Omniparser + Any LLM
-```python
-model="omniparser+ollama_chat/mistral-small3.2"
-model="omniparser+vertex_ai/gemini-pro"
-model="omniparser+anthropic/claude-3-5-sonnet-20241022"
-model="omniparser+openai/gpt-4o"
-```
-
-## Custom Tools
-
-Define custom tools using decorated functions:
-
-```python
-from computer.helpers import sandboxed
-
-@sandboxed()
-def read_file(location: str) -> str:
-    """Read contents of a file
-    
-    Parameters
-    ----------
-    location : str
-        Path to the file to read
-        
-    Returns
-    -------
-    str
-        Contents of the file or error message
-    """
-    try:
-        with open(location, 'r') as f:
-            return f.read()
-    except Exception as e:
-        return f"Error reading file: {str(e)}"
-
-def calculate(a: int, b: int) -> int:
-    """Calculate the sum of two integers"""
-    return a + b
-
-# Use with agent
-agent = ComputerAgent(
-    model="anthropic/claude-3-5-sonnet-20241022",
-    tools=[computer, read_file, calculate]
-)
-```
-
-## Callbacks System
-
-agent provides a comprehensive callback system for extending functionality:
-
-### Built-in Callbacks
-
-```python
-from agent.callbacks import (
-    ImageRetentionCallback,
-    TrajectorySaverCallback, 
-    BudgetManagerCallback,
-    LoggingCallback
-)
-
-agent = ComputerAgent(
-    model="anthropic/claude-3-5-sonnet-20241022",
-    tools=[computer],
-    callbacks=[
-        ImageRetentionCallback(only_n_most_recent_images=3),
-        TrajectorySaverCallback(trajectory_dir="trajectories"),
-        BudgetManagerCallback(max_budget=10.0, raise_error=True),
-        LoggingCallback(level=logging.INFO)
-    ]
-)
-```
-
-### Custom Callbacks
-
-```python
-from agent.callbacks.base import AsyncCallbackHandler
-
-class CustomCallback(AsyncCallbackHandler):
-    async def on_llm_start(self, messages):
-        """Preprocess messages before LLM call"""
-        # Add custom preprocessing logic
-        return messages
-    
-    async def on_llm_end(self, messages):
-        """Postprocess messages after LLM call"""
-        # Add custom postprocessing logic
-        return messages
-    
-    async def on_usage(self, usage):
-        """Track usage information"""
-        print(f"Tokens used: {usage.total_tokens}")
-```
-
-## Budget Management
-
-Control costs with built-in budget management:
-
-```python
-# Simple budget limit
-agent = ComputerAgent(
-    model="anthropic/claude-3-5-sonnet-20241022",
-    max_trajectory_budget=5.0  # $5 limit
-)
-
-# Advanced budget configuration
-agent = ComputerAgent(
-    model="anthropic/claude-3-5-sonnet-20241022",
-    max_trajectory_budget={
-        "max_budget": 10.0,
-        "raise_error": True,  # Raise error when exceeded
-        "reset_after_each_run": False  # Persistent across runs
-    }
-)
-```
-
-## Trajectory Management
-
-Save and replay agent conversations:
-
-```python
-agent = ComputerAgent(
-    model="anthropic/claude-3-5-sonnet-20241022",
-    trajectory_dir="trajectories",  # Auto-save trajectories
-    tools=[computer]
-)
-
-# Trajectories are saved with:
-# - Complete conversation history
-# - Usage statistics and costs
-# - Timestamps and metadata
-# - Screenshots and computer actions
-```
-
-## Configuration Options
-
-### ComputerAgent Parameters
-
-- `model`: Model identifier (required)
-- `tools`: List of computer objects and decorated functions
-- `callbacks`: List of callback handlers for extensibility
-- `only_n_most_recent_images`: Limit recent images to prevent context overflow
-- `verbosity`: Logging level (logging.INFO, logging.DEBUG, etc.)
-- `trajectory_dir`: Directory to save conversation trajectories
-- `max_retries`: Maximum API call retries (default: 3)
-- `screenshot_delay`: Delay between actions and screenshots (default: 0.5s)
-- `use_prompt_caching`: Enable prompt caching for supported models
-- `max_trajectory_budget`: Budget limit configuration
-
-### Environment Variables
-
-```bash
-# Computer instance (cloud)
-export CUA_CONTAINER_NAME="your-container-name"
-export CUA_API_KEY="your-cua-api-key"
-
-# LLM API keys
-export ANTHROPIC_API_KEY="your-anthropic-key"
-export OPENAI_API_KEY="your-openai-key"
-```
-
-## Advanced Usage
-
-### Streaming Responses
-
-```python
-async for result in agent.run(messages, stream=True):
-    # Process streaming chunks
-    for item in result["output"]:
-        if item["type"] == "message":
-            print(item["content"][0]["text"], end="", flush=True)
-        elif item["type"] == "computer_call":
-            action = item["action"]
-            print(f"\n[Action: {action['type']}]")
-```
-
-### Interactive Chat Loop
-
-```python
-history = []
-while True:
-    user_input = input("> ")
-    if user_input.lower() in ['quit', 'exit']:
-        break
-        
-    history.append({"role": "user", "content": user_input})
-    
-    async for result in agent.run(history):
-        history += result["output"]
-        
-        # Display assistant responses
-        for item in result["output"]:
-            if item["type"] == "message":
-                print(item["content"][0]["text"])
-```
-
-### Error Handling
-
-```python
-try:
-    async for result in agent.run(messages):
-        # Process results
-        pass
-except BudgetExceededException:
-    print("Budget limit exceeded")
-except Exception as e:
-    print(f"Agent error: {e}")
-```
-
-## API Reference
-
-### ComputerAgent.run()
-
-```python
-async def run(
-    self,
-    messages: Messages,
-    stream: bool = False,
-    **kwargs
-) -> AsyncGenerator[Dict[str, Any], None]:
-    """
-    Run the agent with the given messages.
-    
-    Args:
-        messages: List of message dictionaries
-        stream: Whether to stream the response
-        **kwargs: Additional arguments
-        
-    Returns:
-        AsyncGenerator that yields response chunks
-    """
-```
-
-### Message Format
-
-```python
-messages = [
-    {
-        "role": "user",
-        "content": "Take a screenshot and describe what you see"
-    },
-    {
-        "role": "assistant", 
-        "content": "I'll take a screenshot for you."
-    }
-]
-```
-
-### Response Format
-
-```python
-{
-    "output": [
-        {
-            "type": "message",
-            "role": "assistant",
-            "content": [{"type": "output_text", "text": "I can see..."}]
-        },
-        {
-            "type": "computer_call",
-            "action": {"type": "screenshot"},
-            "call_id": "call_123"
-        },
-        {
-            "type": "computer_call_output",
-            "call_id": "call_123",
-            "output": {"image_url": "data:image/png;base64,..."}
-        }
-    ],
-    "usage": {
-        "prompt_tokens": 150,
-        "completion_tokens": 75,
-        "total_tokens": 225,
-        "response_cost": 0.01,
-    }
-}
-```
-
-## License
-
-MIT License - see LICENSE file for details.

cua_agent-0.4.14.dist-info/RECORD

@@ -1,50 +0,0 @@
-agent/__init__.py,sha256=vWbQYgjkzIso7zILSm4OAbNU_vrmN4HyYkfX8vC-Yi0,1547
-agent/__main__.py,sha256=lBUe8Niqa5XoCjwFfXyX7GtnUwjjZXC1-j4V9mvUYSc,538
-agent/adapters/__init__.py,sha256=lNH6srgIMmZOI7dgicJs3LCk_1MeqLF0lou9n7b23Ts,238
-agent/adapters/huggingfacelocal_adapter.py,sha256=Uqjtcohhzd33VFh38Ra2y4Uv_lTghMswoqS1t-KKFkw,8480
-agent/adapters/human_adapter.py,sha256=xT4nnfNXb1z-vnGFlLmFEZN7TMcoMBGS40MtR1Zwv4o,13079
-agent/agent.py,sha256=mEbmN5G6y8jZ0FrlUnHfJQFE7r_GlXrHxqC93twv54k,27881
-agent/callbacks/__init__.py,sha256=yxxBXUqpXQ-jRi_ixJMtmQPxoNRy5Vz1PUBzNNa1Dwg,538
-agent/callbacks/base.py,sha256=UnnnYlh6XCm6HKZZsAPaT_Eyo9LUYLyjyNwF-QRm6Ns,4691
-agent/callbacks/budget_manager.py,sha256=RyKM-7iXQcDotYvrw3eURzeEHEXvQjID-NobtvQWE7k,1832
-agent/callbacks/image_retention.py,sha256=tiuRT5ke9xXTb2eP8Gz-2ITyAMY29LURUH6AbjX3RP8,6165
-agent/callbacks/logging.py,sha256=OOxU97EzrxlnUAtiEnvy9FB7SwCUK90-rdpDFA2Ae4E,10921
-agent/callbacks/pii_anonymization.py,sha256=NEkUTUjQBi82nqus7kT-1E4RaeQ2hQrY7YCnKndLhP8,3272
-agent/callbacks/telemetry.py,sha256=PU7pkK7W1v1xjDN-9gA30lGvn4-WhqK3BPHGW3HpTOc,7497
-agent/callbacks/trajectory_saver.py,sha256=VHbiDQzI_XludkWhZIVqIMrsxgwKfFWwVtqaRot_D4U,12231
-agent/cli.py,sha256=AgaXwywHd3nGQWuqMRj6SbPyFaCPjfo5980Y1ApQOTQ,12413
-agent/computers/__init__.py,sha256=39ISJsaREaQIZckpzxSuLhuR763wUU3TxUux78EKjAg,1477
-agent/computers/base.py,sha256=hZntX4vgc1ahD3EnFeb9lUjtBmgka1vb27hndPl9tKQ,2187
-agent/computers/cua.py,sha256=xp2A34kT2C1NKqSRo2GB6766gkraM-UtpFjRv8LUTSc,4889
-agent/computers/custom.py,sha256=I_CHXvczLg43c_QBk8F_WDOlaSOOzK6b-Tkum2OSRIM,8029
-agent/decorators.py,sha256=n8VvMsififWkmuk75Q7HIpo0xAA2yAeQ6J-OOiwbAKc,1836
-agent/human_tool/__init__.py,sha256=3m5_g-Fo_0yX5vi7eg-A92oTqO0N3aY929Ajp78HKsE,771
-agent/human_tool/__main__.py,sha256=VsW2BAghlonOuqZbP_xuCsaec9bemA1I_ibnDcED9D4,1068
-agent/human_tool/server.py,sha256=ceuL5kw_RjgAi8fueLU3nTjyzOLE25Shv1oTJnSHsoQ,7964
-agent/human_tool/ui.py,sha256=2Jk3Bh-Jctya8GUG-qtYbdi-1qDdwOtcAlUeiIqsoIE,26584
-agent/integrations/hud/__init__.py,sha256=1lqeM6vJAekr38l7yteLNa-Hn3R2eXCusT2FAaY8VPE,2943
-agent/integrations/hud/adapter.py,sha256=M7J71q29Ndr4xXIW7Y6H_HIlJmnp-JlKG_4zKZTuyps,4088
-agent/integrations/hud/agent.py,sha256=vXmI7OBez5lokQ9dCcgWeT8N68xfWpsWT3S36MLhdas,17264
-agent/integrations/hud/computer_handler.py,sha256=N5pVKeKW9bJ-oceYrE7IIHbx6ZrQRQnHItTGrytoHRM,6788
-agent/loops/__init__.py,sha256=Ef8aj07l3osibwDk-DTo80PrpL4_GdKRTP1ikl_b-BQ,328
-agent/loops/anthropic.py,sha256=lvDscOaOcESBWZvnjKntQRWJZ4cEaFJhSsmmFc7J1ow,69562
-agent/loops/base.py,sha256=LK7kSTnc2CB88LI7qr2VP7LMq0eS5r2bSEnrxO6IN5U,2345
-agent/loops/composed_grounded.py,sha256=BgxufIyJCkWnJpp29PE1V2ce4iB9ictGjuVqFDx17B8,12122
-agent/loops/glm45v.py,sha256=V1f-5vAifbYcY-qTc7fW2KXVRkAfApQI_EjavH3X2ak,35110
-agent/loops/gta1.py,sha256=ha5TaUWqUzTffx_ow1WiBU8i3VNP-6FL5XC66ajPFjg,5829
-agent/loops/model_types.csv,sha256=GmFn4x80yoUpQZuQ-GXtJkPVlOLYWZ5u_5A73HRyeNE,112
-agent/loops/omniparser.py,sha256=-db8JUL2Orn47ERIaLbuNShAXn4LeIgYzRWphn_9Dg4,15071
-agent/loops/openai.py,sha256=8Ad_XufpENmLq1nEnhzF3oswPrPK1EPz-C5NU8UOEs0,8035
-agent/loops/uitars.py,sha256=PVNOdwcn2K6RgaxoU-9I4HjBTsEH073M11LTqTrN7C4,31849
-agent/responses.py,sha256=TTJ3wXN_eb0J26GKhO3cVQngOiZ1AgUPIUadozLUQyE,28991
-agent/telemetry.py,sha256=87ZTyBaT0wEPQn4v76II3g0V3GERuIVbypoX-Ug6FKQ,4786
-agent/types.py,sha256=ZoWY8a3GZtB8V0SnOzoI7DQy4nP_GRubxJKbuLPOc8c,840
-agent/ui/__init__.py,sha256=DTZpK85QXscXK2nM9HtpAhVBF13yAamUrtwrQSuV-kM,126
-agent/ui/__main__.py,sha256=vudWXYvGM0aNT5aZ94HPtGW8YXOZ4cLXepHyhUM_k1g,73
-agent/ui/gradio/__init__.py,sha256=yv4Mrfo-Sj2U5sVn_UJHAuwYCezo-5O4ItR2C9jzNko,145
-agent/ui/gradio/app.py,sha256=m2yDd6Tua_lMMZT1zCzOty2meYEy756d8OlFF7lpdeU,9117
-agent/ui/gradio/ui_components.py,sha256=vfsqVo_COsFfw11ouMHClib9fdBf3q52G-qbuo0RyOY,36068
-cua_agent-0.4.14.dist-info/METADATA,sha256=uLZvYOCvm5B-sX4z-WNZ1CYLmpZYQd31Rk-33MwzOMM,12616
-cua_agent-0.4.14.dist-info/WHEEL,sha256=9P2ygRxDrTJz3gsagc0Z96ukrxjr-LFBGOgv3AuKlCA,90
-cua_agent-0.4.14.dist-info/entry_points.txt,sha256=6OYgBcLyFCUgeqLgnvMyOJxPCWzgy7se4rLPKtNonMs,34
-cua_agent-0.4.14.dist-info/RECORD,,