opensmith 0.1.0__tar.gz

opensmith-0.1.0/PKG-INFO

@@ -0,0 +1,159 @@
+Metadata-Version: 2.4
+Name: opensmith
+Version: 0.1.0
+Summary: Local-first LLM pipeline tracer. No cloud. No setup.
+Project-URL: Homepage, https://github.com/shivnathtathe/opensmith
+License: MIT
+Keywords: agent,debug,langsmith,llm,local,observability,tracing
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Topic :: Software Development :: Debuggers
+Requires-Python: >=3.10
+Requires-Dist: click>=8.0.0
+Requires-Dist: fastapi>=0.100.0
+Requires-Dist: pydantic>=2.0
+Requires-Dist: rich>=13.0.0
+Requires-Dist: uvicorn>=0.20.0
+Provides-Extra: dev
+Requires-Dist: httpx; extra == 'dev'
+Requires-Dist: pytest; extra == 'dev'
+Requires-Dist: pytest-asyncio; extra == 'dev'
+Description-Content-Type: text/markdown
+
+<div align="center">
+
+<pre style="font-family: monospace; font-size: 18px; 
+line-height: 1.2; color: #ededec; background: #0a0a0a; 
+padding: 20px; display: inline-block;">
+ ██████  ██████  ███████ ███    ██ ███████ ███    ███ ██ ████████ ██   ██ 
+██    ██ ██   ██ ██      ████   ██ ██      ████  ████ ██    ██    ██   ██ 
+██    ██ ██████  █████   ██ ██  ██ ███████ ██ ████ ██ ██    ██    ███████ 
+██    ██ ██      ██      ██  ██ ██      ██ ██  ██  ██ ██    ██    ██   ██ 
+ ██████  ██      ███████ ██   ████ ███████ ██      ██ ██    ██    ██   ██ 
+</pre>
+
+**Local-first LLM pipeline tracer. No cloud. No setup.**
+
+![PyPI](https://img.shields.io/pypi/v/opensmith)
+![Python](https://img.shields.io/pypi/pyversions/opensmith)
+![License](https://img.shields.io/github/license/shivnathtathe/opensmith)
+
+</div>
+
+# opensmith
+
+Local-first LLM pipeline tracer. No cloud. No setup.
+
+## Why opensmith
+
+LangSmith is powerful, but it is built around cloud-hosted tracing and is most natural inside the LangChain ecosystem. opensmith is a local-first alternative: install it with `pip`, use it with any Python LLM pipeline, and inspect traces on your machine without accounts, hosted services, Docker, or configuration. No trace data leaves your machine.
+
+## Install
+
+```bash
+pip install opensmith
+```
+
+## Quickstart
+
+### Example 1: `@trace` decorator
+
+```python
+from opensmith import trace
+
+
+@trace
+def call_llm(prompt: str):
+    return openai.chat.completions.create(
+        model="gpt-4o-mini",
+        messages=[{"role": "user", "content": prompt}],
+    )
+
+
+@trace
+def my_pipeline(question: str):
+    # search_docs is your own retrieval function
+    docs = search_docs(question)
+    return call_llm(docs + question)
+```
+
+### Example 2: context manager
+
+```python
+from opensmith import trace
+
+
+with trace("my_pipeline") as t:
+    t.log("query", query)
+    response = openai.chat.completions.create(
+        model="gpt-4o-mini",
+        messages=[{"role": "user", "content": query}],
+    )
+    t.log("response", response)
+```
+
+### Example 3: `autopatch()` zero code changes
+
+```python
+from opensmith import autopatch
+
+
+autopatch()
+```
+
+Patch only selected backends:
+
+```python
+from opensmith import autopatch
+
+
+autopatch(only=["openai"])
+```
+
+Patch everything except selected backends:
+
+```python
+from opensmith import autopatch
+
+
+autopatch(exclude=["chromadb"])
+```
+
+## Dashboard
+
+```bash
+opensmith ui
+```
+
+Open `http://localhost:7823`.
+
+![dashboard](docs/dashboard.png)
+
+## CLI reference
+
+| Command | Description |
+| --- | --- |
+| `opensmith ui` | Start the local dashboard at `localhost:7823`. |
+| `opensmith traces` | List recent traces in the terminal. |
+| `opensmith stats` | Show aggregate trace, step, token, and cost statistics. |
+| `opensmith clear` | Delete all locally stored traces after confirmation. |
+
+## Supported backends
+
+| Backend | Package | Status |
+|---------|---------|--------|
+| openai | openai | ✅ |
+| anthropic | anthropic | ✅ |
+| litellm | litellm | ✅ |
+| qdrant | qdrant-client | ✅ |
+| chromadb | chromadb | ✅ |
+| pinecone | pinecone-client | ✅ |
+
+## Storage
+
+Traces are stored locally at `~/.opensmith/traces.db`.
+
+## License
+
+MIT

opensmith-0.1.0/README.md

@@ -0,0 +1,136 @@
+<div align="center">
+
+<pre style="font-family: monospace; font-size: 18px; 
+line-height: 1.2; color: #ededec; background: #0a0a0a; 
+padding: 20px; display: inline-block;">
+ ██████  ██████  ███████ ███    ██ ███████ ███    ███ ██ ████████ ██   ██ 
+██    ██ ██   ██ ██      ████   ██ ██      ████  ████ ██    ██    ██   ██ 
+██    ██ ██████  █████   ██ ██  ██ ███████ ██ ████ ██ ██    ██    ███████ 
+██    ██ ██      ██      ██  ██ ██      ██ ██  ██  ██ ██    ██    ██   ██ 
+ ██████  ██      ███████ ██   ████ ███████ ██      ██ ██    ██    ██   ██ 
+</pre>
+
+**Local-first LLM pipeline tracer. No cloud. No setup.**
+
+![PyPI](https://img.shields.io/pypi/v/opensmith)
+![Python](https://img.shields.io/pypi/pyversions/opensmith)
+![License](https://img.shields.io/github/license/shivnathtathe/opensmith)
+
+</div>
+
+# opensmith
+
+Local-first LLM pipeline tracer. No cloud. No setup.
+
+## Why opensmith
+
+LangSmith is powerful, but it is built around cloud-hosted tracing and is most natural inside the LangChain ecosystem. opensmith is a local-first alternative: install it with `pip`, use it with any Python LLM pipeline, and inspect traces on your machine without accounts, hosted services, Docker, or configuration. No trace data leaves your machine.
+
+## Install
+
+```bash
+pip install opensmith
+```
+
+## Quickstart
+
+### Example 1: `@trace` decorator
+
+```python
+from opensmith import trace
+
+
+@trace
+def call_llm(prompt: str):
+    return openai.chat.completions.create(
+        model="gpt-4o-mini",
+        messages=[{"role": "user", "content": prompt}],
+    )
+
+
+@trace
+def my_pipeline(question: str):
+    # search_docs is your own retrieval function
+    docs = search_docs(question)
+    return call_llm(docs + question)
+```
+
+### Example 2: context manager
+
+```python
+from opensmith import trace
+
+
+with trace("my_pipeline") as t:
+    t.log("query", query)
+    response = openai.chat.completions.create(
+        model="gpt-4o-mini",
+        messages=[{"role": "user", "content": query}],
+    )
+    t.log("response", response)
+```
+
+### Example 3: `autopatch()` zero code changes
+
+```python
+from opensmith import autopatch
+
+
+autopatch()
+```
+
+Patch only selected backends:
+
+```python
+from opensmith import autopatch
+
+
+autopatch(only=["openai"])
+```
+
+Patch everything except selected backends:
+
+```python
+from opensmith import autopatch
+
+
+autopatch(exclude=["chromadb"])
+```
+
+## Dashboard
+
+```bash
+opensmith ui
+```
+
+Open `http://localhost:7823`.
+
+![dashboard](docs/dashboard.png)
+
+## CLI reference
+
+| Command | Description |
+| --- | --- |
+| `opensmith ui` | Start the local dashboard at `localhost:7823`. |
+| `opensmith traces` | List recent traces in the terminal. |
+| `opensmith stats` | Show aggregate trace, step, token, and cost statistics. |
+| `opensmith clear` | Delete all locally stored traces after confirmation. |
+
+## Supported backends
+
+| Backend | Package | Status |
+|---------|---------|--------|
+| openai | openai | ✅ |
+| anthropic | anthropic | ✅ |
+| litellm | litellm | ✅ |
+| qdrant | qdrant-client | ✅ |
+| chromadb | chromadb | ✅ |
+| pinecone | pinecone-client | ✅ |
+
+## Storage
+
+Traces are stored locally at `~/.opensmith/traces.db`.
+
+## License
+
+MIT

opensmith-0.1.0/opensmith/__init__.py

@@ -0,0 +1,14 @@
+from opensmith.tracer import TraceCallable, trace
+from opensmith.patcher import autopatch, unpatch
+from opensmith.storage import Storage
+from opensmith.models import Trace, Step, Run
+
+__all__ = [
+    "trace",
+    "autopatch",
+    "unpatch",
+    "Storage",
+    "Trace",
+    "Step",
+    "Run",
+]

opensmith-0.1.0/opensmith/cli.py

@@ -0,0 +1,99 @@
+from __future__ import annotations
+
+import time
+from typing import Any
+
+import click
+import uvicorn
+from rich.console import Console
+from rich.table import Table
+
+from opensmith.storage import Storage
+
+
+console = Console()
+
+
+@click.group(name="opensmith")
+def cli() -> None:
+    """Local-first LLM pipeline tracer."""
+
+
+@cli.command()
+@click.option("--port", default=7823, show_default=True, type=int)
+@click.option("--host", default="127.0.0.1", show_default=True)
+def ui(port: int, host: str) -> None:
+    """Start the local dashboard."""
+    click.echo(f"opensmith UI running at http://{host}:{port}")
+    click.echo("Press Ctrl+C to stop")
+    uvicorn.run("opensmith.server:app", host=host, port=port)
+
+
+@cli.command()
+def clear() -> None:
+    """Clear all traces."""
+    if not click.confirm("Clear all traces?", default=False):
+        return
+
+    Storage().delete_all()
+    click.echo("Cleared all traces.")
+
+
+@cli.command()
+def stats() -> None:
+    """Show trace statistics."""
+    data = Storage().get_stats()
+
+    table = Table(title="opensmith stats")
+    table.add_column("Metric")
+    table.add_column("Value", justify="right")
+
+    table.add_row("Total traces", str(data["total_traces"]))
+    table.add_row("Total steps", str(data["total_steps"]))
+    table.add_row("Total tokens", str(data["total_tokens"]))
+    table.add_row("Total cost (USD)", f"${float(data['total_cost_usd']):.6f}")
+
+    console.print(table)
+
+
+@cli.command()
+@click.option("--limit", default=20, show_default=True, type=int)
+def traces(limit: int) -> None:
+    """List recent traces."""
+    rows = Storage().get_traces(limit=limit)
+
+    table = Table(title="opensmith traces")
+    table.add_column("id")
+    table.add_column("name")
+    table.add_column("latency_ms", justify="right")
+    table.add_column("error")
+    table.add_column("created_at")
+
+    for row in rows:
+        table.add_row(
+            str(row.get("id", ""))[:8],
+            str(row.get("name") or ""),
+            _format_latency(row.get("latency_ms")),
+            "yes" if row.get("error") else "no",
+            _format_timestamp(row.get("created_at")),
+        )
+
+    console.print(table)
+
+
+def _format_latency(value: Any) -> str:
+    if value is None:
+        return ""
+    try:
+        return f"{float(value):.2f}"
+    except (TypeError, ValueError):
+        return ""
+
+
+def _format_timestamp(value: Any) -> str:
+    if value is None:
+        return ""
+    try:
+        return time.strftime("%Y-%m-%d %H:%M:%S", time.localtime(float(value)))
+    except (TypeError, ValueError, OSError):
+        return ""

opensmith-0.1.0/opensmith/models.py

@@ -0,0 +1,51 @@
+from __future__ import annotations
+
+import time
+from typing import Any, Literal
+from uuid import uuid4
+
+from pydantic import BaseModel, Field
+
+
+StepType = Literal["llm", "retrieval", "tool", "custom"]
+
+
+class Step(BaseModel):
+    id: str = Field(default_factory=lambda: str(uuid4()))
+    trace_id: str | None = None
+    name: str
+    input: Any | None = None
+    output: Any | None = None
+    error: str | None = None
+    start_time: float | None = None
+    end_time: float | None = None
+    latency_ms: float | None = None
+    tokens_input: int | None = None
+    tokens_output: int | None = None
+    tokens_total: int | None = None
+    model: str | None = None
+    cost_usd: float | None = None
+    step_type: StepType | None = None
+    metadata: dict[str, Any] | None = None
+
+
+class Trace(BaseModel):
+    id: str = Field(default_factory=lambda: str(uuid4()))
+    name: str
+    input: Any | None = None
+    output: Any | None = None
+    error: str | None = None
+    start_time: float | None = None
+    end_time: float | None = None
+    latency_ms: float | None = None
+    parent_id: str | None = None
+    run_id: str | None = None
+    metadata: dict[str, Any] | None = None
+    steps: list[Step] = Field(default_factory=list)
+
+
+class Run(BaseModel):
+    id: str = Field(default_factory=lambda: str(uuid4()))
+    name: str | None = None
+    tags: list[str] = Field(default_factory=list)
+    created_at: float = Field(default_factory=lambda: time.time())