synthesis-atlas-cli 0.1.0__tar.gz

synthesis_atlas_cli-0.1.0/PKG-INFO

@@ -0,0 +1,110 @@
+Metadata-Version: 2.4
+Name: synthesis-atlas-cli
+Version: 0.1.0
+Summary: Atlas CLI — first-class programmatic interface to the Atlas control plane.
+License-Expression: MIT
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+Requires-Dist: click>=8.1.0
+Requires-Dist: httpx>=0.28.1
+Requires-Dist: pydantic[email]>=2.0.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: ruff>=0.16.0; extra == "dev"
+Requires-Dist: mypy>=2.0.0; extra == "dev"
+
+# Atlas CLI
+
+Command-line interface for the Atlas evaluation platform.
+
+`atlas` talks to the Atlas control-plane API to manage benchmarks, models, runs, and
+reports. The CLI distribution bundles the Atlas SDK (`atlas_sdk`) and the
+internal LLM layer (`packages.llm`) that powers the agent brain, so a single
+`pip install synthesis-atlas-cli` is fully self-contained.
+
+## Install
+
+```bash
+pip install synthesis-atlas-cli
+```
+
+- Python 3.11+ is required.
+- No `atlas-sdk` dependency is pulled from PyPI — the SDK ships inside the wheel
+  (the PyPI `atlas-sdk` name belongs to an unrelated project).
+
+## Quick start
+
+```bash
+# 1. Verify the install
+atlas --version
+
+# 2. Point at the Atlas API (defaults to http://localhost:8000)
+export ATLAS_BASE_URL="https://api.example.com"
+
+# 3. Authenticate (token is saved in %APPDATA%\Atlas\config.toml, never in the repo)
+atlas login
+
+# 4. Confirm your identity
+atlas whoami
+
+# 5. Browse the full command list
+atlas --help
+```
+
+## Commands
+
+- `atlas health` — check API health
+- `atlas leaderboard` — model / benchmark leaderboards
+- `atlas benchmark` — benchmark operations
+- `atlas model` — model operations
+- `atlas report` — execution reports
+- `atlas run` — start executions
+- `atlas dashboard` — dashboard summaries
+- `atlas activity` — recent activity
+
+These are deterministic, scriptable operations (human, JSON, or quiet output via
+`--output`). Run `atlas --help` for the full command list.
+
+## Agent
+
+The agentic side of the CLI runs an LLM brain directly in your terminal. It
+comes in two shapes:
+
+- **Interactive REPL** — run bare `atlas` in a terminal to start a
+  Gemini-CLI-style conversation:
+  ```bash
+  atlas
+  ```
+- **One-shot task** — run a single quoted task non-interactively:
+  ```bash
+  atlas agent "List the available benchmarks"
+  ```
+
+The agent brain uses an LLM provider. Set one of:
+
+```bash
+export GEMINI_API_KEY="..."
+export GROQ_API_KEY="..."
+```
+
+With no key configured the agent refuses to start and points you at the missing
+environment variable.
+
+## Development
+
+```bash
+pip install -e ./sdk/python -e ./cli   # editable install from the monorepo
+```
+
+This installs the CLI and SDK as editable packages; `packages.llm` resolves to
+the bundled copy inside the CLI layout (see `pyproject.toml`).
+
+The CLI version is defined once in `cli/cli/__init__.py` (`__version__`) and is
+picked up dynamically by `pyproject.toml`. See
+[docs/guides/atlas-cli-release.md](../docs/guides/atlas-cli-release.md) for the
+release-time staging build, offline artifact validation, and the (not yet enabled)
+PyPI publishing workflow.
+
+## License
+
+Copyright (c) 2026. All rights reserved.

synthesis_atlas_cli-0.1.0/README.md

@@ -0,0 +1,95 @@
+# Atlas CLI
+
+Command-line interface for the Atlas evaluation platform.
+
+`atlas` talks to the Atlas control-plane API to manage benchmarks, models, runs, and
+reports. The CLI distribution bundles the Atlas SDK (`atlas_sdk`) and the
+internal LLM layer (`packages.llm`) that powers the agent brain, so a single
+`pip install synthesis-atlas-cli` is fully self-contained.
+
+## Install
+
+```bash
+pip install synthesis-atlas-cli
+```
+
+- Python 3.11+ is required.
+- No `atlas-sdk` dependency is pulled from PyPI — the SDK ships inside the wheel
+  (the PyPI `atlas-sdk` name belongs to an unrelated project).
+
+## Quick start
+
+```bash
+# 1. Verify the install
+atlas --version
+
+# 2. Point at the Atlas API (defaults to http://localhost:8000)
+export ATLAS_BASE_URL="https://api.example.com"
+
+# 3. Authenticate (token is saved in %APPDATA%\Atlas\config.toml, never in the repo)
+atlas login
+
+# 4. Confirm your identity
+atlas whoami
+
+# 5. Browse the full command list
+atlas --help
+```
+
+## Commands
+
+- `atlas health` — check API health
+- `atlas leaderboard` — model / benchmark leaderboards
+- `atlas benchmark` — benchmark operations
+- `atlas model` — model operations
+- `atlas report` — execution reports
+- `atlas run` — start executions
+- `atlas dashboard` — dashboard summaries
+- `atlas activity` — recent activity
+
+These are deterministic, scriptable operations (human, JSON, or quiet output via
+`--output`). Run `atlas --help` for the full command list.
+
+## Agent
+
+The agentic side of the CLI runs an LLM brain directly in your terminal. It
+comes in two shapes:
+
+- **Interactive REPL** — run bare `atlas` in a terminal to start a
+  Gemini-CLI-style conversation:
+  ```bash
+  atlas
+  ```
+- **One-shot task** — run a single quoted task non-interactively:
+  ```bash
+  atlas agent "List the available benchmarks"
+  ```
+
+The agent brain uses an LLM provider. Set one of:
+
+```bash
+export GEMINI_API_KEY="..."
+export GROQ_API_KEY="..."
+```
+
+With no key configured the agent refuses to start and points you at the missing
+environment variable.
+
+## Development
+
+```bash
+pip install -e ./sdk/python -e ./cli   # editable install from the monorepo
+```
+
+This installs the CLI and SDK as editable packages; `packages.llm` resolves to
+the bundled copy inside the CLI layout (see `pyproject.toml`).
+
+The CLI version is defined once in `cli/cli/__init__.py` (`__version__`) and is
+picked up dynamically by `pyproject.toml`. See
+[docs/guides/atlas-cli-release.md](../docs/guides/atlas-cli-release.md) for the
+release-time staging build, offline artifact validation, and the (not yet enabled)
+PyPI publishing workflow.
+
+## License
+
+Copyright (c) 2026. All rights reserved.

synthesis_atlas_cli-0.1.0/atlas_sdk/__init__.py

@@ -0,0 +1,117 @@
+"""atlas-sdk: Python SDK for the Atlas control-plane API.
+
+A thin HTTP client containing zero Atlas business logic.
+CLI → atlas-sdk → HTTP → /api/v1.
+"""
+
+from atlas_sdk.auth import StaticTokenSupplier, TokenSupplier
+from atlas_sdk.client import AtlasClient
+from atlas_sdk.errors import (
+    ApiError,
+    AuthError,
+    ConflictError,
+    ForbiddenError,
+    NetworkError,
+    NotFoundError,
+    RateLimitedError,
+    ServerError,
+    ValidationError,
+)
+from atlas_sdk.models.benchmarks import (
+    BenchmarkRead,
+    BenchmarkVersionRead,
+    PageResponse,
+)
+from atlas_sdk.models.dashboard import (
+    DashboardActivity,
+    DashboardCapability,
+    DashboardCapabilityScore,
+    DashboardHierarchy,
+    DashboardItem,
+    DashboardRuntime,
+    DashboardSnapshot,
+    DashboardSummary,
+)
+from atlas_sdk.models.executions import (
+    ArtifactResponse,
+    ExecutionAttemptResponse,
+    ExecutionCreateRequest,
+    ExecutionListResponse,
+    ExecutionPage,
+    ExecutionResponse,
+    ExecutionState,
+)
+from atlas_sdk.models.history import ExecutionHistoryRead, ModelActivityRead
+from atlas_sdk.models.leaderboard import (
+    LeaderboardEntryRead,
+    LeaderboardRead,
+    LeaderboardType,
+    ModelBenchmarkHistory,
+    ModelBenchmarkVersionHistory,
+    ModelSummary,
+    TrendPoint,
+)
+from atlas_sdk.models.models import ModelRead, ModelStatus
+from atlas_sdk.models.projects import OrganizationRead, ProjectRead
+from atlas_sdk.models.reports import (
+    CapabilityScoreRead,
+    DownloadResult,
+    PaginatedReportRunsRead,
+    ReportRunEntryRead,
+    ReportRunStatus,
+    ReportSummaryRead,
+)
+
+__all__ = [
+    "AtlasClient",
+    "ApiError",
+    "AuthError",
+    "ArtifactResponse",
+    "BenchmarkRead",
+    "BenchmarkVersionRead",
+    "ConflictError",
+    "DashboardActivity",
+    "DashboardCapability",
+    "DashboardCapabilityScore",
+    "DashboardHierarchy",
+    "DashboardItem",
+    "DashboardRuntime",
+    "DashboardSnapshot",
+    "DashboardSummary",
+    "ExecutionAttemptResponse",
+    "ExecutionCreateRequest",
+    "ExecutionHistoryRead",
+    "ExecutionListResponse",
+    "ExecutionPage",
+    "ExecutionResponse",
+    "ExecutionState",
+    "ForbiddenError",
+    "LeaderboardEntryRead",
+    "LeaderboardRead",
+    "LeaderboardType",
+    "ModelActivityRead",
+    "ModelBenchmarkHistory",
+    "ModelBenchmarkVersionHistory",
+    "ModelRead",
+    "ModelStatus",
+    "ModelSummary",
+    "OrganizationRead",
+    "ProjectRead",
+    "TrendPoint",
+    "NetworkError",
+    "NotFoundError",
+    "PaginatedReportRunsRead",
+    "PageResponse",
+    "RateLimitedError",
+    "ReportRunEntryRead",
+    "ReportRunStatus",
+    "CapabilityScoreRead",
+    "ReportSummaryRead",
+    "DownloadResult",
+    "ServerError",
+    "StaticTokenSupplier",
+    "TokenSupplier",
+    "ValidationError",
+]
+
+__version__ = "0.1.0"

synthesis_atlas_cli-0.1.0/atlas_sdk/auth.py

@@ -0,0 +1,28 @@
+"""Token supply strategies for SDK authentication.
+
+The SDK owns *attaching* credentials to HTTP requests.
+The CLI owns credential *storage and configuration*.
+
+A ``TokenSupplier`` is a zero-argument callable that returns a bearer token
+string.  The ``AtlasClient`` calls it before every request.
+"""
+
+from __future__ import annotations
+
+from typing import Protocol
+
+
+class TokenSupplier(Protocol):
+    """Protocol for token supply — any callable ``() -> str``."""
+
+    def __call__(self) -> str: ...  # pragma: no cover
+
+
+class StaticTokenSupplier:
+    """Returns a fixed token.  Useful for testing and CI environments."""
+
+    def __init__(self, token: str) -> None:
+        self._token = token
+
+    def __call__(self) -> str:
+        return self._token