scios-cli 0.1.9__tar.gz → 0.3.2__tar.gz

{scios_cli-0.1.9 → scios_cli-0.3.2}/PKG-INFO

@@ -1,31 +1,31 @@
 Metadata-Version: 2.4
 Name: scios-cli
-Version: 0.1.9
-Summary: Scios Local Agent Workspace Sync CLI — bridge your terminal to the Scios Cloud backend
+Version: 0.3.2
+Summary: Scios unified CLI — dev environment, deployment, database, logs, and more
 Author: Scios Team
 License: Apache-2.0
 Project-URL: Homepage, https://github.com/google-octo/science-studio
 Project-URL: Repository, https://github.com/google-octo/science-studio
-Project-URL: Documentation, https://github.com/google-octo/science-studio/tree/main/packages/cli
 Keywords: scios,cli,agent,sync,science,workflow
 Classifier: Development Status :: 4 - Beta
 Classifier: Intended Audience :: Developers
 Classifier: Intended Audience :: Science/Research
 Classifier: License :: OSI Approved :: Apache Software License
 Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.9
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
 Classifier: Topic :: Scientific/Engineering
-Classifier: Topic :: Software Development :: Libraries
 Classifier: Operating System :: OS Independent
 Requires-Python: >=3.9
 Description-Content-Type: text/markdown
 License-File: LICENSE
+Requires-Dist: typer[all]>=0.12.0
+Requires-Dist: rich>=13.0.0
+Requires-Dist: questionary>=2.0.0
 Requires-Dist: requests>=2.31.0
 Requires-Dist: watchdog>=3.0.0
+Requires-Dist: python-dotenv>=1.0.0
+Requires-Dist: tomli>=2.0.0; python_version < "3.11"
+Requires-Dist: tomli-w>=1.0.0
+Requires-Dist: mcp>=1.0.0
 Dynamic: license-file
 
 # Scios CLI 🚀
@@ -105,6 +105,40 @@ scios-sync 1234-5678-your-idea-id --endpoint "https://api.scios.ai/v1" --token "
 ```
 Passing `--local` directly triggers the Cloud APIs to launch that pipeline on the heavy GPUs immediately without ever having to touch a web button.
 
+### 4. Record the Houdini app while it runs (`--record-video`)
+When your workflow drives a **local** application — for example controlling Houdini through the Houdini MCP — you can have `scios-sync` screen-record the desktop locally for the entire execution, producing a single `.mp4` of the run.
+
+```bash
+scios-sync <idea_id> \
+  --endpoint "https://api.scios.ai/v1" \
+  --token "eyJh..." \
+  --local \
+  --record-video
+```
+
+Behaviour:
+1. Starts an `ffmpeg` screen capture **before** posting the execution (no missed frames).
+2. Triggers the workflow as usual and prints the `execution_id`.
+3. Polls `GET /workflows/executions/{execution_id}` every `--poll-interval` seconds (default 2s), printing each status transition.
+4. When the execution reaches a terminal status (`completed`, `failed`, `cancelled`, `error`, `stopped`), sends `q` to ffmpeg so it finalises the mp4 cleanly.
+5. Renames the file to `recordings/execution_<execution_id>.mp4` next to your current directory (or writes to `--video-out` if you passed it).
+
+Requirements:
+- `ffmpeg` on `PATH` (`brew install ffmpeg` / `apt install ffmpeg`).
+- macOS: grant Terminal (or your shell) **Screen Recording** permission under *System Settings → Privacy & Security*.
+- Linux: an X11 (or XWayland) display reachable at `:0.0`.
+
+Useful flags:
+| Flag | Default | Notes |
+|------|---------|-------|
+| `--video-fps` | `24` | Frame rate of the capture. |
+| `--video-out PATH` | auto | Override the mp4 output path. |
+| `--ffmpeg-input "..."` | platform default | Full ffmpeg input args, e.g. `"-f avfoundation -framerate 24 -i 2:none"` to record a specific display. List devices on macOS with `ffmpeg -f avfoundation -list_devices true -i ""`. |
+| `--poll-interval` | `2.0` | Seconds between execution-status polls. |
+| `--max-wait` | `3600` | Hard cap on the recording length in seconds. |
+
+Make sure the Houdini app + the `houdini_addon.py` MCP listener (port 9876) are already running before you fire the CLI — the Scios agents will reach into Houdini over MCP while the recorder is rolling.
+
 ---
 
 ### Manual Fallback Commands

{scios_cli-0.1.9 → scios_cli-0.3.2}/README.md

@@ -75,6 +75,40 @@ scios-sync 1234-5678-your-idea-id --endpoint "https://api.scios.ai/v1" --token "
 ```
 Passing `--local` directly triggers the Cloud APIs to launch that pipeline on the heavy GPUs immediately without ever having to touch a web button.
 
+### 4. Record the Houdini app while it runs (`--record-video`)
+When your workflow drives a **local** application — for example controlling Houdini through the Houdini MCP — you can have `scios-sync` screen-record the desktop locally for the entire execution, producing a single `.mp4` of the run.
+
+```bash
+scios-sync <idea_id> \
+  --endpoint "https://api.scios.ai/v1" \
+  --token "eyJh..." \
+  --local \
+  --record-video
+```
+
+Behaviour:
+1. Starts an `ffmpeg` screen capture **before** posting the execution (no missed frames).
+2. Triggers the workflow as usual and prints the `execution_id`.
+3. Polls `GET /workflows/executions/{execution_id}` every `--poll-interval` seconds (default 2s), printing each status transition.
+4. When the execution reaches a terminal status (`completed`, `failed`, `cancelled`, `error`, `stopped`), sends `q` to ffmpeg so it finalises the mp4 cleanly.
+5. Renames the file to `recordings/execution_<execution_id>.mp4` next to your current directory (or writes to `--video-out` if you passed it).
+
+Requirements:
+- `ffmpeg` on `PATH` (`brew install ffmpeg` / `apt install ffmpeg`).
+- macOS: grant Terminal (or your shell) **Screen Recording** permission under *System Settings → Privacy & Security*.
+- Linux: an X11 (or XWayland) display reachable at `:0.0`.
+
+Useful flags:
+| Flag | Default | Notes |
+|------|---------|-------|
+| `--video-fps` | `24` | Frame rate of the capture. |
+| `--video-out PATH` | auto | Override the mp4 output path. |
+| `--ffmpeg-input "..."` | platform default | Full ffmpeg input args, e.g. `"-f avfoundation -framerate 24 -i 2:none"` to record a specific display. List devices on macOS with `ffmpeg -f avfoundation -list_devices true -i ""`. |
+| `--poll-interval` | `2.0` | Seconds between execution-status polls. |
+| `--max-wait` | `3600` | Hard cap on the recording length in seconds. |
+
+Make sure the Houdini app + the `houdini_addon.py` MCP listener (port 9876) are already running before you fire the CLI — the Scios agents will reach into Houdini over MCP while the recorder is rolling.
+
 ---
 
 ### Manual Fallback Commands

{scios_cli-0.1.9 → scios_cli-0.3.2}/pyproject.toml

@@ -4,8 +4,8 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "scios-cli"
-version = "0.1.9"
-description = "Scios Local Agent Workspace Sync CLI — bridge your terminal to the Scios Cloud backend"
+version = "0.3.2"
+description = "Scios unified CLI — dev environment, deployment, database, logs, and more"
 readme = "README.md"
 license = {text = "Apache-2.0"}
 requires-python = ">=3.9"
@@ -19,28 +19,31 @@ classifiers = [
     "Intended Audience :: Science/Research",
     "License :: OSI Approved :: Apache Software License",
     "Programming Language :: Python :: 3",
-    "Programming Language :: Python :: 3.9",
-    "Programming Language :: Python :: 3.10",
-    "Programming Language :: Python :: 3.11",
-    "Programming Language :: Python :: 3.12",
-    "Programming Language :: Python :: 3.13",
     "Topic :: Scientific/Engineering",
-    "Topic :: Software Development :: Libraries",
     "Operating System :: OS Independent",
 ]
 dependencies = [
+    "typer[all]>=0.12.0",
+    "rich>=13.0.0",
+    "questionary>=2.0.0",
     "requests>=2.31.0",
     "watchdog>=3.0.0",
+    "python-dotenv>=1.0.0",
+    "tomli>=2.0.0; python_version < '3.11'",
+    "tomli-w>=1.0.0",
+    "mcp>=1.0.0",
 ]
 
 [project.urls]
 Homepage = "https://github.com/google-octo/science-studio"
 Repository = "https://github.com/google-octo/science-studio"
-Documentation = "https://github.com/google-octo/science-studio/tree/main/packages/cli"
 
 [project.scripts]
+scios = "scios_cli.app:main"
+# Backward-compat aliases
 scios-sync = "scios_cli.main:cli_entry"
 scios-init = "scios_cli.install:cli_install_protocol"
+scios-houdini = "scios_cli.houdini:cli_houdini"
 
 [tool.setuptools.packages.find]
 include = ["scios_cli*"]

scios_cli-0.3.2/scios_cli/__init__.py

@@ -0,0 +1,2 @@
+"""Scios CLI — unified command-line interface for the Scios science-studio platform."""
+__version__ = "0.3.0"

scios_cli-0.3.2/scios_cli/ag/__init__.py

@@ -0,0 +1,17 @@
+"""scios ag — Antigravity integration package.
+
+Projects a Scios idea into a local Antigravity project folder, keeps agent code
+in two-way sync with the backend, and runs workflows locally or in the cloud.
+
+All state lives in the backend DB and is reached over the REST API (never the DB
+directly) so the experience works from a plain `pip install scios-cli`.
+"""
+from __future__ import annotations
+
+__all__ = [
+    "api_client",
+    "manifest",
+    "sync_core",
+    "scaffold",
+    "local_runner",
+]

scios_cli-0.3.2/scios_cli/ag/api_client.py

@@ -0,0 +1,276 @@
+"""REST client for the Scios backend used by `scios ag`.
+
+Single source of truth for every backend interaction the Antigravity integration
+needs. Uses `requests` (already a CLI dependency) — no direct DB access, so this
+works from a plain `pip install scios-cli`.
+
+Auth: a JWT Bearer token (same as `scios sync`). Resolution order:
+  1. explicit `token=` argument
+  2. `SCIOS_API_TOKEN` environment variable
+  3. `[auth].token` in the workspace `scios.toml`
+
+All endpoints were verified in Phase 0 (see BUILD_PROGRESS.md).
+"""
+from __future__ import annotations
+
+import os
+import time
+from typing import Any
+
+import requests
+
+DEFAULT_ENDPOINT = "https://api.scios.dev/api/v1"
+
+
+class SciosAPIError(RuntimeError):
+    """Raised when the backend returns a non-2xx response."""
+
+    def __init__(self, status_code: int, message: str, url: str):
+        self.status_code = status_code
+        self.url = url
+        super().__init__(f"[{status_code}] {message} ({url})")
+
+
+class SciosClient:
+    """Thin, typed wrapper over the Scios REST API.
+
+    `endpoint` must include the `/api/v1` suffix (matching `scios sync`), e.g.
+    ``https://api.scios.dev/api/v1``.
+    """
+
+    def __init__(self, endpoint: str = DEFAULT_ENDPOINT, token: str | None = None, timeout: float = 60.0):
+        self.endpoint = endpoint.rstrip("/")
+        self.token = token or os.environ.get("SCIOS_API_TOKEN")
+        self.timeout = timeout
+        self._session = requests.Session()
+
+    # ── low-level ──────────────────────────────────────────────────────────
+    @property
+    def _headers(self) -> dict[str, str]:
+        if not self.token:
+            raise SciosAPIError(401, "No auth token. Set SCIOS_API_TOKEN or scios.toml [auth].token", self.endpoint)
+        return {"Authorization": f"Bearer {self.token}", "Content-Type": "application/json"}
+
+    def _request(self, method: str, path: str, *, json: Any = None, params: dict | None = None,
+                 timeout: float | None = None) -> Any:
+        url = f"{self.endpoint}{path}"
+        resp = self._session.request(
+            method, url, json=json, params=params, headers=self._headers,
+            timeout=timeout or self.timeout,
+        )
+        if not resp.ok:
+            detail = resp.text
+            try:
+                body = resp.json()
+                detail = body.get("detail") or body.get("message") or detail
+            except Exception:
+                pass
+            raise SciosAPIError(resp.status_code, str(detail), url)
+        if resp.content and "application/json" in resp.headers.get("content-type", ""):
+            return resp.json()
+        return resp.content
+
+    def get(self, path: str, **kw) -> Any:
+        return self._request("GET", path, **kw)
+
+    def post(self, path: str, **kw) -> Any:
+        return self._request("POST", path, **kw)
+
+    def patch(self, path: str, **kw) -> Any:
+        return self._request("PATCH", path, **kw)
+
+    # ── mount / sync (Phase 1) ─────────────────────────────────────────────
+    def get_sync_manifest(self, idea_id: str) -> dict:
+        """GET /ideas/{idea_id}/sync-manifest — the one-shot mount payload.
+
+        Returns {idea_id, active_workflow_id, workflow_definition, agents[],
+        execution, datasets[]}.
+        """
+        return self.get(f"/ideas/{idea_id}/sync-manifest")
+
+    def update_agent_code(self, agent_id: str, code_content: str) -> dict:
+        """PATCH /agents/{agent_id}/code — the single write path for agent code."""
+        return self.patch(f"/agents/{agent_id}/code", json={"code_content": code_content})
+
+    def get_idea(self, idea_id: str) -> dict:
+        """GET /ideas/{idea_id} — includes build_execute_progress/status, scios_score."""
+        return self.get(f"/ideas/{idea_id}")
+
+    # ── creation (Phase 2) ─────────────────────────────────────────────────
+    def create_workspace(self, name: str, description: str, category_id: str | None = None,
+                         metadata: dict | None = None) -> dict:
+        body: dict[str, Any] = {"name": name, "description": description}
+        if category_id:
+            body["categoryId"] = category_id
+        if metadata:
+            body["metadata"] = metadata
+        return self.post("/workspaces", json=body)
+
+    def create_research_goal(self, workspace_id: str, title: str, description: str,
+                             details: str | None = None, target: str | None = None,
+                             parameters: dict | None = None, original_prompt: str | None = None) -> dict:
+        body: dict[str, Any] = {"title": title, "description": description, "workspaceId": workspace_id}
+        if details:
+            body["details"] = details
+        if target:
+            body["target"] = target
+        if parameters:
+            body["parameters"] = parameters
+        if original_prompt:
+            body["originalPrompt"] = original_prompt
+        return self.post(f"/workspaces/{workspace_id}/goals", json=body)
+
+    def start_research_goal(self, workspace_id: str, goal_id: str, configuration: dict | None = None) -> dict:
+        """POST /workspaces/{ws}/goals/{goal}/start — generates ideas (Co-Scientist)."""
+        body = {"goalId": goal_id, "configuration": configuration or {}}
+        return self.post(f"/workspaces/{workspace_id}/goals/{goal_id}/start", json=body, timeout=300.0)
+
+    def list_session_ideas(self, session_id: str, limit: int = 20) -> list[dict]:
+        """GET /ideas/?session_id=... — ideas generated for a session.
+
+        Co-Scientist generates ideas asynchronously into the session; this is the
+        robust way to discover them (the goal/session detail endpoint is flaky).
+        """
+        resp = self.get("/ideas/", params={"session_id": session_id, "limit": limit})
+        if isinstance(resp, dict):
+            return resp.get("ideas") or resp.get("items") or []
+        return resp if isinstance(resp, list) else []
+
+    # ── build-execute (Phase 2) ────────────────────────────────────────────
+    def trigger_build_execute(self, idea_id: str, stage_config: dict | None = None) -> dict:
+        """POST /ideas/build-execute — start Architect→Vibing→Execute→Optimize."""
+        body: dict[str, Any] = {"idea_ids": [idea_id]}
+        if stage_config is not None:
+            body["stage_config"] = stage_config
+        return self.post("/ideas/build-execute", json=body)
+
+    def retry_build_execute(self, idea_id: str, stage_config: dict | None = None,
+                            force_retry: bool = False, skip_optimization: bool = False) -> dict:
+        body: dict[str, Any] = {"forceRetry": force_retry, "skipOptimization": skip_optimization}
+        if stage_config is not None:
+            body["stage_config"] = stage_config
+        return self.post(f"/ideas/{idea_id}/build-execute/retry", json=body)
+
+    def cancel_build_execute(self, idea_id: str) -> dict:
+        return self.post(f"/ideas/{idea_id}/build-execute/cancel")
+
+    def get_build_execute_progress(self, idea_id: str) -> dict:
+        """Return {status, scios_score, progress} derived from GET /ideas/{id}."""
+        idea = self.get_idea(idea_id)
+        return {
+            "status": idea.get("buildExecuteStatus") or idea.get("build_execute_status"),
+            "scios_score": idea.get("sciosScore") or idea.get("scios_score"),
+            "progress": idea.get("buildExecuteProgress") or idea.get("build_execute_progress"),
+        }
+
+    def wait_for_build_execute(self, idea_id: str, poll_interval: float = 5.0,
+                               timeout: float = 3600.0, on_progress=None) -> dict:
+        """Poll build_execute_progress until a terminal status or timeout.
+
+        Terminal statuses: 'completed', 'failed'. Returns the final progress dict.
+        """
+        deadline = time.time() + timeout
+        last_status = None
+        while time.time() < deadline:
+            prog = self.get_build_execute_progress(idea_id)
+            status = prog.get("status")
+            if on_progress and status != last_status:
+                on_progress(prog)
+                last_status = status
+            elif on_progress:
+                on_progress(prog)
+            if status in ("completed", "failed"):
+                return prog
+            time.sleep(poll_interval)
+        raise SciosAPIError(408, f"build-execute did not finish within {timeout}s", f"/ideas/{idea_id}")
+
+    # ── execution (Phase 3 cloud) ──────────────────────────────────────────
+    def execute_workflow(self, workflow_id: str, execution_mode: str = "worker",
+                         inputs: dict | None = None, session_id: str | None = None,
+                         execution_quantity: int = 1) -> dict:
+        """POST /workflows/{id}/execute. `--mode cloud` ⇒ execution_mode='worker'."""
+        body: dict[str, Any] = {
+            "execution_mode": execution_mode,
+            "execution_quantity": execution_quantity,
+        }
+        if inputs is not None:
+            body["inputs"] = inputs
+        if session_id:
+            body["session_id"] = session_id
+        return self.post(f"/workflows/{workflow_id}/execute", json=body)
+
+    def list_executions(self, workflow_id: str) -> list[dict]:
+        return self.get(f"/workflows/{workflow_id}/executions")
+
+    def get_execution(self, execution_id: str) -> dict:
+        """GET /workflows/executions/{id} — execution detail incl. results_dashboard
+        and result_analysis. (Route is under the /workflows prefix; a bare
+        /executions/{id} returns 404.)"""
+        return self.get(f"/workflows/executions/{execution_id}")
+
+    def get_node_data(self, execution_id: str, node_id: str, data_key: str,
+                      data_category: str = "input") -> Any:
+        """GET /datasets/execution/{exec}/nodes/{node}/data — resolve one offloaded
+        node input/output value by its data_key (used to hydrate Zero-Copy start
+        inputs for a local run)."""
+        return self.get(
+            f"/datasets/execution/{execution_id}/nodes/{node_id}/data",
+            params={"data_category": data_category, "data_key": data_key},
+        )
+
+    def get_execution_trace(self, execution_id: str, slim: bool = False) -> Any:
+        """GET /workflows/executions/{id}/trace — hydrates _stored_in_datasets offloads."""
+        return self.get(f"/workflows/executions/{execution_id}/trace", params={"slim": str(slim).lower()})
+
+    def get_execution_logs(self, execution_id: str) -> Any:
+        return self.get(f"/workflows/executions/{execution_id}/logs")
+
+    # ── datasets (Phase 5) ─────────────────────────────────────────────────
+    def get_dataset_content(self, dataset_id: str) -> bytes:
+        return self.get(f"/datasets/{dataset_id}/content")
+
+    # ── maxwell assistant (Phase 4) ────────────────────────────────────────
+    def maxwell_create_session(self, workspace_id: str | None = None) -> dict:
+        """POST /maxwell/sessions — start a Maxwell assistant session."""
+        body: dict[str, Any] = {}
+        if workspace_id:
+            body["workspace_id"] = workspace_id
+        return self.post("/maxwell/sessions", json=body)
+
+    def suggest_all_fields(self, session_id: str, research_context: str,
+                           title: str | None = None, description: str | None = None) -> dict:
+        """POST /maxwell/sessions/{id}/suggest-all-fields — the same AI auto-amend
+        the /dashboard/plan page uses. Turns a raw goal prompt into structured
+        {title, description, targetMetrics, constraints, methodology, category, ...}."""
+        body: dict[str, Any] = {"researchContext": research_context}
+        if title:
+            body["title"] = title
+        if description:
+            body["description"] = description
+        return self.post(f"/maxwell/sessions/{session_id}/suggest-all-fields", json=body, timeout=180.0)
+
+    def maxwell_query(self, session_id: str, query: str) -> dict:
+        """POST /maxwell/sessions/{id}/query — send a natural-language query."""
+        return self.post(f"/maxwell/sessions/{session_id}/query", json={"query": query}, timeout=300.0)
+
+    def maxwell_history(self, session_id: str) -> dict:
+        return self.get(f"/maxwell/sessions/{session_id}/history")
+
+    # ── mcp tool call (Phase 3/4) ──────────────────────────────────────────
+    def call_tool(self, tool_name: str, arguments: dict, server_name: str = "science",
+                  poll_interval: float = 2.0) -> Any:
+        """POST /mcp/tools/call, transparently awaiting a promoted background job."""
+        data = self.post("/mcp/tools/call", json={
+            "server_name": server_name, "tool_name": tool_name, "arguments": arguments,
+        }, timeout=900.0)
+        if isinstance(data, dict) and "job_id" in data:
+            job_id = data["job_id"]
+            while True:
+                time.sleep(poll_interval)
+                job = self.get(f"/mcp/tools/status/{job_id}")
+                status = job.get("status")
+                if status == "completed":
+                    return job.get("result")
+                if status == "failed":
+                    raise SciosAPIError(500, f"tool '{tool_name}' failed: {job.get('error')}", "/mcp/tools/call")
+        return data