codeer-cli 0.1.7__tar.gz → 0.1.9__tar.gz

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/API_REFERENCE.md

@@ -149,10 +149,10 @@ for the apply → test → publish workflow. Pass the draft `AgentHistory.id` fr
 
 | Method & path | Purpose |
 | --- | --- |
-| `GET /eval/workspaces/{workspace_id}/case-labels` | List reusable eval case labels |
-| `POST /eval/workspaces/{workspace_id}/case-labels` | Create reusable eval case label (`name`, `color?`) |
-| `PUT /eval/case-labels/{label_id}` | Update eval case label name/color |
-| `DELETE /eval/case-labels/{label_id}` | Delete eval case label and clear associations |
+| `GET /external/eval/case-labels` | List reusable eval case labels in the API key workspace |
+| `POST /external/eval/case-labels` | Create reusable eval case label (`name`, `color?`) in the API key workspace |
+| `PUT /external/eval/case-labels/{label_id}` | Update an eval case label in the API key workspace |
+| `DELETE /external/eval/case-labels/{label_id}` | Delete an eval case label and clear associations |
 | `POST /eval/cases` | Create case (`input`, `expected_output?`, `rubric?`, `label_ids?`); rubric = user-docs "Standard" |
 | `GET /eval/agents/{agent_id}/cases` | List cases for an agent |
 | `GET /eval/cases/{case_id}` | Read one |
@@ -171,8 +171,11 @@ for the apply → test → publish workflow. Pass the draft `AgentHistory.id` fr
 | `POST /eval/rubric` | Set/override the rubric for one (case, evaluator); also creates assignment |
 | `POST /eval/rubrics/batch` | **Read** rubrics for a batch of (case, evaluator) pairs |
 
-Eval case labels are workspace-scoped reusable objects. The case create/update
-payload uses `label_ids` (stringified label IDs), not freeform label names:
+Eval case labels are workspace-scoped reusable objects. The external label
+endpoints infer the workspace from the API key and do not accept a workspace
+override; switch CLI profiles to operate on another workspace. The case
+create/update payload uses `label_ids` (stringified label IDs), not freeform
+label names:
 
 ```json
 {
@@ -222,17 +225,18 @@ normalized `tool_calls`, `tool_calls_summary`, and `tool_total_duration_ms`;
 in `eval_table_full.json`. Per-tool time is computed from `start_at/end_at`.
 
 **`evaluator_id` is singular — one call returns results for one evaluator
-only.** Cases are also bound to specific evaluator assignments. To see the
-full picture for a case, first read the case/evaluator assignments, then call
-results once per assigned evaluator. `codeer eval run` and
-`codeer eval rubrics` handle this automatically; if calling the API directly,
-prefer `eval_mod.get_case_evaluator_infos(case_ids=[...])` as the source of
-truth for which pairs should run.
+only.** To see the full picture for a case, call results once per evaluator
+you care about. `codeer eval run` and `codeer eval rubrics` handle this
+automatically; when no evaluator is supplied, the public CLI uses external
+rubric batches to find case/evaluator pairs with configured rubrics.
 
 Regression workflow (apply prompt change → re-run all assigned pairs → spot
 side effects): `codeer eval run --agent <agent_id>` runs the latest
 AgentHistory by default. For the common "many cases, one tester" flow, use
 `codeer eval run --agent <agent_id> --cases <ids> --evaluator <evaluator_id>`.
+When triggering runs, call `POST /external/eval/runs` once per evaluator with
+that evaluator's case IDs. Do not call legacy internal trigger endpoints from
+the public CLI.
 
 ## Stage 7 — Publish
 
@@ -246,12 +250,19 @@ AgentHistory by default. For the common "many cases, one tester" flow, use
 
 | Method & path | Purpose |
 | --- | --- |
+| `POST /chats` | Create a persisted history using an agent's current published version |
+| `POST /chats/{id}/messages` | Append a turn to an existing persisted history using the current published version |
 | `GET /histories?agent_id=X&feedback_filter=improve_feedback&external_user_id=…` | List conversations with filters |
 | `GET /histories/{id}` | Read one history's metadata |
 | `GET /histories/{id}/conversations` | Full conversation turns incl. tool calls |
 | `POST /histories/{hid}/conversations/{cid}/feedbacks` | Leave freeform improvement feedback |
 | `POST /histories/{hid}/conversations/{cid}/score` | Numeric score |
 
+The CLI exposes the first two operations as `codeer history create` and
+`codeer history send`. Non-streaming message requests default to a 120-second
+per-message timeout. A timeout has an uncertain write outcome, so read the
+history before retrying to avoid duplicate turns.
+
 `feedback_filter` accepts the `FeedbackFilterType` enum values:
 `no_feedback`, `with_feedback`, `helpful_feedback`, `improve_feedback`.
 

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: codeer-cli
-Version: 0.1.7
+Version: 0.1.9
 Summary: Command line tools for managing Codeer agents over the Codeer API.
 Project-URL: Homepage, https://www.codeer.ai
 Author: Codeer.AI
@@ -143,9 +143,20 @@ Use this pattern during agent lifecycle work:
 ```bash
 codeer agent list
 codeer history list --agent <agent-id> --limit 50
+codeer history create --agent <agent-id> --message "Review this plan" --timeout 120
+codeer history send <history-id> --message "Use the recommended options" --timeout 120
 codeer eval run --agent <agent-id> --cases <case-ids> --evaluator <evaluator-id> --out .codeer/eval_run.json
 ```
 
+`history create` and `history send` use the agent's current published version.
+Their per-message timeout defaults to 120 seconds. If a write request times
+out, inspect the history before retrying: the server may have completed the
+turn after the client stopped waiting.
+
+Eval case label commands always operate on the active API-key workspace. They
+do not accept a workspace override; switch CLI profiles to target another
+workspace.
+
 Flags:
 
 - `--full` prints bounded extra detail for human inspection. It is still

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/README.md

@@ -125,9 +125,20 @@ Use this pattern during agent lifecycle work:
 ```bash
 codeer agent list
 codeer history list --agent <agent-id> --limit 50
+codeer history create --agent <agent-id> --message "Review this plan" --timeout 120
+codeer history send <history-id> --message "Use the recommended options" --timeout 120
 codeer eval run --agent <agent-id> --cases <case-ids> --evaluator <evaluator-id> --out .codeer/eval_run.json
 ```
 
+`history create` and `history send` use the agent's current published version.
+Their per-message timeout defaults to 120 seconds. If a write request times
+out, inspect the history before retrying: the server may have completed the
+turn after the client stopped waiting.
+
+Eval case label commands always operate on the active API-key workspace. They
+do not accept a workspace override; switch CLI profiles to target another
+workspace.
+
 Flags:
 
 - `--full` prints bounded extra detail for human inspection. It is still

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "codeer-cli"
-version = "0.1.7"
+version = "0.1.9"
 description = "Command line tools for managing Codeer agents over the Codeer API."
 readme = "README.md"
 requires-python = ">=3.11"

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/src/codeer_cli/__init__.py

@@ -19,7 +19,7 @@ workspace-local dotenv files or credential files.
 """
 
 from ._validate import ToolValidationError
-from .client import AuthError, CodeerClient, CodeerError
+from .client import AuthError, CodeerClient, CodeerError, TransportError
 from .parse import (
     AgentSummary,
     ConversationTurn,
@@ -43,7 +43,7 @@ from .parse import (
 )
 
 __all__ = [
-    "CodeerClient", "CodeerError", "AuthError", "ToolValidationError",
+    "CodeerClient", "CodeerError", "TransportError", "AuthError", "ToolValidationError",
     # parsers
     "AgentSummary", "ConversationTurn", "EvalResultSummary", "HistorySummary",
     "KBNode", "ToolCall", "EvalToolCall",

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/src/codeer_cli/chats.py

@@ -36,6 +36,7 @@ def send_published_agent_message(
     external_user_id: Optional[str] = None,
     attachment_ids: Optional[List[str]] = None,
     stream: bool = False,
+    timeout: Optional[float] = None,
 ) -> Iterator[dict] | dict:
     """Send a user message through the API-key external chat flow.
 
@@ -51,7 +52,7 @@ def send_published_agent_message(
     path = f"/chats/{chat_id}/messages"
     if stream:
         return client.stream_sse("POST", path, json=body)
-    return client.post(path, json=body)
+    return client.post(path, json=body, timeout=timeout)
 
 
 def send_message(
@@ -84,4 +85,3 @@ def list_messages(client: CodeerClient, chat_id: int) -> list[dict]:
 
 def list_chats(client: CodeerClient) -> list[dict]:
     return client.get("/chats")
-

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/src/codeer_cli/cli.py

@@ -4,7 +4,7 @@
     codeer agent list|get|apply|diff|versions
     codeer kb list|files|upload|node-rename|node-delete|faq-list|faq-get|faq-create|faq-update|faq-delete
     codeer eval list|label-list|label-create|label-update|label-delete|case-update|case-delete|evaluators|evaluator-create|evaluator-update|run|export|reconcile|cases-apply|rubrics|rubrics-apply
-    codeer history list|get|conversations|negative-feedback
+    codeer history list|get|conversations|negative-feedback|create|send
 """
 
 from __future__ import annotations

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/src/codeer_cli/client.py

@@ -37,6 +37,16 @@ class ScopeResolutionError(CodeerError):
     """Raised when workspace or organization scope cannot be inferred."""
 
 
+class TransportError(CodeerError):
+    """Raised when an HTTP request fails before a response is available."""
+
+    def __init__(self, message: str, body: Any = None):
+        RuntimeError.__init__(self, message)
+        self.status = 0
+        self.message = message
+        self.body = body
+
+
 @dataclass
 class CodeerClient:
     """Thin wrapper around httpx.Client with Codeer API-key auth.
@@ -148,9 +158,32 @@ class CodeerClient:
         json: Any = None,
         files: Any = None,
         data: Any = None,
+        timeout: Optional[float] = None,
     ) -> Any:
         url = path if path.startswith("http") else f"/api/v1{path if path.startswith('/') else '/' + path}"
-        r = self._client.request(method, url, params=params, json=json, files=files, data=data)
+        request_kwargs: dict[str, Any] = {}
+        if timeout is not None:
+            request_kwargs["timeout"] = timeout
+        method_upper = method.upper()
+        try:
+            r = self._client.request(
+                method_upper,
+                url,
+                params=params,
+                json=json,
+                files=files,
+                data=data,
+                **request_kwargs,
+            )
+        except httpx.TimeoutException as exc:
+            raise self._transport_error(
+                method_upper,
+                path,
+                exc,
+                timeout_seconds=timeout if timeout is not None else self.timeout,
+            ) from exc
+        except httpx.RequestError as exc:
+            raise self._transport_error(method_upper, path, exc) from exc
         return self._parse(r)
 
     def get(self, path: str, **kwargs: Any) -> Any:
@@ -181,29 +214,68 @@ class CodeerClient:
         Each event is a dict like ``{"event": "message", "data": <parsed-json-or-str>}``.
         """
         url = path if path.startswith("http") else f"/api/v1{path if path.startswith('/') else '/' + path}"
-        with self._client.stream(method, url, params=params, json=json) as r:
-            if r.status_code >= 400:
-                body = r.read().decode("utf-8", "replace")
-                self._raise_for_error(r.status_code, body)
-            event = "message"
-            buf: list[str] = []
-            for line in r.iter_lines():
-                if line == "":
-                    if buf:
-                        raw = "\n".join(buf)
-                        yield {"event": event, "data": _maybe_json(raw)}
-                        buf = []
-                        event = "message"
-                    continue
-                if line.startswith(":"):
-                    continue
-                if line.startswith("event:"):
-                    event = line[len("event:"):].strip()
-                    continue
-                if line.startswith("data:"):
-                    buf.append(line[len("data:"):].lstrip())
-            if buf:
-                yield {"event": event, "data": _maybe_json("\n".join(buf))}
+        method_upper = method.upper()
+        try:
+            with self._client.stream(method_upper, url, params=params, json=json) as r:
+                if r.status_code >= 400:
+                    body = r.read().decode("utf-8", "replace")
+                    self._raise_for_error(r.status_code, body)
+                event = "message"
+                buf: list[str] = []
+                for line in r.iter_lines():
+                    if line == "":
+                        if buf:
+                            raw = "\n".join(buf)
+                            yield {"event": event, "data": _maybe_json(raw)}
+                            buf = []
+                            event = "message"
+                        continue
+                    if line.startswith(":"):
+                        continue
+                    if line.startswith("event:"):
+                        event = line[len("event:"):].strip()
+                        continue
+                    if line.startswith("data:"):
+                        buf.append(line[len("data:"):].lstrip())
+                if buf:
+                    yield {"event": event, "data": _maybe_json("\n".join(buf))}
+        except httpx.TimeoutException as exc:
+            raise self._transport_error(
+                method_upper,
+                path,
+                exc,
+                timeout_seconds=self.timeout,
+            ) from exc
+        except httpx.RequestError as exc:
+            raise self._transport_error(method_upper, path, exc) from exc
+
+    def _transport_error(
+        self,
+        method: str,
+        path: str,
+        exc: httpx.RequestError,
+        *,
+        timeout_seconds: float | None = None,
+    ) -> TransportError:
+        outcome_uncertain = (
+            method not in {"GET", "HEAD", "OPTIONS"}
+            and not isinstance(exc, httpx.ConnectError)
+        )
+        if isinstance(exc, httpx.TimeoutException):
+            timeout_value = timeout_seconds if timeout_seconds is not None else self.timeout
+            message = f"Request timed out after {timeout_value:g}s: {method} {path}."
+            if outcome_uncertain:
+                message += " The server may have completed the request; inspect current state before retrying."
+        else:
+            message = f"Request failed: {method} {path}: {exc}"
+        return TransportError(
+            message,
+            {
+                "method": method,
+                "path": path,
+                "outcome_uncertain": outcome_uncertain,
+            },
+        )
 
     def _parse(self, r: httpx.Response) -> Any:
         text = r.text

{codeer_cli-0.1.7 → codeer_cli-0.1.9}/src/codeer_cli/commands/_util.py

@@ -62,5 +62,7 @@ def print_json(value: Any) -> None:
 def write_json(path: str | None, value: Any) -> None:
     if not path:
         return
-    Path(path).write_text(json.dumps(value, ensure_ascii=False, indent=2, default=str) + "\n")
+    out = Path(path)
+    out.parent.mkdir(parents=True, exist_ok=True)
+    out.write_text(json.dumps(value, ensure_ascii=False, indent=2, default=str) + "\n")
     log(f"wrote full detail to {path}")