@evolvingmachines/evolve 0.0.65 → 0.0.67

package/skills/evolve-evals/references/cli-reference/agent.mdx

@@ -1,79 +0,0 @@
----
-title: "evolve agent"
-description: "Register and manage your own agents."
----
-
-import GlobalOptions from '/snippets/global-options.mdx';
-import ListFlags from '/snippets/list-flags.mdx';
-
-```bash
-evolve agent <command> [options]
-```
-
-## agent list
-
-```bash
-evolve agent list [options]
-```
-
-List registered agents.
-
-<ParamField path="--scope" type="my | shared | org">
-  Visibility scope: `my`, your own registrations (the default); `shared`, your organizations' other members'; or `org`, every registration in your organizations.
-</ParamField>
-
-<ListFlags />
-
-## agent show
-
-```bash
-evolve agent show <name>
-```
-
-Show a registered agent: your own of that name first, else the oldest of that name across the organizations you belong to. A name outside your organizations answers `agent_not_found`.
-
-## agent add
-
-```bash
-evolve agent add <name> [options]
-```
-
-Register an agent from an install script or a local directory.
-
-The registration belongs to you and to an organization: its members may name the agent in their own jobs, and only you can change or delete it. A name stays unique per person, so two teammates may each register their own `acme-cli`.
-
-A registration that cannot be built — the script exits non-zero, or installs nothing executable (see [Registered agents](/core-concepts/agents)) — fails its trials as the agent's own error (`failure_phase` `agent_source`; the trial's stderr stream holds the install's output), never retried: `agent remove` it, `agent add` it again, and resume the job.
-
-<ParamField path="--org" type="name">
-  Organization the registration belongs to. Default: the organization from `evolve auth org use`, else your personal one. It is fixed once set.
-</ParamField>
-
-<ParamField path="--install-script" type="path">
-  Install script file. Its contents are uploaded.
-</ParamField>
-
-<ParamField path="--dir" type="path">
-  Local agent directory, tarred and uploaded.
-</ParamField>
-
-<ParamField path="--run" type="command" required>
-  Run command, executed with `sh -c`.
-</ParamField>
-
-<ParamField path="--ae, --agent-env" type="KEY=VALUE">
-  Environment injected at run time. Repeatable. It may not override the six run-contract keys, and a credential-shaped key is refused, both with `agent_invalid_env`; see [the run contract](/core-concepts/agents#the-run-contract).
-</ParamField>
-
-```bash
-evolve agent add acme-cli --install-script ./install.sh --run "acme-cli --headless"
-```
-
-## agent remove
-
-```bash
-evolve agent remove <name>
-```
-
-Delete a registered agent. Past jobs keep their record.
-
-<GlobalOptions />

package/skills/evolve-evals/references/cli-reference/analysis.mdx

@@ -1,160 +0,0 @@
----
-title: "evolve analysis"
-description: "List, inspect, and download trace-analysis runs."
----
-
-import GlobalOptions from '/snippets/global-options.mdx';
-import ListFlags from '/snippets/list-flags.mdx';
-
-```bash
-evolve analysis <command> [options]
-```
-
-`show`, `trace` and `download` take an analysis id, or a trial id. An analysis id (or its unambiguous prefix) names that run. A trial id (or prefix) names the trial's latest analysis, the one `trial show` prints on its analysis row. A prefix matching both an analysis and a trial is refused as ambiguous, naming both.
-
-A trial nobody analyzed is refused with the remedy, `evolve analyze <job>`, and so is a regrade result's id. An id you cannot read answers `analysis_not_found`; `download` on a run still queued or running answers `analysis_not_terminal`.
-
-## analysis list
-
-```bash
-evolve analysis list [options]
-```
-
-List analysis runs, newest first, with the trial, job and task each one judged.
-
-<ListFlags />
-
-<ParamField path="--scope" type="my | shared">
-  Visibility scope: `my`, what you created (the default), or `shared`, your organizations' rows that teammates created.
-</ParamField>
-
-<ParamField path="--job" type="job-id">
-  Only analyses of this job's trials. An id, or an unambiguous prefix.
-</ParamField>
-
-<ParamField path="--status" type="s1,s2,...">
-  Filter by analysis status: `queued`, `running`, `completed`, `failed`.
-</ParamField>
-
-```bash
-evolve analysis list --job 3e1f9a2c-… --status failed
-```
-
-## analysis show
-
-```bash
-evolve analysis show <analysis-id | trial-id>
-```
-
-Show one analysis run in full: the verdict document.
-
-## analysis trace
-
-```bash
-evolve analysis trace <analysis-id | trial-id> [options]
-```
-
-Print the analyzer's own parsed transcript.
-
-<ParamField path="--since" type="n">
-  Skip the first N events. To resume, pass the count you already hold; sequence numbers are dense from 0, so N is also the next one.
-</ParamField>
-
-## analysis download
-
-```bash
-evolve analysis download <analysis-id | trial-id> [options]
-```
-
-Save an analysis run as a trial folder plus `evolve.json`, or stream one artifact.
-
-<ParamField path="-o, --output-dir" type="dir" default="analyses/">
-  Directory to save under. The run lands in `<dir>/analyze-<analyzed trial>__<7 chars>/`, the run's own folder name, read from the archive.
-</ParamField>
-
-<ParamField path="--overwrite">
-  Replace an existing folder of the same name.
-</ParamField>
-
-<ParamField path="--stream" type="artifact">
-  Print one artifact to stdout instead of saving: `analysis` (the verdict document), `trace-parsed`, `trace-stdout`, `trace-stderr` or `agent-home`.
-</ParamField>
-
-<ParamField path="--since" type="n">
-  With `--stream trace-parsed`: skip the first N events.
-</ParamField>
-
-```bash
-evolve analysis download a0a1b2c3-… --stream trace-stdout
-```
-
-## analysis files
-
-```bash
-evolve analysis files <status|ls|cat|search|changes|archive> <analysis-id> [path] [options]
-```
-
-The run's file system: while the box runs, `files` reads it as it changes; after the run, the same commands read the kept tree. `files status` says which you get.
-
-- `files status <analysis-id>` — `live`, `captured`, `capturing` (the kept tree is still being written) or `none`; the box, how change events arrive (`watcher`), and the capture record (`ready`, `incomplete` with what was left out, or `failed`).
-- `files ls <analysis-id> [path]` — one folder, sorted by name (default `/`). Each row shows the type, mode, size, mtime and name; `created (agent)` or `modified (verifier)` marks what the run changed and when, `image only` marks a file the run never touched (it lists but does not open on the kept tree).
-- `files cat <analysis-id> <path>` — the raw bytes of one file, to stdout. `--range bytes=a-b` (or `bytes=a-`, `bytes=-n`) reads a slice.
-- `files search <analysis-id> <text>` — every line matching the text, as `path:line: snippet`. `--path` narrows the search to one folder (the whole box takes seconds); `--regex` treats the text as a pattern; a `(truncated)` note means there was more.
-- `files changes <analysis-id>` — the files the run created, modified or removed, with the phase (`--phase agent|verifier`).
-- `files archive <analysis-id>` — a `.tar.gz` of one subtree (`--path`, default the whole tree) to stdout, or saved under `-o <dir>`. The kept tree's archive lists the files it does not carry in `MANIFEST.tsv`; while the box runs, a subtree too large to read out in time is refused (`feature_unsupported`).
-
-<ParamField path="--source" type="live|capture">
-  Force the source. Without it, whichever the run has. A source that is not there is refused with `filesystem_state`.
-</ParamField>
-
-<ParamField path="-l, --limit" type="n">
-  Page size on `ls`, `search` and `changes` (`ls`, `changes` default 500; `search` default 200; max 1000).
-</ParamField>
-
-<ParamField path="--cursor" type="c">
-  Resume a paged `ls` or `changes` after the previous page's `next_cursor`.
-</ParamField>
-
-```bash
-evolve analysis files ls a0a1b2c3-… /app/work
-evolve analysis files search a0a1b2c3-… 'permission denied' --path /app/work
-evolve analysis files archive a0a1b2c3-… --path /app/work -o archives/
-```
-
-## analysis logs
-
-```bash
-evolve analysis logs <analysis-id> --stream <name> [--follow] [options]
-```
-
-The box's own streams: `agent` (the harness's stdout and stderr), `verifier` and `system` (the box's system log, only when the job asked for it with `--system-log`); `setup` and `metrics` are named but not recorded today, so their pages are empty and say why. One page by default; `--follow` keeps printing lines as they arrive while the box lives, and returns once it is gone.
-
-<ParamField path="--stream" type="name" required>
-  `agent`, `verifier`, `system`, `setup` or `metrics`.
-</ParamField>
-
-<ParamField path="-f, --follow">
-  Keep printing new lines while the box lives.
-</ParamField>
-
-<ParamField path="-l, --limit" type="n" default="1000">
-  Lines per page, max 1000.
-</ParamField>
-
-<ParamField path="--cursor" type="seq">
-  Resume after this line.
-</ParamField>
-
-```bash
-evolve analysis logs a0a1b2c3-… --stream agent --follow
-```
-
-## analysis procs
-
-```bash
-evolve analysis procs <analysis-id>
-```
-
-The processes running in the box right now. Live only: once the box is gone the command is refused with `filesystem_state`.
-
-<GlobalOptions />

package/skills/evolve-evals/references/cli-reference/analyze.mdx

@@ -1,84 +0,0 @@
----
-title: "evolve analyze"
-description: "Analyze a finished job's trial traces against a rubric, on the platform."
----
-
-import GlobalOptions from '/snippets/global-options.mdx';
-
-```bash
-evolve analyze <job-id> [options]
-evolve analyze --show-defaults
-```
-
-Analyze a terminal job's trial traces against a rubric, server-side. Without `--watch` the command returns at once with the job block and the hint `Follow it with: evolve job show <id>`; `--json` prints the accepted job body. Exit 0 on an accepted wave; with `--watch`, exit 1 when any analysis failed.
-
-```bash
-evolve analyze 3e1f9a2c-… \
-  -r rubric.toml \
-  -p prompt.txt \
-  --failing \
-  -l 20 \
-  -n 2 \
-  --watch
-evolve analyze 3e1f9a2c-… -t d1a10c4e-… -t d1a10f72-…
-```
-
-## Options
-
-<ParamField path="-m, --model" type="name" default="openrouter/deepseek/deepseek-v4.1-flash">
-  Model the analyzer runs. `glm-5.3-flash` and `haiku` are alternatives, `glm-5.3` escalates, and `fireworks/deepseek-v4.1-flash` is the same model on its Fireworks route. Must be on the `claude` roster.
-</ParamField>
-
-<ParamField path="--effort" type="value">
-  Reasoning effort the analyzer runs at. Defaults to the per-model default: `high` on `openrouter/deepseek/deepseek-v4.1-flash`, `max` on `glm-5.3-flash`.
-</ParamField>
-
-<ParamField path="-r, --rubric" type="path">
-  Rubric file: TOML (one `[[criteria]]` table per criterion), YAML or JSON in the `{criteria: [{name, description, guidance}]}` shape, parsed at the keyboard with unknown fields refused by name; the server owns the bounds. Defaults to the platform's analyze rubric, seven criteria with `score_is_earned` first.
-</ParamField>
-
-<ParamField path="-p, --prompt" type="path">
-  Prompt file for the evaluator agent; its text replaces the built-in prompt, with `{trial_path}`, `{task_section}` and `{criteria_guidance}` rendered, `{{` and `}}` writing a literal brace, and an unknown `{token}` rendering empty. The instructions for writing the result are appended after it. An empty file is refused; there is no length bound. Defaults to the built-in prompt.
-</ParamField>
-
-<ParamField path="-e, --env" type="provider">
-  Sandbox provider the analyzer runs on. Defaults to `daytona`.
-</ParamField>
-
-<ParamField path="--show-defaults">
-  Print the defaults an analysis runs under when you name none: model, effort, provider, the rubric's criteria and the built-in prompt template, then exit. With `--json`, one object. Takes no job id and no other analyze flag.
-</ParamField>
-
-<ParamField path="-n, --n-concurrent" type="n">
-  Max concurrent trial analyses, 1 to 150, beneath the organization's `max_concurrent_analyses` (fleet default 60). Defaults to the ceiling.
-</ParamField>
-
-<ParamField path="--passing">
-  Only analyze passing trials (reward 1.0).
-</ParamField>
-
-<ParamField path="--failing">
-  Only analyze failing trials (reward below 1.0, or an exception).
-</ParamField>
-
-<ParamField path="-t, --trial" type="trial-id">
-  Analyze only this trial; repeatable. Combines with `--passing` or `--failing` (a named trial on the other side is skipped) and comes before `-l`. An id that is not a trial of this job is refused, with the unknown ids named.
-</ParamField>
-
-<ParamField path="-l, --n-trials" type="n">
-  Max trials to analyze, after `--passing`, `--failing` or `--trial`, in the job's trial order.
-</ParamField>
-
-<ParamField path="--watch">
-  Poll until every analysis settles, then print one row per analyzed trial: the label (`custom rubric` when there is none), the criterion outcomes, the analyzer's cost and a summary excerpt, with failed analyses listed below. With `--json`, NDJSON envelopes: `analysis.accepted`, `analysis.stats` per change, `analysis.final` with the job and the analyzed trials.
-</ParamField>
-
-<ParamField path="-q, --quiet">
-  With `--watch`: suppress the progress lines and print the final block only.
-</ParamField>
-
-<GlobalOptions />
-
-## Reading analyses back
-
-The [`analysis`](/cli-reference/analysis) group lists, shows, traces and downloads analysis runs.

package/skills/evolve-evals/references/cli-reference/auth.mdx

@@ -1,133 +0,0 @@
----
-title: "evolve auth"
-description: "Identity, API keys, and your organizations."
----
-
-import GlobalOptions from '/snippets/global-options.mdx';
-
-```bash
-evolve auth <command> [options]
-```
-
-## auth status
-
-```bash
-evolve auth status
-```
-
-Who am I: the caller and the API key in use.
-
-## auth org list
-
-```bash
-evolve auth org list [options]
-```
-
-List the organizations you belong to.
-
-<ParamField path="--search" type="text">
-  Free-text filter over slug, display name and role.
-</ParamField>
-
-<ParamField path="--columns" type="keys | all | help">
-  Choose and order columns, comma-separated. `help` lists the keys.
-</ParamField>
-
-<ParamField path="-q, --quiet">
-  Print only slugs, one per line, for piping.
-</ParamField>
-
-<ParamField path="--no-trunc">
-  Full cell content instead of one-line truncation.
-</ParamField>
-
-<ParamField path="--no-headers">
-  Omit the header row in piped (TSV) output.
-</ParamField>
-
-## auth org show
-
-```bash
-evolve auth org show <slug>
-```
-
-Show one organization: your role, its members, its quota and live usage.
-
-```bash
-evolve auth org show acme
-```
-
-## auth org create
-
-```bash
-evolve auth org create <name> [--display-name <text>]
-```
-
-Create an organization. You become its owner. The name is its slug: lowercase letters, digits and hyphens, starting and ending with a letter or digit, 48 characters at most; `personal` is reserved.
-
-```bash
-evolve auth org create acme --display-name "Acme Corp"
-```
-
-```text
-Created organization acme
-slug          acme
-display name  Acme Corp
-role          owner
-
-Invite a teammate with: evolve auth org invite acme
-```
-
-## auth org invite
-
-```bash
-evolve auth org invite <org>
-```
-
-Mint an invite token for an organization you own. The token is shown once; send your teammate the join command it prints.
-
-```bash
-evolve auth org invite acme
-```
-
-```text
-token    evi_...
-expires  2026-09-24T00:00:00.000Z
-uses     unlimited
-
-Send the teammate this command: evolve auth org join evi_...
-```
-
-## auth org join
-
-```bash
-evolve auth org join <token>
-```
-
-Join the organization an invite token names, as a member. Running it again with the same token is harmless.
-
-```bash
-evolve auth org join evi_...
-```
-
-```text
-Joined acme as member
-```
-
-## auth org use
-
-```bash
-evolve auth org use [<name> | personal]
-```
-
-Set the organization your jobs and datasets land in when a command names none. It is written to `$XDG_CONFIG_HOME/evolve/config.json`, else `~/.config/evolve/config.json`. `personal` clears it; with no argument it prints the current default. `--org` on `evolve run` or `evolve dataset publish` always wins over it.
-
-```bash
-evolve auth org use acme
-```
-
-```text
-Default org: acme (/Users/you/.config/evolve/config.json)
-```
-
-<GlobalOptions />