@eigenpal/cli 0.4.3 → 0.4.5

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (14) hide show
  1. package/CHANGELOG.md +3 -1
  2. package/dist/cli.js +38514 -29904
  3. package/dist/skill/SKILL.md +86 -43
  4. package/dist/skill/reference/cli/agent.md +0 -4
  5. package/dist/skill/reference/cli/auth.md +0 -4
  6. package/dist/skill/reference/cli/completion.md +0 -4
  7. package/dist/skill/reference/cli/init.md +0 -4
  8. package/dist/skill/reference/cli/skill.md +0 -4
  9. package/dist/skill/reference/cli/status.md +0 -4
  10. package/dist/skill/reference/cli/workflow.md +186 -191
  11. package/dist/skill/reference/dataset-format.md +10 -10
  12. package/dist/skill/reference/debugging.md +12 -9
  13. package/dist/skill/reference/evaluators.md +5 -5
  14. package/package.json +7 -7
package/dist/skill/reference/cli/workflow.md CHANGED
@@ -1,10 +1,6 @@
1
1
  # eigenpal workflow
2
2
 
3
- > **Auto-generated.** This file is regenerated from the live Commander tree in
4
- > `packages/cli/src/cli.ts` by `bun run --cwd packages/cli generate:cli-docs`.
5
- > Do not hand-edit — your changes will be overwritten on the next run.
6
-
7
- All workflow operations. Core verbs (list / push / pull / validate) sit directly here; sub-namespaces (versions, evaluators, dataset, experiment, execution, step-type) group operations on each owned resource. The agent surface mirrors this shape 1:1 when it lands.
3
+ Manage workflows: push, pull, run, evaluate.
8
4
 
9
5
  ## Contents
10
6
 
@@ -21,34 +17,34 @@ All workflow operations. Core verbs (list / push / pull / validate) sit directly
21
17
  - [Step](#step)
22
18
  - [Details](#details)
23
19
  - [`eigenpal workflow list [options]`](#eigenpal-workflow-list-options)
24
- - [`eigenpal workflow pull [options] <workflowId>`](#eigenpal-workflow-pull-options-workflowid)
20
+ - [`eigenpal workflow pull [options] <workflow-id>`](#eigenpal-workflow-pull-options-workflow-id)
25
21
  - [`eigenpal workflow push [options]`](#eigenpal-workflow-push-options)
26
22
  - [`eigenpal workflow validate [options]`](#eigenpal-workflow-validate-options)
27
- - [`eigenpal workflow clear-local [options] [workflow-slug] [examples...]`](#eigenpal-workflow-clear-local-options-workflow-slug-examples)
28
- - [`eigenpal workflow evaluators pull [options] <workflowId>`](#eigenpal-workflow-evaluators-pull-options-workflowid)
29
- - [`eigenpal workflow evaluators push [options] <workflowId>`](#eigenpal-workflow-evaluators-push-options-workflowid)
23
+ - [`eigenpal workflow clear-local [options] [examples...]`](#eigenpal-workflow-clear-local-options-examples)
24
+ - [`eigenpal workflow evaluators pull [options] <workflow-id>`](#eigenpal-workflow-evaluators-pull-options-workflow-id)
25
+ - [`eigenpal workflow evaluators push [options] <workflow-id>`](#eigenpal-workflow-evaluators-push-options-workflow-id)
30
26
  - [`eigenpal workflow evaluators validate [options] [path]`](#eigenpal-workflow-evaluators-validate-options-path)
31
- - [`eigenpal workflow dataset list [options] <workflowId>`](#eigenpal-workflow-dataset-list-options-workflowid)
32
- - [`eigenpal workflow dataset pull [options] <workflowId>`](#eigenpal-workflow-dataset-pull-options-workflowid)
33
- - [`eigenpal workflow dataset push [options] <workflowId>`](#eigenpal-workflow-dataset-push-options-workflowid)
34
- - [`eigenpal workflow dataset example create [options] <workflowId>`](#eigenpal-workflow-dataset-example-create-options-workflowid)
35
- - [`eigenpal workflow dataset example update [options] <workflowId> <exampleId>`](#eigenpal-workflow-dataset-example-update-options-workflowid-exampleid)
36
- - [`eigenpal workflow dataset example delete [options] <workflowId> <exampleId>`](#eigenpal-workflow-dataset-example-delete-options-workflowid-exampleid)
37
- - [`eigenpal workflow dataset example get [options] <workflowId> <exampleId>`](#eigenpal-workflow-dataset-example-get-options-workflowid-exampleid)
27
+ - [`eigenpal workflow dataset list [options] <workflow-id>`](#eigenpal-workflow-dataset-list-options-workflow-id)
28
+ - [`eigenpal workflow dataset pull [options] <workflow-id>`](#eigenpal-workflow-dataset-pull-options-workflow-id)
29
+ - [`eigenpal workflow dataset push [options] <workflow-id>`](#eigenpal-workflow-dataset-push-options-workflow-id)
30
+ - [`eigenpal workflow dataset example create [options] <workflow-id>`](#eigenpal-workflow-dataset-example-create-options-workflow-id)
31
+ - [`eigenpal workflow dataset example update [options] <workflow-id> <exampleId>`](#eigenpal-workflow-dataset-example-update-options-workflow-id-exampleid)
32
+ - [`eigenpal workflow dataset example delete [options] <workflow-id> <exampleId>`](#eigenpal-workflow-dataset-example-delete-options-workflow-id-exampleid)
33
+ - [`eigenpal workflow dataset example get [options] <workflow-id> <exampleId>`](#eigenpal-workflow-dataset-example-get-options-workflow-id-exampleid)
38
34
  - [`eigenpal workflow dataset validate [options] [path]`](#eigenpal-workflow-dataset-validate-options-path)
39
- - [`eigenpal workflow experiment list [options] <workflowId>`](#eigenpal-workflow-experiment-list-options-workflowid)
40
- - [`eigenpal workflow experiment run [options] <workflowId>`](#eigenpal-workflow-experiment-run-options-workflowid)
41
- - [`eigenpal workflow experiment status [options] <workflowId> <batchId>`](#eigenpal-workflow-experiment-status-options-workflowid-batchid)
42
- - [`eigenpal workflow experiment results [options] <workflowId> [batchId]`](#eigenpal-workflow-experiment-results-options-workflowid-batchid)
35
+ - [`eigenpal workflow experiment list [options] <workflow-id>`](#eigenpal-workflow-experiment-list-options-workflow-id)
36
+ - [`eigenpal workflow experiment run [options] <workflow-id>`](#eigenpal-workflow-experiment-run-options-workflow-id)
37
+ - [`eigenpal workflow experiment status [options] <workflow-id> <batchId>`](#eigenpal-workflow-experiment-status-options-workflow-id-batchid)
38
+ - [`eigenpal workflow experiment results [options] <workflow-id> [batchId]`](#eigenpal-workflow-experiment-results-options-workflow-id-batchid)
43
39
  - [`eigenpal workflow experiment compare [options] <batchIdA> <batchIdB>`](#eigenpal-workflow-experiment-compare-options-batchida-batchidb)
44
- - [`eigenpal workflow execution run [options] <workflow-slug> [examples...]`](#eigenpal-workflow-execution-run-options-workflow-slug-examples)
40
+ - [`eigenpal workflow execution run [options] <workflow-id> [examples...]`](#eigenpal-workflow-execution-run-options-workflow-id-examples)
45
41
  - [`eigenpal workflow execution get [options] <executionId>`](#eigenpal-workflow-execution-get-options-executionid)
46
- - [`eigenpal workflow execution list [options] <workflowId>`](#eigenpal-workflow-execution-list-options-workflowid)
42
+ - [`eigenpal workflow execution list [options] <workflow-id>`](#eigenpal-workflow-execution-list-options-workflow-id)
47
43
  - [`eigenpal workflow execution watch [options] <executionId>`](#eigenpal-workflow-execution-watch-options-executionid)
48
44
  - [`eigenpal workflow execution compare [options] <executionA> <executionB>`](#eigenpal-workflow-execution-compare-options-executiona-executionb)
49
45
  - [`eigenpal workflow execution cancel [options] <executionId>`](#eigenpal-workflow-execution-cancel-options-executionid)
50
- - [`eigenpal workflow versions list [options] <workflowId>`](#eigenpal-workflow-versions-list-options-workflowid)
51
- - [`eigenpal workflow versions restore [options] <workflowId> <versionId>`](#eigenpal-workflow-versions-restore-options-workflowid-versionid)
46
+ - [`eigenpal workflow versions list [options] <workflow-id>`](#eigenpal-workflow-versions-list-options-workflow-id)
47
+ - [`eigenpal workflow versions restore [options] <workflow-id> <versionId>`](#eigenpal-workflow-versions-restore-options-workflow-id-versionid)
52
48
  - [`eigenpal workflow step-type list [options]`](#eigenpal-workflow-step-type-list-options)
53
49
  - [`eigenpal workflow step-type get [options] <type>`](#eigenpal-workflow-step-type-get-options-type)
54
50
  - [`eigenpal workflow evaluator-type list [options]`](#eigenpal-workflow-evaluator-type-list-options)
@@ -60,38 +56,38 @@ All workflow operations. Core verbs (list / push / pull / validate) sit directly
60
56
  ```
61
57
  workflow
62
58
  ├── list
63
- ├── pull <workflowId>
59
+ ├── pull <workflow-id>
64
60
  ├── push
65
61
  ├── evaluators
66
- │ ├── pull <workflowId>
67
- │ ├── push <workflowId>
62
+ │ ├── pull <workflow-id>
63
+ │ ├── push <workflow-id>
68
64
  │ └── validate [path]
69
65
  ├── dataset
70
- │ ├── list <workflowId>
71
- │ ├── pull <workflowId>
72
- │ ├── push <workflowId>
66
+ │ ├── list <workflow-id>
67
+ │ ├── pull <workflow-id>
68
+ │ ├── push <workflow-id>
73
69
  │ ├── example
74
- │ │ ├── create <workflowId>
75
- │ │ ├── update <workflowId> <exampleId>
76
- │ │ ├── delete <workflowId> <exampleId>
77
- │ │ └── get <workflowId> <exampleId>
70
+ │ │ ├── create <workflow-id>
71
+ │ │ ├── update <workflow-id> <exampleId>
72
+ │ │ ├── delete <workflow-id> <exampleId>
73
+ │ │ └── get <workflow-id> <exampleId>
78
74
  │ └── validate [path]
79
75
  ├── experiment
80
- │ ├── list <workflowId>
81
- │ ├── run <workflowId>
82
- │ ├── status <workflowId> <batchId>
83
- │ ├── results <workflowId> [batchId]
76
+ │ ├── list <workflow-id>
77
+ │ ├── run <workflow-id>
78
+ │ ├── status <workflow-id> <batchId>
79
+ │ ├── results <workflow-id> [batchId]
84
80
  │ └── compare <batchIdA> <batchIdB>
85
81
  ├── execution
86
- │ ├── run <workflow-slug> [examples...]
82
+ │ ├── run <workflow-id> [examples...]
87
83
  │ ├── get <executionId>
88
- │ ├── list <workflowId>
84
+ │ ├── list <workflow-id>
89
85
  │ ├── watch <executionId>
90
86
  │ ├── compare <executionA> <executionB>
91
87
  │ └── cancel <executionId>
92
88
  ├── versions
93
- │ ├── list <workflowId>
94
- │ └── restore <workflowId> <versionId>
89
+ │ ├── list <workflow-id>
90
+ │ └── restore <workflow-id> <versionId>
95
91
  ├── step-type
96
92
  │ ├── list
97
93
  │ └── get <type>
@@ -99,7 +95,7 @@ workflow
99
95
  │ ├── list
100
96
  │ └── get <type>
101
97
  ├── validate
102
- ├── clear-local [workflow-slug] [examples...]
98
+ ├── clear-local [examples...]
103
99
  └── step
104
100
  └── exec <type>
105
101
  ```
@@ -108,62 +104,62 @@ workflow
108
104
 
109
105
  ### Core
110
106
 
111
- | Command | Description |
112
- | ----------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
113
- | `eigenpal workflow list [options]` | List workflows the caller can read. |
114
- | `eigenpal workflow pull [options] <workflowId>` | Download the YAML definition of the workflow at its current version. |
115
- | `eigenpal workflow push [options]` | Create or update a workflow from a YAML file. |
116
- | `eigenpal workflow validate [options]` | Local-only validation against the templated project layout: ./workflow.yaml + ./evaluators.yaml + ./dataset/. For targeted validation use `evaluators validate` or `dataset validate`. |
117
- | `eigenpal workflow clear-local [options] [workflow-slug] [examples...]` | Delete LOCAL execution artifacts and judge summaries under `./.eigenpal/` (server-side data is never touched). Keeps the latest run per example by default; pass `--all` to wipe everything. |
107
+ | Command | Description |
108
+ | ------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
109
+ | `eigenpal workflow list [options]` | List workflows the caller can read. |
110
+ | `eigenpal workflow pull [options] <workflow-id>` | Download the YAML definition of the workflow at its current version. |
111
+ | `eigenpal workflow push [options]` | Create or update a workflow from a YAML file. |
112
+ | `eigenpal workflow validate [options]` | Local-only validation against the templated project layout: ./workflow.yaml + ./evaluators.yaml + ./dataset/. For targeted validation use `evaluators validate` or `dataset validate`. |
113
+ | `eigenpal workflow clear-local [options] [examples...]` | Delete local execution artifacts under ./dataset/examples/. Keeps the latest run per example by default. |
118
114
 
119
115
  ### Evaluators
120
116
 
121
- | Command | Description |
122
- | ---------------------------------------------------------- | ---------------------------------------------------------------------------------------------- |
123
- | `eigenpal workflow evaluators pull [options] <workflowId>` | Download the workflow's evaluators YAML. |
124
- | `eigenpal workflow evaluators push [options] <workflowId>` | Overwrite the workflow's evaluator config from a YAML file. |
125
- | `eigenpal workflow evaluators validate [options] [path]` | Validate an evaluators YAML file against the EvalConfig schema. Defaults to ./evaluators.yaml. |
117
+ | Command | Description |
118
+ | ----------------------------------------------------------- | ---------------------------------------------------------------------------------------------- |
119
+ | `eigenpal workflow evaluators pull [options] <workflow-id>` | Download the workflow's evaluators YAML. |
120
+ | `eigenpal workflow evaluators push [options] <workflow-id>` | Overwrite the workflow's evaluator config from a YAML file. |
121
+ | `eigenpal workflow evaluators validate [options] [path]` | Validate an evaluators YAML file against the EvalConfig schema. Defaults to ./evaluators.yaml. |
126
122
 
127
123
  ### Dataset
128
124
 
129
- | Command | Description |
130
- | ----------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
131
- | `eigenpal workflow dataset list [options] <workflowId>` | List eval examples for the workflow. |
132
- | `eigenpal workflow dataset pull [options] <workflowId>` | Download the workflow's dataset as a ZIP archive. |
133
- | `eigenpal workflow dataset push [options] <workflowId>` | Replace or extend the workflow's dataset from a ZIP or folder. |
134
- | `eigenpal workflow dataset example create [options] <workflowId>` | Create one eval example without re-uploading the whole dataset. Pair `--input-*` and `--expected-*` flags to seed trigger input + ground truth; `--annotation` is free-form metadata. |
135
- | `eigenpal workflow dataset example update [options] <workflowId> <exampleId>` | Patch one eval example. Any flag you omit is left alone; pass `--annotation ""` to clear an annotation. |
136
- | `eigenpal workflow dataset example delete [options] <workflowId> <exampleId>` | Delete one eval example by id. Single-row deletes have a small blast radius compared to `dataset push --mode replace`, so there is no interactive confirmation; CI / non-TTY shells must pass `--yes` to acknowledge intent. |
137
- | `eigenpal workflow dataset example get [options] <workflowId> <exampleId>` | Fetch one eval example by id, including triggerInput, expectedOutput, and metadata. Pretty sections in human mode; full payload under --json. |
138
- | `eigenpal workflow dataset validate [options] [path]` | Validate a dataset folder against the examples/<name>/{input,expected,meta} convention. Defaults to ./dataset/. |
125
+ | Command | Description |
126
+ | ------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------------- |
127
+ | `eigenpal workflow dataset list [options] <workflow-id>` | List eval examples for the workflow. |
128
+ | `eigenpal workflow dataset pull [options] <workflow-id>` | Download the workflow's dataset as a ZIP archive. |
129
+ | `eigenpal workflow dataset push [options] <workflow-id>` | Replace or extend the workflow's dataset from a ZIP or folder. |
130
+ | `eigenpal workflow dataset example create [options] <workflow-id>` | Create one eval example without re-uploading the dataset. |
131
+ | `eigenpal workflow dataset example update [options] <workflow-id> <exampleId>` | Patch one eval example. Omitted flags are left alone. |
132
+ | `eigenpal workflow dataset example delete [options] <workflow-id> <exampleId>` | Delete one eval example by id. Non-TTY shells require --yes. |
133
+ | `eigenpal workflow dataset example get [options] <workflow-id> <exampleId>` | Fetch one eval example with full triggerInput, expectedOutput, and metadata. |
134
+ | `eigenpal workflow dataset validate [options] [path]` | Validate a dataset folder against the examples/<name>/{input,expected,meta} convention. Defaults to ./dataset/. |
139
135
 
140
136
  ### Experiment
141
137
 
142
- | Command | Description |
143
- | ----------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------- |
144
- | `eigenpal workflow experiment list [options] <workflowId>` | List executions for the workflow, newest first. |
145
- | `eigenpal workflow experiment run [options] <workflowId>` | Start a batch eval against the workflow's dataset. |
146
- | `eigenpal workflow experiment status [options] <workflowId> <batchId>` | Aggregate progress for a batch by `batchId`. |
147
- | `eigenpal workflow experiment results [options] <workflowId> [batchId]` | Download eval results in CSV or JSON. |
148
- | `eigenpal workflow experiment compare [options] <batchIdA> <batchIdB>` | Side-by-side eval-score diff between two experiment batches. Highlights regressions vs improvements per (example, evaluator) and prints aggregate stats. |
138
+ | Command | Description |
139
+ | ------------------------------------------------------------------------ | -------------------------------------------------- |
140
+ | `eigenpal workflow experiment list [options] <workflow-id>` | List executions for the workflow, newest first. |
141
+ | `eigenpal workflow experiment run [options] <workflow-id>` | Start a batch eval against the workflow's dataset. |
142
+ | `eigenpal workflow experiment status [options] <workflow-id> <batchId>` | Aggregate progress for a batch by `batchId`. |
143
+ | `eigenpal workflow experiment results [options] <workflow-id> [batchId]` | Download eval results in CSV or JSON. |
144
+ | `eigenpal workflow experiment compare [options] <batchIdA> <batchIdB>` | Diff eval scores between two experiment batches. |
149
145
 
150
146
  ### Execution
151
147
 
152
- | Command | Description |
153
- | ------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
154
- | `eigenpal workflow execution run [options] <workflow-slug> [examples...]` | Run a workflow against one or more local examples on the server. Builds the input payload from the local dataset folder. |
155
- | `eigenpal workflow execution get [options] <executionId>` | Fetch a single execution payload. Optionally narrow to one step. |
156
- | `eigenpal workflow execution list [options] <workflowId>` | List recent executions for a workflow. |
157
- | `eigenpal workflow execution watch [options] <executionId>` | Stream live status of an execution: vertical step list with adaptive polling (2s while transitioning, 5s steady, 30-min auto-detach). ASCII status badges; pipe-safe. |
158
- | `eigenpal workflow execution compare [options] <executionA> <executionB>` | Side-by-side comparison of two executions. Highlights status / duration / output diffs per step. |
159
- | `eigenpal workflow execution cancel [options] <executionId>` | Request cancellation of an execution. Idempotent — already-terminal executions exit 0 with an info line. |
148
+ | Command | Description |
149
+ | ------------------------------------------------------------------------- | ---------------------------------------------------------------- |
150
+ | `eigenpal workflow execution run [options] <workflow-id> [examples...]` | Run a saved workflow against local dataset examples. |
151
+ | `eigenpal workflow execution get [options] <executionId>` | Fetch a single execution payload. Optionally narrow to one step. |
152
+ | `eigenpal workflow execution list [options] <workflow-id>` | List recent executions for a workflow. |
153
+ | `eigenpal workflow execution watch [options] <executionId>` | Stream live execution status until terminal or 30-min detach. |
154
+ | `eigenpal workflow execution compare [options] <executionA> <executionB>` | Diff two executions side-by-side, per step. |
155
+ | `eigenpal workflow execution cancel [options] <executionId>` | Cancel an execution. Idempotent on already-terminal runs. |
160
156
 
161
157
  ### Versions
162
158
 
163
- | Command | Description |
164
- | ----------------------------------------------------------------------- | ------------------------------------------------ |
165
- | `eigenpal workflow versions list [options] <workflowId>` | List historical workflow versions, newest first. |
166
- | `eigenpal workflow versions restore [options] <workflowId> <versionId>` | Restore the workflow to a previous version. |
159
+ | Command | Description |
160
+ | ------------------------------------------------------------------------ | ------------------------------------------------ |
161
+ | `eigenpal workflow versions list [options] <workflow-id>` | List historical workflow versions, newest first. |
162
+ | `eigenpal workflow versions restore [options] <workflow-id> <versionId>` | Restore the workflow to a previous version. |
167
163
 
168
164
  ### Step-type
169
165
 
@@ -201,15 +197,15 @@ List workflows the caller can read.
201
197
  | `--base-url <url>` | no | | Server base URL |
202
198
  | `--json` | no | | Output the raw server response as JSON |
203
199
 
204
- ### `eigenpal workflow pull [options] <workflowId>`
200
+ ### `eigenpal workflow pull [options] <workflow-id>`
205
201
 
206
202
  Download the YAML definition of the workflow at its current version.
207
203
 
208
204
  ### Arguments
209
205
 
210
- | Name | Required | Variadic | Description |
211
- | ------------ | -------- | -------- | ----------- |
212
- | `workflowId` | yes | no | |
206
+ | Name | Required | Variadic | Description |
207
+ | ------------- | -------- | -------- | ----------- |
208
+ | `workflow-id` | yes | no | |
213
209
 
214
210
  ### Options
215
211
 
@@ -243,16 +239,15 @@ Local-only validation against the templated project layout: ./workflow.yaml + ./
243
239
  | -------------- | -------- | ------- | -------------------------------------------------------------------------- |
244
240
  | `--dir <path>` | no | | Project root (defaults to cwd; resolves the three default paths from here) |
245
241
 
246
- ### `eigenpal workflow clear-local [options] [workflow-slug] [examples...]`
242
+ ### `eigenpal workflow clear-local [options] [examples...]`
247
243
 
248
- Delete LOCAL execution artifacts and judge summaries under `./.eigenpal/` (server-side data is never touched). Keeps the latest run per example by default; pass `--all` to wipe everything.
244
+ Delete local execution artifacts under ./dataset/examples/. Keeps the latest run per example by default.
249
245
 
250
246
  ### Arguments
251
247
 
252
- | Name | Required | Variadic | Description |
253
- | --------------- | -------- | -------- | ----------- |
254
- | `workflow-slug` | no | no | |
255
- | `examples` | no | yes | |
248
+ | Name | Required | Variadic | Description |
249
+ | ---------- | -------- | -------- | ----------- |
250
+ | `examples` | no | yes | |
256
251
 
257
252
  ### Options
258
253
 
@@ -261,15 +256,15 @@ Delete LOCAL execution artifacts and judge summaries under `./.eigenpal/` (serve
261
256
  | `--dir <dir>` | no | | Local eigenpal directory |
262
257
  | `--all` | no | `false` | Remove all artifacts, including the latest kept by default |
263
258
 
264
- ### `eigenpal workflow evaluators pull [options] <workflowId>`
259
+ ### `eigenpal workflow evaluators pull [options] <workflow-id>`
265
260
 
266
261
  Download the workflow's evaluators YAML.
267
262
 
268
263
  ### Arguments
269
264
 
270
- | Name | Required | Variadic | Description |
271
- | ------------ | -------- | -------- | ----------- |
272
- | `workflowId` | yes | no | |
265
+ | Name | Required | Variadic | Description |
266
+ | ------------- | -------- | -------- | ----------- |
267
+ | `workflow-id` | yes | no | |
273
268
 
274
269
  ### Options
275
270
 
@@ -278,15 +273,15 @@ Download the workflow's evaluators YAML.
278
273
  | `--out <path>` | no | | Write YAML to file instead of stdout |
279
274
  | `--base-url <url>` | no | | Server base URL |
280
275
 
281
- ### `eigenpal workflow evaluators push [options] <workflowId>`
276
+ ### `eigenpal workflow evaluators push [options] <workflow-id>`
282
277
 
283
278
  Overwrite the workflow's evaluator config from a YAML file.
284
279
 
285
280
  ### Arguments
286
281
 
287
- | Name | Required | Variadic | Description |
288
- | ------------ | -------- | -------- | ----------- |
289
- | `workflowId` | yes | no | |
282
+ | Name | Required | Variadic | Description |
283
+ | ------------- | -------- | -------- | ----------- |
284
+ | `workflow-id` | yes | no | |
290
285
 
291
286
  ### Options
292
287
 
@@ -306,15 +301,15 @@ Validate an evaluators YAML file against the EvalConfig schema. Defaults to ./ev
306
301
  | ------ | -------- | -------- | ----------- |
307
302
  | `path` | no | no | |
308
303
 
309
- ### `eigenpal workflow dataset list [options] <workflowId>`
304
+ ### `eigenpal workflow dataset list [options] <workflow-id>`
310
305
 
311
306
  List eval examples for the workflow.
312
307
 
313
308
  ### Arguments
314
309
 
315
- | Name | Required | Variadic | Description |
316
- | ------------ | -------- | -------- | ----------- |
317
- | `workflowId` | yes | no | |
310
+ | Name | Required | Variadic | Description |
311
+ | ------------- | -------- | -------- | ----------- |
312
+ | `workflow-id` | yes | no | |
318
313
 
319
314
  ### Options
320
315
 
@@ -325,15 +320,15 @@ List eval examples for the workflow.
325
320
  | `--base-url <url>` | no | | Server base URL |
326
321
  | `--json` | no | | Output the raw server response as JSON |
327
322
 
328
- ### `eigenpal workflow dataset pull [options] <workflowId>`
323
+ ### `eigenpal workflow dataset pull [options] <workflow-id>`
329
324
 
330
325
  Download the workflow's dataset as a ZIP archive.
331
326
 
332
327
  ### Arguments
333
328
 
334
- | Name | Required | Variadic | Description |
335
- | ------------ | -------- | -------- | ----------- |
336
- | `workflowId` | yes | no | |
329
+ | Name | Required | Variadic | Description |
330
+ | ------------- | -------- | -------- | ----------- |
331
+ | `workflow-id` | yes | no | |
337
332
 
338
333
  ### Options
339
334
 
@@ -342,15 +337,15 @@ Download the workflow's dataset as a ZIP archive.
342
337
  | `--out <zip>` | no | | Write the dataset ZIP to this path. When omitted, the binary streams to stdout. |
343
338
  | `--base-url <url>` | no | | Server base URL |
344
339
 
345
- ### `eigenpal workflow dataset push [options] <workflowId>`
340
+ ### `eigenpal workflow dataset push [options] <workflow-id>`
346
341
 
347
342
  Replace or extend the workflow's dataset from a ZIP or folder.
348
343
 
349
344
  ### Arguments
350
345
 
351
- | Name | Required | Variadic | Description |
352
- | ------------ | -------- | -------- | ----------- |
353
- | `workflowId` | yes | no | |
346
+ | Name | Required | Variadic | Description |
347
+ | ------------- | -------- | -------- | ----------- |
348
+ | `workflow-id` | yes | no | |
354
349
 
355
350
  ### Options
356
351
 
@@ -362,15 +357,15 @@ Replace or extend the workflow's dataset from a ZIP or folder.
362
357
  | `--base-url <url>` | no | | Server base URL |
363
358
  | `--json` | no | | Output the raw server response as JSON |
364
359
 
365
- ### `eigenpal workflow dataset example create [options] <workflowId>`
360
+ ### `eigenpal workflow dataset example create [options] <workflow-id>`
366
361
 
367
- Create one eval example without re-uploading the whole dataset. Pair `--input-*` and `--expected-*` flags to seed trigger input + ground truth; `--annotation` is free-form metadata.
362
+ Create one eval example without re-uploading the dataset.
368
363
 
369
364
  ### Arguments
370
365
 
371
- | Name | Required | Variadic | Description |
372
- | ------------ | -------- | -------- | ----------- |
373
- | `workflowId` | yes | no | |
366
+ | Name | Required | Variadic | Description |
367
+ | ------------- | -------- | -------- | ----------- |
368
+ | `workflow-id` | yes | no | |
374
369
 
375
370
  ### Options
376
371
 
@@ -385,16 +380,16 @@ Create one eval example without re-uploading the whole dataset. Pair `--input-*`
385
380
  | `--base-url <url>` | no | | Server base URL |
386
381
  | `--json` | no | | Output the raw server response as JSON |
387
382
 
388
- ### `eigenpal workflow dataset example update [options] <workflowId> <exampleId>`
383
+ ### `eigenpal workflow dataset example update [options] <workflow-id> <exampleId>`
389
384
 
390
- Patch one eval example. Any flag you omit is left alone; pass `--annotation ""` to clear an annotation.
385
+ Patch one eval example. Omitted flags are left alone.
391
386
 
392
387
  ### Arguments
393
388
 
394
- | Name | Required | Variadic | Description |
395
- | ------------ | -------- | -------- | ----------- |
396
- | `workflowId` | yes | no | |
397
- | `exampleId` | yes | no | |
389
+ | Name | Required | Variadic | Description |
390
+ | ------------- | -------- | -------- | ----------- |
391
+ | `workflow-id` | yes | no | |
392
+ | `exampleId` | yes | no | |
398
393
 
399
394
  ### Options
400
395
 
@@ -410,16 +405,16 @@ Patch one eval example. Any flag you omit is left alone; pass `--annotation ""`
410
405
  | `--base-url <url>` | no | | Server base URL |
411
406
  | `--json` | no | | Output the raw server response as JSON |
412
407
 
413
- ### `eigenpal workflow dataset example delete [options] <workflowId> <exampleId>`
408
+ ### `eigenpal workflow dataset example delete [options] <workflow-id> <exampleId>`
414
409
 
415
- Delete one eval example by id. Single-row deletes have a small blast radius compared to `dataset push --mode replace`, so there is no interactive confirmation; CI / non-TTY shells must pass `--yes` to acknowledge intent.
410
+ Delete one eval example by id. Non-TTY shells require --yes.
416
411
 
417
412
  ### Arguments
418
413
 
419
- | Name | Required | Variadic | Description |
420
- | ------------ | -------- | -------- | ----------- |
421
- | `workflowId` | yes | no | |
422
- | `exampleId` | yes | no | |
414
+ | Name | Required | Variadic | Description |
415
+ | ------------- | -------- | -------- | ----------- |
416
+ | `workflow-id` | yes | no | |
417
+ | `exampleId` | yes | no | |
423
418
 
424
419
  ### Options
425
420
 
@@ -429,16 +424,16 @@ Delete one eval example by id. Single-row deletes have a small blast radius comp
429
424
  | `--base-url <url>` | no | | Server base URL |
430
425
  | `--json` | no | | Output the raw server response as JSON |
431
426
 
432
- ### `eigenpal workflow dataset example get [options] <workflowId> <exampleId>`
427
+ ### `eigenpal workflow dataset example get [options] <workflow-id> <exampleId>`
433
428
 
434
- Fetch one eval example by id, including triggerInput, expectedOutput, and metadata. Pretty sections in human mode; full payload under --json.
429
+ Fetch one eval example with full triggerInput, expectedOutput, and metadata.
435
430
 
436
431
  ### Arguments
437
432
 
438
- | Name | Required | Variadic | Description |
439
- | ------------ | -------- | -------- | ----------- |
440
- | `workflowId` | yes | no | |
441
- | `exampleId` | yes | no | |
433
+ | Name | Required | Variadic | Description |
434
+ | ------------- | -------- | -------- | ----------- |
435
+ | `workflow-id` | yes | no | |
436
+ | `exampleId` | yes | no | |
442
437
 
443
438
  ### Options
444
439
 
@@ -457,15 +452,15 @@ Validate a dataset folder against the examples/<name>/{input,expected,meta} conv
457
452
  | ------ | -------- | -------- | ----------- |
458
453
  | `path` | no | no | |
459
454
 
460
- ### `eigenpal workflow experiment list [options] <workflowId>`
455
+ ### `eigenpal workflow experiment list [options] <workflow-id>`
461
456
 
462
457
  List executions for the workflow, newest first.
463
458
 
464
459
  ### Arguments
465
460
 
466
- | Name | Required | Variadic | Description |
467
- | ------------ | -------- | -------- | ----------- |
468
- | `workflowId` | yes | no | |
461
+ | Name | Required | Variadic | Description |
462
+ | ------------- | -------- | -------- | ----------- |
463
+ | `workflow-id` | yes | no | |
469
464
 
470
465
  ### Options
471
466
 
@@ -477,15 +472,15 @@ List executions for the workflow, newest first.
477
472
  | `--base-url <url>` | no | | Server base URL |
478
473
  | `--json` | no | | Output the raw server response as JSON |
479
474
 
480
- ### `eigenpal workflow experiment run [options] <workflowId>`
475
+ ### `eigenpal workflow experiment run [options] <workflow-id>`
481
476
 
482
477
  Start a batch eval against the workflow's dataset.
483
478
 
484
479
  ### Arguments
485
480
 
486
- | Name | Required | Variadic | Description |
487
- | ------------ | -------- | -------- | ----------- |
488
- | `workflowId` | yes | no | |
481
+ | Name | Required | Variadic | Description |
482
+ | ------------- | -------- | -------- | ----------- |
483
+ | `workflow-id` | yes | no | |
489
484
 
490
485
  ### Options
491
486
 
@@ -497,37 +492,37 @@ Start a batch eval against the workflow's dataset.
497
492
  | `--base-url <url>` | no | | Server base URL |
498
493
  | `--json` | no | | Output the raw server response as JSON |
499
494
 
500
- ### `eigenpal workflow experiment status [options] <workflowId> <batchId>`
495
+ ### `eigenpal workflow experiment status [options] <workflow-id> <batchId>`
501
496
 
502
497
  Aggregate progress for a batch by `batchId`.
503
498
 
504
499
  ### Arguments
505
500
 
506
- | Name | Required | Variadic | Description |
507
- | ------------ | -------- | -------- | ----------- |
508
- | `workflowId` | yes | no | |
509
- | `batchId` | yes | no | |
501
+ | Name | Required | Variadic | Description |
502
+ | ------------- | -------- | -------- | ----------- |
503
+ | `workflow-id` | yes | no | |
504
+ | `batchId` | yes | no | |
510
505
 
511
506
  ### Options
512
507
 
513
- | Flag | Required | Default | Description |
514
- | ---------------------- | -------- | ------- | ------------------------------------------------------------------------------------------- |
515
- | `--watch` | no | `false` | Poll until every execution reaches a terminal state (completed/failed/cancelled), then exit |
516
- | `--interval <seconds>` | no | `5` | Poll interval in seconds when --watch is set (default 5) |
517
- | `--max-wait <seconds>` | no | `1800` | Hard ceiling for --watch in seconds (default 1800 = 30 min) |
518
- | `--base-url <url>` | no | | Server base URL |
519
- | `--json` | no | | Output the raw server response as JSON |
508
+ | Flag | Required | Default | Description |
509
+ | ---------------------- | -------- | ------- | ---------------------------------------------------------------------------------------------------- |
510
+ | `--watch` | no | `false` | Poll until every execution reaches a terminal state (completed/failed/cancelled/rejected), then exit |
511
+ | `--interval <seconds>` | no | `5` | Poll interval in seconds when --watch is set (default 5) |
512
+ | `--max-wait <seconds>` | no | `1800` | Hard ceiling for --watch in seconds (default 1800 = 30 min) |
513
+ | `--base-url <url>` | no | | Server base URL |
514
+ | `--json` | no | | Output the raw server response as JSON |
520
515
 
521
- ### `eigenpal workflow experiment results [options] <workflowId> [batchId]`
516
+ ### `eigenpal workflow experiment results [options] <workflow-id> [batchId]`
522
517
 
523
518
  Download eval results in CSV or JSON.
524
519
 
525
520
  ### Arguments
526
521
 
527
- | Name | Required | Variadic | Description |
528
- | ------------ | -------- | -------- | ----------- |
529
- | `workflowId` | yes | no | |
530
- | `batchId` | no | no | |
522
+ | Name | Required | Variadic | Description |
523
+ | ------------- | -------- | -------- | ----------- |
524
+ | `workflow-id` | yes | no | |
525
+ | `batchId` | no | no | |
531
526
 
532
527
  ### Options
533
528
 
@@ -539,7 +534,7 @@ Download eval results in CSV or JSON.
539
534
 
540
535
  ### `eigenpal workflow experiment compare [options] <batchIdA> <batchIdB>`
541
536
 
542
- Side-by-side eval-score diff between two experiment batches. Highlights regressions vs improvements per (example, evaluator) and prints aggregate stats.
537
+ Diff eval scores between two experiment batches.
543
538
 
544
539
  ### Arguments
545
540
 
@@ -550,23 +545,23 @@ Side-by-side eval-score diff between two experiment batches. Highlights regressi
550
545
 
551
546
  ### Options
552
547
 
553
- | Flag | Required | Default | Description |
554
- | ------------------------------------------------------ | -------- | ------------------ | ------------------------------------------------------------------------------------------------------------------------------------- |
555
- | `--sort <abs-delta-desc\|delta-asc\|delta-desc\|name>` | no | `"abs-delta-desc"` | Row sort order. Default sorts by absolute delta descending so the biggest movers (regressions and improvements alike) are at the top. |
556
- | `--regression-threshold <n>` | no | `0.05` | Δ < -threshold is flagged as a regression with ⚠ (default 0.05) |
557
- | `--base-url <url>` | no | | Server base URL |
558
- | `--json` | no | | Output the raw server response as JSON |
548
+ | Flag | Required | Default | Description |
549
+ | ------------------------------------------------------ | -------- | ------------------ | ------------------------------------------------------ |
550
+ | `--sort <abs-delta-desc\|delta-asc\|delta-desc\|name>` | no | `"abs-delta-desc"` | Row sort order (default: biggest movers first) |
551
+ | `--regression-threshold <n>` | no | `0.05` | Δ below this is flagged as a regression (default 0.05) |
552
+ | `--base-url <url>` | no | | Server base URL |
553
+ | `--json` | no | | Output the raw server response as JSON |
559
554
 
560
- ### `eigenpal workflow execution run [options] <workflow-slug> [examples...]`
555
+ ### `eigenpal workflow execution run [options] <workflow-id> [examples...]`
561
556
 
562
- Run a workflow against one or more local examples on the server. Builds the input payload from the local dataset folder.
557
+ Run a saved workflow against local dataset examples.
563
558
 
564
559
  ### Arguments
565
560
 
566
- | Name | Required | Variadic | Description |
567
- | --------------- | -------- | -------- | ----------- |
568
- | `workflow-slug` | yes | no | |
569
- | `examples` | no | yes | |
561
+ | Name | Required | Variadic | Description |
562
+ | ------------- | -------- | -------- | ----------- |
563
+ | `workflow-id` | yes | no | |
564
+ | `examples` | no | yes | |
570
565
 
571
566
  ### Options
572
567
 
@@ -596,15 +591,15 @@ Fetch a single execution payload. Optionally narrow to one step.
596
591
  | `--base-url <url>` | no | | Server base URL |
597
592
  | `--json` | no | | Output the raw server response as JSON |
598
593
 
599
- ### `eigenpal workflow execution list [options] <workflowId>`
594
+ ### `eigenpal workflow execution list [options] <workflow-id>`
600
595
 
601
596
  List recent executions for a workflow.
602
597
 
603
598
  ### Arguments
604
599
 
605
- | Name | Required | Variadic | Description |
606
- | ------------ | -------- | -------- | ----------- |
607
- | `workflowId` | yes | no | |
600
+ | Name | Required | Variadic | Description |
601
+ | ------------- | -------- | -------- | ----------- |
602
+ | `workflow-id` | yes | no | |
608
603
 
609
604
  ### Options
610
605
 
@@ -618,7 +613,7 @@ List recent executions for a workflow.
618
613
 
619
614
  ### `eigenpal workflow execution watch [options] <executionId>`
620
615
 
621
- Stream live status of an execution: vertical step list with adaptive polling (2s while transitioning, 5s steady, 30-min auto-detach). ASCII status badges; pipe-safe.
616
+ Stream live execution status until terminal or 30-min detach.
622
617
 
623
618
  ### Arguments
624
619
 
@@ -635,7 +630,7 @@ Stream live status of an execution: vertical step list with adaptive polling (2s
635
630
 
636
631
  ### `eigenpal workflow execution compare [options] <executionA> <executionB>`
637
632
 
638
- Side-by-side comparison of two executions. Highlights status / duration / output diffs per step.
633
+ Diff two executions side-by-side, per step.
639
634
 
640
635
  ### Arguments
641
636
 
@@ -653,7 +648,7 @@ Side-by-side comparison of two executions. Highlights status / duration / output
653
648
 
654
649
  ### `eigenpal workflow execution cancel [options] <executionId>`
655
650
 
656
- Request cancellation of an execution. Idempotent — already-terminal executions exit 0 with an info line.
651
+ Cancel an execution. Idempotent on already-terminal runs.
657
652
 
658
653
  ### Arguments
659
654
 
@@ -669,15 +664,15 @@ Request cancellation of an execution. Idempotent — already-terminal executions
669
664
  | `--base-url <url>` | no | | Server base URL |
670
665
  | `--json` | no | | Output the raw server response as JSON |
671
666
 
672
- ### `eigenpal workflow versions list [options] <workflowId>`
667
+ ### `eigenpal workflow versions list [options] <workflow-id>`
673
668
 
674
669
  List historical workflow versions, newest first.
675
670
 
676
671
  ### Arguments
677
672
 
678
- | Name | Required | Variadic | Description |
679
- | ------------ | -------- | -------- | ----------- |
680
- | `workflowId` | yes | no | |
673
+ | Name | Required | Variadic | Description |
674
+ | ------------- | -------- | -------- | ----------- |
675
+ | `workflow-id` | yes | no | |
681
676
 
682
677
  ### Options
683
678
 
@@ -688,16 +683,16 @@ List historical workflow versions, newest first.
688
683
  | `--base-url <url>` | no | | Server base URL |
689
684
  | `--json` | no | | Output the raw server response as JSON |
690
685
 
691
- ### `eigenpal workflow versions restore [options] <workflowId> <versionId>`
686
+ ### `eigenpal workflow versions restore [options] <workflow-id> <versionId>`
692
687
 
693
688
  Restore the workflow to a previous version.
694
689
 
695
690
  ### Arguments
696
691
 
697
- | Name | Required | Variadic | Description |
698
- | ------------ | -------- | -------- | ----------- |
699
- | `workflowId` | yes | no | |
700
- | `versionId` | yes | no | |
692
+ | Name | Required | Variadic | Description |
693
+ | ------------- | -------- | -------- | ----------- |
694
+ | `workflow-id` | yes | no | |
695
+ | `versionId` | yes | no | |
701
696
 
702
697
  ### Options
703
698