@eigenpal/cli 0.4.3 → 0.4.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +2 -0
- package/dist/cli.js +71322 -70484
- package/dist/skill/SKILL.md +86 -43
- package/dist/skill/reference/cli/agent.md +0 -4
- package/dist/skill/reference/cli/auth.md +0 -4
- package/dist/skill/reference/cli/completion.md +0 -4
- package/dist/skill/reference/cli/init.md +0 -4
- package/dist/skill/reference/cli/skill.md +0 -4
- package/dist/skill/reference/cli/status.md +0 -4
- package/dist/skill/reference/cli/workflow.md +179 -184
- package/dist/skill/reference/dataset-format.md +10 -10
- package/dist/skill/reference/debugging.md +11 -8
- package/dist/skill/reference/evaluators.md +5 -5
- package/package.json +6 -6
|
@@ -5,7 +5,7 @@ itself is the manifest — there is no top-level `manifest.json`. The
|
|
|
5
5
|
import endpoint **rejects** archives that contain one (legacy format).
|
|
6
6
|
|
|
7
7
|
This is the format the CLI builds and ships to
|
|
8
|
-
`eigenpal workflow dataset push <
|
|
8
|
+
`eigenpal workflow dataset push <workflow-id> --file dataset/`. After it lands
|
|
9
9
|
on the server, the canonical per-row surface is
|
|
10
10
|
`eigenpal workflow dataset example {get,create,update,delete}` (and
|
|
11
11
|
`dataset list` for a table view) — the local folder is a pre-push
|
|
@@ -163,10 +163,10 @@ Reports per-example issues:
|
|
|
163
163
|
|
|
164
164
|
```bash
|
|
165
165
|
# Replace = wipes existing examples for the workflow, uploads the folder fresh.
|
|
166
|
-
eigenpal workflow dataset push <
|
|
166
|
+
eigenpal workflow dataset push <workflow-id> --file ./dataset --mode replace
|
|
167
167
|
|
|
168
168
|
# Append = adds to whatever's already on the server.
|
|
169
|
-
eigenpal workflow dataset push <
|
|
169
|
+
eigenpal workflow dataset push <workflow-id> --file ./dataset --mode append
|
|
170
170
|
```
|
|
171
171
|
|
|
172
172
|
The endpoint streams progress as NDJSON. The terminal `done` event
|
|
@@ -183,8 +183,8 @@ includes `{ created, expectedSet, … }`:
|
|
|
183
183
|
To inspect or round-trip what's currently on the server:
|
|
184
184
|
|
|
185
185
|
```bash
|
|
186
|
-
eigenpal workflow dataset list <
|
|
187
|
-
eigenpal workflow dataset pull <
|
|
186
|
+
eigenpal workflow dataset list <workflow-id>
|
|
187
|
+
eigenpal workflow dataset pull <workflow-id> --out current.zip
|
|
188
188
|
# (or omit --out to stream the zip to stdout for piping)
|
|
189
189
|
```
|
|
190
190
|
|
|
@@ -200,8 +200,8 @@ re-zipping and re-uploading the whole folder.
|
|
|
200
200
|
### Inspect one example end-to-end
|
|
201
201
|
|
|
202
202
|
```bash
|
|
203
|
-
eigenpal workflow dataset example get <
|
|
204
|
-
eigenpal workflow dataset example get <
|
|
203
|
+
eigenpal workflow dataset example get <workflow-id> <example-id>
|
|
204
|
+
eigenpal workflow dataset example get <workflow-id> <example-id> --json | jq '.expectedOutput'
|
|
205
205
|
```
|
|
206
206
|
|
|
207
207
|
Pretty mode prints labelled `Inputs` / `Expected` / `Metadata` sections;
|
|
@@ -216,7 +216,7 @@ eigenpal workflow execution get exec_… --json | jq '.output.data' > /tmp/corre
|
|
|
216
216
|
|
|
217
217
|
# 2. Patch the example's expected output in place. PATCH semantics:
|
|
218
218
|
# every flag you omit is left alone.
|
|
219
|
-
eigenpal workflow dataset example update <
|
|
219
|
+
eigenpal workflow dataset example update <workflow-id> <example-id> \
|
|
220
220
|
--expected-file /tmp/correct.json
|
|
221
221
|
```
|
|
222
222
|
|
|
@@ -226,7 +226,7 @@ empty string to clear an annotation: `--annotation ""`.
|
|
|
226
226
|
### Add one new example
|
|
227
227
|
|
|
228
228
|
```bash
|
|
229
|
-
eigenpal workflow dataset example create <
|
|
229
|
+
eigenpal workflow dataset example create <workflow-id> \
|
|
230
230
|
--name missing-required-field \
|
|
231
231
|
--input-json '{"language":"en"}' \
|
|
232
232
|
--expected-file /tmp/expected.json \
|
|
@@ -243,7 +243,7 @@ scalar args + `expected/output.json`-style outputs.
|
|
|
243
243
|
### Delete one bad example
|
|
244
244
|
|
|
245
245
|
```bash
|
|
246
|
-
eigenpal workflow dataset example delete <
|
|
246
|
+
eigenpal workflow dataset example delete <workflow-id> <example-id> --yes
|
|
247
247
|
```
|
|
248
248
|
|
|
249
249
|
`--yes` is required for non-TTY shells (CI). Interactive shells may
|
|
@@ -11,18 +11,21 @@ eigenpal workflow execution compare <a> <b> # side-by-side diff of two
|
|
|
11
11
|
## 1. Reproduce the failure
|
|
12
12
|
|
|
13
13
|
```bash
|
|
14
|
-
eigenpal workflow execution run <workflow-
|
|
14
|
+
eigenpal workflow execution run <workflow-id> <example-name>
|
|
15
15
|
```
|
|
16
16
|
|
|
17
|
-
|
|
18
|
-
|
|
17
|
+
`<workflow-id>` is either a `wf_…` id or a slug (the YAML's `name:`
|
|
18
|
+
field). The workflow must be pushed (`eigenpal workflow push`) before
|
|
19
|
+
`execution run` works — only saved workflows execute. Streams a live
|
|
20
|
+
step list as the run progresses. Bails to the prompt the moment a step
|
|
21
|
+
transitions to `failed`.
|
|
19
22
|
|
|
20
23
|
If the workflow is server-stable and the failure is on a real
|
|
21
24
|
historical execution, skip the rerun and pull the recorded execution
|
|
22
25
|
directly:
|
|
23
26
|
|
|
24
27
|
```bash
|
|
25
|
-
eigenpal workflow execution list <
|
|
28
|
+
eigenpal workflow execution list <workflow-id> --status failed --limit 5
|
|
26
29
|
eigenpal workflow execution get exec_…
|
|
27
30
|
```
|
|
28
31
|
|
|
@@ -185,7 +188,7 @@ regressions vs improvements; aggregate stats at the bottom.
|
|
|
185
188
|
|
|
186
189
|
**No `--workflow-id` needed.** The server resolves the owning workflow
|
|
187
190
|
from each batch id. Both batches must belong to the same workflow within
|
|
188
|
-
your tenant. (Sibling `experiment` subcommands still take `<
|
|
191
|
+
your tenant. (Sibling `experiment` subcommands still take `<workflow-id>` as
|
|
189
192
|
the first positional — only `compare` is workflow-agnostic.)
|
|
190
193
|
|
|
191
194
|
## 7. Connection vs auth errors
|
|
@@ -239,14 +242,14 @@ steps were faked. Re-import the dataset (`workflow dataset push
|
|
|
239
242
|
|
|
240
243
|
```bash
|
|
241
244
|
# Kicks off, prints { batchId, executionIds }
|
|
242
|
-
eigenpal workflow experiment run <
|
|
245
|
+
eigenpal workflow experiment run <workflow-id>
|
|
243
246
|
|
|
244
247
|
# --watch polls until every execution is terminal, prints a per-example
|
|
245
248
|
# failure summary, and exits non-zero if any failed/cancelled.
|
|
246
|
-
eigenpal workflow experiment status <
|
|
249
|
+
eigenpal workflow experiment status <workflow-id> --batch-id <id> --watch
|
|
247
250
|
|
|
248
251
|
# Without --watch: one-shot snapshot, no polling. Prefer --watch in CI / agents.
|
|
249
|
-
eigenpal workflow experiment status <
|
|
252
|
+
eigenpal workflow experiment status <workflow-id> --batch-id <id>
|
|
250
253
|
```
|
|
251
254
|
|
|
252
255
|
The terminal `--watch` output looks like:
|
|
@@ -135,20 +135,20 @@ Reports field-level issues:
|
|
|
135
135
|
|
|
136
136
|
```bash
|
|
137
137
|
# Push the evaluators (overwrites the workflow's existing config).
|
|
138
|
-
eigenpal workflow evaluators push <
|
|
138
|
+
eigenpal workflow evaluators push <workflow-id> --file evaluators.yaml
|
|
139
139
|
|
|
140
140
|
# Kick off a server-side batch eval over the whole pushed dataset.
|
|
141
141
|
# Returns { batchId, executionIds }.
|
|
142
|
-
eigenpal workflow experiment run <
|
|
142
|
+
eigenpal workflow experiment run <workflow-id>
|
|
143
143
|
|
|
144
144
|
# Or restrict to a single example:
|
|
145
|
-
eigenpal workflow experiment run <
|
|
145
|
+
eigenpal workflow experiment run <workflow-id> --example-id evx_…
|
|
146
146
|
|
|
147
147
|
# Watch progress.
|
|
148
|
-
eigenpal workflow experiment status <
|
|
148
|
+
eigenpal workflow experiment status <workflow-id> --batch-id <id>
|
|
149
149
|
|
|
150
150
|
# Pull results when done.
|
|
151
|
-
eigenpal workflow experiment results <
|
|
151
|
+
eigenpal workflow experiment results <workflow-id> --batch-id <id> \
|
|
152
152
|
--format csv --out results.csv
|
|
153
153
|
```
|
|
154
154
|
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@eigenpal/cli",
|
|
3
|
-
"version": "0.4.
|
|
3
|
+
"version": "0.4.4",
|
|
4
4
|
"description": "Eigenpal CLI — author and run document workflows from your terminal. Agent-ready.",
|
|
5
5
|
"keywords": [
|
|
6
6
|
"eigenpal",
|
|
@@ -24,7 +24,7 @@
|
|
|
24
24
|
"url": "git+https://github.com/eigenpal/cli.git"
|
|
25
25
|
},
|
|
26
26
|
"license": "Apache-2.0",
|
|
27
|
-
"author": "
|
|
27
|
+
"author": "Jedr Blaszyk <jedr@eigenpal.com> (https://eigenpal.com)",
|
|
28
28
|
"type": "module",
|
|
29
29
|
"main": "./src/index.ts",
|
|
30
30
|
"types": "./src/index.ts",
|
|
@@ -49,13 +49,13 @@
|
|
|
49
49
|
"typecheck": "tsc --noEmit"
|
|
50
50
|
},
|
|
51
51
|
"dependencies": {
|
|
52
|
-
"@clack/prompts": "^
|
|
52
|
+
"@clack/prompts": "^1.3.0",
|
|
53
53
|
"ajv": "^8.17.1",
|
|
54
|
-
"commander": "^
|
|
54
|
+
"commander": "^14.0.3",
|
|
55
55
|
"fflate": "0.8.2",
|
|
56
56
|
"openai": "^6.27.0",
|
|
57
57
|
"picocolors": "^1.1.1",
|
|
58
|
-
"quickjs-emscripten": "^0.
|
|
58
|
+
"quickjs-emscripten": "^0.32.0",
|
|
59
59
|
"yaml": "^2.7.0",
|
|
60
60
|
"zod": "^4.0.0"
|
|
61
61
|
},
|
|
@@ -63,7 +63,7 @@
|
|
|
63
63
|
"@eigenpal/types": "workspace:*",
|
|
64
64
|
"@eigenpal/workflow-yaml": "workspace:*",
|
|
65
65
|
"@t3-oss/env-core": "^0.13.11",
|
|
66
|
-
"typescript": "^
|
|
66
|
+
"typescript": "^6.0.3"
|
|
67
67
|
},
|
|
68
68
|
"files": [
|
|
69
69
|
"dist",
|