@eigenpal/cli 0.4.9 → 0.4.11
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +56 -0
- package/dist/cli.js +28879 -27558
- package/dist/skill/SKILL.md +7 -1
- package/dist/skill/examples/hello-world/workflow.yaml +4 -2
- package/dist/skill/reference/cli/agent.md +803 -1
- package/dist/skill/reference/cli/init.md +2 -2
- package/dist/skill/reference/evaluators.md +96 -28
- package/dist/skill/reference/step-types.md +7 -18
- package/dist/skill/reference/workflow-yaml.md +6 -4
- package/dist/templates/blank/workflow.yaml +4 -2
- package/dist/templates/pdf-extraction/evaluators.yaml +1 -0
- package/dist/templates/text-classification/evaluators.yaml +1 -0
- package/package.json +1 -1
package/dist/skill/SKILL.md
CHANGED
|
@@ -118,7 +118,7 @@ fall back to `workflow execution run` against the server.
|
|
|
118
118
|
|
|
119
119
|
```bash
|
|
120
120
|
eigenpal workflow step exec transform.script \
|
|
121
|
-
--config-json '{"
|
|
121
|
+
--config-json '{"function":"function script(items) { return items.reduce((s,i)=>s+i.v,0); }"}' \
|
|
122
122
|
--inputs items=@items.json
|
|
123
123
|
# 3
|
|
124
124
|
```
|
|
@@ -174,6 +174,12 @@ eigenpal workflow evaluators validate ./evaluators.yaml
|
|
|
174
174
|
eigenpal workflow evaluators push <workflow-id> --file evaluators.yaml
|
|
175
175
|
```
|
|
176
176
|
|
|
177
|
+
Always set `description:` on every evaluator entry. It's a short, plain-language
|
|
178
|
+
sentence (≤500 chars; aim for one line) explaining what the evaluator measures
|
|
179
|
+
and why it matters, written for a non-technical reviewer in the dashboard.
|
|
180
|
+
Skip model names, thresholds, and dot-paths; those belong in `config`. See
|
|
181
|
+
[`reference/evaluators.md`](reference/evaluators.md#writing-descriptions-for-stakeholders).
|
|
182
|
+
|
|
177
183
|
### Build + validate + upload a dataset
|
|
178
184
|
|
|
179
185
|
```bash
|
|
@@ -15,8 +15,10 @@ steps:
|
|
|
15
15
|
with:
|
|
16
16
|
inputs:
|
|
17
17
|
text: '{{ input.text }}'
|
|
18
|
-
|
|
19
|
-
|
|
18
|
+
function: |
|
|
19
|
+
function script(text) {
|
|
20
|
+
return { length: text.length, original: text };
|
|
21
|
+
}
|
|
20
22
|
outputSchema:
|
|
21
23
|
type: object
|
|
22
24
|
properties:
|