@withgauge/cli 0.10.2 → 0.11.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +57 -1
- package/dist/index.js +2430 -1639
- package/package.json +4 -2
package/README.md
CHANGED
|
@@ -27,6 +27,12 @@ gauge stats rankings -o json # brand rankings (share of voice) as JSON
|
|
|
27
27
|
gauge query -d ecosystem -m installs,install_rate -o json # a flexible report
|
|
28
28
|
```
|
|
29
29
|
|
|
30
|
+
`gauge instructions` prints the CLI's own agent instructions to stdout: one
|
|
31
|
+
skill file covering every command group. `gauge instructions <topic>` reprints
|
|
32
|
+
one group alone. `gauge --help` points agents at it, or write the file into the
|
|
33
|
+
repo with `gauge instructions --install`. The text ships inside the CLI, so it
|
|
34
|
+
never drifts from the commands it describes.
|
|
35
|
+
|
|
30
36
|
Run `gauge --help` (or `gauge <command> --help`) for the full command set:
|
|
31
37
|
evals, preference, models, personas, skills, mcp, repos, runs, optimizations,
|
|
32
38
|
experiments,
|
|
@@ -92,6 +98,56 @@ immediate launches. They use the stored configuration and ask before spending
|
|
|
92
98
|
(`--yes` skips the prompt for scripts).
|
|
93
99
|
`gauge preference run <id> --scenario <scenarioId>` (repeatable) runs a subset;
|
|
94
100
|
omit it and every scenario runs. Neither launch touches the cadence clock.
|
|
101
|
+
Superusers can use `--org <slug>` to launch in any org. Their runs use PLATFORM
|
|
102
|
+
funding by default, like Run Now in the web UI; `--bill-to-org` uses that org's
|
|
103
|
+
credits instead. Other users always use org credits and can launch only in orgs
|
|
104
|
+
they belong to.
|
|
105
|
+
|
|
106
|
+
## Optimizations: Gauge measures, you author
|
|
107
|
+
|
|
108
|
+
`gauge optimizations` improves one surface you own — a docs page or a skill —
|
|
109
|
+
against an eval or a preference prompt. Gauge measures a baseline, runs the
|
|
110
|
+
trials you author, judges them, and tells you which change won. It never writes
|
|
111
|
+
the change itself, and it never touches your repository. You edit on disk and
|
|
112
|
+
send the text; Gauge serves it to the sandboxed agent in place of the live page
|
|
113
|
+
or skill version.
|
|
114
|
+
|
|
115
|
+
A scripted or agent-driven loop:
|
|
116
|
+
|
|
117
|
+
```sh
|
|
118
|
+
gauge optimizations diagnose --eval es_1 # where the sessions fail
|
|
119
|
+
gauge optimizations estimate --eval es_1 --target claude-code:claude-opus-4-8
|
|
120
|
+
gauge optimizations start --eval es_1 --target claude-code:claude-opus-4-8 --yes
|
|
121
|
+
gauge optimizations watch cl_1 # exit 4 = your turn
|
|
122
|
+
|
|
123
|
+
gauge optimizations page cl_1 --url https://docs.acme.dev/start > start.md
|
|
124
|
+
$EDITOR start.md
|
|
125
|
+
gauge optimizations trials add cl_1 \
|
|
126
|
+
--title "Lead with the env var" --page https://docs.acme.dev/start \
|
|
127
|
+
--body-file start.md --launch --idempotency-key start-env-var --yes
|
|
128
|
+
|
|
129
|
+
gauge optimizations watch cl_1
|
|
130
|
+
gauge optimizations trial cl_1 R1 # score, verdict, sessions
|
|
131
|
+
gauge optimizations change cl_1 R1 --body # the winning text, to paste
|
|
132
|
+
gauge optimizations adopt cl_1 R1 --yes # mark the winner; baseline stays fixed
|
|
133
|
+
gauge optimizations complete cl_1 --yes
|
|
134
|
+
```
|
|
135
|
+
|
|
136
|
+
`page` and `skill-files` print the exact frozen content a trial starts from.
|
|
137
|
+
Edit a skill with `--edit-skill <versionId> --skill-dir <path>`: the directory
|
|
138
|
+
holds the complete bundle, `SKILL.md` included. `trials template --kind <kind>`
|
|
139
|
+
prints a skeleton for the `--file` form.
|
|
140
|
+
|
|
141
|
+
Every detail carries `nextAction` — `START`, `WAIT`, `AUTHOR_TRIAL`,
|
|
142
|
+
`LAUNCH_ROUND`, `ADOPT`, `RESUME`, or `NONE`. Read it (`get -o json`) instead of
|
|
143
|
+
inferring whose turn it is from round and trial statuses. `watch` exits `4` when
|
|
144
|
+
the answer is you.
|
|
145
|
+
|
|
146
|
+
`--idempotency-key` makes `trials add` safe to retry: the same key returns the
|
|
147
|
+
trial the first call created, and never buys a second set of sessions.
|
|
148
|
+
|
|
149
|
+
Adoption moves Gauge's measured baseline. It does not open a pull request, so
|
|
150
|
+
take the winning text from `change --body` and apply it to your own source.
|
|
95
151
|
|
|
96
152
|
## Models, reports, and scripting
|
|
97
153
|
|
|
@@ -107,7 +163,7 @@ and effective capabilities. Open harnesses use `--agent pi:<model>` and
|
|
|
107
163
|
|
|
108
164
|
Every read supports `-o json` for scripting. `GAUGE_API_TOKEN` overrides
|
|
109
165
|
stored credentials (useful in CI). Exit codes: `0` ok · `1` error ·
|
|
110
|
-
`2` usage · `3` billing-blocked.
|
|
166
|
+
`2` usage · `3` billing-blocked · `4` needs your input (`optimizations watch`).
|
|
111
167
|
|
|
112
168
|
## Support
|
|
113
169
|
|