@seldonqa/cli 0.7.0 → 0.8.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -1
- package/package.json +6 -6
package/README.md
CHANGED
|
@@ -92,6 +92,22 @@ seldon run --url "$PREVIEW_URL" --fail-on fail
|
|
|
92
92
|
|
|
93
93
|
`--fail-on fail` returns a non-zero exit code when any case fails; `--fail-on any` also gates on blocked or timed-out cases. Non-interactive shells block until the run finishes; `--no-wait` submits and returns immediately (re-read later with `seldon report`). With `--json` the report is stable, machine-readable output you can post to a pull request or hand a coding agent for an automated fix loop.
|
|
94
94
|
|
|
95
|
+
## Local targets — automatic tunnels
|
|
96
|
+
|
|
97
|
+
Point `--url` at a local address — `localhost`, `127.0.0.1`, `0.0.0.0`, `::1`, or a bare `:PORT` — and Seldon exposes it to the QA agent through a temporary, authenticated **Cloudflare tunnel** for the duration of the run. No deploy, no manual tunnelling:
|
|
98
|
+
|
|
99
|
+
```bash
|
|
100
|
+
seldon run --url http://localhost:3000
|
|
101
|
+
```
|
|
102
|
+
|
|
103
|
+
You'll see a one-line warning that the local address will be exposed and a `[Y/n]` prompt (defaults to yes). The public hostname is protected by Cloudflare Access, so **only this run's agent can reach it**, and the tunnel is **torn down automatically** when the run finishes or you press Ctrl-C. In CI or any non-interactive shell the prompt is skipped automatically; pass **`--auto-approve`** to skip it explicitly:
|
|
104
|
+
|
|
105
|
+
```bash
|
|
106
|
+
seldon run --url localhost:3000 --auto-approve # e.g. in a CI job
|
|
107
|
+
```
|
|
108
|
+
|
|
109
|
+
Remote `--url`s are used as-is (no tunnel).
|
|
110
|
+
|
|
95
111
|
## Commands
|
|
96
112
|
|
|
97
113
|
| Command | What it does |
|
|
@@ -100,7 +116,7 @@ seldon run --url "$PREVIEW_URL" --fail-on fail
|
|
|
100
116
|
| `seldon cases add` | Append a test case (`--name` `--step …` `--criteria`) |
|
|
101
117
|
| `seldon cases` | List the cases in the current `seldon.yml` |
|
|
102
118
|
| `seldon validate` | Validate the file locally |
|
|
103
|
-
| `seldon run [--url <url>]` | Ingest `seldon.yml` and run it; `--no-wait` to detach, `--fail-on` to gate, `--label <tag>` to profile |
|
|
119
|
+
| `seldon run [--url <url>]` | Ingest `seldon.yml` and run it; a local `--url` is auto-exposed via a Cloudflare tunnel (`--auto-approve` to skip the prompt); `--no-wait` to detach, `--fail-on` to gate, `--label <tag>` to profile |
|
|
104
120
|
| `seldon report [--md \| --json] [--full]` | Show the report for the last run (or `--id <run>`) |
|
|
105
121
|
| `seldon logs --follow` | Stream the agent's live reasoning |
|
|
106
122
|
| `seldon runs` | List QA runs with color-coded status |
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@seldonqa/cli",
|
|
3
|
-
"version": "0.
|
|
3
|
+
"version": "0.8.0",
|
|
4
4
|
"description": "Seldon QA - generate a QA test plan from any codebase and run AI agents against your live app, from your terminal or CI.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"keywords": [
|
|
@@ -32,11 +32,11 @@
|
|
|
32
32
|
"commander": "^12.1.0"
|
|
33
33
|
},
|
|
34
34
|
"optionalDependencies": {
|
|
35
|
-
"@seldonqa/cli-
|
|
36
|
-
"@seldonqa/cli-darwin-arm64": "0.
|
|
37
|
-
"@seldonqa/cli-
|
|
38
|
-
"@seldonqa/cli-
|
|
39
|
-
"@seldonqa/cli-
|
|
35
|
+
"@seldonqa/cli-darwin-x64": "0.8.0",
|
|
36
|
+
"@seldonqa/cli-darwin-arm64": "0.8.0",
|
|
37
|
+
"@seldonqa/cli-linux-x64": "0.8.0",
|
|
38
|
+
"@seldonqa/cli-win32-x64": "0.8.0",
|
|
39
|
+
"@seldonqa/cli-linux-arm64": "0.8.0"
|
|
40
40
|
},
|
|
41
41
|
"devDependencies": {
|
|
42
42
|
"@types/node": "^20.14.0",
|