agent-inspect 4.4.0 → 5.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/docs/CLI.md +34 -0
- package/package.json +1 -1
- package/packages/cli/dist/chunk-TB45H3QT.mjs +7881 -0
- package/packages/cli/dist/chunk-TB45H3QT.mjs.map +1 -0
- package/packages/cli/dist/index.cjs +10295 -9414
- package/packages/cli/dist/index.cjs.map +1 -1
- package/packages/cli/dist/index.mjs +4756 -7991
- package/packages/cli/dist/index.mjs.map +1 -1
- package/packages/cli/dist/{src-FJOHPC4X.mjs → src-ZRFSYML6.mjs} +3 -3
- package/packages/cli/dist/{src-FJOHPC4X.mjs.map → src-ZRFSYML6.mjs.map} +1 -1
- package/packages/core/dist/advanced.cjs +3210 -13
- package/packages/core/dist/advanced.cjs.map +1 -1
- package/packages/core/dist/advanced.d.cts +135 -1
- package/packages/core/dist/advanced.d.ts +135 -1
- package/packages/core/dist/advanced.mjs +575 -9
- package/packages/core/dist/advanced.mjs.map +1 -1
- package/packages/core/dist/checks.mjs +2 -1648
- package/packages/core/dist/checks.mjs.map +1 -1
- package/packages/core/dist/chunk-QLYOCCEF.mjs +1650 -0
- package/packages/core/dist/chunk-QLYOCCEF.mjs.map +1 -0
- package/packages/core/dist/chunk-X2FLDF7M.mjs +1581 -0
- package/packages/core/dist/chunk-X2FLDF7M.mjs.map +1 -0
- package/packages/core/dist/readers.mjs +3 -1579
- package/packages/core/dist/readers.mjs.map +1 -1
- package/packages/cli/dist/chunk-ORHDQUT6.mjs +0 -3862
- package/packages/cli/dist/chunk-ORHDQUT6.mjs.map +0 -1
package/CHANGELOG.md
CHANGED
package/docs/CLI.md
CHANGED
|
@@ -896,6 +896,40 @@ npx agent-inspect bundle --since 24h --dir ./.agent-inspect --json
|
|
|
896
896
|
|
|
897
897
|
Recipe: [shareable-bundle-basic](../examples/recipes/shareable-bundle-basic/README.md).
|
|
898
898
|
|
|
899
|
+
### 6.25 `suite`
|
|
900
|
+
|
|
901
|
+
Define and run **local trace suites** for CI trajectory checks (v5.0+). Suites read existing traces only — no agent replay, no model calls, no upload.
|
|
902
|
+
|
|
903
|
+
```bash
|
|
904
|
+
agent-inspect suite init
|
|
905
|
+
agent-inspect suite validate [--config path]
|
|
906
|
+
agent-inspect suite list [--config path]
|
|
907
|
+
agent-inspect suite run [--config path] [--json] [--markdown] [-o dir]
|
|
908
|
+
agent-inspect suite report --input <suite-run.json> [--format markdown|json]
|
|
909
|
+
```
|
|
910
|
+
|
|
911
|
+
Default config file: `agent-inspect.suite.json` in the current directory.
|
|
912
|
+
|
|
913
|
+
Options (shared):
|
|
914
|
+
|
|
915
|
+
- `--config <path>` — suite config (`.json`, `.js`, `.mjs`, `.cjs`)
|
|
916
|
+
|
|
917
|
+
`run` also supports:
|
|
918
|
+
|
|
919
|
+
- `-o, --output <dir>` — write JSON run artifact (default: `.agent-inspect/suite-runs`)
|
|
920
|
+
- `--json` / `--markdown` — structured or readable output
|
|
921
|
+
|
|
922
|
+
Case fields include `requireTools`, `forbidTools`, `maxDurationMs`, and `expectedObservations` (outcome names that must be `passed`).
|
|
923
|
+
|
|
924
|
+
Example:
|
|
925
|
+
|
|
926
|
+
```bash
|
|
927
|
+
npx agent-inspect suite init
|
|
928
|
+
npx agent-inspect suite run --config fixtures/configs/outcome-suite.suite.json --json
|
|
929
|
+
```
|
|
930
|
+
|
|
931
|
+
Recipe: [trace-suite-basic](../examples/recipes/trace-suite-basic/README.md).
|
|
932
|
+
|
|
899
933
|
## 7. Optional TUI behavior
|
|
900
934
|
|
|
901
935
|
`view --tui` delegates to `@agent-inspect/tui` and requires an interactive terminal. If the package is not installed, the CLI prints a short install hint.
|
package/package.json
CHANGED