@axlsdk/studio 0.20.0 → 0.20.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -3
- package/package.json +4 -4
package/README.md
CHANGED
|
@@ -89,7 +89,9 @@ The `--conditions` flag is useful in monorepos where workspace packages use the
|
|
|
89
89
|
|
|
90
90
|
## Panels
|
|
91
91
|
|
|
92
|
-
Eight panels, all live over WebSocket. The
|
|
92
|
+
Eight panels, all live over WebSocket. The captures below use representative seeded
|
|
93
|
+
runs; see [`docs/assets/CAPTURE.md`](../../docs/assets/CAPTURE.md) for how to regenerate
|
|
94
|
+
them.
|
|
93
95
|
|
|
94
96
|
### Agent Playground
|
|
95
97
|
|
|
@@ -101,7 +103,12 @@ Chat with any registered agent in real time. Streaming tokens, tool calls with e
|
|
|
101
103
|
|
|
102
104
|
### Trace Explorer
|
|
103
105
|
|
|
104
|
-
Waterfall visualization of execution traces. Filter by type, agent, or tool; see token
|
|
106
|
+
Waterfall visualization of execution traces. Filter by type, agent, or tool; see token
|
|
107
|
+
counts, cost per step, and duration. Tool rows distinguish calls that succeeded,
|
|
108
|
+
failed, were denied, were cancelled, or were rejected before they started. Studio also
|
|
109
|
+
keeps older trace history readable and identifies incomplete runs instead of presenting
|
|
110
|
+
missing events as a complete story. The Stats view shows the event-type distribution,
|
|
111
|
+
top tools, and retry stacks.
|
|
105
112
|
|
|
106
113
|
> **Studio vs `ctx.events`.** Studio consumes the same `AxlEvent` firehose via `runtime.on('trace', …)` — every event from every execution. Inside a workflow handler, `ctx.events` is the in-handler counterpart (per-context, scoped to the current workflow). The two coexist: Studio is for cross-execution observability and replay; `ctx.events` is for in-handler streaming UIs. See [`docs/observability.md`](../../docs/observability.md#observation-paths).
|
|
107
114
|
|
|
@@ -115,7 +122,14 @@ Track spending across agents, models, workflows, and embedders with time-window
|
|
|
115
122
|
|
|
116
123
|
### Eval Runner
|
|
117
124
|
|
|
118
|
-
Run evaluations from the UI, watch items stream in, and drill into per-item scores,
|
|
125
|
+
Run evaluations from the UI, watch items stream in, and drill into per-item scores,
|
|
126
|
+
timing, cost, and LLM-judge reasoning. Compare two runs (baseline vs candidate) with
|
|
127
|
+
bootstrap-CI significance, a score-distribution chart, and an item-level diff table.
|
|
128
|
+
The History tab groups multi-run results and tracks mean scores across runs. Toggle
|
|
129
|
+
**Capture traces** to render each item's events inline. For tool-using workflows, those
|
|
130
|
+
events show whether a call failed, was denied, was cancelled, or never started, giving
|
|
131
|
+
you better evidence for debugging and custom scorers. Studio does not turn those states
|
|
132
|
+
into scores automatically. Requires `@axlsdk/eval` as an optional peer dependency.
|
|
119
133
|
|
|
120
134
|
Amber banners flag runs you shouldn't fully trust — a scorer that failed on too many items, a subset run, or annotations dropped by the dataset schema — so a thinned or misconfigured run can't quietly look clean.
|
|
121
135
|
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@axlsdk/studio",
|
|
3
|
-
"version": "0.20.
|
|
3
|
+
"version": "0.20.1",
|
|
4
4
|
"description": "Local development UI for debugging, testing, and iterating on Axl agents and workflows",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/server/index.cjs",
|
|
@@ -40,7 +40,7 @@
|
|
|
40
40
|
"hono": "^4.7.0",
|
|
41
41
|
"tsx": "^4.19.0",
|
|
42
42
|
"ws": "^8.0.0",
|
|
43
|
-
"@axlsdk/axl": "0.20.
|
|
43
|
+
"@axlsdk/axl": "0.20.1"
|
|
44
44
|
},
|
|
45
45
|
"devDependencies": {
|
|
46
46
|
"@tailwindcss/vite": "^4.1.0",
|
|
@@ -65,10 +65,10 @@
|
|
|
65
65
|
"vite": "^6.0.0",
|
|
66
66
|
"vitest": "^3.0.0",
|
|
67
67
|
"zod": "^4.0.0",
|
|
68
|
-
"@axlsdk/testing": "0.20.
|
|
68
|
+
"@axlsdk/testing": "0.20.1"
|
|
69
69
|
},
|
|
70
70
|
"peerDependencies": {
|
|
71
|
-
"@axlsdk/eval": "0.20.
|
|
71
|
+
"@axlsdk/eval": "0.20.1"
|
|
72
72
|
},
|
|
73
73
|
"peerDependenciesMeta": {
|
|
74
74
|
"@axlsdk/eval": {
|