@axlsdk/studio 0.20.0 → 0.20.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (2) hide show
  1. package/README.md +17 -3
  2. package/package.json +4 -4
package/README.md CHANGED
@@ -89,7 +89,9 @@ The `--conditions` flag is useful in monorepos where workspace packages use the
89
89
 
90
90
  ## Panels
91
91
 
92
- Eight panels, all live over WebSocket. The screenshots below are placeholders — see [`docs/assets/CAPTURE.md`](../../docs/assets/CAPTURE.md) for how to record the real thing.
92
+ Eight panels, all live over WebSocket. The captures below use representative seeded
93
+ runs; see [`docs/assets/CAPTURE.md`](../../docs/assets/CAPTURE.md) for how to regenerate
94
+ them.
93
95
 
94
96
  ### Agent Playground
95
97
 
@@ -101,7 +103,12 @@ Chat with any registered agent in real time. Streaming tokens, tool calls with e
101
103
 
102
104
  ### Trace Explorer
103
105
 
104
- Waterfall visualization of execution traces. Filter by type, agent, or tool; see token counts, cost per step, and duration. The Stats view shows the event-type distribution, top tools, and retry stacks.
106
+ Waterfall visualization of execution traces. Filter by type, agent, or tool; see token
107
+ counts, cost per step, and duration. Tool rows distinguish calls that succeeded,
108
+ failed, were denied, were cancelled, or were rejected before they started. Studio also
109
+ keeps older trace history readable and identifies incomplete runs instead of presenting
110
+ missing events as a complete story. The Stats view shows the event-type distribution,
111
+ top tools, and retry stacks.
105
112
 
106
113
  > **Studio vs `ctx.events`.** Studio consumes the same `AxlEvent` firehose via `runtime.on('trace', …)` — every event from every execution. Inside a workflow handler, `ctx.events` is the in-handler counterpart (per-context, scoped to the current workflow). The two coexist: Studio is for cross-execution observability and replay; `ctx.events` is for in-handler streaming UIs. See [`docs/observability.md`](../../docs/observability.md#observation-paths).
107
114
 
@@ -115,7 +122,14 @@ Track spending across agents, models, workflows, and embedders with time-window
115
122
 
116
123
  ### Eval Runner
117
124
 
118
- Run evaluations from the UI, watch items stream in, and drill into per-item scores, timing, cost, and LLM-judge reasoning. Compare two runs (baseline vs candidate) with bootstrap-CI significance, a score-distribution chart, and an item-level diff table. The History tab groups multi-run results and tracks mean scores across runs. Toggle **Capture traces** to render each item's events inline. Requires `@axlsdk/eval` as an optional peer dependency.
125
+ Run evaluations from the UI, watch items stream in, and drill into per-item scores,
126
+ timing, cost, and LLM-judge reasoning. Compare two runs (baseline vs candidate) with
127
+ bootstrap-CI significance, a score-distribution chart, and an item-level diff table.
128
+ The History tab groups multi-run results and tracks mean scores across runs. Toggle
129
+ **Capture traces** to render each item's events inline. For tool-using workflows, those
130
+ events show whether a call failed, was denied, was cancelled, or never started, giving
131
+ you better evidence for debugging and custom scorers. Studio does not turn those states
132
+ into scores automatically. Requires `@axlsdk/eval` as an optional peer dependency.
119
133
 
120
134
  Amber banners flag runs you shouldn't fully trust — a scorer that failed on too many items, a subset run, or annotations dropped by the dataset schema — so a thinned or misconfigured run can't quietly look clean.
121
135
 
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@axlsdk/studio",
3
- "version": "0.20.0",
3
+ "version": "0.20.1",
4
4
  "description": "Local development UI for debugging, testing, and iterating on Axl agents and workflows",
5
5
  "type": "module",
6
6
  "main": "./dist/server/index.cjs",
@@ -40,7 +40,7 @@
40
40
  "hono": "^4.7.0",
41
41
  "tsx": "^4.19.0",
42
42
  "ws": "^8.0.0",
43
- "@axlsdk/axl": "0.20.0"
43
+ "@axlsdk/axl": "0.20.1"
44
44
  },
45
45
  "devDependencies": {
46
46
  "@tailwindcss/vite": "^4.1.0",
@@ -65,10 +65,10 @@
65
65
  "vite": "^6.0.0",
66
66
  "vitest": "^3.0.0",
67
67
  "zod": "^4.0.0",
68
- "@axlsdk/testing": "0.20.0"
68
+ "@axlsdk/testing": "0.20.1"
69
69
  },
70
70
  "peerDependencies": {
71
- "@axlsdk/eval": "0.20.0"
71
+ "@axlsdk/eval": "0.20.1"
72
72
  },
73
73
  "peerDependenciesMeta": {
74
74
  "@axlsdk/eval": {