@mastra/playground-ui 18.0.0-alpha.4 → 19.0.0-alpha.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (42) hide show
  1. package/CHANGELOG.md +42 -0
  2. package/dist/index.cjs.js +14379 -11170
  3. package/dist/index.cjs.js.map +1 -1
  4. package/dist/index.es.js +14368 -11169
  5. package/dist/index.es.js.map +1 -1
  6. package/dist/src/domains/agents/components/agent-combobox.d.ts +1 -2
  7. package/dist/src/domains/agents/components/agent-page-tabs.d.ts +5 -2
  8. package/dist/src/domains/agents/components/agent-playground/agent-playground-datasets.d.ts +5 -0
  9. package/dist/src/domains/agents/components/agent-playground/agent-playground-eval.d.ts +20 -6
  10. package/dist/src/domains/agents/components/agent-playground/agent-playground-evaluate.d.ts +11 -0
  11. package/dist/src/domains/agents/components/agent-playground/agent-playground-review.d.ts +9 -0
  12. package/dist/src/domains/agents/components/agent-playground/agent-playground-scorers.d.ts +5 -0
  13. package/dist/src/domains/agents/components/agent-playground/agent-playground-traces.d.ts +5 -0
  14. package/dist/src/domains/agents/components/agent-playground/agent-playground-view.d.ts +1 -2
  15. package/dist/src/domains/agents/components/agent-playground/dataset-detail-view.d.ts +14 -0
  16. package/dist/src/domains/agents/components/agent-playground/index.d.ts +3 -1
  17. package/dist/src/domains/agents/components/agent-playground/scorer-detail-view.d.ts +16 -0
  18. package/dist/src/domains/agents/components/agent-playground/scorer-mini-editor.d.ts +18 -0
  19. package/dist/src/domains/agents/components/agent-table/agent-table.d.ts +1 -2
  20. package/dist/src/domains/agents/components/agent-table/columns.d.ts +1 -1
  21. package/dist/src/domains/agents/components/agent-top-bar-controls.d.ts +5 -0
  22. package/dist/src/domains/agents/context/agent-edit-form-context.d.ts +2 -0
  23. package/dist/src/domains/agents/context/index.d.ts +2 -0
  24. package/dist/src/domains/agents/context/playground-model-context.d.ts +15 -0
  25. package/dist/src/domains/agents/context/review-queue-context.d.ts +65 -0
  26. package/dist/src/domains/agents/hooks/use-agent-experiments.d.ts +3 -3
  27. package/dist/src/domains/agents/hooks/use-completed-items.d.ts +5 -0
  28. package/dist/src/domains/agents/hooks/use-review-items.d.ts +6 -0
  29. package/dist/src/domains/agents/index.d.ts +1 -1
  30. package/dist/src/domains/agents/utils/agent-form-mappers.d.ts +1 -1
  31. package/dist/src/domains/configuration/hooks/use-has-observability.d.ts +4 -0
  32. package/dist/src/domains/configuration/index.d.ts +1 -0
  33. package/dist/src/domains/datasets/components/create-dataset-dialog.d.ts +4 -1
  34. package/dist/src/domains/datasets/components/generate-items-dialog.d.ts +32 -0
  35. package/dist/src/domains/datasets/components/save-as-dataset-item-dialog.d.ts +5 -1
  36. package/dist/src/domains/datasets/context/generation-context.d.ts +52 -0
  37. package/dist/src/domains/datasets/hooks/use-dataset-mutations.d.ts +5 -1
  38. package/dist/src/domains/datasets/index.d.ts +1 -0
  39. package/dist/src/ds/components/Combobox/combobox-styles.d.ts +1 -1
  40. package/package.json +10 -10
  41. package/dist/src/domains/agents/components/agent-source-icon.d.ts +0 -7
  42. package/dist/src/domains/agents/hooks/use-clone-agent.d.ts +0 -4
package/CHANGELOG.md CHANGED
@@ -1,5 +1,47 @@
1
1
  # @mastra/playground-ui
2
2
 
3
+ ## 19.0.0-alpha.0
4
+
5
+ ### Minor Changes
6
+
7
+ - Added Evaluate tab to the agent playground with full dataset management, scorer editing, experiment execution, and review workflow. ([#14470](https://github.com/mastra-ai/mastra/pull/14470))
8
+
9
+ **Evaluate tab** — A new sidebar-driven tab for managing datasets, scorers, and experiments within the agent playground. Key features:
10
+ - **Dataset management**: Create, attach/detach, and browse datasets. Inline item editing and deletion. Background LLM-powered test data generation with review-before-add flow.
11
+ - **Scorer editor**: Create and edit scorers with test items, linked test datasets, configurable score ranges, and model selection. Run scorer experiments directly from the editor.
12
+ - **Experiment runner**: Trigger experiments from dataset or scorer views with correct target routing (agent, scorer, or workflow). Past runs displayed with pass/fail counts and auto-polling for status updates.
13
+ - **Collapsible sidebar sections**: Datasets, Scorers, and Experiments sections are collapsible with search-enabled attach dialogs.
14
+
15
+ **Review tab** — A dedicated review workflow for experiment results:
16
+ - Tag-based organization with dataset-level tag vocabulary and bulk tagging
17
+ - LLM-powered analysis ("Analyze untagged/selected") that proposes tags with reasons, using existing tags when applicable
18
+ - Thumbs up/down ratings and comments persisted via feedback API
19
+ - Mark items as complete for audit trail
20
+ - Completed items section with read-only display
21
+
22
+ ### Patch Changes
23
+
24
+ - Removed 'Create an Agent' button from agent list page and table empty state. Removed 'Create Scorer' button from top-level scorers page. Removed stored/code source icons (AgentSourceIcon) from agent headers, combobox, and table. Renamed 'Versions' tab to 'Editor' in agent page tabs. Added GaugeIcon to the 'Create Scorer' button in the review tab. ([#14555](https://github.com/mastra-ai/mastra/pull/14555))
25
+
26
+ - Updated dependencies [[`68ed4e9`](https://github.com/mastra-ai/mastra/commit/68ed4e9f118e8646b60a6112dabe854d0ef53902), [`085c1da`](https://github.com/mastra-ai/mastra/commit/085c1daf71b55a97b8ebad26623089e40055021c), [`085c1da`](https://github.com/mastra-ai/mastra/commit/085c1daf71b55a97b8ebad26623089e40055021c), [`4a75e10`](https://github.com/mastra-ai/mastra/commit/4a75e106bd31c283a1b3fe74c923610dcc46415b), [`085c1da`](https://github.com/mastra-ai/mastra/commit/085c1daf71b55a97b8ebad26623089e40055021c), [`085c1da`](https://github.com/mastra-ai/mastra/commit/085c1daf71b55a97b8ebad26623089e40055021c)]:
27
+ - @mastra/core@1.16.0-alpha.0
28
+ - @mastra/client-js@1.10.0-alpha.0
29
+ - @mastra/react@0.2.17-alpha.0
30
+ - @mastra/ai-sdk@1.2.0
31
+
32
+ ## 18.0.0
33
+
34
+ ### Patch Changes
35
+
36
+ - Fixed blank page crash when clicking "Add Header" while using `npx mastra studio` ([#14482](https://github.com/mastra-ai/mastra/pull/14482))
37
+
38
+ - Updated dependencies [[`cb611a1`](https://github.com/mastra-ai/mastra/commit/cb611a1e89a4f4cf74c97b57e0c27bb56f2eceb5), [`da93115`](https://github.com/mastra-ai/mastra/commit/da931155c1a9bc63d455d3d86b4ec984db5991fe), [`b70443a`](https://github.com/mastra-ai/mastra/commit/b70443a9fe90dc10e25bd8c41b024cfd1faea917), [`b71bce1`](https://github.com/mastra-ai/mastra/commit/b71bce144912ed33f76c52a94e594988a649c3e1), [`62d1d3c`](https://github.com/mastra-ai/mastra/commit/62d1d3cc08fe8182e7080237fd975de862ec8c91), [`9e1a3ed`](https://github.com/mastra-ai/mastra/commit/9e1a3ed07cfafb5e8e19a796ce0bee817002d7c0), [`8681ecb`](https://github.com/mastra-ai/mastra/commit/8681ecb86184d5907267000e4576cc442a9a83fc), [`413fe2c`](https://github.com/mastra-ai/mastra/commit/413fe2c23548a3b1324b5d7939c98418246e903c), [`28d0249`](https://github.com/mastra-ai/mastra/commit/28d0249295782277040ad1e0d243e695b7ab1ce4), [`cd7b568`](https://github.com/mastra-ai/mastra/commit/cd7b568fe427b1b4838abe744fa5367a47539db3), [`681ee1c`](https://github.com/mastra-ai/mastra/commit/681ee1c811359efd1b8bebc4bce35b9bb7b14bec), [`bb0f09d`](https://github.com/mastra-ai/mastra/commit/bb0f09dbac58401b36069f483acf5673202db5b5), [`a579f7a`](https://github.com/mastra-ai/mastra/commit/a579f7a31e582674862b5679bc79af7ccf7429b8), [`5f7e9d0`](https://github.com/mastra-ai/mastra/commit/5f7e9d0db664020e1f3d97d7d18c6b0b9d4843d0), [`d7f14c3`](https://github.com/mastra-ai/mastra/commit/d7f14c3285cd253ecdd5f58139b7b6cbdf3678b5), [`0efe12a`](https://github.com/mastra-ai/mastra/commit/0efe12a5f008a939a1aac71699486ba40138054e), [`631d9d9`](https://github.com/mastra-ai/mastra/commit/631d9d9ce2b96169d8cdd12bdc45d4f3a0f3b530)]:
39
+ - @mastra/core@1.15.0
40
+ - @mastra/ai-sdk@1.2.0
41
+ - @mastra/schema-compat@1.2.6
42
+ - @mastra/client-js@1.9.1
43
+ - @mastra/react@0.2.16
44
+
3
45
  ## 18.0.0-alpha.4
4
46
 
5
47
  ### Patch Changes