@mastra/evals 1.0.0-beta.4 → 1.0.0-beta.5

package/CHANGELOG.md

@@ -1,5 +1,35 @@
 # @mastra/evals
 
+## 1.0.0-beta.5
+
+### Major Changes
+
+- Refactor workflow and tool types to remove Zod-specific constraints ([#11814](https://github.com/mastra-ai/mastra/pull/11814))
+
+  Removed Zod-specific type constraints across all workflow implementations and tool types, replacing them with generic types. This ensures type consistency across default, evented, and inngest workflows while preparing for Zod v4 migration.
+
+  **Workflow Changes:**
+  - Removed `z.ZodObject<any>` and `z.ZodType<any>` constraints from all workflow generic types
+  - Updated method signatures to use `TInput` and `TState` directly instead of `z.infer<TInput>` and `z.infer<TState>`
+  - Aligned conditional types across all workflow implementations using `TInput extends unknown` pattern
+  - Fixed `TSteps` generic to properly use `TEngineType` instead of `any`
+
+  **Tool Changes:**
+  - Removed Zod schema constraints from `ToolExecutionContext` and related interfaces
+  - Simplified type parameters from `TSuspendSchema extends ZodLikeSchema` to `TSuspend` and `TResume`
+  - Updated tool execution context types to use generic types
+
+  **Type Utilities:**
+  - Refactored type helpers to work with generic schemas instead of Zod-specific types
+  - Updated type extraction utilities for better compatibility
+
+  This change maintains backward compatibility while improving type consistency and preparing for Zod v4 support across all affected packages.
+
+### Patch Changes
+
+- Updated dependencies [[`ebae12a`](https://github.com/mastra-ai/mastra/commit/ebae12a2dd0212e75478981053b148a2c246962d), [`c61a0a5`](https://github.com/mastra-ai/mastra/commit/c61a0a5de4904c88fd8b3718bc26d1be1c2ec6e7), [`69136e7`](https://github.com/mastra-ai/mastra/commit/69136e748e32f57297728a4e0f9a75988462f1a7), [`449aed2`](https://github.com/mastra-ai/mastra/commit/449aed2ba9d507b75bf93d427646ea94f734dfd1), [`eb648a2`](https://github.com/mastra-ai/mastra/commit/eb648a2cc1728f7678768dd70cd77619b448dab9), [`0131105`](https://github.com/mastra-ai/mastra/commit/0131105532e83bdcbb73352fc7d0879eebf140dc), [`9d5059e`](https://github.com/mastra-ai/mastra/commit/9d5059eae810829935fb08e81a9bb7ecd5b144a7), [`ef756c6`](https://github.com/mastra-ai/mastra/commit/ef756c65f82d16531c43f49a27290a416611e526), [`b00ccd3`](https://github.com/mastra-ai/mastra/commit/b00ccd325ebd5d9e37e34dd0a105caae67eb568f), [`3bdfa75`](https://github.com/mastra-ai/mastra/commit/3bdfa7507a91db66f176ba8221aa28dd546e464a), [`e770de9`](https://github.com/mastra-ai/mastra/commit/e770de941a287a49b1964d44db5a5763d19890a6), [`52e2716`](https://github.com/mastra-ai/mastra/commit/52e2716b42df6eff443de72360ae83e86ec23993), [`27b4040`](https://github.com/mastra-ai/mastra/commit/27b4040bfa1a95d92546f420a02a626b1419a1d6), [`610a70b`](https://github.com/mastra-ai/mastra/commit/610a70bdad282079f0c630e0d7bb284578f20151), [`8dc7f55`](https://github.com/mastra-ai/mastra/commit/8dc7f55900395771da851dc7d78d53ae84fe34ec), [`8379099`](https://github.com/mastra-ai/mastra/commit/8379099fc467af6bef54dd7f80c9bd75bf8bbddf), [`8c0ec25`](https://github.com/mastra-ai/mastra/commit/8c0ec25646c8a7df253ed1e5ff4863a0d3f1316c), [`ff4d9a6`](https://github.com/mastra-ai/mastra/commit/ff4d9a6704fc87b31a380a76ed22736fdedbba5a), [`69821ef`](https://github.com/mastra-ai/mastra/commit/69821ef806482e2c44e2197ac0b050c3fe3a5285), [`1ed5716`](https://github.com/mastra-ai/mastra/commit/1ed5716830867b3774c4a1b43cc0d82935f32b96), [`4186bdd`](https://github.com/mastra-ai/mastra/commit/4186bdd00731305726fa06adba0b076a1d50b49f), [`7aaf973`](https://github.com/mastra-ai/mastra/commit/7aaf973f83fbbe9521f1f9e7a4fd99b8de464617)]:
+  - @mastra/core@1.0.0-beta.22
+
 ## 1.0.0-beta.4
 
 ### Patch Changes

package/dist/docs/README.md

@@ -28,4 +28,4 @@ docs/
 ## Version
 
 Package: @mastra/evals
-Version: 1.0.0-beta.4
+Version: 1.0.0-beta.5

package/dist/docs/SKILL.md

@@ -5,7 +5,7 @@ description: Documentation for @mastra/evals. Includes links to type definitions
 
 # @mastra/evals Documentation
 
-> **Version**: 1.0.0-beta.4
+> **Version**: 1.0.0-beta.5
 > **Package**: @mastra/evals
 
 ## Quick Navigation

package/dist/docs/SOURCE_MAP.json

@@ -1,5 +1,5 @@
 {
-  "version": "1.0.0-beta.4",
+  "version": "1.0.0-beta.5",
   "package": "@mastra/evals",
   "exports": {},
   "modules": {}

package/dist/docs/evals/03-reference.md

@@ -3496,7 +3496,7 @@ const scorer = createToolCallAccuracyScorerCode({
 
 // Simulate LLM input and output with tool call
 const inputMessages = [
-  createUIMessage({
+  createTestMessage({
     content: "What is the weather like in New York today?",
     role: "user",
     id: "input-1",
@@ -3504,7 +3504,7 @@ const inputMessages = [
 ];
 
 const output = [
-  createUIMessage({
+  createTestMessage({
     content: "Let me check the weather for you.",
     role: "assistant",
     id: "output-1",
@@ -3539,7 +3539,7 @@ const strictScorer = createToolCallAccuracyScorerCode({
 
 // Multiple tools called - fails in strict mode
 const output = [
-  createUIMessage({
+  createTestMessage({
     content: "Let me help you with that.",
     role: "assistant",
     id: "output-1",
@@ -3578,7 +3578,7 @@ const orderScorer = createToolCallAccuracyScorerCode({
 });
 
 const output = [
-  createUIMessage({
+  createTestMessage({
     content: "I will authenticate and fetch the data.",
     role: "assistant",
     id: "output-1",
@@ -3617,7 +3617,7 @@ const flexibleOrderScorer = createToolCallAccuracyScorerCode({
 });
 
 const output = [
-  createUIMessage({
+  createTestMessage({
     content: "Performing comprehensive operation.",
     role: "assistant",
     id: "output-1",
@@ -3743,7 +3743,7 @@ const llmScorer = createToolCallAccuracyScorerLLM({
 });
 
 const inputMessages = [
-  createUIMessage({
+  createTestMessage({
     content: "What is the weather like in San Francisco today?",
     role: "user",
     id: "input-1",
@@ -3751,7 +3751,7 @@ const inputMessages = [
 ];
 
 const output = [
-  createUIMessage({
+  createTestMessage({
     content: "Let me check the current weather for you.",
     role: "assistant",
     id: "output-1",
@@ -3778,7 +3778,7 @@ console.log(result.reason); // "The agent correctly used the weather-tool to add
 
 ```typescript title="src/example-llm-inappropriate.ts"
 const inputMessages = [
-  createUIMessage({
+  createTestMessage({
     content: "What is the weather in Tokyo?",
     role: "user",
     id: "input-1",
@@ -3786,7 +3786,7 @@ const inputMessages = [
 ];
 
 const inappropriateOutput = [
-  createUIMessage({
+  createTestMessage({
     content: "Let me search for that information.",
     role: "assistant",
     id: "output-1",
@@ -3815,7 +3815,7 @@ The LLM scorer recognizes when agents appropriately ask for clarification:
 
 ```typescript title="src/example-llm-clarification.ts"
 const vagueInput = [
-  createUIMessage({
+  createTestMessage({
     content: 'I need help with something',
     role: 'user',
     id: 'input-1'
@@ -3823,7 +3823,7 @@ const vagueInput = [
 ];
 
 const clarificationOutput = [
-  createUIMessage({
+  createTestMessage({
     content: 'I'd be happy to help! Could you please provide more details about what you need assistance with?',
     role: 'assistant',
     id: 'output-1',
@@ -3868,14 +3868,14 @@ const llmScorer = createLLMScorer({
 // Test data
 const run = createAgentTestRun({
   inputMessages: [
-    createUIMessage({
+    createTestMessage({
       content: "What is the weather?",
       role: "user",
       id: "input-1",
     }),
   ],
   output: [
-    createUIMessage({
+    createTestMessage({
       content: "Let me find that information.",
       role: "assistant",
       id: "output-1",

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@mastra/evals",
-  "version": "1.0.0-beta.4",
+  "version": "1.0.0-beta.5",
   "description": "",
   "type": "module",
   "files": [
@@ -77,7 +77,7 @@
     "vitest": "4.0.16",
     "zod": "^3.25.76",
     "@internal/types-builder": "0.0.28",
-    "@mastra/core": "1.0.0-beta.20",
+    "@mastra/core": "1.0.0-beta.22",
     "@internal/lint": "0.0.53"
   },
   "engines": {