@mastra/core 1.18.1-alpha.0 → 1.19.0-alpha.2

package/dist/docs/references/docs-studio-overview.md

@@ -0,0 +1,127 @@
+# Studio
+
+Studio provides an interactive UI for building, testing, and managing your agents, workflows, and tools. Run it locally during development, or [deploy it](https://mastra.ai/docs/studio/deployment) to production so your team can manage agents, monitor performance, and gain insights through built-in observability.
+
+Add [authentication](https://mastra.ai/docs/studio/auth) to protect your deployed Studio with login screens, role-based access control, and permission-based UI rendering so you can control what each team member can see and do. You can also [create a project in Mastra Cloud](https://mastra.ai/docs/mastra-cloud/setup) for a hosted option.
+
+[YouTube video player](https://www.youtube-nocookie.com/embed/ojGu6Bi4wYk)
+
+## Start Studio
+
+If you created your application with `create mastra`, start the development server using the `dev` script. You can also run it directly with `mastra dev`.
+
+**npm**:
+
+```bash
+npm run dev
+```
+
+**pnpm**:
+
+```bash
+pnpm run dev
+```
+
+**Yarn**:
+
+```bash
+yarn dev
+```
+
+**Bun**:
+
+```bash
+bun run dev
+```
+
+Once the server is running, you can:
+
+- Open the Studio UI at [http://localhost:4111](http://localhost:4111/) to interact with your agents, workflows, and tools.
+- Visit <http://localhost:4111/swagger-ui> to discover and interact with the underlying REST API.
+
+To run Studio in production, see [Studio deployment](https://mastra.ai/docs/studio/deployment). To run Studio independently from your Mastra server, use [`mastra studio`](https://mastra.ai/reference/cli/mastra).
+
+## Primitives
+
+### Agents
+
+Chat with your agent directly, dynamically switch [models](https://mastra.ai/models), and tweak settings like temperature and top-p to understand how they affect the output.
+
+When you interact with your agent, you can follow each step of its reasoning, view tool call outputs, and [observe](#observability) traces and logs to see how responses are generated. You can also attach [scorers](#scorers) to measure and compare response quality over time.
+
+### Workflows
+
+Visualize your workflow as a graph and run it step by step with a custom input. During execution, the interface updates in real time to show the active step and the path taken.
+
+When running a workflow, you can also view detailed traces showing tool calls, raw JSON outputs, and any errors that might have occurred along the way.
+
+### Processors
+
+View the input and output processors attached to each agent. The agent detail panel lists every processor by name and type, so you can verify your guardrails, token limiters, and custom processors are wired up correctly before testing.
+
+See [processors](https://mastra.ai/docs/agents/processors) and [guardrails](https://mastra.ai/docs/agents/guardrails) for configuration details.
+
+### MCP servers
+
+List the MCP servers attached to your Mastra instance and explore their available tools.
+
+### Tools
+
+Run tools on their own to observe behavior and test them before assigning them to an agent. If something goes wrong, re-run a tool in isolation to debug the issue.
+
+### Workspaces
+
+Browse the files in your agent's workspace filesystem using a built-in file browser. Switch between workspace mounts, create directories, and view file contents with syntax highlighting. Writable workspaces allow directory creation and file deletion; read-only workspaces are labeled accordingly. The Skills tab lists all discovered skills with their instructions, references, and metadata. Install community skills from [skills.sh](https://skills.sh) or remove existing ones.
+
+See [workspaces](https://mastra.ai/docs/workspace/overview) for configuration details.
+
+### Request context
+
+Set runtime variables that flow into your agent's instructions and tools through dependency injection. Edit request context as JSON or use a schema-driven form when your agent defines a `requestContextSchema`. Values persist across test chats and experiments, so you can trigger conditional flows without restarting.
+
+See [request context](https://mastra.ai/docs/server/request-context) for configuration details.
+
+## Evaluation
+
+### Scorers
+
+The Scorers tab displays the results of your agent's scorers as they run. When messages pass through your agent, the defined scorers evaluate each output asynchronously and render their results here. This allows you to understand how your scorers respond to different interactions, compare performance across test cases, and identify areas for improvement.
+
+### Datasets
+
+Create and manage collections of test cases to evaluate your agents and workflows. Import items from CSV or JSON, define input and ground-truth schemas, and pin to specific versions so you can reproduce experiments exactly. Run experiments with [scorers](https://mastra.ai/docs/evals/overview) to compare quality across prompts, models, or code changes.
+
+See [datasets overview](https://mastra.ai/docs/evals/datasets/overview) for the full API and versioning details.
+
+### Experiments
+
+Run all items in a dataset against an agent, workflow, or scorer and collect the results in one place. Select a target, optionally attach scorers, and trigger the experiment. The results view shows each item's input, output, status, and individual score breakdowns. Compare two experiments side by side to measure the impact of prompt, model, or code changes.
+
+See [datasets overview](https://mastra.ai/docs/evals/datasets/overview) for setup details.
+
+## Observability
+
+Visit the [Studio observability](https://mastra.ai/docs/studio/observability) docs to learn more.
+
+## Settings
+
+Configure the connection between Studio and your Mastra server. The settings page includes:
+
+- **Mastra instance URL**: The base URL of your Mastra server (e.g. `http://localhost:4111`).
+- **API prefix**: Optional path prefix for all API requests (defaults to `/api`).
+- **Custom headers**: Add key-value pairs sent with every request, useful for authentication tokens or routing headers.
+- **Theme**: Switch between dark, light, or system theme.
+
+## Code configuration
+
+In addition to the [settings](#settings) UI, you can configure the local development server and Studio also through the [`server`](https://mastra.ai/reference/configuration) option in your `src/mastra/index.ts`.
+
+By default, Studio runs at <http://localhost:4111>. You can change the [`host`](https://mastra.ai/reference/configuration) and [`port`](https://mastra.ai/reference/configuration).
+
+Mastra also supports HTTPS development through the [`--https`](https://mastra.ai/reference/cli/mastra) flag, which automatically creates and manages certificates for your project. When you run `mastra dev --https`, a private key and certificate are generated for localhost (or your configured host). Visit the [HTTPS reference](https://mastra.ai/reference/configuration) to learn more.
+
+## Next steps
+
+- Learn how to [deploy Studio](https://mastra.ai/docs/studio/deployment) for production use.
+- Add [authentication](https://mastra.ai/docs/studio/auth) to control access to your deployed Studio.
+- Explore [Studio observability](https://mastra.ai/docs/studio/observability) to monitor agent performance and gain insights through metrics, logs, and traces.

package/dist/docs/references/docs-workflows-agents-and-tools.md

@@ -1,14 +1,14 @@
 # Agents and tools
 
-Workflow steps can call agents to leverage LLM reasoning or call tools for type-safe logic. You can either invoke them from within a step's `execute` function or compose them directly as steps using `createStep()`.
+Workflow steps can call agents to leverage LLM reasoning or call tools for type-safe logic. You can either invoke them from within a step's `execute()` function or compose them directly as steps using `createStep()`.
 
 ## Using agents in workflows
 
-Use agents in workflow steps when you need reasoning, language generation, or other LLM-based tasks. Call from a step's `execute` function for more control over the agent call (e.g., track message history or return structured output). Compose agents as steps when you don't need to modify how the agent is invoked.
+Use agents in workflow steps when you need reasoning, language generation, or other LLM-based tasks. Call from a step's `execute()` function for more control over the agent call (e.g., track message history or return structured output). Compose agents as steps when you don't need to modify how the agent is invoked.
 
 ### Calling agents
 
-Call agents inside a step's `execute` function using `.generate()` or `.stream()`. This lets you modify the agent call and handle the response before passing it to the next step.
+Call agents inside a step's `execute()` function using `.generate()` or `.stream()`. This lets you modify the agent call and handle the response before passing it to the next step.
 
 ```typescript
 const step1 = createStep({
@@ -41,7 +41,6 @@ Compose an agent as a step using `createStep()` when you don't need to modify th
 
 ```typescript
 import { testAgent } from '../agents/test-agent'
-
 const step1 = createStep(testAgent)
 
 export const testWorkflow = createWorkflow({})
@@ -111,20 +110,20 @@ The `structuredOutput.schema` option accepts any Zod schema. The agent will gene
 
 ## Using tools in workflows
 
-Use tools in workflow steps to leverage existing tool logic. Call from a step's `execute` function when you need to prepare context or process responses. Compose tools as steps when you don't need to modify how the tool is used.
+Use tools in workflow steps to leverage existing tool logic. Call from a step's `.execute()` function when you need to prepare context or process responses. Compose tools as steps when you don't need to modify how the tool is used.
 
 ### Calling tools
 
-Call tools inside a step's `execute` function using `.execute()`. This gives you more control over the tool's input context, or process its response before passing it to the next step.
+Call tools inside a step's `.execute()` function. This gives you more control over the tool's input context, or process its response before passing it to the next step.
 
 ```typescript
 import { testTool } from '../tools/test-tool'
 
 const step2 = createStep({
   execute: async ({ inputData, requestContext }) => {
-    const { formatted } = inputData
+    const { text } = inputData
 
-    const response = await testTool.execute({ text: formatted }, { requestContext })
+    const response = await testTool.execute({ text }, { requestContext })
 
     return {
       emphasized: response.emphasized,
@@ -133,8 +132,6 @@ const step2 = createStep({
 })
 ```
 
-> **Info:** Visit [Calling Tools](https://mastra.ai/docs/workflows/agents-and-tools) for more examples.
-
 ### Tools as steps
 
 Compose a tool as a step using `createStep()` when the previous step's output matches the tool's input context. You can use `.map()` to transform the previous step's output if they don't.

package/dist/docs/references/docs-workflows-control-flow.md

@@ -99,7 +99,7 @@ export const testWorkflow = createWorkflow({
   .commit()
 ```
 
-> 📹 Watch: How to run steps in parallel and optimize your Mastra workflow → [YouTube (3 minutes)](https://youtu.be/GQJxve5Hki4)
+> **📹 Watch:** How to run steps in parallel and optimize your Mastra workflow → [YouTube (3 minutes)](https://youtu.be/GQJxve5Hki4)
 
 ### Output structure
 

package/dist/docs/references/docs-workflows-overview.md

@@ -45,7 +45,7 @@ const step1 = createStep({
 })
 ```
 
-> **Info:** Visit [Step Class](https://mastra.ai/reference/workflows/step) for a full list of configuration options.
+> **Info:** Visit [`Step`](https://mastra.ai/reference/workflows/step) for a full list of configuration options.
 
 ### Using agents and tools
 
@@ -80,6 +80,15 @@ export const testWorkflow = createWorkflow({
 
 Workflows can be composed using a number of different methods. The method you choose determines how each step's schema should be structured. Visit the [Control Flow](https://mastra.ai/docs/workflows/control-flow) page for more information.
 
+## Studio
+
+Open [Studio](https://mastra.ai/docs/studio/overview) and select a workflow from the **Workflows** tab.
+
+- **Graph view**: The center panel visualizes the workflow's steps and execution flow.
+- **Input form**: The right sidebar generates a form from the workflow's `inputSchema`. Fill it in and start the run.
+- **Live status**: During execution, the graph updates each step's status in real time. The sidebar shows the workflow's input, output, state, and logs.
+- [**Time travel**](https://mastra.ai/docs/workflows/time-travel): After a run completes, replay individual steps to inspect or retry them.
+
 ## Workflow state
 
 Workflow state lets you share values across steps without passing them through every step's inputSchema and outputSchema. Use state for tracking progress, accumulating results, or sharing configuration across the entire workflow.
@@ -188,7 +197,7 @@ const testWorkflow = mastra.getWorkflow('testWorkflow')
 
 Workflows can be run in two modes: start waits for all steps to complete before returning, and stream emits events during execution. Choose the approach that fits your use case: start when you only need the final result, and stream when you want to monitor progress or trigger actions as steps complete.
 
-**Start**:
+**.start()**:
 
 Create a workflow run instance using `createRun()`, then call `.start()` with `inputData` matching the workflow's `inputSchema`. The workflow executes all steps and returns the final result.
 
@@ -206,7 +215,7 @@ if (result.status === 'success') {
 }
 ```
 
-**Stream**:
+**.stream()**:
 
 Create a workflow run instance using `.createRun()`, then call `.stream()` with `inputData` matching the workflow's `inputSchema`. Iterate over `fullStream` to track progress, then await `result` to get the final workflow result.
 
@@ -356,10 +365,6 @@ const step1 = createStep({
 
 > **Tip:** For type-safe request context schema validation, see [Schema Validation](https://mastra.ai/docs/server/request-context).
 
-## Testing with Studio
-
-Use [Studio](https://mastra.ai/docs/getting-started/studio) to run workflows with different inputs, visualize the execution lifecycle, see the inputs and outputs for each step, and inspect each part of the workflow in more detail.
-
 ## Related
 
 For a closer look at workflows, see our [Workflow Guide](https://mastra.ai/guides/guide/ai-recruiter), which walks through the core concepts with a practical example.

package/dist/docs/references/docs-workflows-suspend-and-resume.md

@@ -1,4 +1,4 @@
-# Suspend and resume
+# Suspend & resume
 
 Workflows can be paused at any step to collect additional data, wait for API callbacks, throttle costly operations, or request [human-in-the-loop](https://mastra.ai/docs/workflows/human-in-the-loop) input. When a workflow is suspended, its current execution state is saved as a snapshot. You can later resume the workflow from a [specific step ID](https://mastra.ai/docs/workflows/snapshots), restoring the exact state captured in that snapshot. [Snapshots](https://mastra.ai/docs/workflows/snapshots) are stored in your configured storage provider and persist across deployments and application restarts.
 

package/dist/docs/references/guides-concepts-multi-agent-systems.md

@@ -22,7 +22,7 @@ Multi-agent patterns are useful when the system needs a clear way to divide cont
 
 ## Handoffs
 
-A handoff pattern transfers control from one agent to another. Unlike a supervisor pattern, the first agent does not stay in charge for the full task. Instead, the active specialist takes ownership of the next part of the interaction.
+A handoff pattern transfers control from one agent to another. Unlike a supervisor pattern, the first agent doesn't stay in charge for the full task. Instead, the active specialist takes ownership of the next part of the interaction.
 
 Use handoffs when the next specialist should continue the interaction directly instead of reporting back through a central coordinator. The tradeoff is that context management becomes more important, since the system must decide what the next agent inherits and what remains scoped.
 
@@ -34,13 +34,13 @@ A workflow pattern defines the execution path in code. Instead of asking an agen
 
 Use workflows when the task is well understood and the execution path is known in advance. The main advantage is predictability: The system is easier to debug, reason about, and audit because the structure is explicit. The tradeoff is flexibility, since workflows are less adaptive when the task changes as it unfolds.
 
-In Mastra, [workflows](https://mastra.ai/docs/workflows/overview) can implement several coordination patterns, including handoffs and councils. What makes a workflow distinct is not which agents it calls, but that the control logic lives in the workflow itself.
+In Mastra, [workflows](https://mastra.ai/docs/workflows/overview) can implement several coordination patterns, including handoffs and councils. What makes a workflow distinct isn't which agents it calls, but that the control logic lives in the workflow itself.
 
 ## Supervisors
 
 A supervisor pattern keeps one lead agent in control for the full task. The supervisor decides when to delegate, which specialist to call, what context to pass, and how to combine the result.
 
-Use this pattern when the task is open-ended and the full sequence is not known in advance. For example, a research task may require different lines of inquiry based on what earlier steps uncover. A supervisor can adapt as the task unfolds. The tradeoff is that the supervisor becomes the main coordination point. That makes the pattern flexible, but it also means the result depends heavily on good delegation behavior and clear subagent boundaries.
+Use this pattern when the task is open-ended and the full sequence isn't known in advance. For example, a research task may require different lines of inquiry based on what earlier steps uncover. A supervisor can adapt as the task unfolds. The tradeoff is that the supervisor becomes the main coordination point. That makes the pattern flexible, but it also means the result depends heavily on good delegation behavior and clear subagent boundaries.
 
 In Mastra, this pattern maps directly to [supervisor agents](https://mastra.ai/docs/agents/supervisor-agents). A supervisor agent defines subagents on the `agents` property and uses `stream()` or `generate()` to coordinate them. Mastra also provides delegation hooks, message filtering, and memory isolation to help control this pattern.
 
@@ -52,7 +52,7 @@ A council pattern asks multiple agents to work on the same problem independently
 
 Use this pattern when the question is ambiguous, evaluative, or high-stakes and answer quality matters more than speed. The tradeoff is cost, since councils intentionally duplicate effort and usually take longer and use more tokens than other patterns.
 
-Mastra does not provide a dedicated council primitive. In Mastra, implement this pattern with [agents](https://mastra.ai/docs/agents/overview) and [workflows](https://mastra.ai/docs/workflows/overview): Run multiple agents in parallel, collect their outputs, and add a final synthesis or review step. Workflow control flow methods such as `.parallel()` provide the structure for this pattern.
+Mastra doesn't provide a dedicated council primitive. In Mastra, implement this pattern with [agents](https://mastra.ai/docs/agents/overview) and [workflows](https://mastra.ai/docs/workflows/overview): Run multiple agents in parallel, collect their outputs, and add a final synthesis or review step. Workflow control flow methods such as `.parallel()` provide the structure for this pattern.
 
 ## Choosing a pattern
 

package/dist/docs/references/reference-agents-agent.md

@@ -6,7 +6,7 @@ The `Agent` class is the foundation for creating AI agents in Mastra. It provide
 
 ### Basic string instructions
 
-Passing instructions as a string or array of strings is the simplest way to set up an agent. This is useful for straightforward use cases where you just need to provide a prompt without additional configuration.
+Passing instructions as a string or array of strings is the simplest way to set up an agent. This is useful for straightforward use cases where you need to provide a prompt without additional configuration.
 
 ```typescript
 import { Agent } from '@mastra/core/agent'

package/dist/docs/references/reference-configuration.md

@@ -749,9 +749,9 @@ Return a `{ status, body }` object to override the default `400` response, or `u
 
 The `context` parameter indicates which part of the request failed validation:
 
-- `'query'` — query parameters
-- `'body'` — request body
-- `'path'` — path parameters
+- `'query'`: query parameters
+- `'body'`: request body
+- `'path'`: path parameters
 
 ```typescript
 import { Mastra } from '@mastra/core'
@@ -797,7 +797,7 @@ export const mastra = new Mastra({
 **Type:** `string`\
 **Default:** `/`
 
-Base path for hosting Mastra Studio. Use this to host the Studio on a sub-path of your existing application instead of the root.
+Base path for hosting [Studio](https://mastra.ai/docs/studio/overview). Use this to host the Studio on a sub-path of your existing application instead of the root.
 
 This is useful when integrating with existing applications, using authentication tools like Cloudflare Zero Trust that benefit from shared domains, or managing multiple services under a single domain.
 

package/dist/docs/references/reference-memory-observational-memory.md

@@ -666,7 +666,7 @@ const selector = new ModelByInputTokens({
 
 #### Behavior
 
-- Thresholds are sorted internally, so the order in the config object does not matter.
+- Thresholds are sorted internally, so the order in the config object doesn't matter.
 - `inputTokens ≤ smallest threshold` → uses that threshold's model
 - `inputTokens > largest threshold` → `resolve()` throws an error. If this happens during an OM Observer or Reflector run, OM aborts via TripWire, so callers receive an empty `text` result or streamed `tripwire` instead of a normal assistant response.
 - OM computes the input token count for the Observer or Reflector call and resolves the matching model tier directly

package/dist/docs/references/reference-storage-cloudflare-d1.md

@@ -2,7 +2,7 @@
 
 The Cloudflare D1 storage implementation provides a serverless SQL database solution using Cloudflare D1, supporting relational operations and transactional consistency.
 
-> **Observability Not Supported:** Cloudflare D1 storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to D1, and Mastra Studio's observability features won't work with D1 as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** Cloudflare D1 storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to D1, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with D1 as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
 
 > **Row Size Limit:** Cloudflare D1 enforces a **1 MiB maximum row size**. This limit can be exceeded when storing messages with base64-encoded attachments such as images. See [Handling large attachments](https://mastra.ai/docs/memory/storage) for workarounds including uploading attachments to external storage.
 

package/dist/docs/references/reference-storage-lance.md

@@ -2,7 +2,7 @@
 
 The LanceDB storage implementation provides a high-performance storage solution using the LanceDB database system, which excels at handling both traditional data storage and vector operations.
 
-> **Observability Not Supported:** LanceDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to LanceDB, and Mastra Studio's observability features won't work with LanceDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** LanceDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to LanceDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with LanceDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
 
 ## Installation
 

package/dist/docs/references/reference-storage-upstash.md

@@ -4,7 +4,7 @@ The Upstash storage implementation provides a serverless-friendly storage soluti
 
 > **Pricing:** When using Mastra with Upstash, the pay-as-you-go model can result in unexpectedly high costs due to the high volume of Redis commands generated during agent conversations. We strongly recommend using a **fixed pricing plan** for predictable costs. See [Upstash pricing](https://upstash.com/pricing/redis) for details and [GitHub issue #5850](https://github.com/mastra-ai/mastra/issues/5850) for context.
 
-> **Observability Not Supported:** Upstash storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to Upstash, and Mastra Studio's observability features won't work with Upstash as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** Upstash storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to Upstash, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with Upstash as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
 
 ## Installation
 

package/dist/docs/references/reference.md

@@ -84,6 +84,10 @@ The Reference section provides documentation of Mastra's API, including paramete
 - [Deployer](https://mastra.ai/reference/deployer)
 - [Netlify](https://mastra.ai/reference/deployer/netlify)
 - [Vercel](https://mastra.ai/reference/deployer/vercel)
+- [createScorer()](https://mastra.ai/reference/evals/create-scorer)
+- [MastraScorer](https://mastra.ai/reference/evals/mastra-scorer)
+- [runEvals()](https://mastra.ai/reference/evals/run-evals)
+- [Scorer Utils](https://mastra.ai/reference/evals/scorer-utils)
 - [Answer Relevancy Scorer](https://mastra.ai/reference/evals/answer-relevancy)
 - [Answer Similarity Scorer](https://mastra.ai/reference/evals/answer-similarity)
 - [Bias](https://mastra.ai/reference/evals/bias)
@@ -91,30 +95,16 @@ The Reference section provides documentation of Mastra's API, including paramete
 - [Content Similarity Scorer](https://mastra.ai/reference/evals/content-similarity)
 - [Context Precision Scorer](https://mastra.ai/reference/evals/context-precision)
 - [Context Relevance Scorer](https://mastra.ai/reference/evals/context-relevance)
-- [createScorer()](https://mastra.ai/reference/evals/create-scorer)
 - [Faithfulness](https://mastra.ai/reference/evals/faithfulness)
 - [Hallucination](https://mastra.ai/reference/evals/hallucination)
 - [Keyword Coverage Scorer](https://mastra.ai/reference/evals/keyword-coverage)
-- [MastraScorer](https://mastra.ai/reference/evals/mastra-scorer)
 - [Noise Sensitivity Scorer](https://mastra.ai/reference/evals/noise-sensitivity)
 - [Prompt Alignment Scorer](https://mastra.ai/reference/evals/prompt-alignment)
-- [runEvals()](https://mastra.ai/reference/evals/run-evals)
-- [Scorer Utils](https://mastra.ai/reference/evals/scorer-utils)
 - [Textual Difference Scorer](https://mastra.ai/reference/evals/textual-difference)
 - [Tone Consistency Scorer](https://mastra.ai/reference/evals/tone-consistency)
 - [Tool Call Accuracy Scorers](https://mastra.ai/reference/evals/tool-call-accuracy)
 - [Toxicity](https://mastra.ai/reference/evals/toxicity)
 - [Trajectory Accuracy Scorers](https://mastra.ai/reference/evals/trajectory-accuracy)
-- [Harness Class](https://mastra.ai/reference/harness/harness-class)
-- [Cloned Thread Utilities](https://mastra.ai/reference/memory/clone-utilities)
-- [Memory Class](https://mastra.ai/reference/memory/memory-class)
-- [Observational Memory](https://mastra.ai/reference/memory/observational-memory)
-- [.cloneThread()](https://mastra.ai/reference/memory/cloneThread)
-- [.createThread()](https://mastra.ai/reference/memory/createThread)
-- [.deleteMessages()](https://mastra.ai/reference/memory/deleteMessages)
-- [.getThreadById()](https://mastra.ai/reference/memory/getThreadById)
-- [.listThreads()](https://mastra.ai/reference/memory/listThreads)
-- [.recall()](https://mastra.ai/reference/memory/recall)
 - [Dataset Class](https://mastra.ai/reference/datasets/dataset)
 - [DatasetsManager Class](https://mastra.ai/reference/datasets/datasets-manager)
 - [.addItem()](https://mastra.ai/reference/datasets/addItem)
@@ -139,7 +129,18 @@ The Reference section provides documentation of Mastra's API, including paramete
 - [.startExperimentAsync()](https://mastra.ai/reference/datasets/startExperimentAsync)
 - [.update()](https://mastra.ai/reference/datasets/update)
 - [.updateItem()](https://mastra.ai/reference/datasets/updateItem)
+- [Harness Class](https://mastra.ai/reference/harness/harness-class)
+- [Cloned Thread Utilities](https://mastra.ai/reference/memory/clone-utilities)
+- [Memory Class](https://mastra.ai/reference/memory/memory-class)
+- [Observational Memory](https://mastra.ai/reference/memory/observational-memory)
+- [.cloneThread()](https://mastra.ai/reference/memory/cloneThread)
+- [.createThread()](https://mastra.ai/reference/memory/createThread)
+- [.deleteMessages()](https://mastra.ai/reference/memory/deleteMessages)
+- [.getThreadById()](https://mastra.ai/reference/memory/getThreadById)
+- [.listThreads()](https://mastra.ai/reference/memory/listThreads)
+- [.recall()](https://mastra.ai/reference/memory/recall)
 - [PinoLogger](https://mastra.ai/reference/logging/pino-logger)
+- [Automatic Metrics](https://mastra.ai/reference/observability/metrics/automatic-metrics)
 - [Configuration](https://mastra.ai/reference/observability/tracing/configuration)
 - [Instances](https://mastra.ai/reference/observability/tracing/instances)
 - [Interfaces](https://mastra.ai/reference/observability/tracing/interfaces)
@@ -276,6 +277,7 @@ The Reference section provides documentation of Mastra's API, including paramete
 - [LocalSandbox](https://mastra.ai/reference/workspace/local-sandbox)
 - [S3Filesystem](https://mastra.ai/reference/workspace/s3-filesystem)
 - [SandboxProcessManager](https://mastra.ai/reference/workspace/process-manager)
+- [VercelSandbox](https://mastra.ai/reference/workspace/vercel)
 - [Workspace Class](https://mastra.ai/reference/workspace/workspace-class)
 - [WorkspaceFilesystem](https://mastra.ai/reference/workspace/filesystem)
 - [WorkspaceSandbox](https://mastra.ai/reference/workspace/sandbox)

package/dist/evals/index.cjs

@@ -1,22 +1,22 @@
 'use strict';
 
-var chunkRVBOSWN5_cjs = require('../chunk-RVBOSWN5.cjs');
-var chunkCJ4RMDJJ_cjs = require('../chunk-CJ4RMDJJ.cjs');
+var chunkE3JUOJME_cjs = require('../chunk-E3JUOJME.cjs');
+var chunkO542TXPV_cjs = require('../chunk-O542TXPV.cjs');
 var chunk4BZRWJBH_cjs = require('../chunk-4BZRWJBH.cjs');
 
 
 
 Object.defineProperty(exports, "runEvals", {
   enumerable: true,
-  get: function () { return chunkRVBOSWN5_cjs.runEvals; }
+  get: function () { return chunkE3JUOJME_cjs.runEvals; }
 });
 Object.defineProperty(exports, "MastraScorer", {
   enumerable: true,
-  get: function () { return chunkCJ4RMDJJ_cjs.MastraScorer; }
+  get: function () { return chunkO542TXPV_cjs.MastraScorer; }
 });
 Object.defineProperty(exports, "createScorer", {
   enumerable: true,
-  get: function () { return chunkCJ4RMDJJ_cjs.createScorer; }
+  get: function () { return chunkO542TXPV_cjs.createScorer; }
 });
 Object.defineProperty(exports, "extractTrajectory", {
   enumerable: true,

package/dist/evals/index.js

@@ -1,5 +1,5 @@
-export { runEvals } from '../chunk-GALW5K2E.js';
-export { MastraScorer, createScorer } from '../chunk-IVXAQT6H.js';
+export { runEvals } from '../chunk-IOHKSHT4.js';
+export { MastraScorer, createScorer } from '../chunk-BS5UESNT.js';
 export { extractTrajectory, extractTrajectoryFromTrace, extractWorkflowTrajectory, listScoresResponseSchema, saveScorePayloadSchema, scoreResultSchema, scoreRowDataSchema, scoringEntityTypeSchema, scoringExtractStepResultSchema, scoringHookInputSchema, scoringInputSchema, scoringInputWithExtractStepResultAndAnalyzeStepResultSchema, scoringInputWithExtractStepResultAndScoreAndReasonSchema, scoringInputWithExtractStepResultSchema, scoringPromptsSchema, scoringSourceSchema, scoringValueSchema } from '../chunk-PMWMEK4T.js';
 //# sourceMappingURL=index.js.map
 //# sourceMappingURL=index.js.map

package/dist/evals/scoreTraces/index.cjs

@@ -1,6 +1,6 @@
 'use strict';
 
-var chunkZ7DO2WCR_cjs = require('../../chunk-Z7DO2WCR.cjs');
+var chunkIQV2SVCE_cjs = require('../../chunk-IQV2SVCE.cjs');
 var chunk4BZRWJBH_cjs = require('../../chunk-4BZRWJBH.cjs');
 var chunkBF7IH4JU_cjs = require('../../chunk-BF7IH4JU.cjs');
 var chunk4U7ZLI36_cjs = require('../../chunk-4U7ZLI36.cjs');
@@ -235,7 +235,7 @@ function transformTraceToScorerInputAndOutput(trace) {
 }
 
 // src/evals/scoreTraces/scoreTracesWorkflow.ts
-var getTraceStep = chunkZ7DO2WCR_cjs.createStep({
+var getTraceStep = chunkIQV2SVCE_cjs.createStep({
   id: "__process-trace-scoring",
   inputSchema: v4.z.object({
     targets: v4.z.array(
@@ -446,7 +446,7 @@ async function attachScoreToSpan({
   } catch {
   }
 }
-var scoreTracesWorkflow = chunkZ7DO2WCR_cjs.createWorkflow({
+var scoreTracesWorkflow = chunkIQV2SVCE_cjs.createWorkflow({
   id: "__batch-scoring-traces",
   inputSchema: v4.z.object({
     targets: v4.z.array(

package/dist/evals/scoreTraces/index.js

@@ -1,4 +1,4 @@
-import { createStep, createWorkflow } from '../../chunk-KFL6ZGWG.js';
+import { createStep, createWorkflow } from '../../chunk-VYZRHQUD.js';
 import { saveScorePayloadSchema } from '../../chunk-PMWMEK4T.js';
 import { resolveObservabilityContext } from '../../chunk-KRFGPA2H.js';
 import { MastraError } from '../../chunk-FJEVLHJT.js';

package/dist/harness/harness.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"harness.d.ts","sourceRoot":"","sources":["../../src/harness/harness.ts"],"names":[],"mappings":"AAKA,OAAO,KAAK,EAAE,cAAc,EAAE,cAAc,EAAE,MAAM,kBAAkB,CAAC;AACvE,OAAO,EAAE,cAAc,EAAE,MAAM,oBAAoB,CAAC;AAIpD,OAAO,KAAK,EAAE,yBAAyB,EAAE,MAAM,kBAAkB,CAAC;AAClE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AAKnD,OAAO,KAAK,EACV,cAAc,EACd,gBAAgB,EAChB,aAAa,EACb,mBAAmB,EAEnB,oBAAoB,EACpB,cAAc,EAEd,WAAW,EAEX,cAAc,EACd,aAAa,EACb,eAAe,EACf,gBAAgB,EAChB,eAAe,EACf,YAAY,EACb,MAAM,SAAS,CAAC;AAEjB;;;;;;;;;;;;;;;;;;;;;;;;;GAyBG;AACH,qBAAa,OAAO,CAAC,MAAM,GAAG,EAAE;;IAC9B,QAAQ,CAAC,EAAE,EAAE,MAAM,CAAC;IAEpB,OAAO,CAAC,MAAM,CAAwB;IACtC,OAAO,CAAC,WAAW,CAAqC;IACxD,OAAO,CAAC,KAAK,CAAS;IACtB,OAAO,CAAC,aAAa,CAAS;IAC9B,OAAO,CAAC,eAAe,CAAuB;IAC9C,OAAO,CAAC,UAAU,CAAS;IAC3B,OAAO,CAAC,iBAAiB,CAAS;IAClC,OAAO,CAAC,SAAS,CAA8B;IAC/C,OAAO,CAAC,eAAe,CAAgC;IACvD,OAAO,CAAC,cAAc,CAAkB;IACxC,OAAO,CAAC,YAAY,CAAuB;IAC3C,OAAO,CAAC,kBAAkB,CAAa;IACvC,OAAO,CAAC,aAAa,CAAmE;IACxF,OAAO,CAAC,sBAAsB,CAEd;IAChB,OAAO,CAAC,uBAAuB,CAAuB;IACtD,OAAO,CAAC,sBAAsB,CAAuB;IACrD,OAAO,CAAC,2BAA2B,CAAuB;IAC1D,OAAO,CAAC,gBAAgB,CAA+C;IACvE,OAAO,CAAC,oBAAoB,CAGxB;IACJ,OAAO,CAAC,SAAS,CAAoC;IACrD,OAAO,CAAC,WAAW,CAEO;IAC1B,OAAO,CAAC,oBAAoB,CAAS;IACrC,OAAO,CAAC,eAAe,CAAuF;IAC9G,OAAO,CAAC,UAAU,CAIhB;IACF,OAAO,CAAC,wBAAwB,CAAqB;IACrD,OAAO,CAAC,mBAAmB,CAAqB;IAChD,OAAO,CAAC,YAAY,CAA8C;gBAGtD,MAAM,EAAE,aAAa,CAAC,MAAM,CAAC;IAwCzC;;;OAGG;IACG,IAAI,IAAI,OAAO,CAAC,IAAI,CAAC;IA4D3B;;OAEG;IACG,oBAAoB,IAAI,OAAO,CAAC,aAAa,CAAC;YAgBtC,gBAAgB;IAe9B;;OAEG;IACH,QAAQ,IAAI,QAAQ,CAAC,MAAM,CAAC;IAI5B;;;OAGG;IACG,QAAQ,CAAC,OAAO,EAAE,OAAO,CAAC,MAAM,CAAC,GAAG,OAAO,CAAC,IAAI,CAAC;IAkBvD,OAAO,CAAC,iBAAiB;IA4BzB,SAAS,IAAI,WAAW,CAAC,MAAM,CAAC,EAAE;IAIlC,gBAAgB,IAAI,MAAM;IAI1B,cAAc,IAAI,WAAW,CAAC,MAAM,CAAC;IAQrC;;;OAGG;IACG,UAAU,CAAC,EAAE,MAAM,EAAE,EAAE;QAAE,MAAM,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IA6B/D;;;OAGG;YACW,eAAe;IAmB7B;;OAEG;IACH,OAAO,CAAC,eAAe;IAQvB;;OAEG;IACH,YAAY,IAAI,MAAM;IAOtB;;OAEG;IACH,cAAc,IAAI,MAAM;IAIxB;;OAEG;IACG,WAAW,CAAC,EAChB,OAAO,EACP,KAAgB,EAChB,MAAM,GACP,EAAE;QACD,OAAO,EAAE,MAAM,CAAC;QAChB,KAAK,CAAC,EAAE,QAAQ,GAAG,QAAQ,CAAC;QAC5B,MAAM,CAAC,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC,IAAI,CAAC;IAoBjB,iBAAiB,IAAI,MAAM;IAK3B,gBAAgB,IAAI,OAAO;IAI3B;;;OAGG;IACG,yBAAyB,IAAI,OAAO,CAAC,eAAe,CAAC;IA2C3D;;;;OAIG;IACG,mBAAmB,IAAI,OAAO,CAAC,cAAc,EAAE,CAAC;YAuExC,uBAAuB;IAerC,kBAAkB,IAAI,MAAM,GAAG,IAAI;IAInC,aAAa,IAAI,MAAM;IAIvB,aAAa,CAAC,EAAE,UAAU,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAK3D,oBAAoB,IAAI,MAAM;IAIxB,mBAAmB,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;IAMxC,YAAY,CAAC,EAAE,KAAK,EAAE,GAAE;QAAE,KAAK,CAAC,EAAE,MAAM,CAAA;KAAO,GAAG,OAAO,CAAC,aAAa,CAAC;IA+F9E;;OAEG;IACH,IAAI,MAAM;mCAlGoB;YAAE,KAAK,CAAC,EAAE,MAAM,CAAA;SAAE,KAAQ,OAAO,CAAC,aAAa,CAAC;qCAgN7C;YAAE,QAAQ,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;gCA2BzC;YAAE,YAAY,CAAC,EAAE,OAAO,CAAA;SAAE,KAAG,OAAO,CAAC,aAAa,EAAE,CAAC;kCArGnD;YAAE,KAAK,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;qCA1BtB;YAAE,QAAQ,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;MAF5E;YAEa,YAAY;IA0BpB,YAAY,CAAC,EAAE,KAAK,EAAE,EAAE;QAAE,KAAK,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAYzD,WAAW,CAAC,EAChB,cAAc,EACd,KAAK,EACL,UAAU,GACX,GAAE;QACD,cAAc,CAAC,EAAE,MAAM,CAAC;QACxB,KAAK,CAAC,EAAE,MAAM,CAAC;QACf,UAAU,CAAC,EAAE,MAAM,CAAC;KAChB,GAAG,OAAO,CAAC,aAAa,CAAC;IAsDzB,YAAY,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IA2B/D,WAAW,CAAC,OAAO,CAAC,EAAE;QAAE,YAAY,CAAC,EAAE,OAAO,CAAA;KAAE,GAAG,OAAO,CAAC,aAAa,EAAE,CAAC;IAoB3E,gBAAgB,CAAC,EAAE,GAAG,EAAE,KAAK,EAAE,EAAE;QAAE,GAAG,EAAE,MAAM,CAAC;QAAC,KAAK,EAAE,OAAO,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;YAoBxE,mBAAmB;YAsBnB,kBAAkB;IA6FhC;;;;OAIG;IACG,cAAc,IAAI,OAAO,CAAC,IAAI,CAAC;IA+G/B,4BAA4B,IAAI,OAAO,CAAC,yBAAyB,GAAG,IAAI,CAAC;IAW/E;;OAEG;IACH,kBAAkB,IAAI,MAAM,GAAG,SAAS;IAIxC;;OAEG;IACH,mBAAmB,IAAI,MAAM,GAAG,SAAS;IAIzC;;OAEG;IACH,uBAAuB,IAAI,MAAM,GAAG,SAAS;IAI7C;;OAEG;IACH,sBAAsB,IAAI,MAAM,GAAG,SAAS;IAI5C;;OAEG;IACH,wBAAwB;IAMxB;;OAEG;IACH,yBAAyB;IAMzB;;OAEG;IACG,mBAAmB,CAAC,EAAE,OAAO,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAM1E;;OAEG;IACG,oBAAoB,CAAC,EAAE,OAAO,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAU3E,kBAAkB,CAAC,EAAE,SAAS,EAAE,GAAE;QAAE,SAAS,CAAC,EAAE,MAAM,CAAA;KAAO,GAAG,MAAM,GAAG,IAAI;IAUvE,kBAAkB,CAAC,EAAE,OAAO,EAAE,SAAS,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,SAAS,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAWxG,oBAAoB,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,YAAY,CAAA;KAAE,GAAG,IAAI;IAIpE,gBAAgB,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAI1D,gBAAgB,IAAI;QAAE,UAAU,EAAE,YAAY,EAAE,CAAC;QAAC,KAAK,EAAE,MAAM,EAAE,CAAA;KAAE;IAOnE,eAAe,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,YAAY,GAAG,IAAI;IAIxE,wBAAwB,CAAC,EAAE,QAAQ,EAAE,MAAM,EAAE,EAAE;QAAE,QAAQ,EAAE,YAAY,CAAC;QAAC,MAAM,EAAE,gBAAgB,CAAA;KAAE,GAAG,IAAI;IAM1G,oBAAoB,CAAC,EAAE,QAAQ,EAAE,MAAM,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAC;QAAC,MAAM,EAAE,gBAAgB,CAAA;KAAE,GAAG,IAAI;IAMhG,kBAAkB,IAAI,eAAe;IAMrC;;;;OAIG;IACH,OAAO,CAAC,mBAAmB;IAyB3B;;;OAGG;IACG,WAAW,CAAC,EAChB,OAAO,EACP,KAAK,EACL,cAAc,EACd,cAAc,EACd,cAAc,EAAE,mBAAmB,GACpC,EAAE;QACD,OAAO,EAAE,MAAM,CAAC;QAChB,KAAK,CAAC,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACtE,cAAc,CAAC,EAAE,cAAc,CAAC;QAChC,cAAc,CAAC,EAAE,cAAc,CAAC;QAChC,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,OAAO,CAAC,IAAI,CAAC;IA2GX,YAAY,CAAC,OAAO,CAAC,EAAE;QAAE,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,EAAE,CAAC;IAKrE,qBAAqB,CAAC,EAAE,QAAQ,EAAE,KAAK,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,EAAE,CAAC;IAmB3G,4BAA4B,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,GAAG,IAAI,CAAC;IAKhG,8BAA8B,CAAC,EAAE,SAAS,EAAE,EAAE;QAAE,SAAS,EAAE,MAAM,EAAE,CAAA;KAAE,GAAG,OAAO,CAAC,GAAG,CAAC,MAAM,EAAE,cAAc,CAAC,CAAC;IAuBlH,OAAO,CAAC,uBAAuB;IAwK/B;;OAEG;YACW,aAAa;IA2d3B;;OAEG;IACH,KAAK,IAAI,IAAI;IAUb;;OAEG;IACG,KAAK,CAAC,EAAE,OAAO,EAAE,cAAc,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,cAAc,CAAC,EAAE,cAAc,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAM7G;;OAEG;IACG,QAAQ,CAAC,EAAE,OAAO,EAAE,cAAc,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,cAAc,CAAC,EAAE,cAAc,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAShH,gBAAgB,IAAI,MAAM;IAI1B,SAAS,IAAI,OAAO;IAIpB,eAAe,IAAI,MAAM,GAAG,IAAI;IAQhC;;;OAGG;IACH,eAAe,IAAI,QAAQ,CAAC,mBAAmB,CAAC;IAIhD;;;OAGG;IACH,OAAO,CAAC,uBAAuB;IAiB/B;;;OAGG;IACH,qBAAqB,CAAC,EACpB,QAAQ,EACR,cAAc,GACf,EAAE;QACD,QAAQ,EAAE,SAAS,GAAG,SAAS,GAAG,uBAAuB,CAAC;QAC1D,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,IAAI;IAkBR;;;OAGG;IACG,uBAAuB,CAAC,EAC5B,UAAU,EACV,cAAc,GACf,EAAE;QACD,UAAU,EAAE,GAAG,CAAC;QAChB,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,OAAO,CAAC,IAAI,CAAC;IAwBjB;;;OAGG;IACH,gBAAgB,CAAC,EAAE,UAAU,EAAE,OAAO,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,CAAC,MAAM,EAAE,MAAM,KAAK,IAAI,CAAA;KAAE,GAAG,IAAI;IAI1G;;;OAGG;IACH,iBAAiB,CAAC,EAAE,UAAU,EAAE,MAAM,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAC;QAAC,MAAM,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAQvF;;;OAGG;IACH,oBAAoB,CAAC,EACnB,MAAM,EACN,OAAO,GACR,EAAE;QACD,MAAM,EAAE,MAAM,CAAC;QACf,OAAO,EAAE,CAAC,MAAM,EAAE;YAAE,MAAM,EAAE,UAAU,GAAG,UAAU,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,KAAK,IAAI,CAAC;KACnF,GAAG,IAAI;IAIR;;;;OAIG;IACG,qBAAqB,CAAC,EAC1B,MAAM,EACN,QAAQ,GACT,EAAE;QACD,MAAM,EAAE,MAAM,CAAC;QACf,QAAQ,EAAE;YAAE,MAAM,EAAE,UAAU,GAAG,UAAU,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC;KAClE,GAAG,OAAO,CAAC,IAAI,CAAC;YAeH,iBAAiB;YA+BjB,iBAAiB;YA8BjB,gBAAgB;IAsC9B;;OAEG;IACH,SAAS,CAAC,QAAQ,EAAE,oBAAoB,GAAG,MAAM,IAAI;IAUrD,OAAO,CAAC,IAAI;IAiBZ,OAAO,CAAC,mBAAmB;IAa3B;;;;OAIG;IACH,OAAO,CAAC,uBAAuB;IAuY/B;;;;OAIG;YACW,aAAa;IA0C3B;;;OAGG;YACW,mBAAmB;IA8BjC;;OAEG;YACW,aAAa;IAoB3B,aAAa,IAAI;QAAE,YAAY,EAAE,MAAM,CAAC;QAAC,gBAAgB,EAAE,MAAM,CAAC;QAAC,WAAW,EAAE,MAAM,CAAA;KAAE;YAI1E,iBAAiB;IAwB/B,YAAY,IAAI,SAAS,GAAG,SAAS;IAIrC;;;;OAIG;IACG,gBAAgB,CAAC,EACrB,cAAc,GACf,GAAE;QACD,cAAc,CAAC,EAAE,cAAc,CAAC;KAC5B,GAAG,OAAO,CAAC,SAAS,GAAG,SAAS,CAAC;IAUvC,YAAY,IAAI,OAAO;IAIvB,gBAAgB,IAAI,OAAO;IAKrB,gBAAgB,IAAI,OAAO,CAAC,IAAI,CAAC;IAmBvC,OAAO,CAAC,eAAe;IAyBvB,iBAAiB,CAAC,OAAO,EAAE,gBAAgB,GAAG,IAAI;IAoB5C,eAAe,CAAC,EAAE,EAAE,EAAE,EAAE;QAAE,EAAE,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAatD,cAAc,IAAI,OAAO,CAAC,IAAI,CAAC;IAkB/B,OAAO,IAAI,OAAO,CAAC,IAAI,CAAC;IASxB,UAAU,IAAI,OAAO,CAAC,cAAc,CAAC;IAY3C,OAAO,CAAC,UAAU;CAMnB"}
+{"version":3,"file":"harness.d.ts","sourceRoot":"","sources":["../../src/harness/harness.ts"],"names":[],"mappings":"AAKA,OAAO,KAAK,EAAE,cAAc,EAAE,cAAc,EAAE,MAAM,kBAAkB,CAAC;AACvE,OAAO,EAAE,cAAc,EAAE,MAAM,oBAAoB,CAAC;AAIpD,OAAO,KAAK,EAAE,yBAAyB,EAAE,MAAM,kBAAkB,CAAC;AAElE,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAC;AAKnD,OAAO,KAAK,EACV,cAAc,EACd,gBAAgB,EAChB,aAAa,EACb,mBAAmB,EAEnB,oBAAoB,EACpB,cAAc,EAEd,WAAW,EAEX,cAAc,EACd,aAAa,EACb,eAAe,EACf,gBAAgB,EAChB,eAAe,EACf,YAAY,EACb,MAAM,SAAS,CAAC;AAEjB;;;;;;;;;;;;;;;;;;;;;;;;;GAyBG;AACH,qBAAa,OAAO,CAAC,MAAM,GAAG,EAAE;;IAC9B,QAAQ,CAAC,EAAE,EAAE,MAAM,CAAC;IAEpB,OAAO,CAAC,MAAM,CAAwB;IACtC,OAAO,CAAC,WAAW,CAAqC;IACxD,OAAO,CAAC,KAAK,CAAS;IACtB,OAAO,CAAC,aAAa,CAAS;IAC9B,OAAO,CAAC,eAAe,CAAuB;IAC9C,OAAO,CAAC,UAAU,CAAS;IAC3B,OAAO,CAAC,iBAAiB,CAAS;IAClC,OAAO,CAAC,SAAS,CAA8B;IAC/C,OAAO,CAAC,eAAe,CAAgC;IACvD,OAAO,CAAC,cAAc,CAAkB;IACxC,OAAO,CAAC,YAAY,CAAuB;IAC3C,OAAO,CAAC,kBAAkB,CAAa;IACvC,OAAO,CAAC,aAAa,CAAmE;IACxF,OAAO,CAAC,sBAAsB,CAEd;IAChB,OAAO,CAAC,uBAAuB,CAAuB;IACtD,OAAO,CAAC,sBAAsB,CAAuB;IACrD,OAAO,CAAC,2BAA2B,CAAuB;IAC1D,OAAO,CAAC,gBAAgB,CAA+C;IACvE,OAAO,CAAC,oBAAoB,CAGxB;IACJ,OAAO,CAAC,SAAS,CAAoC;IACrD,OAAO,CAAC,WAAW,CAEO;IAC1B,OAAO,CAAC,oBAAoB,CAAS;IACrC,OAAO,CAAC,eAAe,CAAuF;IAC9G,OAAO,CAAC,UAAU,CAIhB;IACF,OAAO,CAAC,wBAAwB,CAAqB;IACrD,OAAO,CAAC,mBAAmB,CAAqB;IAChD,OAAO,CAAC,YAAY,CAA8C;gBAGtD,MAAM,EAAE,aAAa,CAAC,MAAM,CAAC;IAwCzC;;;OAGG;IACG,IAAI,IAAI,OAAO,CAAC,IAAI,CAAC;IA4D3B;;OAEG;IACG,oBAAoB,IAAI,OAAO,CAAC,aAAa,CAAC;YAgBtC,gBAAgB;IAe9B;;OAEG;IACH,QAAQ,IAAI,QAAQ,CAAC,MAAM,CAAC;IAI5B;;;OAGG;IACG,QAAQ,CAAC,OAAO,EAAE,OAAO,CAAC,MAAM,CAAC,GAAG,OAAO,CAAC,IAAI,CAAC;IAkBvD,OAAO,CAAC,iBAAiB;IA4BzB,SAAS,IAAI,WAAW,CAAC,MAAM,CAAC,EAAE;IAIlC,gBAAgB,IAAI,MAAM;IAI1B,cAAc,IAAI,WAAW,CAAC,MAAM,CAAC;IAQrC;;;OAGG;IACG,UAAU,CAAC,EAAE,MAAM,EAAE,EAAE;QAAE,MAAM,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IA6B/D;;;OAGG;YACW,eAAe;IAmB7B;;OAEG;IACH,OAAO,CAAC,eAAe;IAQvB;;OAEG;IACH,YAAY,IAAI,MAAM;IAOtB;;OAEG;IACH,cAAc,IAAI,MAAM;IAIxB;;OAEG;IACG,WAAW,CAAC,EAChB,OAAO,EACP,KAAgB,EAChB,MAAM,GACP,EAAE;QACD,OAAO,EAAE,MAAM,CAAC;QAChB,KAAK,CAAC,EAAE,QAAQ,GAAG,QAAQ,CAAC;QAC5B,MAAM,CAAC,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC,IAAI,CAAC;IAoBjB,iBAAiB,IAAI,MAAM;IAK3B,gBAAgB,IAAI,OAAO;IAI3B;;;OAGG;IACG,yBAAyB,IAAI,OAAO,CAAC,eAAe,CAAC;IA2C3D;;;;OAIG;IACG,mBAAmB,IAAI,OAAO,CAAC,cAAc,EAAE,CAAC;YAuExC,uBAAuB;IAerC,kBAAkB,IAAI,MAAM,GAAG,IAAI;IAInC,aAAa,IAAI,MAAM;IAIvB,aAAa,CAAC,EAAE,UAAU,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAK3D,oBAAoB,IAAI,MAAM;IAIxB,mBAAmB,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;IAMxC,YAAY,CAAC,EAAE,KAAK,EAAE,GAAE;QAAE,KAAK,CAAC,EAAE,MAAM,CAAA;KAAO,GAAG,OAAO,CAAC,aAAa,CAAC;IA+F9E;;OAEG;IACH,IAAI,MAAM;mCAlGoB;YAAE,KAAK,CAAC,EAAE,MAAM,CAAA;SAAE,KAAQ,OAAO,CAAC,aAAa,CAAC;qCAgN7C;YAAE,QAAQ,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;gCA2BzC;YAAE,YAAY,CAAC,EAAE,OAAO,CAAA;SAAE,KAAG,OAAO,CAAC,aAAa,EAAE,CAAC;kCArGnD;YAAE,KAAK,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;qCA1BtB;YAAE,QAAQ,EAAE,MAAM,CAAA;SAAE,KAAG,OAAO,CAAC,IAAI,CAAC;MAF5E;YAEa,YAAY;IA0BpB,YAAY,CAAC,EAAE,KAAK,EAAE,EAAE;QAAE,KAAK,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAYzD,WAAW,CAAC,EAChB,cAAc,EACd,KAAK,EACL,UAAU,GACX,GAAE;QACD,cAAc,CAAC,EAAE,MAAM,CAAC;QACxB,KAAK,CAAC,EAAE,MAAM,CAAC;QACf,UAAU,CAAC,EAAE,MAAM,CAAC;KAChB,GAAG,OAAO,CAAC,aAAa,CAAC;IAsDzB,YAAY,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IA2B/D,WAAW,CAAC,OAAO,CAAC,EAAE;QAAE,YAAY,CAAC,EAAE,OAAO,CAAA;KAAE,GAAG,OAAO,CAAC,aAAa,EAAE,CAAC;IAoB3E,gBAAgB,CAAC,EAAE,GAAG,EAAE,KAAK,EAAE,EAAE;QAAE,GAAG,EAAE,MAAM,CAAC;QAAC,KAAK,EAAE,OAAO,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;YAoBxE,mBAAmB;YAsBnB,kBAAkB;IA6FhC;;;;OAIG;IACG,cAAc,IAAI,OAAO,CAAC,IAAI,CAAC;IA+G/B,4BAA4B,IAAI,OAAO,CAAC,yBAAyB,GAAG,IAAI,CAAC;IAW/E;;OAEG;IACH,kBAAkB,IAAI,MAAM,GAAG,SAAS;IAIxC;;OAEG;IACH,mBAAmB,IAAI,MAAM,GAAG,SAAS;IAIzC;;OAEG;IACH,uBAAuB,IAAI,MAAM,GAAG,SAAS;IAI7C;;OAEG;IACH,sBAAsB,IAAI,MAAM,GAAG,SAAS;IAI5C;;OAEG;IACH,wBAAwB;IAMxB;;OAEG;IACH,yBAAyB;IAMzB;;OAEG;IACG,mBAAmB,CAAC,EAAE,OAAO,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAM1E;;OAEG;IACG,oBAAoB,CAAC,EAAE,OAAO,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAU3E,kBAAkB,CAAC,EAAE,SAAS,EAAE,GAAE;QAAE,SAAS,CAAC,EAAE,MAAM,CAAA;KAAO,GAAG,MAAM,GAAG,IAAI;IAUvE,kBAAkB,CAAC,EAAE,OAAO,EAAE,SAAS,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,SAAS,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAWxG,oBAAoB,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,YAAY,CAAA;KAAE,GAAG,IAAI;IAIpE,gBAAgB,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAI1D,gBAAgB,IAAI;QAAE,UAAU,EAAE,YAAY,EAAE,CAAC;QAAC,KAAK,EAAE,MAAM,EAAE,CAAA;KAAE;IAOnE,eAAe,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,YAAY,GAAG,IAAI;IAIxE,wBAAwB,CAAC,EAAE,QAAQ,EAAE,MAAM,EAAE,EAAE;QAAE,QAAQ,EAAE,YAAY,CAAC;QAAC,MAAM,EAAE,gBAAgB,CAAA;KAAE,GAAG,IAAI;IAM1G,oBAAoB,CAAC,EAAE,QAAQ,EAAE,MAAM,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAC;QAAC,MAAM,EAAE,gBAAgB,CAAA;KAAE,GAAG,IAAI;IAMhG,kBAAkB,IAAI,eAAe;IAMrC;;;;OAIG;IACH,OAAO,CAAC,mBAAmB;IAyB3B;;;OAGG;IACG,WAAW,CAAC,EAChB,OAAO,EACP,KAAK,EACL,cAAc,EACd,cAAc,EACd,cAAc,EAAE,mBAAmB,GACpC,EAAE;QACD,OAAO,EAAE,MAAM,CAAC;QAChB,KAAK,CAAC,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACtE,cAAc,CAAC,EAAE,cAAc,CAAC;QAChC,cAAc,CAAC,EAAE,cAAc,CAAC;QAChC,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,OAAO,CAAC,IAAI,CAAC;IA2GX,YAAY,CAAC,OAAO,CAAC,EAAE;QAAE,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,EAAE,CAAC;IAKrE,qBAAqB,CAAC,EAAE,QAAQ,EAAE,KAAK,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAC;QAAC,KAAK,CAAC,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,EAAE,CAAC;IAmB3G,4BAA4B,CAAC,EAAE,QAAQ,EAAE,EAAE;QAAE,QAAQ,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,cAAc,GAAG,IAAI,CAAC;IAKhG,8BAA8B,CAAC,EAAE,SAAS,EAAE,EAAE;QAAE,SAAS,EAAE,MAAM,EAAE,CAAA;KAAE,GAAG,OAAO,CAAC,GAAG,CAAC,MAAM,EAAE,cAAc,CAAC,CAAC;IAuBlH,OAAO,CAAC,uBAAuB;IAwK/B;;OAEG;YACW,aAAa;IA2d3B;;OAEG;IACH,KAAK,IAAI,IAAI;IAUb;;OAEG;IACG,KAAK,CAAC,EAAE,OAAO,EAAE,cAAc,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,cAAc,CAAC,EAAE,cAAc,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAM7G;;OAEG;IACG,QAAQ,CAAC,EAAE,OAAO,EAAE,cAAc,EAAE,EAAE;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,cAAc,CAAC,EAAE,cAAc,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAShH,gBAAgB,IAAI,MAAM;IAI1B,SAAS,IAAI,OAAO;IAIpB,eAAe,IAAI,MAAM,GAAG,IAAI;IAQhC;;;OAGG;IACH,eAAe,IAAI,QAAQ,CAAC,mBAAmB,CAAC;IAIhD;;;OAGG;IACH,OAAO,CAAC,uBAAuB;IAiB/B;;;OAGG;IACH,qBAAqB,CAAC,EACpB,QAAQ,EACR,cAAc,GACf,EAAE;QACD,QAAQ,EAAE,SAAS,GAAG,SAAS,GAAG,uBAAuB,CAAC;QAC1D,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,IAAI;IAkBR;;;OAGG;IACG,uBAAuB,CAAC,EAC5B,UAAU,EACV,cAAc,GACf,EAAE;QACD,UAAU,EAAE,GAAG,CAAC;QAChB,cAAc,CAAC,EAAE,cAAc,CAAC;KACjC,GAAG,OAAO,CAAC,IAAI,CAAC;IAwBjB;;;OAGG;IACH,gBAAgB,CAAC,EAAE,UAAU,EAAE,OAAO,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,CAAC,MAAM,EAAE,MAAM,KAAK,IAAI,CAAA;KAAE,GAAG,IAAI;IAI1G;;;OAGG;IACH,iBAAiB,CAAC,EAAE,UAAU,EAAE,MAAM,EAAE,EAAE;QAAE,UAAU,EAAE,MAAM,CAAC;QAAC,MAAM,EAAE,MAAM,CAAA;KAAE,GAAG,IAAI;IAQvF;;;OAGG;IACH,oBAAoB,CAAC,EACnB,MAAM,EACN,OAAO,GACR,EAAE;QACD,MAAM,EAAE,MAAM,CAAC;QACf,OAAO,EAAE,CAAC,MAAM,EAAE;YAAE,MAAM,EAAE,UAAU,GAAG,UAAU,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,KAAK,IAAI,CAAC;KACnF,GAAG,IAAI;IAIR;;;;OAIG;IACG,qBAAqB,CAAC,EAC1B,MAAM,EACN,QAAQ,GACT,EAAE;QACD,MAAM,EAAE,MAAM,CAAC;QACf,QAAQ,EAAE;YAAE,MAAM,EAAE,UAAU,GAAG,UAAU,CAAC;YAAC,QAAQ,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC;KAClE,GAAG,OAAO,CAAC,IAAI,CAAC;YAeH,iBAAiB;YA+BjB,iBAAiB;YA8BjB,gBAAgB;IAsC9B;;OAEG;IACH,SAAS,CAAC,QAAQ,EAAE,oBAAoB,GAAG,MAAM,IAAI;IAUrD,OAAO,CAAC,IAAI;IAiBZ,OAAO,CAAC,mBAAmB;IAa3B;;;;OAIG;IACH,OAAO,CAAC,uBAAuB;IAuY/B;;;;OAIG;YACW,aAAa;IA0C3B;;;OAGG;YACW,mBAAmB;IA8BjC;;OAEG;YACW,aAAa;IAoB3B,aAAa,IAAI;QAAE,YAAY,EAAE,MAAM,CAAC;QAAC,gBAAgB,EAAE,MAAM,CAAC;QAAC,WAAW,EAAE,MAAM,CAAA;KAAE;YAI1E,iBAAiB;IAwB/B,YAAY,IAAI,SAAS,GAAG,SAAS;IAIrC;;;;OAIG;IACG,gBAAgB,CAAC,EACrB,cAAc,GACf,GAAE;QACD,cAAc,CAAC,EAAE,cAAc,CAAC;KAC5B,GAAG,OAAO,CAAC,SAAS,GAAG,SAAS,CAAC;IAUvC,YAAY,IAAI,OAAO;IAIvB,gBAAgB,IAAI,OAAO;IAKrB,gBAAgB,IAAI,OAAO,CAAC,IAAI,CAAC;IAmBvC,OAAO,CAAC,eAAe;IAyBvB,iBAAiB,CAAC,OAAO,EAAE,gBAAgB,GAAG,IAAI;IAoB5C,eAAe,CAAC,EAAE,EAAE,EAAE,EAAE;QAAE,EAAE,EAAE,MAAM,CAAA;KAAE,GAAG,OAAO,CAAC,IAAI,CAAC;IAatD,cAAc,IAAI,OAAO,CAAC,IAAI,CAAC;IAkB/B,OAAO,IAAI,OAAO,CAAC,IAAI,CAAC;IASxB,UAAU,IAAI,OAAO,CAAC,cAAc,CAAC;IAY3C,OAAO,CAAC,UAAU;CAMnB"}