@mastra/core 1.6.0 → 1.7.0-alpha.0

package/dist/docs/references/docs-evals-running-in-ci.md

@@ -1,106 +0,0 @@
-# Running Scorers in CI
-
-Running scorers in your CI pipeline provides quantifiable metrics for measuring agent quality over time. The `runEvals` function processes multiple test cases through your agent or workflow and returns aggregate scores.
-
-## Basic Setup
-
-You can use any testing framework that supports ESM modules, such as [Vitest](https://vitest.dev/), [Jest](https://jestjs.io/), or [Mocha](https://mochajs.org/).
-
-## Creating Test Cases
-
-Use `runEvals` to evaluate your agent against multiple test cases. The function accepts an array of data items, each containing an `input` and optional `groundTruth` for scorer validation.
-
-```typescript
-import { describe, it, expect } from 'vitest';
-import { createScorer, runEvals } from "@mastra/core/evals";
-import { weatherAgent } from "./weather-agent";
-import { locationScorer } from "../scorers/location-scorer";
-
-describe('Weather Agent Tests', () => {
-  it('should correctly extract locations from queries', async () => {
-    const result = await runEvals({
-      data: [
-        {
-          input: 'weather in Berlin',
-          groundTruth: { expectedLocation: 'Berlin', expectedCountry: 'DE' }
-        },
-        {
-          input: 'weather in Berlin, Maryland',
-          groundTruth: { expectedLocation: 'Berlin', expectedCountry: 'US' }
-        },
-        {
-          input: 'weather in Berlin, Russia',
-          groundTruth: { expectedLocation: 'Berlin', expectedCountry: 'RU' }
-        },
-      ],
-      target: weatherAgent,
-      scorers: [locationScorer]
-    });
-
-    // Assert aggregate score meets threshold
-    expect(result.scores['location-accuracy']).toBe(1);
-    expect(result.summary.totalItems).toBe(3);
-  });
-});
-```
-
-## Understanding Results
-
-The `runEvals` function returns an object with:
-
-- `scores`: Average scores for each scorer across all test cases
-- `summary.totalItems`: Total number of test cases processed
-
-```typescript
-{
-  scores: {
-    'location-accuracy': 1.0,  // Average score across all items
-    'another-scorer': 0.85
-  },
-  summary: {
-    totalItems: 3
-  }
-}
-```
-
-## Multiple Test Scenarios
-
-Create separate test cases for different evaluation scenarios:
-
-```typescript
-describe('Weather Agent Tests', () => {
-  const locationScorer = createScorer({ /* ... */ });
-
-  it('should handle location disambiguation', async () => {
-    const result = await runEvals({
-      data: [
-        { input: 'weather in Berlin', groundTruth: { /* ... */ } },
-        { input: 'weather in Berlin, Maryland', groundTruth: { /* ... */ } },
-      ],
-      target: weatherAgent,
-      scorers: [locationScorer]
-    });
-
-    expect(result.scores['location-accuracy']).toBe(1);
-  });
-
-  it('should handle typos and misspellings', async () => {
-    const result = await runEvals({
-      data: [
-        { input: 'weather in Berln', groundTruth: { expectedLocation: 'Berlin', expectedCountry: 'DE' } },
-        { input: 'weather in Parris', groundTruth: { expectedLocation: 'Paris', expectedCountry: 'FR' } },
-      ],
-      target: weatherAgent,
-      scorers: [locationScorer]
-    });
-
-    expect(result.scores['location-accuracy']).toBe(1);
-  });
-});
-```
-
-## Next Steps
-
-- Learn about [creating custom scorers](https://mastra.ai/docs/evals/custom-scorers)
-- Explore [built-in scorers](https://mastra.ai/docs/evals/built-in-scorers)
-- Read the [runEvals API reference](https://mastra.ai/reference/evals/run-evals)

package/dist/docs/references/docs-mcp-overview.md

@@ -1,370 +0,0 @@
-# MCP Overview
-
-Mastra supports the [Model Context Protocol (MCP)](https://modelcontextprotocol.io/introduction), an open standard for connecting AI agents to external tools and resources. It serves as a universal plugin system, enabling agents to call tools regardless of language or hosting environment.
-
-Mastra can also be used to author MCP servers, exposing agents, tools, and other structured resources via the MCP interface. These can then be accessed by any system or agent that supports the protocol.
-
-Mastra currently supports two MCP classes:
-
-1. `MCPClient`: Connects to one or many MCP servers to access their tools, resources, prompts, and handle elicitation requests.
-2. `MCPServer`: Exposes Mastra tools, agents, workflows, prompts, and resources to MCP-compatible clients.
-
-## Getting started
-
-To use MCP, install the required dependency:
-
-**npm**:
-
-```bash
-npm install @mastra/mcp@latest
-```
-
-**pnpm**:
-
-```bash
-pnpm add @mastra/mcp@latest
-```
-
-**Yarn**:
-
-```bash
-yarn add @mastra/mcp@latest
-```
-
-**Bun**:
-
-```bash
-bun add @mastra/mcp@latest
-```
-
-## Configuring `MCPClient`
-
-The `MCPClient` connects Mastra primitives to external MCP servers, which can be local packages (invoked using `npx`) or remote HTTP(S) endpoints. Each server must be configured with either a `command` or a `url`, depending on how it's hosted.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-
-export const testMcpClient = new MCPClient({
-  id: "test-mcp-client",
-  servers: {
-    wikipedia: {
-      command: "npx",
-      args: ["-y", "wikipedia-mcp"],
-    },
-    weather: {
-      url: new URL(
-        `https://server.smithery.ai/@smithery-ai/national-weather-service/mcp?api_key=${process.env.SMITHERY_API_KEY}`,
-      ),
-    },
-  },
-});
-```
-
-> **Info:** Visit [MCPClient](https://mastra.ai/reference/tools/mcp-client) for a full list of configuration options.
-
-> **Authentication:** For connecting to OAuth-protected MCP servers, see the [OAuth Authentication](https://mastra.ai/reference/tools/mcp-client) section.
-
-## Using `MCPClient` with an agent
-
-To use tools from an MCP server in an agent, import your `MCPClient` and call `.listTools()` in the `tools` parameter. This loads from the defined MCP servers, making them available to the agent.
-
-```typescript
-import { Agent } from "@mastra/core/agent";
-import { testMcpClient } from "../mcp/test-mcp-client";
-
-export const testAgent = new Agent({
-  id: "test-agent",
-  name: "Test Agent",
-  description: "You are a helpful AI assistant",
-  instructions: `
-      You are a helpful assistant that has access to the following MCP Servers.
-      - Wikipedia MCP Server
-      - US National Weather Service
-
-      Answer questions using the information you find using the MCP Servers.`,
-  model: "openai/gpt-5.1",
-  tools: await testMcpClient.listTools(),
-});
-```
-
-> **Info:** Visit [Agent Class](https://mastra.ai/reference/agents/agent) for a full list of configuration options.
-
-## Configuring `MCPServer`
-
-To expose agents, tools, and workflows from your Mastra application to external systems over HTTP(S) use the `MCPServer` class. This makes them accessible to any system or agent that supports the protocol.
-
-```typescript
-import { MCPServer } from "@mastra/mcp";
-
-import { testAgent } from "../agents/test-agent";
-import { testWorkflow } from "../workflows/test-workflow";
-import { testTool } from "../tools/test-tool";
-
-export const testMcpServer = new MCPServer({
-  id: "test-mcp-server",
-  name: "Test Server",
-  version: "1.0.0",
-  agents: { testAgent },
-  tools: { testTool },
-  workflows: { testWorkflow },
-});
-```
-
-> **Info:** Visit [MCPServer](https://mastra.ai/reference/tools/mcp-server) for a full list of configuration options.
-
-> **Authentication:** To protect your MCP server with OAuth, see the [OAuth Protection](https://mastra.ai/reference/tools/mcp-server) section.
-
-## Registering an `MCPServer`
-
-To make an MCP server available to other systems or agents that support the protocol, register it in the main `Mastra` instance using `mcpServers`.
-
-```typescript
-import { Mastra } from "@mastra/core/mastra";
-
-import { testMcpServer } from "./mcp/test-mcp-server";
-
-export const mastra = new Mastra({
-  mcpServers: { testMcpServer },
-});
-```
-
-## Static and dynamic tools
-
-`MCPClient` offers two approaches to retrieving tools from connected servers, suitable for different application architectures:
-
-| Feature           | Static Configuration (`await mcp.listTools()`) | Dynamic Configuration (`await mcp.listToolsets()`)   |
-| ----------------- | ---------------------------------------------- | ---------------------------------------------------- |
-| **Use Case**      | Single-user, static config (e.g., CLI tool)    | Multi-user, dynamic config (e.g., SaaS app)          |
-| **Configuration** | Fixed at agent initialization                  | Per-request, dynamic                                 |
-| **Credentials**   | Shared across all uses                         | Can vary per user/request                            |
-| **Agent Setup**   | Tools added in `Agent` constructor             | Tools passed in `.generate()` or `.stream()` options |
-
-### Static tools
-
-Use the `.listTools()` method to fetch tools from all configured MCP servers. This is suitable when configuration (such as API keys) is static and consistent across users or requests. Call it once and pass the result to the `tools` property when defining your agent.
-
-> **Info:** Visit [listTools()](https://mastra.ai/reference/tools/mcp-client) for more information.
-
-```typescript
-import { Agent } from "@mastra/core/agent";
-
-import { testMcpClient } from "../mcp/test-mcp-client";
-
-export const testAgent = new Agent({
-  id: "test-agent",
-  tools: await testMcpClient.listTools(),
-});
-```
-
-### Dynamic tools
-
-Use the `.listToolsets()` method when tool configuration may vary by request or user, such as in a multi-tenant system where each user provides their own API key. This method returns toolsets that can be passed to the `toolsets` option in the agent's `.generate()` or `.stream()` calls.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-import { mastra } from "./mastra";
-
-async function handleRequest(userPrompt: string, userApiKey: string) {
-  const userMcp = new MCPClient({
-    servers: {
-      weather: {
-        url: new URL("http://localhost:8080/mcp"),
-        requestInit: {
-          headers: {
-            Authorization: `Bearer ${userApiKey}`,
-          },
-        },
-      },
-    },
-  });
-
-  const agent = mastra.getAgent("testAgent");
-
-  const response = await agent.generate(userPrompt, {
-    toolsets: await userMcp.listToolsets(),
-  });
-
-  await userMcp.disconnect();
-
-  return Response.json({
-    data: response.text,
-  });
-}
-```
-
-> **Info:** Visit [listToolsets()](https://mastra.ai/reference/tools/mcp-client) for more information.
-
-## Connecting to an MCP registry
-
-MCP servers can be discovered through registries. Here's how to connect to some popular ones using `MCPClient`:
-
-**Klavis AI**:
-
-[Klavis AI](https://klavis.ai) provides hosted, enterprise-authenticated, high-quality MCP servers.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    salesforce: {
-      url: new URL("https://salesforce-mcp-server.klavis.ai/mcp/?instance_id={private-instance-id}"),
-    },
-    hubspot: {
-      url: new URL("https://hubspot-mcp-server.klavis.ai/mcp/?instance_id={private-instance-id}"),
-    },
-  },
-});
-```
-
-Klavis AI offers enterprise-grade authentication and security for production deployments.
-
-For more details on how to integrate Mastra with Klavis, check out their [documentation](https://docs.klavis.ai/documentation/ai-platform-integration/mastra).
-
-**mcp.run**:
-
-[mcp.run](https://www.mcp.run/) provides pre-authenticated, managed MCP servers. Tools are grouped into Profiles, each with a unique, signed URL.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    marketing: { // Example profile name
-      url: new URL(process.env.MCP_RUN_SSE_URL!), // Get URL from mcp.run profile
-    },
-  },
-});
-```
-
-> **Important:** Treat the mcp.run SSE URL like a password. Store it securely, for example, in an environment variable.
->
-> ```bash
-> MCP_RUN_SSE_URL=https://www.mcp.run/api/mcp/sse?nonce=...
-> ```
-
-**Composio.dev**:
-
-[Composio.dev](https://composio.dev) offers a registry of [SSE-based MCP servers](https://mcp.composio.dev). You can use the SSE URL generated for tools like Cursor directly.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    googleSheets: {
-      url: new URL("https://mcp.composio.dev/googlesheets/[private-url-path]"),
-    },
-    gmail: {
-      url: new URL("https://mcp.composio.dev/gmail/[private-url-path]"),
-    },
-  },
-});
-```
-
-Authentication with services like Google Sheets often happens interactively through the agent conversation.
-
-_Note: Composio URLs are typically tied to a single user account, making them best suited for personal automation rather than multi-tenant applications._
-
-**Smithery.ai**:
-
-[Smithery.ai](https://smithery.ai) provides a registry accessible via their CLI.
-
-```typescript
-// Unix/Mac
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    sequentialThinking: {
-      command: "npx",
-      args: [
-        "-y",
-        "@smithery/cli@latest",
-        "run",
-        "@smithery-ai/server-sequential-thinking",
-        "--config",
-        "{}",
-      ],
-    },
-  },
-});
-```
-
-```typescript
-// Windows
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    sequentialThinking: {
-      command: "npx",
-      args: [
-        "-y",
-        "@smithery/cli@latest",
-        "run",
-        "@smithery-ai/server-sequential-thinking",
-        "--config",
-        "{}",
-      ],
-    },
-  },
-});
-```
-
-**Ampersand**:
-
-[Ampersand](https://withampersand.com?utm_source=mastra-docs) offers an [MCP Server](https://docs.withampersand.com/mcp) that allows you to connect your agent to 150+ integrations with SaaS products like Salesforce, Hubspot, and Zendesk.
-
-```typescript
-// MCPClient with Ampersand MCP Server using SSE
-export const mcp = new MCPClient({
-  servers: {
-    "@amp-labs/mcp-server": {
-      url: `https://mcp.withampersand.com/v1/sse?${new URLSearchParams({
-        apiKey: process.env.AMPERSAND_API_KEY,
-        project: process.env.AMPERSAND_PROJECT_ID,
-        integrationName: process.env.AMPERSAND_INTEGRATION_NAME,
-        groupRef: process.env.AMPERSAND_GROUP_REF,
-      })}`,
-    },
-  },
-});
-```
-
-```typescript
-// If you prefer to run the MCP server locally:
-import { MCPClient } from "@mastra/mcp";
-
-// MCPClient with Ampersand MCP Server using stdio transport
-export const mcp = new MCPClient({
-  servers: {
-    "@amp-labs/mcp-server": {
-      command: "npx",
-      args: [
-        "-y",
-        "@amp-labs/mcp-server@latest",
-        "--transport",
-        "stdio",
-        "--project",
-        process.env.AMPERSAND_PROJECT_ID,
-        "--integrationName",
-        process.env.AMPERSAND_INTEGRATION_NAME,
-        "--groupRef",
-        process.env.AMPERSAND_GROUP_REF, // optional
-      ],
-      env: {
-        AMPERSAND_API_KEY: process.env.AMPERSAND_API_KEY,
-      },
-    },
-  },
-});
-```
-
-As an alternative to MCP, Ampersand's AI SDK also has an adapter for Mastra, so you can [directly import Ampersand tools](https://docs.withampersand.com/ai-sdk#use-with-mastra) for your agent to access.
-
-## Related
-
-- [Using Tools](https://mastra.ai/docs/agents/using-tools)
-- [MCPClient](https://mastra.ai/reference/tools/mcp-client)
-- [MCPServer](https://mastra.ai/reference/tools/mcp-server)

package/dist/docs/references/docs-mcp-publishing-mcp-server.md

@@ -1,95 +0,0 @@
-# Publishing an MCP Server
-
-This example guides you through setting up a basic Mastra MCPServer using the stdio transport, building it, and preparing it for publishing to NPM.
-
-## Install dependencies
-
-Install the necessary packages:
-
-```bash
-pnpm add @mastra/mcp @mastra/core tsup
-```
-
-## Setting up an MCP Server
-
-1. Create a file for your stdio server, for example, `/src/mastra/stdio.ts`.
-
-2. Add the following code to the file. Remember to import your actual Mastra tools and name the server appropriately.
-
-   ```typescript
-   #!/usr/bin/env node
-   import { MCPServer } from "@mastra/mcp";
-   import { weatherTool } from "./tools";
-
-   const server = new MCPServer({
-     name: "my-mcp-server",
-     version: "1.0.0",
-     tools: { weatherTool },
-   });
-
-   server.startStdio().catch((error) => {
-     console.error("Error running MCP server:", error);
-     process.exit(1);
-   });
-   ```
-
-3. Update your `package.json` to include the `bin` entry pointing to your built server file and a script to build the server with both ESM and CJS outputs.
-
-   ```json
-   {
-     "bin": "dist/stdio.mjs",
-     "scripts": {
-       "build:mcp": "tsup src/mastra/stdio.ts --format esm,cjs --no-splitting --dts && echo '#!/usr/bin/env node' | cat - dist/stdio.mjs > temp && mv temp dist/stdio.mjs && chmod +x dist/stdio.mjs"
-     }
-   }
-   ```
-
-   The build command generates both ESM (`.mjs`) and CJS (`.cjs`) outputs for maximum compatibility. The shebang (`#!/usr/bin/env node`) is prepended to the ESM artifact to make it directly executable, and the `bin` entry points to this file.
-
-4. Run the build command:
-
-   ```bash
-   pnpm run build:mcp
-   ```
-
-   This will compile your server code into both ESM and CJS formats and make the ESM output file executable. On Unix-like systems, the `chmod +x` step makes the file directly executable. Windows users may need to use WSL or handle execution through Node.js directly.
-
-## Publishing to NPM
-
-To make your MCP server available for others (or yourself) to use via `npx` or as a dependency, you can publish it to NPM.
-
-1. Ensure you have an NPM account and are logged in (`npm login`).
-
-2. Make sure your package name in `package.json` is unique and available.
-
-3. Run the publish command from your project root after building:
-
-   ```bash
-   npm publish --access public
-   ```
-
-   For more details on publishing packages, refer to the [NPM documentation](https://docs.npmjs.com/creating-and-publishing-scoped-public-packages).
-
-## Using a published MCP Server
-
-Once published, your MCP server can be used by an `MCPClient` by specifying the command to run your package. You can also use any other MCP client like Claude desktop, Cursor, or Windsurf.
-
-```typescript
-import { MCPClient } from "@mastra/mcp";
-
-const mcp = new MCPClient({
-  servers: {
-    // Give this MCP server instance a name
-    yourServerName: {
-      command: "npx",
-      args: ["-y", "@your-org-name/your-package-name@latest"], // Replace with your package name
-    },
-  },
-});
-
-// You can then get tools or toolsets from this configuration to use in your agent
-const tools = await mcp.listTools();
-const toolsets = await mcp.listToolsets();
-```
-
-Note: If you published without an organization scope, the `args` might just be `["-y", "your-package-name@latest"]`.