@mastra/mcp-docs-server 1.1.35-alpha.8 → 1.1.35

package/.docs/reference/storage/dsql.md

@@ -0,0 +1,428 @@
+# Aurora DSQL Storage
+
+The Aurora DSQL storage implementation provides storage using Amazon Aurora DSQL with IAM authentication.
+
+Aurora DSQL does not support PostgreSQL extensions (`CREATE EXTENSION`), including `pgvector`. For vector storage, use a separate vector store such as `@mastra/s3vectors`.
+
+## Installation
+
+```bash
+npm install @mastra/dsql@beta
+```
+
+## Prerequisites
+
+- Amazon Aurora DSQL cluster
+- AWS credentials with access to the DSQL cluster (IAM authentication)
+
+## Usage
+
+```typescript
+import { DSQLStore } from '@mastra/dsql'
+
+const storage = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+  // region is auto-detected from host, or specify explicitly:
+  // region: 'us-east-1',
+  // user: 'admin', // default
+  // database: 'postgres', // default
+})
+
+// Initialize the store (creates tables if needed)
+await storage.init()
+```
+
+## Parameters
+
+**id** (`string`): Unique identifier for this store instance
+
+**host** (`string`): DSQL cluster endpoint (e.g., abc123.dsql.us-east-1.on.aws)
+
+**pool** (`pg.Pool`): Pre-configured pg.Pool instance. Use this for direct control over the connection pool. Cannot be used with host configuration.
+
+**user** (`string`): Database user. Aurora DSQL's admin role is 'admin'.
+
+**database** (`string`): Database name. Aurora DSQL exposes a single database named 'postgres' per cluster.
+
+**region** (`string`): AWS region. Extracted from host if not provided.
+
+**schemaName** (`string`): PostgreSQL schema name where Mastra tables and indexes are created.
+
+**customCredentialsProvider** (`AwsCredentialIdentityProvider`): Custom AWS credentials provider for IAM authentication.
+
+**max** (`number`): Maximum connections in the pool.
+
+**min** (`number`): Minimum connections in the pool.
+
+**idleTimeoutMillis** (`number`): Close idle connections after this many milliseconds.
+
+**maxLifetimeSeconds** (`number`): Maximum connection lifetime in seconds. Must be less than 3600 due to Aurora DSQL's 60-minute connection limit.
+
+**connectionTimeoutMillis** (`number`): Connection acquisition timeout in milliseconds.
+
+**allowExitOnIdle** (`boolean`): Allow the process to exit when all connections are idle.
+
+## Constructor Examples
+
+You can instantiate `DSQLStore` in the following ways:
+
+```typescript
+import { DSQLStore } from '@mastra/dsql'
+
+// Basic configuration (region auto-detected from host)
+const store1 = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+})
+
+// With explicit region and schema
+const store2 = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+  region: 'us-east-1',
+  schemaName: 'my_app',
+})
+
+// With custom credentials provider
+import { fromNodeProviderChain } from '@aws-sdk/credential-providers'
+
+const store3 = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+  customCredentialsProvider: fromNodeProviderChain(),
+})
+
+// With connection pool settings
+const store4 = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+  max: 20,
+  min: 2,
+  idleTimeoutMillis: 300000,
+  maxLifetimeSeconds: 3000,
+  connectionTimeoutMillis: 10000,
+})
+
+// Using a pre-configured pg.Pool
+import { Pool } from 'pg'
+import { AuroraDSQLClient } from '@aws/aurora-dsql-node-postgres-connector'
+
+const pool = new Pool({
+  host: 'abc123.dsql.us-east-1.on.aws',
+  Client: AuroraDSQLClient,
+  region: 'us-east-1',
+})
+
+const store5 = new DSQLStore({
+  id: 'my-dsql-store',
+  pool,
+})
+```
+
+## Additional Notes
+
+### Schema Management
+
+The storage implementation handles schema creation and updates automatically. It creates the following tables:
+
+- `mastra_workflow_snapshot`: Stores workflow state and execution data
+- `mastra_threads`: Stores conversation threads
+- `mastra_messages`: Stores individual messages
+- `mastra_ai_spans`: Stores span data for observability
+- `mastra_scorers`: Stores scoring and evaluation data
+- `mastra_resources`: Stores resource working memory data
+- `mastra_agents`: Stores agent data
+
+### Initialization
+
+When you pass storage to the Mastra class, `init()` is called automatically before any storage operation:
+
+```typescript
+import { Mastra } from '@mastra/core'
+import { DSQLStore } from '@mastra/dsql'
+
+const storage = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+})
+
+const mastra = new Mastra({
+  storage, // init() is called automatically
+})
+```
+
+If you're using storage directly without Mastra, you must call `init()` explicitly to create the tables:
+
+```typescript
+import { DSQLStore } from '@mastra/dsql'
+
+const storage = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+})
+
+// Required when using storage directly
+await storage.init()
+
+// Access domain-specific stores via getStore()
+const memoryStore = await storage.getStore('memory')
+const thread = await memoryStore?.getThreadById({ threadId: '...' })
+```
+
+> **Warning:** If `init()` is not called, tables won't be created and storage operations will fail silently or throw errors.
+
+### Direct Database and Pool Access
+
+`DSQLStore` exposes both the underlying database client and the pg.Pool instance as public fields:
+
+```typescript
+storage.db // Database client for executing queries
+storage.pool // Underlying pg.Pool instance
+```
+
+This enables direct queries and custom transaction management. When using these fields:
+
+- You are responsible for proper connection and transaction handling.
+- Closing the store (`storage.close()`) will destroy the connection pool if it was created by the store.
+- Direct access bypasses any additional logic or validation provided by DSQLStore methods.
+
+This approach is intended for advanced scenarios where low-level access is required.
+
+### Aurora DSQL Specifics
+
+#### IAM-only authentication
+
+Connections are authenticated with IAM. There are no database passwords. `@mastra/dsql` uses `@aws/aurora-dsql-node-postgres-connector` to generate short-lived auth tokens. You can provide a custom credentials provider via `customCredentialsProvider`.
+
+#### Single database, schema-based isolation
+
+Each cluster exposes a single database named `postgres`. Logical separation is done via schemas. The `schemaName` option controls where Mastra tables are created.
+
+#### No PostgreSQL extensions
+
+`CREATE EXTENSION` is not supported. This includes `pgvector`, `PostGIS`, and others. For vector storage, use a separate store such as `@mastra/s3vectors` alongside `DSQLStore`.
+
+#### JSON stored as text
+
+JSON/JSONB are available as query types but not as column types. `@mastra/dsql` stores structured fields (metadata, content, etc.) in `TEXT` columns and casts to JSON at query time.
+
+#### Schema and DDL constraints
+
+Some PostgreSQL features are not available:
+
+- Foreign key constraints
+- `TRUNCATE`
+- Synchronous `CREATE INDEX`
+
+Indexes are created asynchronously using `CREATE INDEX ASYNC`. The store's `init()` and index helper APIs respect these constraints.
+
+#### Transactions and optimistic concurrency
+
+Aurora DSQL uses optimistic concurrency control (OCC) and may return retriable OCC errors under contention. There are limits on transaction duration and size. Large bulk operations should be split into smaller batches at the application level.
+
+#### Connection lifetime
+
+Individual connections are limited to about 60 minutes. The default `maxLifetimeSeconds: 3300` ensures connections are recycled before hitting this limit.
+
+## Usage Example
+
+### Adding memory to an agent
+
+To add Aurora DSQL memory to an agent use the `Memory` class and create a new `storage` key using `DSQLStore`. The `host` should point to your Aurora DSQL cluster endpoint.
+
+```typescript
+import { Memory } from '@mastra/memory'
+import { Agent } from '@mastra/core/agent'
+import { DSQLStore } from '@mastra/dsql'
+
+export const dsqlAgent = new Agent({
+  id: 'dsql-agent',
+  name: 'DSQL Agent',
+  instructions:
+    'You are an AI agent with the ability to automatically recall memories from previous interactions.',
+  model: 'openai/gpt-5.1',
+  memory: new Memory({
+    storage: new DSQLStore({
+      id: 'dsql-agent-storage',
+      host: process.env.DSQL_HOST!,
+    }),
+    options: {
+      generateTitle: true, // Explicitly enable automatic title generation
+    },
+  }),
+})
+```
+
+### Using the agent
+
+Use `memoryOptions` to scope recall for this request. Set `lastMessages: 5` to limit recency-based recall, and use `semanticRecall` to fetch the `topK: 3` most relevant messages, including `messageRange: 2` neighboring messages for context around each match.
+
+```typescript
+import 'dotenv/config'
+
+import { mastra } from './mastra'
+
+const threadId = '123'
+const resourceId = 'user-456'
+
+const agent = mastra.getAgent('dsql-agent')
+
+const message = await agent.stream('My name is Mastra', {
+  memory: {
+    thread: threadId,
+    resource: resourceId,
+  },
+})
+
+await message.textStream.pipeTo(new WritableStream())
+
+const stream = await agent.stream("What's my name?", {
+  memory: {
+    thread: threadId,
+    resource: resourceId,
+  },
+  memoryOptions: {
+    lastMessages: 5,
+    semanticRecall: {
+      topK: 3,
+      messageRange: 2,
+    },
+  },
+})
+
+for await (const chunk of stream.textStream) {
+  process.stdout.write(chunk)
+}
+```
+
+## Index Management
+
+Aurora DSQL storage provides index management capabilities to optimize query performance.
+
+### Automatic Performance Indexes
+
+Aurora DSQL storage automatically creates composite indexes during initialization for common query patterns:
+
+- `mastra_threads_resourceid_createdat_idx`: (resourceId, createdAt)
+- `mastra_messages_thread_id_createdat_idx`: (thread\_id, createdAt)
+- `mastra_ai_spans_traceid_startedat_idx`: (traceId, startedAt)
+- `mastra_ai_spans_parentspanid_startedat_idx`: (parentSpanId, startedAt)
+- `mastra_ai_spans_name_idx`: (name)
+- `mastra_ai_spans_spantype_startedat_idx`: (spanType, startedAt)
+- `mastra_scores_trace_id_span_id_created_at_idx`: (traceId, spanId, createdAt)
+
+Aurora DSQL creates these indexes asynchronously using `CREATE INDEX ASYNC`. Because index creation is asynchronous, new indexes may not be immediately available after `init()`. The store will continue to function without them, but queries may be slower until index creation completes.
+
+### Creating Custom Indexes
+
+Create additional indexes to optimize specific query patterns:
+
+```typescript
+await storage.createIndex({
+  name: 'idx_threads_resource',
+  table: 'mastra_threads',
+  columns: ['resourceId'],
+})
+
+await storage.createIndex({
+  name: 'idx_messages_composite',
+  table: 'mastra_messages',
+  columns: ['thread_id', 'createdAt'],
+})
+```
+
+Aurora DSQL does not allow `ASC`/`DESC` in `CREATE INDEX ASYNC`. If you include them, they will be automatically stripped.
+
+### Index Options
+
+**name** (`string`): Unique name for the index
+
+**table** (`string`): Table name (e.g., 'mastra\_threads')
+
+**columns** (`string[]`): Array of column names. ASC/DESC modifiers are automatically stripped for Aurora DSQL compatibility.
+
+**unique** (`boolean`): Create a unique index.
+
+**concurrent** (`boolean`): Ignored in Aurora DSQL. Indexes are always created asynchronously.
+
+**where** (`string`): Partial index condition.
+
+**method** (`string`): Ignored in Aurora DSQL. Only btree indexes are supported.
+
+**opclass** (`string`): Ignored in Aurora DSQL.
+
+**storage** (`Record<string, any>`): Ignored in Aurora DSQL.
+
+**tablespace** (`string`): Ignored in Aurora DSQL. Tablespaces are not supported.
+
+### Managing Indexes
+
+List and monitor existing indexes:
+
+```typescript
+// List all indexes
+const allIndexes = await storage.listIndexes()
+console.log(allIndexes)
+// [
+//   {
+//     name: 'mastra_threads_pkey',
+//     table: 'mastra_threads',
+//     columns: ['id'],
+//     unique: true,
+//     size: '16 KB',
+//     definition: 'CREATE UNIQUE INDEX...'
+//   },
+//   ...
+// ]
+
+// List indexes for a specific table
+const threadIndexes = await storage.listIndexes('mastra_threads')
+
+// Get detailed statistics for an index
+const stats = await storage.describeIndex('idx_threads_resource')
+console.log(stats)
+// {
+//   name: 'idx_threads_resource',
+//   table: 'mastra_threads',
+//   columns: ['resourceId'],
+//   unique: false,
+//   size: '128 KB',
+//   definition: 'CREATE INDEX idx_threads_resource...',
+//   method: 'btree',
+//   scans: 1542,
+//   tuples_read: 45230,
+//   tuples_fetched: 12050
+// }
+
+// Drop an index
+await storage.dropIndex('idx_threads_status')
+```
+
+### Schema-Specific Indexes
+
+When using custom schemas, indexes are created with schema prefixes:
+
+```typescript
+const storage = new DSQLStore({
+  id: 'my-dsql-store',
+  host: 'abc123.dsql.us-east-1.on.aws',
+  schemaName: 'custom_schema',
+})
+
+// Creates index as: custom_schema_idx_threads_status
+await storage.createIndex({
+  name: 'idx_threads_status',
+  table: 'mastra_threads',
+  columns: ['status'],
+})
+```
+
+## Related Resources
+
+- [Aurora DSQL Documentation](https://docs.aws.amazon.com/aurora-dsql/)
+- [SQL Reference](https://docs.aws.amazon.com/aurora-dsql/latest/userguide/working-with-aurora-dsql-sql.html)
+- [Supported SQL Features](https://docs.aws.amazon.com/aurora-dsql/latest/userguide/working-with-postgresql-compatibility-supported-sql-features.html)
+- [Unsupported PostgreSQL Features](https://docs.aws.amazon.com/aurora-dsql/latest/userguide/working-with-postgresql-compatibility-unsupported-features.html)
+- [Supported Data Types](https://docs.aws.amazon.com/aurora-dsql/latest/userguide/working-with-postgresql-compatibility-supported-data-types.html)
+- [Asynchronous Indexes](https://docs.aws.amazon.com/aurora-dsql/latest/userguide/working-with-create-index-async.html)

package/.docs/reference/storage/duckdb.md

@@ -49,7 +49,7 @@ import { Mastra } from '@mastra/core'
 import { MastraCompositeStore } from '@mastra/core/storage'
 import { LibSQLStore } from '@mastra/libsql'
 import { DuckDBStore } from '@mastra/duckdb'
-import { Observability, DefaultExporter } from '@mastra/observability'
+import { Observability, MastraStorageExporter } from '@mastra/observability'
 
 export const mastra = new Mastra({
   storage: new MastraCompositeStore({
@@ -66,7 +66,7 @@ export const mastra = new Mastra({
     configs: {
       default: {
         serviceName: 'mastra',
-        exporters: [new DefaultExporter()],
+        exporters: [new MastraStorageExporter()],
       },
     },
   }),
@@ -139,7 +139,7 @@ await duckdb.observability.init()
 
 ## Observability strategy
 
-DuckDB supports the `event-sourced` strategy used by `DefaultExporter`, which buffers spans in memory and writes completed events in batches. This is appropriate for development-scale traffic. For high-volume production workloads, see [`DefaultExporter` storage provider support](https://mastra.ai/docs/observability/tracing/exporters/default).
+DuckDB supports the `event-sourced` strategy used by `MastraStorageExporter`, which buffers spans in memory and writes completed events in batches. This is appropriate for development-scale traffic. For high-volume production workloads, see [`MastraStorageExporter` storage provider support](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage).
 
 ## Related
 

package/.docs/reference/storage/dynamodb.md

@@ -2,7 +2,7 @@
 
 The DynamoDB storage implementation provides a scalable and performant NoSQL database solution for Mastra, leveraging a single-table design pattern with [ElectroDB](https://electrodb.dev/).
 
-> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `MastraStorageExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse.
 
 > **Item Size Limit:** DynamoDB enforces a **400 KB maximum item size**. This limit can be exceeded when storing messages with base64-encoded attachments such as images. See [Handling large attachments](https://mastra.ai/docs/memory/storage) for workarounds including uploading attachments to external storage.
 

package/.docs/reference/storage/lance.md

@@ -2,7 +2,7 @@
 
 The LanceDB storage implementation provides a high-performance storage solution using the LanceDB database system, which excels at handling both traditional data storage and vector operations.
 
-> **Observability Not Supported:** LanceDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to LanceDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with LanceDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** LanceDB storage **doesn't support the observability domain**. Traces from the `MastraStorageExporter` can't be persisted to LanceDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with LanceDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse.
 
 ## Installation
 

package/.docs/reference/storage/libsql.md

@@ -130,6 +130,6 @@ const thread = await memoryStore?.getThreadById({ threadId: '...' })
 
 ## Observability
 
-libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/default) for immediate visibility while debugging.
+libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) for immediate visibility while debugging.
 
 For production environments with higher trace volumes, consider using [PostgreSQL](https://mastra.ai/reference/storage/postgresql) or [ClickHouse via composite storage](https://mastra.ai/reference/storage/composite).

package/.docs/reference/storage/postgresql.md

@@ -137,7 +137,7 @@ The storage implementation handles schema creation and updates automatically. It
 
 PostgreSQL supports observability and can handle low trace volumes. Throughput capacity depends on deployment factors such as hardware, schema design, indexing, and retention policies, and should be validated for your specific environment. For high-volume production environments, consider:
 
-- Using the `insert-only` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/default) to reduce database write operations
+- Using the `insert-only` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) to reduce database write operations
 - Setting up table partitioning for efficient data retention
 - Migrating observability to [ClickHouse via composite storage](https://mastra.ai/reference/storage/composite) if you need to scale further
 

package/.docs/reference/storage/upstash.md

@@ -4,7 +4,7 @@ The Upstash storage implementation provides a serverless-friendly storage soluti
 
 > **Pricing:** When using Mastra with Upstash, the pay-as-you-go model can result in unexpectedly high costs due to the high volume of Redis commands generated during agent conversations. We strongly recommend using a **fixed pricing plan** for predictable costs. See [Upstash pricing](https://upstash.com/pricing/redis) for details and [GitHub issue #5850](https://github.com/mastra-ai/mastra/issues/5850) for context.
 
-> **Observability Not Supported:** Upstash storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to Upstash, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with Upstash as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** Upstash storage **doesn't support the observability domain**. Traces from the `MastraStorageExporter` can't be persisted to Upstash, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with Upstash as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse.
 
 ## Installation
 

package/.docs/reference/streaming/ChunkType.md

@@ -518,6 +518,50 @@ Emitted when the task throws or times out. Triggers a continuation turn when con
 
 **payload.completedAt** (`Date`): Timestamp at which the task failed
 
+### background-task-suspended
+
+Emitted when a tool calls `suspend()` from inside its background execution. Pauses the task's workflow run with its snapshot persisted; resume with `mastra.backgroundTaskManager.resume(taskId, resumeData)`.
+
+When consumed by [`Agent.streamUntilIdle()`](https://mastra.ai/reference/streaming/agents/streamUntilIdle), this chunk drops the task from the loop's wait set without queuing a continuation — the agent's response ends, and the resumed task's eventual completion injects into the message list for the next user turn.
+
+**type** (`"background-task-suspended"`): Chunk type identifier
+
+**payload** (`BackgroundTaskSuspendedPayload`): Suspension details for the task
+
+**payload.taskId** (`string`): Unique identifier for the background task
+
+**payload.toolName** (`string`): Name of the tool that was executed
+
+**payload.toolCallId** (`string`): Tool-call ID from the originating LLM tool call
+
+**payload.runId** (`string`): Run ID of the agent that dispatched the task
+
+**payload.agentId** (`string`): ID of the agent that dispatched the task
+
+**payload.suspendData** (`unknown`): Whatever the tool passed to \`suspend(data)\`
+
+### background-task-resumed
+
+Emitted when a suspended task is resumed via `mastra.backgroundTaskManager.resume(taskId, resumeData)`. The task transitions back to `running` and the tool's `execute` is restarted with `resumeData` populated.
+
+**type** (`"background-task-resumed"`): Chunk type identifier
+
+**payload** (`BackgroundTaskResumedPayload`): Resume details for the task
+
+**payload.taskId** (`string`): Unique identifier for the background task
+
+**payload.toolName** (`string`): Name of the tool that was executed
+
+**payload.toolCallId** (`string`): Tool-call ID from the originating LLM tool call
+
+**payload.runId** (`string`): Run ID of the agent that dispatched the task
+
+**payload.agentId** (`string`): ID of the agent that dispatched the task
+
+**payload.startedAt** (`Date`): Timestamp at which the task resumed
+
+**payload.args** (`Record<string, unknown>`): Original tool arguments
+
 ### background-task-cancelled
 
 Emitted when the task is cancelled before completing. Triggers a continuation turn when consumed by [`Agent.streamUntilIdle()`](https://mastra.ai/reference/streaming/agents/streamUntilIdle).