@mastra/mcp-docs-server 1.1.8 → 1.1.9-alpha.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.docs/docs/agents/adding-voice.md +4 -4
- package/.docs/docs/agents/agent-approval.md +3 -3
- package/.docs/docs/agents/agent-memory.md +3 -3
- package/.docs/docs/agents/guardrails.md +3 -3
- package/.docs/docs/agents/network-approval.md +5 -2
- package/.docs/docs/agents/networks.md +2 -2
- package/.docs/docs/agents/overview.md +2 -2
- package/.docs/docs/agents/processors.md +42 -24
- package/.docs/docs/agents/structured-output.md +2 -2
- package/.docs/docs/agents/supervisor-agents.md +3 -3
- package/.docs/docs/agents/using-tools.md +3 -3
- package/.docs/docs/build-with-ai/mcp-docs-server.md +5 -5
- package/.docs/docs/build-with-ai/skills.md +2 -2
- package/.docs/docs/community/contributing-templates.md +1 -1
- package/.docs/docs/community/discord.md +3 -3
- package/.docs/docs/community/licensing.md +2 -2
- package/.docs/docs/deployment/cloud-providers.md +2 -2
- package/.docs/docs/deployment/mastra-server.md +2 -2
- package/.docs/docs/deployment/monorepo.md +1 -1
- package/.docs/docs/deployment/overview.md +3 -3
- package/.docs/docs/deployment/studio.md +3 -3
- package/.docs/docs/deployment/web-framework.md +2 -2
- package/.docs/docs/deployment/workflow-runners.md +1 -1
- package/.docs/docs/evals/built-in-scorers.md +1 -1
- package/.docs/docs/evals/custom-scorers.md +6 -6
- package/.docs/docs/evals/overview.md +2 -2
- package/.docs/docs/evals/running-in-ci.md +6 -6
- package/.docs/docs/getting-started/build-with-ai.md +3 -3
- package/.docs/docs/getting-started/manual-install.md +1 -1
- package/.docs/docs/getting-started/project-structure.md +2 -2
- package/.docs/docs/index.md +63 -17
- package/.docs/docs/mastra-cloud/deployment.md +1 -1
- package/.docs/docs/mastra-cloud/studio.md +1 -1
- package/.docs/docs/mcp/overview.md +1 -1
- package/.docs/docs/mcp/publishing-mcp-server.md +4 -4
- package/.docs/docs/memory/memory-processors.md +9 -9
- package/.docs/docs/memory/message-history.md +4 -4
- package/.docs/docs/memory/observational-memory.md +11 -7
- package/.docs/docs/memory/semantic-recall.md +9 -9
- package/.docs/docs/memory/storage.md +1 -1
- package/.docs/docs/memory/working-memory.md +20 -20
- package/.docs/docs/observability/datasets/overview.md +1 -1
- package/.docs/docs/observability/datasets/running-experiments.md +1 -1
- package/.docs/docs/observability/logging.md +1 -1
- package/.docs/docs/observability/overview.md +5 -5
- package/.docs/docs/observability/tracing/bridges/otel.md +9 -9
- package/.docs/docs/observability/tracing/exporters/arize.md +3 -3
- package/.docs/docs/observability/tracing/exporters/braintrust.md +1 -1
- package/.docs/docs/observability/tracing/exporters/cloud.md +2 -2
- package/.docs/docs/observability/tracing/exporters/datadog.md +3 -3
- package/.docs/docs/observability/tracing/exporters/default.md +8 -8
- package/.docs/docs/observability/tracing/exporters/laminar.md +1 -1
- package/.docs/docs/observability/tracing/exporters/langfuse.md +3 -3
- package/.docs/docs/observability/tracing/exporters/langsmith.md +4 -4
- package/.docs/docs/observability/tracing/exporters/otel.md +8 -8
- package/.docs/docs/observability/tracing/exporters/posthog.md +2 -2
- package/.docs/docs/observability/tracing/exporters/sentry.md +4 -4
- package/.docs/docs/observability/tracing/overview.md +24 -24
- package/.docs/docs/observability/tracing/processors/sensitive-data-filter.md +13 -13
- package/.docs/docs/rag/chunking-and-embedding.md +5 -5
- package/.docs/docs/rag/overview.md +2 -2
- package/.docs/docs/rag/retrieval.md +4 -4
- package/.docs/docs/rag/vector-databases.md +13 -13
- package/.docs/docs/server/auth/auth0.md +2 -2
- package/.docs/docs/server/auth/clerk.md +1 -1
- package/.docs/docs/server/auth/composite-auth.md +9 -9
- package/.docs/docs/server/auth/custom-auth-provider.md +12 -12
- package/.docs/docs/server/auth/firebase.md +3 -3
- package/.docs/docs/server/auth/jwt.md +1 -1
- package/.docs/docs/server/auth/simple-auth.md +9 -9
- package/.docs/docs/server/auth/supabase.md +1 -1
- package/.docs/docs/server/auth/workos.md +1 -1
- package/.docs/docs/server/auth.md +2 -2
- package/.docs/docs/server/custom-adapters.md +7 -7
- package/.docs/docs/server/custom-api-routes.md +2 -2
- package/.docs/docs/server/mastra-client.md +2 -2
- package/.docs/docs/server/mastra-server.md +2 -2
- package/.docs/docs/server/request-context.md +2 -2
- package/.docs/docs/server/server-adapters.md +3 -3
- package/.docs/docs/streaming/events.md +2 -2
- package/.docs/docs/streaming/overview.md +2 -2
- package/.docs/docs/streaming/tool-streaming.md +46 -32
- package/.docs/docs/streaming/workflow-streaming.md +1 -1
- package/.docs/docs/voice/overview.md +3 -3
- package/.docs/docs/voice/speech-to-speech.md +1 -1
- package/.docs/docs/voice/speech-to-text.md +2 -2
- package/.docs/docs/voice/text-to-speech.md +2 -2
- package/.docs/docs/workflows/agents-and-tools.md +1 -1
- package/.docs/docs/workflows/control-flow.md +45 -3
- package/.docs/docs/workflows/error-handling.md +4 -4
- package/.docs/docs/workflows/overview.md +3 -3
- package/.docs/docs/workflows/snapshots.md +1 -1
- package/.docs/docs/workflows/suspend-and-resume.md +1 -1
- package/.docs/docs/workflows/time-travel.md +3 -3
- package/.docs/docs/workflows/workflow-state.md +1 -1
- package/.docs/docs/workspace/filesystem.md +3 -3
- package/.docs/docs/workspace/overview.md +53 -8
- package/.docs/docs/workspace/sandbox.md +72 -13
- package/.docs/docs/workspace/search.md +1 -1
- package/.docs/docs/workspace/skills.md +4 -4
- package/.docs/guides/build-your-ui/ai-sdk-ui.md +2 -2
- package/.docs/guides/build-your-ui/assistant-ui.md +1 -1
- package/.docs/guides/build-your-ui/copilotkit.md +2 -2
- package/.docs/guides/deployment/digital-ocean.md +1 -1
- package/.docs/guides/deployment/inngest.md +4 -4
- package/.docs/guides/getting-started/astro.md +1 -1
- package/.docs/guides/getting-started/electron.md +1 -1
- package/.docs/guides/getting-started/next-js.md +1 -1
- package/.docs/guides/getting-started/vite-react.md +1 -1
- package/.docs/guides/guide/ai-recruiter.md +4 -4
- package/.docs/guides/guide/chef-michel.md +4 -4
- package/.docs/guides/guide/code-review-bot.md +3 -3
- package/.docs/guides/guide/dev-assistant.md +5 -5
- package/.docs/guides/guide/docs-manager.md +3 -3
- package/.docs/guides/guide/github-actions-pr-description.md +4 -4
- package/.docs/guides/guide/notes-mcp-server.md +4 -4
- package/.docs/guides/guide/research-assistant.md +4 -4
- package/.docs/guides/guide/research-coordinator.md +1 -1
- package/.docs/guides/guide/stock-agent.md +6 -6
- package/.docs/guides/guide/web-search.md +2 -2
- package/.docs/guides/guide/whatsapp-chat-bot.md +1 -1
- package/.docs/guides/migrations/agentnetwork.md +1 -1
- package/.docs/guides/migrations/ai-sdk-v4-to-v5.md +3 -3
- package/.docs/guides/migrations/network-to-supervisor.md +1 -1
- package/.docs/guides/migrations/upgrade-to-v1/agent.md +1 -1
- package/.docs/guides/migrations/upgrade-to-v1/client.md +2 -2
- package/.docs/guides/migrations/upgrade-to-v1/deployment.md +2 -2
- package/.docs/guides/migrations/upgrade-to-v1/evals.md +1 -1
- package/.docs/guides/migrations/upgrade-to-v1/mastra.md +1 -1
- package/.docs/guides/migrations/upgrade-to-v1/memory.md +2 -2
- package/.docs/guides/migrations/upgrade-to-v1/overview.md +3 -3
- package/.docs/guides/migrations/upgrade-to-v1/storage.md +4 -4
- package/.docs/guides/migrations/upgrade-to-v1/tools.md +2 -2
- package/.docs/guides/migrations/upgrade-to-v1/tracing.md +2 -2
- package/.docs/guides/migrations/upgrade-to-v1/vectors.md +3 -3
- package/.docs/guides/migrations/upgrade-to-v1/voice.md +1 -1
- package/.docs/guides/migrations/upgrade-to-v1/workflows.md +6 -6
- package/.docs/guides/migrations/vnext-to-standard-apis.md +3 -3
- package/.docs/models/embeddings.md +4 -4
- package/.docs/models/gateways/custom-gateways.md +4 -4
- package/.docs/models/gateways/netlify.md +2 -3
- package/.docs/models/gateways/openrouter.md +9 -2
- package/.docs/models/gateways/vercel.md +11 -2
- package/.docs/models/gateways.md +2 -2
- package/.docs/models/index.md +1 -1
- package/.docs/models/providers/302ai.md +3 -3
- package/.docs/models/providers/abacus.md +24 -14
- package/.docs/models/providers/aihubmix.md +10 -5
- package/.docs/models/providers/alibaba-cn.md +83 -74
- package/.docs/models/providers/alibaba-coding-plan-cn.md +78 -0
- package/.docs/models/providers/alibaba-coding-plan.md +78 -0
- package/.docs/models/providers/alibaba.md +3 -3
- package/.docs/models/providers/anthropic.md +4 -4
- package/.docs/models/providers/bailing.md +3 -3
- package/.docs/models/providers/baseten.md +3 -3
- package/.docs/models/providers/berget.md +3 -3
- package/.docs/models/providers/cerebras.md +4 -4
- package/.docs/models/providers/chutes.md +7 -6
- package/.docs/models/providers/clarifai.md +81 -0
- package/.docs/models/providers/cloudferro-sherlock.md +8 -7
- package/.docs/models/providers/cloudflare-workers-ai.md +6 -5
- package/.docs/models/providers/cortecs.md +10 -8
- package/.docs/models/providers/deepinfra.md +11 -6
- package/.docs/models/providers/deepseek.md +4 -4
- package/.docs/models/providers/drun.md +73 -0
- package/.docs/models/providers/evroc.md +3 -3
- package/.docs/models/providers/fastrouter.md +3 -3
- package/.docs/models/providers/fireworks-ai.md +3 -3
- package/.docs/models/providers/firmware.md +31 -23
- package/.docs/models/providers/friendli.md +3 -3
- package/.docs/models/providers/github-models.md +3 -3
- package/.docs/models/providers/google.md +7 -5
- package/.docs/models/providers/groq.md +4 -4
- package/.docs/models/providers/helicone.md +3 -3
- package/.docs/models/providers/huggingface.md +3 -3
- package/.docs/models/providers/iflowcn.md +3 -3
- package/.docs/models/providers/inception.md +7 -5
- package/.docs/models/providers/inference.md +3 -3
- package/.docs/models/providers/io-net.md +3 -3
- package/.docs/models/providers/jiekou.md +3 -3
- package/.docs/models/providers/kilo.md +6 -4
- package/.docs/models/providers/kimi-for-coding.md +4 -4
- package/.docs/models/providers/kuae-cloud-coding-plan.md +3 -3
- package/.docs/models/providers/llama.md +3 -3
- package/.docs/models/providers/lmstudio.md +3 -3
- package/.docs/models/providers/lucidquery.md +3 -3
- package/.docs/models/providers/meganova.md +3 -3
- package/.docs/models/providers/minimax-cn-coding-plan.md +4 -4
- package/.docs/models/providers/minimax-cn.md +4 -4
- package/.docs/models/providers/minimax-coding-plan.md +4 -4
- package/.docs/models/providers/minimax.md +4 -4
- package/.docs/models/providers/mistral.md +4 -4
- package/.docs/models/providers/moark.md +3 -3
- package/.docs/models/providers/modelscope.md +3 -3
- package/.docs/models/providers/moonshotai-cn.md +3 -3
- package/.docs/models/providers/moonshotai.md +3 -3
- package/.docs/models/providers/morph.md +3 -3
- package/.docs/models/providers/nano-gpt.md +523 -42
- package/.docs/models/providers/nebius.md +37 -37
- package/.docs/models/providers/nova.md +3 -3
- package/.docs/models/providers/novita-ai.md +3 -3
- package/.docs/models/providers/nvidia.md +7 -5
- package/.docs/models/providers/ollama-cloud.md +4 -5
- package/.docs/models/providers/openai.md +7 -5
- package/.docs/models/providers/opencode-go.md +3 -3
- package/.docs/models/providers/opencode.md +39 -36
- package/.docs/models/providers/ovhcloud.md +3 -3
- package/.docs/models/providers/perplexity-agent.md +4 -4
- package/.docs/models/providers/perplexity.md +4 -4
- package/.docs/models/providers/poe.md +11 -5
- package/.docs/models/providers/privatemode-ai.md +3 -3
- package/.docs/models/providers/qihang-ai.md +3 -3
- package/.docs/models/providers/qiniu-ai.md +23 -8
- package/.docs/models/providers/requesty.md +20 -4
- package/.docs/models/providers/scaleway.md +3 -3
- package/.docs/models/providers/siliconflow-cn.md +10 -4
- package/.docs/models/providers/siliconflow.md +3 -3
- package/.docs/models/providers/stackit.md +3 -3
- package/.docs/models/providers/stepfun.md +3 -3
- package/.docs/models/providers/submodel.md +3 -3
- package/.docs/models/providers/synthetic.md +3 -3
- package/.docs/models/providers/togetherai.md +5 -7
- package/.docs/models/providers/upstage.md +3 -3
- package/.docs/models/providers/vivgrid.md +4 -4
- package/.docs/models/providers/vultr.md +3 -3
- package/.docs/models/providers/wandb.md +3 -3
- package/.docs/models/providers/xai.md +34 -31
- package/.docs/models/providers/xiaomi.md +4 -4
- package/.docs/models/providers/zai-coding-plan.md +3 -3
- package/.docs/models/providers/zai.md +3 -3
- package/.docs/models/providers/zenmux.md +7 -5
- package/.docs/models/providers/zhipuai-coding-plan.md +3 -3
- package/.docs/models/providers/zhipuai.md +3 -3
- package/.docs/models/providers.md +4 -0
- package/.docs/reference/agents/agent.md +3 -3
- package/.docs/reference/agents/generateLegacy.md +1 -1
- package/.docs/reference/agents/getDefaultGenerateOptions.md +1 -1
- package/.docs/reference/agents/getDefaultOptions.md +1 -1
- package/.docs/reference/agents/getDefaultStreamOptions.md +1 -1
- package/.docs/reference/agents/getDescription.md +1 -1
- package/.docs/reference/agents/network.md +5 -3
- package/.docs/reference/ai-sdk/handle-chat-stream.md +2 -0
- package/.docs/reference/ai-sdk/handle-network-stream.md +2 -0
- package/.docs/reference/ai-sdk/network-route.md +2 -0
- package/.docs/reference/ai-sdk/to-ai-sdk-stream.md +1 -1
- package/.docs/reference/ai-sdk/to-ai-sdk-v4-messages.md +1 -1
- package/.docs/reference/ai-sdk/to-ai-sdk-v5-messages.md +1 -1
- package/.docs/reference/auth/auth0.md +7 -7
- package/.docs/reference/auth/better-auth.md +2 -2
- package/.docs/reference/auth/clerk.md +1 -1
- package/.docs/reference/auth/firebase.md +5 -5
- package/.docs/reference/auth/jwt.md +1 -1
- package/.docs/reference/auth/supabase.md +1 -1
- package/.docs/reference/auth/workos.md +6 -6
- package/.docs/reference/cli/mastra.md +5 -5
- package/.docs/reference/client-js/agents.md +22 -22
- package/.docs/reference/client-js/error-handling.md +2 -2
- package/.docs/reference/client-js/logs.md +2 -2
- package/.docs/reference/client-js/mastra-client.md +2 -2
- package/.docs/reference/client-js/memory.md +6 -6
- package/.docs/reference/client-js/observability.md +4 -4
- package/.docs/reference/client-js/telemetry.md +1 -1
- package/.docs/reference/client-js/tools.md +3 -3
- package/.docs/reference/client-js/vectors.md +2 -2
- package/.docs/reference/client-js/workflows.md +12 -12
- package/.docs/reference/configuration.md +62 -6
- package/.docs/reference/core/getDeployer.md +1 -1
- package/.docs/reference/core/getGatewayById.md +1 -1
- package/.docs/reference/core/getLogger.md +1 -1
- package/.docs/reference/core/getMCPServer.md +2 -2
- package/.docs/reference/core/getMCPServerById.md +2 -2
- package/.docs/reference/core/getMemory.md +1 -1
- package/.docs/reference/core/getScorer.md +4 -4
- package/.docs/reference/core/getScorerById.md +2 -2
- package/.docs/reference/core/getServer.md +1 -1
- package/.docs/reference/core/getStorage.md +1 -1
- package/.docs/reference/core/getStoredAgentById.md +3 -3
- package/.docs/reference/core/getTelemetry.md +1 -1
- package/.docs/reference/core/getWorkflow.md +1 -1
- package/.docs/reference/core/listAgents.md +1 -1
- package/.docs/reference/core/listMCPServers.md +3 -3
- package/.docs/reference/core/listMemory.md +1 -1
- package/.docs/reference/core/listScorers.md +1 -1
- package/.docs/reference/core/listStoredAgents.md +3 -3
- package/.docs/reference/core/listVectors.md +1 -1
- package/.docs/reference/core/mastra-class.md +2 -2
- package/.docs/reference/core/mastra-model-gateway.md +11 -11
- package/.docs/reference/core/setLogger.md +1 -1
- package/.docs/reference/core/setStorage.md +1 -1
- package/.docs/reference/datasets/dataset.md +2 -2
- package/.docs/reference/datasets/datasets-manager.md +1 -1
- package/.docs/reference/datasets/get.md +2 -2
- package/.docs/reference/datasets/getDetails.md +1 -1
- package/.docs/reference/datasets/listItems.md +1 -1
- package/.docs/reference/deployer/vercel.md +1 -1
- package/.docs/reference/deployer.md +4 -4
- package/.docs/reference/evals/answer-relevancy.md +4 -4
- package/.docs/reference/evals/answer-similarity.md +3 -3
- package/.docs/reference/evals/bias.md +4 -4
- package/.docs/reference/evals/completeness.md +6 -6
- package/.docs/reference/evals/content-similarity.md +3 -3
- package/.docs/reference/evals/context-precision.md +9 -9
- package/.docs/reference/evals/context-relevance.md +7 -7
- package/.docs/reference/evals/create-scorer.md +7 -7
- package/.docs/reference/evals/faithfulness.md +3 -3
- package/.docs/reference/evals/hallucination.md +8 -14
- package/.docs/reference/evals/keyword-coverage.md +4 -4
- package/.docs/reference/evals/mastra-scorer.md +7 -7
- package/.docs/reference/evals/noise-sensitivity.md +11 -11
- package/.docs/reference/evals/prompt-alignment.md +5 -5
- package/.docs/reference/evals/run-evals.md +5 -5
- package/.docs/reference/evals/scorer-utils.md +17 -17
- package/.docs/reference/evals/textual-difference.md +4 -4
- package/.docs/reference/evals/tone-consistency.md +5 -5
- package/.docs/reference/evals/tool-call-accuracy.md +10 -10
- package/.docs/reference/evals/toxicity.md +3 -3
- package/.docs/reference/harness/harness-class.md +5 -3
- package/.docs/reference/index.md +2 -0
- package/.docs/reference/memory/clone-utilities.md +7 -7
- package/.docs/reference/memory/cloneThread.md +5 -5
- package/.docs/reference/memory/createThread.md +1 -1
- package/.docs/reference/memory/deleteMessages.md +1 -1
- package/.docs/reference/memory/getThreadById.md +1 -1
- package/.docs/reference/memory/listThreads.md +3 -3
- package/.docs/reference/memory/memory-class.md +1 -1
- package/.docs/reference/memory/observational-memory.md +8 -6
- package/.docs/reference/memory/recall.md +1 -1
- package/.docs/reference/observability/tracing/bridges/otel.md +6 -6
- package/.docs/reference/observability/tracing/configuration.md +17 -17
- package/.docs/reference/observability/tracing/exporters/arize.md +4 -4
- package/.docs/reference/observability/tracing/exporters/braintrust.md +3 -3
- package/.docs/reference/observability/tracing/exporters/cloud-exporter.md +6 -6
- package/.docs/reference/observability/tracing/exporters/console-exporter.md +4 -4
- package/.docs/reference/observability/tracing/exporters/datadog.md +4 -4
- package/.docs/reference/observability/tracing/exporters/default-exporter.md +6 -6
- package/.docs/reference/observability/tracing/exporters/laminar.md +2 -2
- package/.docs/reference/observability/tracing/exporters/langfuse.md +4 -4
- package/.docs/reference/observability/tracing/exporters/langsmith.md +6 -6
- package/.docs/reference/observability/tracing/exporters/otel.md +12 -12
- package/.docs/reference/observability/tracing/exporters/posthog.md +3 -3
- package/.docs/reference/observability/tracing/exporters/sentry.md +5 -5
- package/.docs/reference/observability/tracing/instances.md +9 -9
- package/.docs/reference/observability/tracing/interfaces.md +39 -39
- package/.docs/reference/observability/tracing/processors/sensitive-data-filter.md +6 -6
- package/.docs/reference/observability/tracing/spans.md +15 -13
- package/.docs/reference/processors/message-history-processor.md +1 -1
- package/.docs/reference/processors/processor-interface.md +21 -17
- package/.docs/reference/processors/token-limiter-processor.md +2 -2
- package/.docs/reference/rag/chunk.md +2 -2
- package/.docs/reference/rag/database-config.md +8 -8
- package/.docs/reference/rag/document.md +11 -11
- package/.docs/reference/rag/embeddings.md +5 -5
- package/.docs/reference/rag/extract-params.md +8 -8
- package/.docs/reference/rag/graph-rag.md +4 -4
- package/.docs/reference/rag/metadata-filters.md +15 -15
- package/.docs/reference/rag/rerank.md +2 -2
- package/.docs/reference/rag/rerankWithScorer.md +2 -2
- package/.docs/reference/server/create-route.md +2 -0
- package/.docs/reference/server/express-adapter.md +1 -1
- package/.docs/reference/server/fastify-adapter.md +1 -1
- package/.docs/reference/server/hono-adapter.md +1 -1
- package/.docs/reference/server/koa-adapter.md +2 -2
- package/.docs/reference/server/mastra-server.md +16 -16
- package/.docs/reference/server/register-api-route.md +7 -7
- package/.docs/reference/server/routes.md +1 -1
- package/.docs/reference/storage/cloudflare-d1.md +5 -5
- package/.docs/reference/storage/cloudflare.md +3 -3
- package/.docs/reference/storage/composite.md +1 -1
- package/.docs/reference/storage/convex.md +6 -6
- package/.docs/reference/storage/dynamodb.md +7 -7
- package/.docs/reference/storage/lance.md +5 -5
- package/.docs/reference/storage/libsql.md +1 -1
- package/.docs/reference/storage/mongodb.md +6 -6
- package/.docs/reference/storage/mssql.md +4 -4
- package/.docs/reference/storage/overview.md +2 -2
- package/.docs/reference/storage/postgresql.md +7 -7
- package/.docs/reference/storage/upstash.md +4 -4
- package/.docs/reference/streaming/ChunkType.md +13 -13
- package/.docs/reference/streaming/agents/MastraModelOutput.md +6 -6
- package/.docs/reference/streaming/agents/stream.md +2 -2
- package/.docs/reference/streaming/agents/streamLegacy.md +1 -1
- package/.docs/reference/streaming/workflows/observeStream.md +2 -2
- package/.docs/reference/streaming/workflows/resumeStream.md +1 -1
- package/.docs/reference/streaming/workflows/stream.md +1 -1
- package/.docs/reference/templates/overview.md +4 -4
- package/.docs/reference/tools/create-tool.md +10 -10
- package/.docs/reference/tools/document-chunker-tool.md +4 -4
- package/.docs/reference/tools/graph-rag-tool.md +7 -7
- package/.docs/reference/tools/mcp-client.md +13 -13
- package/.docs/reference/tools/mcp-server.md +27 -27
- package/.docs/reference/tools/vector-query-tool.md +12 -12
- package/.docs/reference/vectors/astra.md +13 -13
- package/.docs/reference/vectors/chroma.md +18 -18
- package/.docs/reference/vectors/convex.md +15 -15
- package/.docs/reference/vectors/couchbase.md +21 -21
- package/.docs/reference/vectors/duckdb.md +17 -17
- package/.docs/reference/vectors/elasticsearch.md +14 -14
- package/.docs/reference/vectors/lance.md +22 -22
- package/.docs/reference/vectors/libsql.md +15 -15
- package/.docs/reference/vectors/mongodb.md +18 -18
- package/.docs/reference/vectors/opensearch.md +11 -11
- package/.docs/reference/vectors/pg.md +23 -21
- package/.docs/reference/vectors/pinecone.md +15 -15
- package/.docs/reference/vectors/qdrant.md +15 -15
- package/.docs/reference/vectors/s3vectors.md +22 -22
- package/.docs/reference/vectors/turbopuffer.md +14 -14
- package/.docs/reference/vectors/upstash.md +15 -15
- package/.docs/reference/vectors/vectorize.md +16 -16
- package/.docs/reference/voice/azure.md +12 -10
- package/.docs/reference/voice/cloudflare.md +9 -7
- package/.docs/reference/voice/composite-voice.md +5 -5
- package/.docs/reference/voice/deepgram.md +5 -5
- package/.docs/reference/voice/elevenlabs.md +7 -7
- package/.docs/reference/voice/google-gemini-live.md +22 -22
- package/.docs/reference/voice/google.md +12 -12
- package/.docs/reference/voice/mastra-voice.md +18 -18
- package/.docs/reference/voice/murf.md +8 -8
- package/.docs/reference/voice/openai-realtime.md +19 -17
- package/.docs/reference/voice/openai.md +12 -8
- package/.docs/reference/voice/playai.md +9 -7
- package/.docs/reference/voice/sarvam.md +8 -6
- package/.docs/reference/voice/speechify.md +11 -9
- package/.docs/reference/voice/voice.addInstructions.md +4 -4
- package/.docs/reference/voice/voice.addTools.md +3 -3
- package/.docs/reference/voice/voice.answer.md +2 -2
- package/.docs/reference/voice/voice.close.md +4 -4
- package/.docs/reference/voice/voice.connect.md +9 -7
- package/.docs/reference/voice/voice.events.md +4 -4
- package/.docs/reference/voice/voice.getSpeakers.md +4 -4
- package/.docs/reference/voice/voice.listen.md +17 -11
- package/.docs/reference/voice/voice.off.md +4 -4
- package/.docs/reference/voice/voice.on.md +5 -5
- package/.docs/reference/voice/voice.send.md +2 -2
- package/.docs/reference/voice/voice.speak.md +19 -9
- package/.docs/reference/voice/voice.updateConfig.md +4 -4
- package/.docs/reference/workflows/run-methods/startAsync.md +1 -1
- package/.docs/reference/workflows/run-methods/timeTravel.md +1 -1
- package/.docs/reference/workflows/run.md +3 -3
- package/.docs/reference/workflows/step.md +2 -2
- package/.docs/reference/workflows/workflow-methods/create-run.md +1 -1
- package/.docs/reference/workflows/workflow.md +1 -1
- package/.docs/reference/workspace/blaxel-sandbox.md +164 -0
- package/.docs/reference/workspace/daytona-sandbox.md +50 -141
- package/.docs/reference/workspace/e2b-sandbox.md +41 -77
- package/.docs/reference/workspace/filesystem.md +25 -11
- package/.docs/reference/workspace/gcs-filesystem.md +21 -1
- package/.docs/reference/workspace/local-filesystem.md +24 -10
- package/.docs/reference/workspace/local-sandbox.md +27 -102
- package/.docs/reference/workspace/process-manager.md +296 -0
- package/.docs/reference/workspace/s3-filesystem.md +21 -1
- package/.docs/reference/workspace/sandbox.md +9 -1
- package/.docs/reference/workspace/workspace-class.md +95 -27
- package/CHANGELOG.md +15 -0
- package/dist/tools/course.d.ts +7 -27
- package/dist/tools/course.d.ts.map +1 -1
- package/dist/tools/docs.d.ts +6 -18
- package/dist/tools/docs.d.ts.map +1 -1
- package/dist/tools/embedded-docs.d.ts +12 -112
- package/dist/tools/embedded-docs.d.ts.map +1 -1
- package/dist/tools/migration.d.ts +6 -26
- package/dist/tools/migration.d.ts.map +1 -1
- package/package.json +6 -6
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The AzureVoice class in Mastra provides text-to-speech and speech-to-text capabilities using Microsoft Azure Cognitive Services.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
This requires Azure Speech Services credentials that can be provided through environment variables or directly in the configuration:
|
|
8
8
|
|
|
@@ -35,7 +35,7 @@ const text = await voice.listen(audioStream)
|
|
|
35
35
|
|
|
36
36
|
## Configuration
|
|
37
37
|
|
|
38
|
-
### Constructor
|
|
38
|
+
### Constructor options
|
|
39
39
|
|
|
40
40
|
**speechModel** (`AzureSpeechConfig`): Configuration for text-to-speech synthesis.
|
|
41
41
|
|
|
@@ -61,17 +61,19 @@ const text = await voice.listen(audioStream)
|
|
|
61
61
|
|
|
62
62
|
## Methods
|
|
63
63
|
|
|
64
|
-
### speak()
|
|
64
|
+
### `speak()`
|
|
65
65
|
|
|
66
66
|
Converts text to speech using Azure's neural text-to-speech service.
|
|
67
67
|
|
|
68
68
|
**input** (`string | NodeJS.ReadableStream`): Text or text stream to convert to speech.
|
|
69
69
|
|
|
70
|
-
**options
|
|
70
|
+
**options** (`Options`): Configuration options.
|
|
71
|
+
|
|
72
|
+
**options.speaker** (`string`): Voice ID to use for speech synthesis (e.g., 'en-US-JennyNeural'). Overrides the default voice.
|
|
71
73
|
|
|
72
74
|
Returns: `Promise<NodeJS.ReadableStream>` - Audio stream in WAV format
|
|
73
75
|
|
|
74
|
-
### listen()
|
|
76
|
+
### `listen()`
|
|
75
77
|
|
|
76
78
|
Transcribes audio using Azure's speech-to-text service.
|
|
77
79
|
|
|
@@ -81,7 +83,7 @@ Returns: `Promise<string>` - The recognized text from the audio
|
|
|
81
83
|
|
|
82
84
|
**Note:** Language and recognition settings are configured in the `listeningModel` configuration during initialization, not passed as options to this method.
|
|
83
85
|
|
|
84
|
-
### getSpeakers()
|
|
86
|
+
### `getSpeakers()`
|
|
85
87
|
|
|
86
88
|
Returns an array of available voice options (200+ voices), where each node contains:
|
|
87
89
|
|
|
@@ -93,17 +95,17 @@ Returns an array of available voice options (200+ voices), where each node conta
|
|
|
93
95
|
|
|
94
96
|
Returns: `Promise<Array<{ voiceId: string; language: string; region: string; }>>`
|
|
95
97
|
|
|
96
|
-
## Important
|
|
98
|
+
## Important notes
|
|
97
99
|
|
|
98
100
|
### Azure Speech Services vs Azure OpenAI
|
|
99
101
|
|
|
100
102
|
**⚠️ Critical:** This package uses **Azure Speech Services**, which is different from **Azure OpenAI Services**.
|
|
101
103
|
|
|
102
|
-
- **
|
|
104
|
+
- **DON'T** use your `AZURE_OPENAI_API_KEY` for this package
|
|
103
105
|
- **DO** use an Azure Speech Services subscription key (obtain from Azure Portal under "Speech Services")
|
|
104
106
|
- These are separate Azure resources with different API keys and endpoints
|
|
105
107
|
|
|
106
|
-
### Environment
|
|
108
|
+
### Environment variables
|
|
107
109
|
|
|
108
110
|
API keys and regions can be provided via constructor options or environment variables:
|
|
109
111
|
|
|
@@ -118,7 +120,7 @@ API keys and regions can be provided via constructor options or environment vari
|
|
|
118
120
|
- Audio output is in WAV format
|
|
119
121
|
- Audio input for recognition must be in WAV format
|
|
120
122
|
|
|
121
|
-
## Available
|
|
123
|
+
## Available voices
|
|
122
124
|
|
|
123
125
|
Azure provides 200+ neural voices across many languages. Some popular English voices include:
|
|
124
126
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The CloudflareVoice class in Mastra provides text-to-speech capabilities using Cloudflare Workers AI. This provider specializes in efficient, low-latency speech synthesis suitable for edge computing environments.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { CloudflareVoice } from '@mastra/voice-cloudflare'
|
|
@@ -29,7 +29,7 @@ console.log(speakers)
|
|
|
29
29
|
|
|
30
30
|
## Configuration
|
|
31
31
|
|
|
32
|
-
### Constructor
|
|
32
|
+
### Constructor options
|
|
33
33
|
|
|
34
34
|
**speechModel** (`CloudflareSpeechConfig`): Configuration for text-to-speech synthesis.
|
|
35
35
|
|
|
@@ -43,19 +43,21 @@ console.log(speakers)
|
|
|
43
43
|
|
|
44
44
|
## Methods
|
|
45
45
|
|
|
46
|
-
### speak()
|
|
46
|
+
### `speak()`
|
|
47
47
|
|
|
48
48
|
Converts text to speech using Cloudflare's text-to-speech service.
|
|
49
49
|
|
|
50
50
|
**input** (`string | NodeJS.ReadableStream`): Text or text stream to convert to speech.
|
|
51
51
|
|
|
52
|
-
**options
|
|
52
|
+
**options** (`Options`): Configuration options.
|
|
53
53
|
|
|
54
|
-
**options.
|
|
54
|
+
**options.speaker** (`string`): Voice ID to use for speech synthesis.
|
|
55
|
+
|
|
56
|
+
**options.format** (`string`): Output audio format.
|
|
55
57
|
|
|
56
58
|
Returns: `Promise<NodeJS.ReadableStream>`
|
|
57
59
|
|
|
58
|
-
### getSpeakers()
|
|
60
|
+
### `getSpeakers()`
|
|
59
61
|
|
|
60
62
|
Returns an array of available voice options, where each node contains:
|
|
61
63
|
|
|
@@ -72,7 +74,7 @@ Returns an array of available voice options, where each node contains:
|
|
|
72
74
|
- For production use, ensure your Cloudflare account has the appropriate Workers AI subscription
|
|
73
75
|
- Voice options are more limited compared to some other providers, but performance at the edge is excellent
|
|
74
76
|
|
|
75
|
-
## Related
|
|
77
|
+
## Related providers
|
|
76
78
|
|
|
77
79
|
If you need speech-to-text capabilities in addition to text-to-speech, consider using one of these providers:
|
|
78
80
|
|
|
@@ -4,7 +4,7 @@ The CompositeVoice class allows you to combine different voice providers for tex
|
|
|
4
4
|
|
|
5
5
|
CompositeVoice supports both Mastra voice providers and AI SDK model providers
|
|
6
6
|
|
|
7
|
-
## Constructor
|
|
7
|
+
## Constructor parameters
|
|
8
8
|
|
|
9
9
|
**config** (`object`): Configuration object for the composite voice service
|
|
10
10
|
|
|
@@ -16,7 +16,7 @@ CompositeVoice supports both Mastra voice providers and AI SDK model providers
|
|
|
16
16
|
|
|
17
17
|
## Methods
|
|
18
18
|
|
|
19
|
-
### speak()
|
|
19
|
+
### `speak()`
|
|
20
20
|
|
|
21
21
|
Converts text to speech using the configured speaking provider.
|
|
22
22
|
|
|
@@ -30,7 +30,7 @@ Notes:
|
|
|
30
30
|
- Options are passed through to the configured speaking provider
|
|
31
31
|
- Returns a stream of audio data
|
|
32
32
|
|
|
33
|
-
### listen()
|
|
33
|
+
### `listen()`
|
|
34
34
|
|
|
35
35
|
Converts speech to text using the configured listening provider.
|
|
36
36
|
|
|
@@ -44,7 +44,7 @@ Notes:
|
|
|
44
44
|
- Options are passed through to the configured listening provider
|
|
45
45
|
- Returns either a string or a stream of transcribed text, depending on the provider
|
|
46
46
|
|
|
47
|
-
### getSpeakers()
|
|
47
|
+
### `getSpeakers()`
|
|
48
48
|
|
|
49
49
|
Returns a list of available voices from the speaking provider, where each node contains:
|
|
50
50
|
|
|
@@ -59,7 +59,7 @@ Notes:
|
|
|
59
59
|
- Each voice object will have at least a voiceId property
|
|
60
60
|
- Additional voice properties depend on the speaking provider
|
|
61
61
|
|
|
62
|
-
## Usage
|
|
62
|
+
## Usage examples
|
|
63
63
|
|
|
64
64
|
### Using Mastra Voice Providers
|
|
65
65
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The Deepgram voice implementation in Mastra provides text-to-speech (TTS) and speech-to-text (STT) capabilities using Deepgram's API. It supports multiple voice models and languages, with configurable options for both speech synthesis and transcription.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { DeepgramVoice } from '@mastra/voice-deepgram'
|
|
@@ -30,7 +30,7 @@ const audioStream = await voice.speak('Hello, world!')
|
|
|
30
30
|
const transcript = await voice.listen(audioStream)
|
|
31
31
|
```
|
|
32
32
|
|
|
33
|
-
## Constructor
|
|
33
|
+
## Constructor parameters
|
|
34
34
|
|
|
35
35
|
**speechModel** (`DeepgramVoiceConfig`): Configuration for text-to-speech functionality. (Default: `{ name: 'aura' }`)
|
|
36
36
|
|
|
@@ -56,7 +56,7 @@ const transcript = await voice.listen(audioStream)
|
|
|
56
56
|
|
|
57
57
|
## Methods
|
|
58
58
|
|
|
59
|
-
### speak()
|
|
59
|
+
### `speak()`
|
|
60
60
|
|
|
61
61
|
Converts text to speech using the configured speech model and voice.
|
|
62
62
|
|
|
@@ -68,7 +68,7 @@ Converts text to speech using the configured speech model and voice.
|
|
|
68
68
|
|
|
69
69
|
Returns: `Promise<NodeJS.ReadableStream>`
|
|
70
70
|
|
|
71
|
-
### listen()
|
|
71
|
+
### `listen()`
|
|
72
72
|
|
|
73
73
|
Converts speech to text using the configured listening model.
|
|
74
74
|
|
|
@@ -78,7 +78,7 @@ Converts speech to text using the configured listening model.
|
|
|
78
78
|
|
|
79
79
|
Returns: `Promise<string>`
|
|
80
80
|
|
|
81
|
-
### getSpeakers()
|
|
81
|
+
### `getSpeakers()`
|
|
82
82
|
|
|
83
83
|
Returns a list of available voice options.
|
|
84
84
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The ElevenLabs voice implementation in Mastra provides high-quality text-to-speech (TTS) and speech-to-text (STT) capabilities using the ElevenLabs API.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { ElevenLabsVoice } from '@mastra/voice-elevenlabs'
|
|
@@ -26,7 +26,7 @@ const audioStream = await voice.speak('Hello, world!')
|
|
|
26
26
|
const speakers = await voice.getSpeakers()
|
|
27
27
|
```
|
|
28
28
|
|
|
29
|
-
## Constructor
|
|
29
|
+
## Constructor parameters
|
|
30
30
|
|
|
31
31
|
**speechModel** (`ElevenLabsVoiceConfig`): Configuration for text-to-speech functionality. (Default: `{ name: 'eleven_multilingual_v2' }`)
|
|
32
32
|
|
|
@@ -38,7 +38,7 @@ const speakers = await voice.getSpeakers()
|
|
|
38
38
|
|
|
39
39
|
## Methods
|
|
40
40
|
|
|
41
|
-
### speak()
|
|
41
|
+
### `speak()`
|
|
42
42
|
|
|
43
43
|
Converts text to speech using the configured speech model and voice.
|
|
44
44
|
|
|
@@ -50,7 +50,7 @@ Converts text to speech using the configured speech model and voice.
|
|
|
50
50
|
|
|
51
51
|
Returns: `Promise<NodeJS.ReadableStream>`
|
|
52
52
|
|
|
53
|
-
### getSpeakers()
|
|
53
|
+
### `getSpeakers()`
|
|
54
54
|
|
|
55
55
|
Returns an array of available voice options, where each node contains:
|
|
56
56
|
|
|
@@ -62,7 +62,7 @@ Returns an array of available voice options, where each node contains:
|
|
|
62
62
|
|
|
63
63
|
**gender** (`string`): Gender of the voice
|
|
64
64
|
|
|
65
|
-
### listen()
|
|
65
|
+
### `listen()`
|
|
66
66
|
|
|
67
67
|
Converts audio input to text using ElevenLabs Speech-to-Text API.
|
|
68
68
|
|
|
@@ -88,9 +88,9 @@ The options object supports the following properties:
|
|
|
88
88
|
|
|
89
89
|
Returns: `Promise<string>` - A Promise that resolves to the transcribed text
|
|
90
90
|
|
|
91
|
-
## Important
|
|
91
|
+
## Important notes
|
|
92
92
|
|
|
93
93
|
1. An ElevenLabs API key is required. Set it via the `ELEVENLABS_API_KEY` environment variable or pass it in the constructor.
|
|
94
94
|
2. The default speaker is set to Aria (ID: '9BWtsMINqrJLrRacOk9x').
|
|
95
|
-
3. Speech-to-text functionality
|
|
95
|
+
3. Speech-to-text functionality isn't supported by ElevenLabs.
|
|
96
96
|
4. Available speakers can be retrieved using the `getSpeakers()` method, which returns detailed information about each voice including language and gender.
|
|
@@ -1,8 +1,8 @@
|
|
|
1
|
-
# Google Gemini Live
|
|
1
|
+
# Google Gemini Live voice
|
|
2
2
|
|
|
3
3
|
The GeminiLiveVoice class provides real-time voice interaction capabilities using Google's Gemini Live API. It supports bidirectional audio streaming, tool calling, session management, and both standard Google API and Vertex AI authentication methods.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { GeminiLiveVoice } from '@mastra/voice-google-gemini-live'
|
|
@@ -88,7 +88,7 @@ voice.close()
|
|
|
88
88
|
|
|
89
89
|
## Configuration
|
|
90
90
|
|
|
91
|
-
### Constructor
|
|
91
|
+
### Constructor options
|
|
92
92
|
|
|
93
93
|
**apiKey** (`string`): Google API key for Gemini API authentication. Required unless using Vertex AI.
|
|
94
94
|
|
|
@@ -122,7 +122,7 @@ voice.close()
|
|
|
122
122
|
|
|
123
123
|
## Methods
|
|
124
124
|
|
|
125
|
-
### connect()
|
|
125
|
+
### `connect()`
|
|
126
126
|
|
|
127
127
|
Establishes a connection to the Gemini Live API. Must be called before using speak, listen, or send methods.
|
|
128
128
|
|
|
@@ -130,7 +130,7 @@ Establishes a connection to the Gemini Live API. Must be called before using spe
|
|
|
130
130
|
|
|
131
131
|
**returns** (`Promise<void>`): Promise that resolves when the connection is established.
|
|
132
132
|
|
|
133
|
-
### speak()
|
|
133
|
+
### `speak()`
|
|
134
134
|
|
|
135
135
|
Converts text to speech and sends it to the model. Can accept either a string or a readable stream as input.
|
|
136
136
|
|
|
@@ -138,15 +138,15 @@ Converts text to speech and sends it to the model. Can accept either a string or
|
|
|
138
138
|
|
|
139
139
|
**options** (`GeminiLiveVoiceOptions`): Optional speech configuration.
|
|
140
140
|
|
|
141
|
-
**options.speaker** (`GeminiVoiceName`): Voice ID to use for this specific speech request.
|
|
141
|
+
**options.speaker** (`GeminiVoiceName`): Voice ID to use for this specific speech request.
|
|
142
142
|
|
|
143
143
|
**options.languageCode** (`string`): Language code for the response.
|
|
144
144
|
|
|
145
|
-
**options.responseModalities** (`('AUDIO' | 'TEXT')[]`): Response modalities to receive from the model.
|
|
145
|
+
**options.responseModalities** (`('AUDIO' | 'TEXT')[]`): Response modalities to receive from the model.
|
|
146
146
|
|
|
147
147
|
Returns: `Promise<void>` (responses are emitted via `speaker` and `writing` events)
|
|
148
148
|
|
|
149
|
-
### listen()
|
|
149
|
+
### `listen()`
|
|
150
150
|
|
|
151
151
|
Processes audio input for speech recognition. Takes a readable stream of audio data and returns the transcribed text.
|
|
152
152
|
|
|
@@ -156,7 +156,7 @@ Processes audio input for speech recognition. Takes a readable stream of audio d
|
|
|
156
156
|
|
|
157
157
|
Returns: `Promise<string>` - The transcribed text
|
|
158
158
|
|
|
159
|
-
### send()
|
|
159
|
+
### `send()`
|
|
160
160
|
|
|
161
161
|
Streams audio data in real-time to the Gemini service for continuous audio streaming scenarios like live microphone input.
|
|
162
162
|
|
|
@@ -164,7 +164,7 @@ Streams audio data in real-time to the Gemini service for continuous audio strea
|
|
|
164
164
|
|
|
165
165
|
Returns: `Promise<void>`
|
|
166
166
|
|
|
167
|
-
### updateSessionConfig()
|
|
167
|
+
### `updateSessionConfig()`
|
|
168
168
|
|
|
169
169
|
Updates the session configuration dynamically. This can be used to modify voice settings, speaker selection, and other runtime configurations.
|
|
170
170
|
|
|
@@ -172,7 +172,7 @@ Updates the session configuration dynamically. This can be used to modify voice
|
|
|
172
172
|
|
|
173
173
|
Returns: `Promise<void>`
|
|
174
174
|
|
|
175
|
-
### addTools()
|
|
175
|
+
### `addTools()`
|
|
176
176
|
|
|
177
177
|
Adds a set of tools to the voice instance. Tools allow the model to perform additional actions during conversations. When GeminiLiveVoice is added to an Agent, any tools configured for the Agent will automatically be available to the voice interface.
|
|
178
178
|
|
|
@@ -180,7 +180,7 @@ Adds a set of tools to the voice instance. Tools allow the model to perform addi
|
|
|
180
180
|
|
|
181
181
|
Returns: `void`
|
|
182
182
|
|
|
183
|
-
### addInstructions()
|
|
183
|
+
### `addInstructions()`
|
|
184
184
|
|
|
185
185
|
Adds or updates system instructions for the model.
|
|
186
186
|
|
|
@@ -188,7 +188,7 @@ Adds or updates system instructions for the model.
|
|
|
188
188
|
|
|
189
189
|
Returns: `void`
|
|
190
190
|
|
|
191
|
-
### answer()
|
|
191
|
+
### `answer()`
|
|
192
192
|
|
|
193
193
|
Triggers a response from the model. This method is primarily used internally when integrated with an Agent.
|
|
194
194
|
|
|
@@ -196,25 +196,25 @@ Triggers a response from the model. This method is primarily used internally whe
|
|
|
196
196
|
|
|
197
197
|
Returns: `Promise<void>`
|
|
198
198
|
|
|
199
|
-
### getSpeakers()
|
|
199
|
+
### `getSpeakers()`
|
|
200
200
|
|
|
201
201
|
Returns a list of available voice speakers for the Gemini Live API.
|
|
202
202
|
|
|
203
203
|
Returns: `Promise<Array<{ voiceId: string; description?: string }>>`
|
|
204
204
|
|
|
205
|
-
### disconnect()
|
|
205
|
+
### `disconnect()`
|
|
206
206
|
|
|
207
207
|
Disconnects from the Gemini Live session and cleans up resources. This is the async method that properly handles cleanup.
|
|
208
208
|
|
|
209
209
|
Returns: `Promise<void>`
|
|
210
210
|
|
|
211
|
-
### close()
|
|
211
|
+
### `close()`
|
|
212
212
|
|
|
213
213
|
Synchronous wrapper for disconnect(). Calls disconnect() internally without awaiting.
|
|
214
214
|
|
|
215
215
|
Returns: `void`
|
|
216
216
|
|
|
217
|
-
### on()
|
|
217
|
+
### `on()`
|
|
218
218
|
|
|
219
219
|
Registers an event listener for voice events.
|
|
220
220
|
|
|
@@ -224,7 +224,7 @@ Registers an event listener for voice events.
|
|
|
224
224
|
|
|
225
225
|
Returns: `void`
|
|
226
226
|
|
|
227
|
-
### off()
|
|
227
|
+
### `off()`
|
|
228
228
|
|
|
229
229
|
Removes a previously registered event listener.
|
|
230
230
|
|
|
@@ -256,7 +256,7 @@ The GeminiLiveVoice class emits the following events:
|
|
|
256
256
|
|
|
257
257
|
**interrupt** (`event`): Interrupt events. Callback receives { type: 'user' | 'model', timestamp: number }.
|
|
258
258
|
|
|
259
|
-
## Available
|
|
259
|
+
## Available models
|
|
260
260
|
|
|
261
261
|
The following Gemini Live models are available:
|
|
262
262
|
|
|
@@ -268,7 +268,7 @@ The following Gemini Live models are available:
|
|
|
268
268
|
- `gemini-live-2.5-flash-preview`
|
|
269
269
|
- `gemini-2.6.flash-preview-tts`
|
|
270
270
|
|
|
271
|
-
## Available
|
|
271
|
+
## Available voices
|
|
272
272
|
|
|
273
273
|
The following voice options are available:
|
|
274
274
|
|
|
@@ -277,7 +277,7 @@ The following voice options are available:
|
|
|
277
277
|
- `Kore`: Neutral, professional
|
|
278
278
|
- `Fenrir`: Warm, approachable
|
|
279
279
|
|
|
280
|
-
## Authentication
|
|
280
|
+
## Authentication methods
|
|
281
281
|
|
|
282
282
|
### Gemini API (Development)
|
|
283
283
|
|
|
@@ -319,7 +319,7 @@ const voice = new GeminiLiveVoice({
|
|
|
319
319
|
})
|
|
320
320
|
```
|
|
321
321
|
|
|
322
|
-
## Advanced
|
|
322
|
+
## Advanced features
|
|
323
323
|
|
|
324
324
|
### Session Management
|
|
325
325
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The Google Voice implementation in Mastra provides both text-to-speech (TTS) and speech-to-text (STT) capabilities using Google Cloud services. It supports multiple voices, languages, advanced audio configuration options, and both standard API key authentication and Vertex AI mode for enterprise deployments.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { GoogleVoice } from '@mastra/voice-google'
|
|
@@ -30,7 +30,7 @@ const transcript = await voice.listen(audioStream, {
|
|
|
30
30
|
const voices = await voice.getSpeakers({ languageCode: 'en-US' })
|
|
31
31
|
```
|
|
32
32
|
|
|
33
|
-
## Constructor
|
|
33
|
+
## Constructor parameters
|
|
34
34
|
|
|
35
35
|
**speechModel** (`GoogleModelConfig`): Configuration for text-to-speech functionality (Default: `{ apiKey: process.env.GOOGLE_API_KEY }`)
|
|
36
36
|
|
|
@@ -58,7 +58,7 @@ const voices = await voice.getSpeakers({ languageCode: 'en-US' })
|
|
|
58
58
|
|
|
59
59
|
## Methods
|
|
60
60
|
|
|
61
|
-
### speak()
|
|
61
|
+
### `speak()`
|
|
62
62
|
|
|
63
63
|
Converts text to speech using Google Cloud Text-to-Speech service.
|
|
64
64
|
|
|
@@ -70,11 +70,11 @@ Converts text to speech using Google Cloud Text-to-Speech service.
|
|
|
70
70
|
|
|
71
71
|
**options.languageCode** (`string`): Language code for the voice (e.g., 'en-US'). Defaults to the language code from the speaker ID or 'en-US'
|
|
72
72
|
|
|
73
|
-
**options.audioConfig** (`ISynthesizeSpeechRequest['audioConfig']`): Audio configuration options from Google Cloud Text-to-Speech API
|
|
73
|
+
**options.audioConfig** (`ISynthesizeSpeechRequest['audioConfig']`): Audio configuration options from Google Cloud Text-to-Speech API
|
|
74
74
|
|
|
75
75
|
Returns: `Promise<NodeJS.ReadableStream>`
|
|
76
76
|
|
|
77
|
-
### listen()
|
|
77
|
+
### `listen()`
|
|
78
78
|
|
|
79
79
|
Converts speech to text using Google Cloud Speech-to-Text service.
|
|
80
80
|
|
|
@@ -84,11 +84,11 @@ Converts speech to text using Google Cloud Speech-to-Text service.
|
|
|
84
84
|
|
|
85
85
|
**options.stream** (`boolean`): Whether to use streaming recognition
|
|
86
86
|
|
|
87
|
-
**options.config** (`IRecognitionConfig`): Recognition configuration from Google Cloud Speech-to-Text API
|
|
87
|
+
**options.config** (`IRecognitionConfig`): Recognition configuration from Google Cloud Speech-to-Text API
|
|
88
88
|
|
|
89
89
|
Returns: `Promise<string>`
|
|
90
90
|
|
|
91
|
-
### getSpeakers()
|
|
91
|
+
### `getSpeakers()`
|
|
92
92
|
|
|
93
93
|
Returns an array of available voice options, where each node contains:
|
|
94
94
|
|
|
@@ -96,19 +96,19 @@ Returns an array of available voice options, where each node contains:
|
|
|
96
96
|
|
|
97
97
|
**languageCodes** (`string[]`): List of language codes supported by this voice
|
|
98
98
|
|
|
99
|
-
### isUsingVertexAI()
|
|
99
|
+
### `isUsingVertexAI()`
|
|
100
100
|
|
|
101
101
|
Checks if Vertex AI mode is enabled.
|
|
102
102
|
|
|
103
103
|
Returns: `boolean` - `true` if using Vertex AI, `false` otherwise
|
|
104
104
|
|
|
105
|
-
### getProject()
|
|
105
|
+
### `getProject()`
|
|
106
106
|
|
|
107
107
|
Gets the configured Google Cloud project ID.
|
|
108
108
|
|
|
109
109
|
Returns: `string | undefined` - The project ID or `undefined` if not set
|
|
110
110
|
|
|
111
|
-
### getLocation()
|
|
111
|
+
### `getLocation()`
|
|
112
112
|
|
|
113
113
|
Gets the configured Google Cloud location/region.
|
|
114
114
|
|
|
@@ -120,7 +120,7 @@ The Google Voice provider supports two authentication methods:
|
|
|
120
120
|
|
|
121
121
|
### Standard Mode (API Key)
|
|
122
122
|
|
|
123
|
-
Uses a Google Cloud API key for authentication. Suitable for development and
|
|
123
|
+
Uses a Google Cloud API key for authentication. Suitable for development and basic use cases.
|
|
124
124
|
|
|
125
125
|
```typescript
|
|
126
126
|
// Using environment variable (GOOGLE_API_KEY)
|
|
@@ -208,7 +208,7 @@ For long-audio Text-to-Speech operations:
|
|
|
208
208
|
- `operations.get` - Get operation status
|
|
209
209
|
- `operations.list` - List operations
|
|
210
210
|
|
|
211
|
-
## Important
|
|
211
|
+
## Important notes
|
|
212
212
|
|
|
213
213
|
1. **Authentication**: Either a Google Cloud API key (standard mode) or service account credentials (Vertex AI mode) is required.
|
|
214
214
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
The MastraVoice class is an abstract base class that defines the core interface for voice services in Mastra. All voice provider implementations (like OpenAI, Deepgram, PlayAI, Speechify) extend this class to provide their specific functionality. The class now includes support for real-time speech-to-speech capabilities through WebSocket connections.
|
|
4
4
|
|
|
5
|
-
## Usage
|
|
5
|
+
## Usage example
|
|
6
6
|
|
|
7
7
|
```typescript
|
|
8
8
|
import { MastraVoice } from '@mastra/core/voice'
|
|
@@ -77,7 +77,7 @@ class MyVoiceProvider extends MastraVoice {
|
|
|
77
77
|
}
|
|
78
78
|
```
|
|
79
79
|
|
|
80
|
-
## Constructor
|
|
80
|
+
## Constructor parameters
|
|
81
81
|
|
|
82
82
|
**config** (`VoiceConfig`): Configuration object for the voice service
|
|
83
83
|
|
|
@@ -105,11 +105,11 @@ class MyVoiceProvider extends MastraVoice {
|
|
|
105
105
|
|
|
106
106
|
**config.realtimeConfig.options** (`unknown`): Provider-specific options for real-time capabilities
|
|
107
107
|
|
|
108
|
-
## Abstract
|
|
108
|
+
## Abstract methods
|
|
109
109
|
|
|
110
110
|
These methods must be implemented by unknown class extending MastraVoice.
|
|
111
111
|
|
|
112
|
-
### speak()
|
|
112
|
+
### `speak()`
|
|
113
113
|
|
|
114
114
|
Converts text to speech using the configured speech model.
|
|
115
115
|
|
|
@@ -131,7 +131,7 @@ Purpose:
|
|
|
131
131
|
- Returns a stream of audio data that can be played or saved
|
|
132
132
|
- May return void if the audio is handled by emitting 'speaking' event
|
|
133
133
|
|
|
134
|
-
### listen()
|
|
134
|
+
### `listen()`
|
|
135
135
|
|
|
136
136
|
Converts speech to text using the configured listening model.
|
|
137
137
|
|
|
@@ -152,7 +152,7 @@ Purpose:
|
|
|
152
152
|
- Not all providers support this functionality (e.g., PlayAI, Speechify)
|
|
153
153
|
- May return void if the transcription is handled by emitting 'writing' event
|
|
154
154
|
|
|
155
|
-
### getSpeakers()
|
|
155
|
+
### `getSpeakers()`
|
|
156
156
|
|
|
157
157
|
Returns a list of available voices supported by the provider.
|
|
158
158
|
|
|
@@ -167,11 +167,11 @@ Purpose:
|
|
|
167
167
|
- Providers can include additional metadata about each voice
|
|
168
168
|
- Used to discover available voices for text-to-speech conversion
|
|
169
169
|
|
|
170
|
-
## Optional
|
|
170
|
+
## Optional methods
|
|
171
171
|
|
|
172
172
|
These methods have default implementations but can be overridden by voice providers that support speech-to-speech capabilities.
|
|
173
173
|
|
|
174
|
-
### connect()
|
|
174
|
+
### `connect()`
|
|
175
175
|
|
|
176
176
|
Establishes a WebSocket or WebRTC connection for communication.
|
|
177
177
|
|
|
@@ -186,7 +186,7 @@ Purpose:
|
|
|
186
186
|
- Returns a Promise that resolves when the connection is established
|
|
187
187
|
- Configuration is provider-specific
|
|
188
188
|
|
|
189
|
-
### send()
|
|
189
|
+
### `send()`
|
|
190
190
|
|
|
191
191
|
Streams audio data in real-time to the voice provider.
|
|
192
192
|
|
|
@@ -201,7 +201,7 @@ Purpose:
|
|
|
201
201
|
- Supports both ReadableStream and Int16Array audio formats
|
|
202
202
|
- Must be in connected state before calling this method
|
|
203
203
|
|
|
204
|
-
### answer()
|
|
204
|
+
### `answer()`
|
|
205
205
|
|
|
206
206
|
Triggers the voice provider to generate a response.
|
|
207
207
|
|
|
@@ -215,7 +215,7 @@ Purpose:
|
|
|
215
215
|
- Used in real-time conversations to prompt the AI to respond
|
|
216
216
|
- Response will be emitted through the event system (e.g., 'speaking' event)
|
|
217
217
|
|
|
218
|
-
### addTools()
|
|
218
|
+
### `addTools()`
|
|
219
219
|
|
|
220
220
|
Equips the voice provider with tools that can be used during conversations.
|
|
221
221
|
|
|
@@ -229,7 +229,7 @@ Purpose:
|
|
|
229
229
|
- Tools can extend the capabilities of the voice provider
|
|
230
230
|
- Implementation is provider-specific
|
|
231
231
|
|
|
232
|
-
### close()
|
|
232
|
+
### `close()`
|
|
233
233
|
|
|
234
234
|
Disconnects from the WebSocket or WebRTC connection.
|
|
235
235
|
|
|
@@ -243,7 +243,7 @@ Purpose:
|
|
|
243
243
|
- Cleans up resources and stops any ongoing real-time processing
|
|
244
244
|
- Should be called when you're done with the voice instance
|
|
245
245
|
|
|
246
|
-
### on()
|
|
246
|
+
### `on()`
|
|
247
247
|
|
|
248
248
|
Registers an event listener for voice events.
|
|
249
249
|
|
|
@@ -261,7 +261,7 @@ Purpose:
|
|
|
261
261
|
- Providers can emit custom events as well
|
|
262
262
|
- Event data structure depends on the event type
|
|
263
263
|
|
|
264
|
-
### off()
|
|
264
|
+
### `off()`
|
|
265
265
|
|
|
266
266
|
Removes an event listener.
|
|
267
267
|
|
|
@@ -277,7 +277,7 @@ Purpose:
|
|
|
277
277
|
- Removes a previously registered event listener
|
|
278
278
|
- Used to clean up event handlers when they're no longer needed
|
|
279
279
|
|
|
280
|
-
## Event
|
|
280
|
+
## Event system
|
|
281
281
|
|
|
282
282
|
The MastraVoice class includes an event system for real-time communication. Standard event types include:
|
|
283
283
|
|
|
@@ -287,7 +287,7 @@ The MastraVoice class includes an event system for real-time communication. Stan
|
|
|
287
287
|
|
|
288
288
|
**error** (`{ message: string; code?: string; details?: unknown }`): Emitted when an error occurs
|
|
289
289
|
|
|
290
|
-
## Protected
|
|
290
|
+
## Protected properties
|
|
291
291
|
|
|
292
292
|
**listeningModel** (`BuiltInModelConfig | undefined`): Configuration for the speech-to-text model
|
|
293
293
|
|
|
@@ -297,13 +297,13 @@ The MastraVoice class includes an event system for real-time communication. Stan
|
|
|
297
297
|
|
|
298
298
|
**realtimeConfig** (`{ model?: string; apiKey?: string; options?: unknown } | undefined`): Configuration for real-time speech-to-speech capabilities
|
|
299
299
|
|
|
300
|
-
## Telemetry
|
|
300
|
+
## Telemetry support
|
|
301
301
|
|
|
302
302
|
MastraVoice includes built-in telemetry support through the `traced` method, which wraps method calls with performance tracking and error monitoring.
|
|
303
303
|
|
|
304
304
|
## Notes
|
|
305
305
|
|
|
306
|
-
- MastraVoice is an abstract class and
|
|
306
|
+
- MastraVoice is an abstract class and can't be instantiated directly
|
|
307
307
|
- Implementations must provide concrete implementations for all abstract methods
|
|
308
308
|
- The class provides a consistent interface across different voice service providers
|
|
309
309
|
- Speech-to-speech capabilities are optional and provider-specific
|