@juspay/neurolink 9.61.1 → 9.62.0

package/CHANGELOG.md

@@ -1,3 +1,15 @@
+## [9.62.0](https://github.com/juspay/neurolink/compare/v9.61.2...v9.62.0) (2026-05-07)
+
+### Features
+
+- **(voice):** add multi-provider TTS, STT, and realtime voice integration ([4b26485](https://github.com/juspay/neurolink/commit/4b26485b6408eed29b2c608afb98a131fcb4a5ba))
+
+## [9.61.2](https://github.com/juspay/neurolink/compare/v9.61.1...v9.61.2) (2026-05-07)
+
+### Bug Fixes
+
+- **(hitl):** prevent duplicate confirmation prompts on tool retry ([14e4890](https://github.com/juspay/neurolink/commit/14e4890d8613ae264f8c8bbd064f882ad4cc22f5))
+
 ## [9.61.1](https://github.com/juspay/neurolink/compare/v9.61.0...v9.61.1) (2026-05-04)
 
 ### Bug Fixes

package/README.md

@@ -40,23 +40,25 @@ Extracted from production systems at Juspay and battle-tested at enterprise scal
 
 ## What's New (Q1 2026)
 
-| Feature                             | Version | Description                                                                                                                                                                                                          | Guide                                                                 |
-| ----------------------------------- | ------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------- |
-| **Gemini 3 Multi-turn Tool Fix**    | v9.49.0 | Fixed multi-step agentic tool calling on Vertex AI Gemini 3 models. Correct `thoughtSignature` replay, `stepIndex` parallel-call grouping, `executionId` session isolation, 5-min timeout, silent-timeout surfacing. | [Vertex AI Guide](docs/getting-started/providers/google-vertex.md)    |
-| **AutoResearch**                    | v9.17.0 | Autonomous AI experiment engine: proposes code changes, runs experiments, evaluates metrics, keeps improvements — unattended for hours.                                                                              | [AutoResearch Guide](docs/features/autoresearch.md)                   |
-| **MCP Enhancements**                | v9.16.0 | Advanced MCP features: tool routing, result caching, request batching, annotations, elicitation, custom server base, multi-server management                                                                         | [MCP Enhancements Guide](docs/features/mcp-enhancements.md)           |
-| **Memory**                          | v9.12.0 | Per-user condensed memory that persists across conversations. LLM-powered condensation with S3, Redis, or SQLite backends.                                                                                           | [Memory Guide](docs/features/memory.md)                               |
-| **Context Window Management**       | v9.2.0  | 4-stage compaction pipeline with auto-detection, budget gate at 80% usage, per-provider token estimation                                                                                                             | [Context Compaction Guide](docs/features/context-compaction.md)       |
-| **Tool Execution Control**          | v9.3.0  | `prepareStep` and `toolChoice` support for per-step tool enforcement in multi-step agentic loops. API-level control over tool calls.                                                                                 | [API Reference](docs/api/type-aliases/GenerateOptions.md#preparestep) |
-| **File Processor System**           | v9.1.0  | 17+ file type processors with ProcessorRegistry, security sanitization, SVG text injection                                                                                                                           | [File Processors Guide](docs/features/file-processors.md)             |
-| **RAG with generate()/stream()**    | v9.2.0  | Pass `rag: { files }` to generate/stream for automatic document chunking, embedding, and AI-powered search. 10 chunking strategies, hybrid search, reranking.                                                        | [RAG Guide](docs/features/rag.md)                                     |
-| **External TracerProvider Support** | v8.43.0 | Integrate NeuroLink with existing OpenTelemetry instrumentation. Prevents duplicate registration conflicts.                                                                                                          | [Observability Guide](docs/features/observability.md)                 |
-| **Server Adapters**                 | v8.43.0 | Multi-framework HTTP server with Hono, Express, Fastify, Koa support. Full CLI for server management with foreground/background modes.                                                                               | [Server Adapters Guide](docs/guides/server-adapters/index.md)         |
-| **Title Generation Events**         | v8.38.0 | Emit `conversation:titleGenerated` event when conversation title is generated. Supports custom title prompts via `NEUROLINK_TITLE_PROMPT`.                                                                           | [Conversation Memory Guide](docs/conversation-memory.md)              |
-| **Video Generation with Veo**       | v8.32.0 | Video generation using Veo 3.1 (`veo-3.1`). Realistic video generation with many parameter options                                                                                                                   | [Video Generation Guide](docs/features/video-generation.md)           |
-| **Image Generation with Gemini**    | v8.31.0 | Native image generation using Gemini 2.0 Flash Experimental (`imagen-3.0-generate-002`). High-quality image synthesis directly from Google AI.                                                                       | [Image Generation Guide](docs/image-generation-streaming.md)          |
-| **HTTP/Streamable HTTP Transport**  | v8.29.0 | Connect to remote MCP servers via HTTP with authentication headers, automatic retry with exponential backoff, and configurable rate limiting.                                                                        | [HTTP Transport Guide](docs/mcp-http-transport.md)                    |
-
+| Feature                             | Version    | Description                                                                                                                                                                                                          | Guide                                                                          |
+| ----------------------------------- | ---------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------ |
+| **Multi-Provider Voice (TTS/STT)**  | unreleased | 4 TTS providers (OpenAI TTS, ElevenLabs, Google TTS, Azure TTS) + 4 STT providers (Whisper, Deepgram, Azure STT, Google STT) + 2 realtime APIs (OpenAI Realtime, Gemini Live). CLI `--tts` / `--stt` flags.          | [TTS Guide](docs/features/tts.md) \| [STT Guide](docs/features/audio-input.md) |
+| **Gemini 3 Multi-turn Tool Fix**    | v9.49.0    | Fixed multi-step agentic tool calling on Vertex AI Gemini 3 models. Correct `thoughtSignature` replay, `stepIndex` parallel-call grouping, `executionId` session isolation, 5-min timeout, silent-timeout surfacing. | [Vertex AI Guide](docs/getting-started/providers/google-vertex.md)             |
+| **AutoResearch**                    | v9.17.0    | Autonomous AI experiment engine: proposes code changes, runs experiments, evaluates metrics, keeps improvements — unattended for hours.                                                                              | [AutoResearch Guide](docs/features/autoresearch.md)                            |
+| **MCP Enhancements**                | v9.16.0    | Advanced MCP features: tool routing, result caching, request batching, annotations, elicitation, custom server base, multi-server management                                                                         | [MCP Enhancements Guide](docs/features/mcp-enhancements.md)                    |
+| **Memory**                          | v9.12.0    | Per-user condensed memory that persists across conversations. LLM-powered condensation with S3, Redis, or SQLite backends.                                                                                           | [Memory Guide](docs/features/memory.md)                                        |
+| **Context Window Management**       | v9.2.0     | 4-stage compaction pipeline with auto-detection, budget gate at 80% usage, per-provider token estimation                                                                                                             | [Context Compaction Guide](docs/features/context-compaction.md)                |
+| **Tool Execution Control**          | v9.3.0     | `prepareStep` and `toolChoice` support for per-step tool enforcement in multi-step agentic loops. API-level control over tool calls.                                                                                 | [API Reference](docs/api/type-aliases/GenerateOptions.md#preparestep)          |
+| **File Processor System**           | v9.1.0     | 17+ file type processors with ProcessorRegistry, security sanitization, SVG text injection                                                                                                                           | [File Processors Guide](docs/features/file-processors.md)                      |
+| **RAG with generate()/stream()**    | v9.2.0     | Pass `rag: { files }` to generate/stream for automatic document chunking, embedding, and AI-powered search. 10 chunking strategies, hybrid search, reranking.                                                        | [RAG Guide](docs/features/rag.md)                                              |
+| **External TracerProvider Support** | v8.43.0    | Integrate NeuroLink with existing OpenTelemetry instrumentation. Prevents duplicate registration conflicts.                                                                                                          | [Observability Guide](docs/features/observability.md)                          |
+| **Server Adapters**                 | v8.43.0    | Multi-framework HTTP server with Hono, Express, Fastify, Koa support. Full CLI for server management with foreground/background modes.                                                                               | [Server Adapters Guide](docs/guides/server-adapters/index.md)                  |
+| **Title Generation Events**         | v8.38.0    | Emit `conversation:titleGenerated` event when conversation title is generated. Supports custom title prompts via `NEUROLINK_TITLE_PROMPT`.                                                                           | [Conversation Memory Guide](docs/conversation-memory.md)                       |
+| **Video Generation with Veo**       | v8.32.0    | Video generation using Veo 3.1 (`veo-3.1`). Realistic video generation with many parameter options                                                                                                                   | [Video Generation Guide](docs/features/video-generation.md)                    |
+| **Image Generation with Gemini**    | v8.31.0    | Native image generation using Gemini 2.0 Flash Experimental (`imagen-3.0-generate-002`). High-quality image synthesis directly from Google AI.                                                                       | [Image Generation Guide](docs/image-generation-streaming.md)                   |
+| **HTTP/Streamable HTTP Transport**  | v8.29.0    | Connect to remote MCP servers via HTTP with authentication headers, automatic retry with exponential backoff, and configurable rate limiting.                                                                        | [HTTP Transport Guide](docs/mcp-http-transport.md)                             |
+
+- **Multi-Provider Voice (TTS/STT)** – Full voice pipeline with 4 TTS providers (OpenAI TTS, ElevenLabs, Google TTS, Azure TTS), 4 STT providers (Whisper, Deepgram, Azure STT, Google STT), and 2 realtime APIs (OpenAI Realtime, Gemini Live). Pass `--tts` / `--stt` flags in the CLI or configure via `tts` / `stt` in the SDK. → [TTS Guide](docs/features/tts.md) | [STT Guide](docs/features/audio-input.md) | [Realtime Guide](docs/features/real-time-services.md)
 - **AutoResearch** – Autonomous AI experiment engine inspired by Karpathy's autoresearch. Phase-gated tool access, git-backed safety, deterministic metric evaluation, and TaskManager integration for continuous unattended research. 12 research tools, 10 typed events, 9 CLI subcommands. → [AutoResearch Guide](docs/features/autoresearch.md)
 - **Memory** – Per-user condensed memory that persists across all conversations. Automatically retrieves and stores memory on each `generate()`/`stream()` call. Supports S3, Redis, and SQLite storage with LLM-powered condensation. → [Memory Guide](docs/features/memory.md)
 - **External TracerProvider Support** – Integrate NeuroLink with applications that already have OpenTelemetry instrumentation. Supports auto-detection and manual configuration. → [Observability Guide](docs/features/observability.md)
@@ -435,6 +437,10 @@ NeuroLink is a comprehensive AI development platform. Every feature below is pro
 | **NVIDIA NIM**        | Llama 3.3 70B, 400+ catalog models                 | ❌              | ✅ Full      | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#nvidia-nim)                                                              |
 | **LM Studio**         | Any model loaded in LM Studio (local)              | ✅ Free (Local) | ✅ Full      | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#lm-studio)                                                               |
 | **llama.cpp**         | Any GGUF model served by llama-server (local)      | ✅ Free (Local) | ✅ Full      | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#llamacpp)                                                                |
+| **OpenAI TTS**        | TTS-1, TTS-1-HD, GPT-4o Audio                      | ❌              | N/A          | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#openai-tts)                                                              |
+| **ElevenLabs**        | Multilingual v2, Turbo v2.5, Flash v2.5            | ✅ Free Tier    | N/A          | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#elevenlabs)                                                              |
+| **Deepgram**          | Nova-3, Nova-2, Enhanced, Base (STT)               | ✅ Free Tier    | N/A          | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#deepgram)                                                                |
+| **Azure Speech**      | Azure Cognitive Services TTS + STT                 | ❌              | N/A          | ✅ Production | [Setup Guide](docs/getting-started/provider-setup.md#azure-speech)                                                            |
 
 **[📖 Provider Comparison Guide](docs/reference/provider-comparison.md)** - Detailed feature matrix and selection criteria
 **[🔬 Provider Feature Compatibility](docs/reference/provider-feature-compatibility.md)** - Test-based compatibility reference for all 19 features across 13 providers

package/dist/adapters/tts/googleTTSHandler.js

@@ -107,7 +107,7 @@ export class GoogleTTSHandler {
                 const languageCodes = voice.languageCodes;
                 const primaryLanguageCode = languageCodes[0];
                 const voiceType = this.detectVoiceType(voiceName);
-                // Map Google's ssmlGender → internal Gender
+                // Map Google's ssmlGender → internal TTSGender
                 const gender = voice.ssmlGender === "MALE"
                     ? "male"
                     : voice.ssmlGender === "FEMALE"