@micdrop/elevenlabs 1.0.0 → 1.0.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -1,29 +1,13 @@
1
1
  # @micdrop/elevenlabs
2
2
 
3
- ElevenLabs implementation for [@micdrop/server](../server/README.md).
3
+ [Micdrop website](https://micdrop.dev) | [Documentation](https://micdrop.dev/docs/ai-integration/provided-integrations/elevenlabs)
4
4
 
5
- This package provides high-quality real-time text-to-speech implementation using ElevenLabs' streaming API.
6
-
7
- ## Features
8
-
9
- - 🎙️ **ElevenLabs TTS** - High-quality streaming text-to-speech with:
10
- - Real-time audio streaming via WebSocket
11
- - Multiple voice models (Multilingual V2, Turbo V2.5, Flash V2.5)
12
- - Customizable voice settings (stability, similarity, style)
13
- - Support for 29+ languages
14
- - Automatic reconnection on connection loss
15
- - Streaming cancellation support
16
- - Keep-alive functionality for long sessions
17
- - 🚀 **ElevenLabsFetchTTS** - Simple fetch-based TTS for non-streaming use cases
5
+ ElevenLabs implementation for [@micdrop/server](https://micdrop.dev/docs/server).
18
6
 
19
7
  ## Installation
20
8
 
21
9
  ```bash
22
10
  npm install @micdrop/elevenlabs
23
- # or
24
- yarn add @micdrop/elevenlabs
25
- # or
26
- pnpm add @micdrop/elevenlabs
27
11
  ```
28
12
 
29
13
  ## ElevenLabs TTS (Text-to-Speech)
@@ -53,108 +37,9 @@ new MicdropServer(socket, {
53
37
  })
54
38
  ```
55
39
 
56
- ### Options
57
-
58
- | Option | Type | Default | Description |
59
- | --------------- | ------------------------------------------------------------------------ | --------------------- | --------------------------------- |
60
- | `apiKey` | `string` | Required | Your ElevenLabs API key |
61
- | `voiceId` | `string` | Required | ElevenLabs voice ID |
62
- | `modelId` | `'eleven_multilingual_v2' \| 'eleven_turbo_v2_5' \| 'eleven_flash_v2_5'` | `'eleven_turbo_v2_5'` | Model to use for speech synthesis |
63
- | `language` | `string` | Optional | Language code (e.g., 'en', 'fr') |
64
- | `outputFormat` | `TextToSpeechStreamRequestOutputFormat` | `'pcm_16000'` | Audio output format |
65
- | `voiceSettings` | `VoiceSettings` | Optional | Voice customization settings |
66
-
67
- ### Voice Settings
68
-
69
- The `voiceSettings` option allows you to customize the voice characteristics:
70
-
71
- ```typescript
72
- const tts = new ElevenLabsTTS({
73
- apiKey: 'your-api-key',
74
- voiceId: 'your-voice-id',
75
- voiceSettings: {
76
- stability: 0.5, // 0.0 to 1.0 - Lower = more variable, Higher = more stable
77
- similarity_boost: 0.75, // 0.0 to 1.0 - How closely to match the original voice
78
- style: 0.5, // 0.0 to 1.0 - Exaggeration of the style
79
- use_speaker_boost: true, // Boost the similarity to the speaker
80
- },
81
- })
82
- ```
83
-
84
- ### Supported Models
85
-
86
- | Model | Description | Languages | Speed |
87
- | ------------------------ | -------------------------------------------- | ------------- | --------- |
88
- | `eleven_multilingual_v2` | High-quality multilingual model | 29+ languages | Standard |
89
- | `eleven_turbo_v2_5` | Fast, high-quality model optimized for speed | English | Fast |
90
- | `eleven_flash_v2_5` | Ultra-fast model for real-time applications | English | Very Fast |
91
-
92
- ### Supported Languages
93
-
94
- ElevenLabs supports 29+ languages including:
95
-
96
- | Code | Language | Code | Language | Code | Language |
97
- | ---- | -------- | ---- | -------- | ---- | ---------- |
98
- | `en` | English | `es` | Spanish | `fr` | French |
99
- | `de` | German | `it` | Italian | `pt` | Portuguese |
100
- | `pl` | Polish | `tr` | Turkish | `ru` | Russian |
101
- | `nl` | Dutch | `cs` | Czech | `ar` | Arabic |
102
- | `zh` | Chinese | `ja` | Japanese | `hu` | Hungarian |
103
- | `ko` | Korean | `hi` | Hindi | `fi` | Finnish |
104
-
105
- ## ElevenLabsFetchTTS (Non-Streaming)
106
-
107
- For simpler use cases where you don't need real-time streaming:
108
-
109
- ```typescript
110
- import { ElevenLabsFetchTTS } from '@micdrop/elevenlabs'
111
-
112
- const tts = new ElevenLabsFetchTTS({
113
- apiKey: process.env.ELEVENLABS_API_KEY || '',
114
- voiceId: '21m00Tcm4TlvDq8ikWAM',
115
- modelId: 'eleven_turbo_v2_5',
116
- })
117
-
118
- // This will wait for the complete text before generating audio
119
- new MicdropServer(socket, {
120
- tts,
121
- // ... other options
122
- })
123
- ```
124
-
125
- ## Getting Started
126
-
127
- 1. Sign up for an [ElevenLabs account](https://elevenlabs.io) and get your API key
128
- 2. Choose a voice from the ElevenLabs voice library or create a custom voice
129
- 3. Install the package and configure with your credentials
130
-
131
- ```typescript
132
- import { ElevenLabsTTS } from '@micdrop/elevenlabs'
133
-
134
- const tts = new ElevenLabsTTS({
135
- apiKey: 'your-elevenlabs-api-key',
136
- voiceId: 'your-voice-id', // Get this from ElevenLabs dashboard
137
- modelId: 'eleven_turbo_v2_5', // Choose based on your needs
138
- language: 'en',
139
- voiceSettings: {
140
- stability: 0.5,
141
- similarity_boost: 0.75,
142
- },
143
- })
144
-
145
- // Use with MicdropServer
146
- new MicdropServer(socket, {
147
- tts,
148
- // ... other options
149
- })
150
- ```
151
-
152
- ### Finding Voice IDs
153
-
154
- You can find voice IDs in several ways:
40
+ ## Documentation
155
41
 
156
- 1. **ElevenLabs Dashboard**: Browse voices in your ElevenLabs account
157
- 2. **Voice Library**: Use the public voice library API
42
+ Read full [documentation of the ElevenLabs integration for Micdrop](https://micdrop.dev/docs/ai-integration/provided-integrations/elevenlabs) on the [website](https://micdrop.dev).
158
43
 
159
44
  ## License
160
45
 
package/dist/index.js CHANGED
@@ -115,7 +115,7 @@ var ElevenLabsTTS = class extends import_server2.TTS {
115
115
  this.receivedAudioText = "";
116
116
  this.canceled = false;
117
117
  this.initPromise = this.initWS().catch((error) => {
118
- this.log("Connection error:", error);
118
+ console.error("[ElevenLabsTTS] Connection error:", error);
119
119
  });
120
120
  }
121
121
  speak(textStream) {
@@ -164,6 +164,7 @@ var ElevenLabsTTS = class extends import_server2.TTS {
164
164
  this.receivedAudioText = "";
165
165
  this.audioStream.end();
166
166
  this.audioStream = void 0;
167
+ this.socket?.send(JSON.stringify({ text: " ", flush: true }));
167
168
  }
168
169
  destroy() {
169
170
  if (this.reconnectTimeout) {
package/dist/index.js.map CHANGED
@@ -1 +1 @@
1
- {"version":3,"sources":["../src/index.ts","../src/ElevenLabsFetchTTS.ts","../src/types.ts","../src/ElevenLabsTTS.ts"],"sourcesContent":["export * from './ElevenLabsFetchTTS'\nexport * from './ElevenLabsTTS'\nexport * from './types'\n","import { ElevenLabsClient } from '@elevenlabs/elevenlabs-js'\nimport { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport { text } from 'stream/consumers'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n} from './types'\n\nexport class ElevenLabsFetchTTS extends TTS {\n private elevenlabs: ElevenLabsClient\n private speechStream: ReadableStream<Uint8Array> | null = null\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n this.elevenlabs = new ElevenLabsClient({\n apiKey: this.options.apiKey,\n })\n }\n\n speak(textStream: Readable) {\n const audioStream = new PassThrough()\n\n const run = async () => {\n try {\n const textContent = await text(textStream)\n const stream = await this.elevenlabs.textToSpeech.stream(\n this.options.voiceId,\n {\n text: textContent,\n modelId: this.options.modelId || DEFAULT_MODEL_ID,\n outputFormat: this.options.outputFormat || DEFAULT_OUTPUT_FORMAT,\n languageCode: this.options.language,\n voiceSettings: this.options.voiceSettings,\n }\n )\n this.speechStream = stream\n for await (const chunk of stream) {\n audioStream.write(chunk)\n }\n } catch (error) {\n if (error instanceof Error && error.name === 'AbortError') {\n // Stream was cancelled. This is expected.\n } else {\n audioStream.emit('error', error as Error)\n }\n } finally {\n audioStream.end()\n this.speechStream = null\n }\n }\n run()\n\n return audioStream\n }\n\n cancel() {\n if (!this.speechStream) return\n this.log('Cancel')\n this.speechStream.cancel?.()\n this.speechStream = null\n }\n}\n","import {\n TextToSpeechStreamRequestOutputFormat,\n VoiceSettings,\n} from '@elevenlabs/elevenlabs-js/api'\n\nexport interface ElevenLabsTTSOptions {\n apiKey: string\n voiceId: string\n modelId?: 'eleven_multilingual_v2' | 'eleven_turbo_v2_5' | 'eleven_flash_v2_5'\n language?: string\n outputFormat?: TextToSpeechStreamRequestOutputFormat\n voiceSettings?: VoiceSettings\n}\n\nexport const DEFAULT_MODEL_ID = 'eleven_turbo_v2_5'\nexport const DEFAULT_OUTPUT_FORMAT = 'pcm_16000'\n\nexport type ElevenLabsWebSocketMessage =\n | ElevenLabsWebSocketAudioOutputMessage\n | ElevenLabsWebSocketFinalOutputMessage\n | ElevenLabsWebSocketErrorMessage\n\nexport interface ElevenLabsWebSocketAudioOutputMessage {\n audio: string\n normalizedAlignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n alignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n isFinal?: boolean | null\n}\n\nexport interface ElevenLabsWebSocketAudioOutputMessageAlignment {\n chars: string[]\n charStartTimesMs: number[]\n charDurationsMs: number[]\n}\n\nexport interface ElevenLabsWebSocketFinalOutputMessage {\n isFinal: boolean\n}\n\nexport interface ElevenLabsWebSocketErrorMessage {\n message: string\n error: string\n code: number\n}\n","import { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport WebSocket from 'ws'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n ElevenLabsWebSocketAudioOutputMessage,\n ElevenLabsWebSocketMessage,\n} from './types'\n\n// API Reference: https://elevenlabs.io/docs/api-reference/text-to-speech/v-1-text-to-speech-voice-id-stream-input\n\nconst WS_INACTIVITY_TIMEOUT = 180\n\nexport class ElevenLabsTTS extends TTS {\n private socket?: WebSocket\n private initPromise: Promise<void>\n private audioStream?: PassThrough\n private textEnded = false // Whether the text stream has ended\n private textSent = '' // Text sent to ElevenLabs\n private textBuffer = '' // Buffer of text to send to ElevenLabs\n private receivedAudioText = '' // Text of chunks received from ElevenLabs\n private keepAliveInterval?: NodeJS.Timeout\n private reconnectTimeout?: NodeJS.Timeout\n private canceled = false\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n // Setup WebSocket connection\n this.initPromise = this.initWS().catch((error) => {\n this.log('Connection error:', error)\n })\n }\n\n speak(textStream: Readable) {\n this.canceled = false\n this.audioStream?.end()\n this.audioStream = new PassThrough()\n this.textEnded = false\n this.textBuffer = ''\n this.textSent = ''\n this.receivedAudioText = ''\n\n // Forward text chunks coming from the caller to ElevenLabs\n textStream.on('data', async (chunk) => {\n if (this.canceled) return\n await this.initPromise\n const text = chunk.toString('utf-8').replace(/[\\r\\n]+/g, ' ')\n const spaceIndex = text.lastIndexOf(' ')\n if (spaceIndex === -1) {\n this.textBuffer += text\n } else {\n this.sendTranscript(this.textBuffer + text.slice(0, spaceIndex + 1))\n this.textBuffer = text.slice(spaceIndex + 1)\n }\n })\n\n textStream.on('error', (error) => {\n this.log('Error in text stream, ending audio stream', error)\n this.audioStream?.end()\n this.audioStream = undefined\n })\n\n textStream.on('end', async () => {\n if (this.canceled) return\n await this.initPromise\n // Send last buffered text\n if (this.textBuffer.trim()) {\n this.sendTranscript(this.textBuffer + ' ')\n this.textBuffer = ''\n }\n this.textEnded = true\n // Flush buffered text and mark end of utterance.\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n this.log('Flushed text')\n })\n\n return this.audioStream\n }\n\n cancel() {\n if (!this.audioStream) return\n this.log('Cancel')\n this.canceled = true\n this.textSent = ''\n this.receivedAudioText = ''\n this.audioStream.end()\n this.audioStream = undefined\n }\n\n destroy() {\n if (this.reconnectTimeout) {\n clearTimeout(this.reconnectTimeout)\n this.reconnectTimeout = undefined\n }\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n this.socket?.removeAllListeners()\n if (this.socket?.readyState === WebSocket.OPEN) {\n this.socket?.close(1000)\n }\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n super.destroy()\n }\n\n private initWS(): Promise<void> {\n return new Promise((resolve, reject) => {\n // Build query params\n const params = new URLSearchParams()\n params.append('model_id', this.options.modelId ?? DEFAULT_MODEL_ID)\n params.append(\n 'output_format',\n this.options.outputFormat ?? DEFAULT_OUTPUT_FORMAT\n )\n params.append('inactivity_timeout', WS_INACTIVITY_TIMEOUT.toString())\n params.append(\n 'voice_settings',\n JSON.stringify(this.options.voiceSettings)\n )\n if (this.options.language) {\n params.append('language_code', this.options.language)\n }\n\n const uri = `wss://api.elevenlabs.io/v1/text-to-speech/${this.options.voiceId}/stream-input?${params.toString()}`\n\n // Connect to ElevenLabs\n const socket = new WebSocket(uri, {\n headers: {\n 'xi-api-key': this.options.apiKey,\n },\n })\n this.socket = socket\n\n socket.addEventListener('open', () => {\n this.log('Connection opened')\n\n // Send initialization / keep-alive message with voice settings\n this.socket?.send(\n JSON.stringify({\n text: ' ',\n voice_settings: this.options.voiceSettings,\n })\n )\n\n // Start keep-alive interval\n this.keepAliveInterval = setInterval(\n () => {\n this.log('Sending keep-alive message')\n this.socket?.send(JSON.stringify({ text: ' ' }))\n },\n (WS_INACTIVITY_TIMEOUT - 1) * 1000\n )\n\n resolve()\n })\n\n socket.addEventListener('error', (error) => {\n reject(error)\n })\n\n socket.addEventListener('message', (event) => {\n if (this.canceled) return\n try {\n this.onMessage(JSON.parse(event.data.toString()))\n } catch (error) {\n console.error('[ElevenLabsTTS] Error:', error)\n console.error('[ElevenLabsTTS] Event data during error:', event.data)\n }\n })\n\n socket.addEventListener('close', ({ code, reason }) => {\n this.socket?.removeAllListeners()\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n\n if (\n // Error: voice_id_does_not_exist\n code !== 1008\n ) {\n this.reconnect()\n } else {\n this.log('Connection closed', { code, reason })\n }\n })\n })\n }\n\n private onMessage(message: ElevenLabsWebSocketMessage) {\n if ('audio' in message && message.audio) {\n this.processAudioMessage(message)\n }\n if ('isFinal' in message && message.isFinal) {\n this.log('Audio ended')\n this.audioStream?.end()\n this.audioStream = undefined\n }\n if ('error' in message) {\n throw new Error(message.error)\n }\n }\n\n private processAudioMessage(message: ElevenLabsWebSocketAudioOutputMessage) {\n const chunk = Buffer.from(message.audio, 'base64')\n\n // Check text of received audio chunk\n if (message.alignment) {\n const chunkText = message.alignment.chars.join('')\n const receivedAudioText = this.receivedAudioText + chunkText\n\n // Ignore chunk if it is from previous session\n if (this.textSent.trim().indexOf(receivedAudioText.trim()) === -1) {\n this.log(`Ignore audio chunk (\"${chunkText}\")`)\n return\n }\n\n this.log(`Received audio chunk (\"${chunkText}\")`)\n this.receivedAudioText = receivedAudioText\n\n // Fix isFinal (apparently ElevenLabs doesn't send it like it should)\n this.fixIsFinal(message)\n }\n\n // Send to audio stream\n this.audioStream?.write(chunk)\n }\n\n private fixIsFinal(message: ElevenLabsWebSocketAudioOutputMessage) {\n if (message.isFinal || !this.textEnded) return\n if (this.receivedAudioText.trim() === this.textSent.trim()) {\n message.isFinal = true\n }\n }\n\n private sendTranscript(text: string) {\n this.textSent += text\n this.socket?.send(JSON.stringify({ text, try_trigger_generation: true }))\n this.log(`Sent transcript: \"${text}\"`)\n }\n\n private reconnect() {\n this.initPromise = new Promise((resolve, reject) => {\n this.log('Reconnecting...')\n this.reconnectTimeout = setTimeout(() => {\n this.reconnectTimeout = undefined\n this.initWS()\n .then(resolve)\n .catch((error) => {\n this.log('Reconnection error:', error)\n reject(error)\n })\n }, 1000)\n })\n }\n}\n"],"mappings":";;;;;;;;;;;;;;;;;;;;;;;;;;;;;;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;;;ACAA,2BAAiC;AACjC,oBAAoB;AACpB,oBAAsC;AACtC,uBAAqB;;;ACWd,IAAM,mBAAmB;AACzB,IAAM,wBAAwB;;;ADL9B,IAAM,qBAAN,cAAiC,kBAAI;AAAA,EAI1C,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAF7B,SAAQ,eAAkD;AAIxD,SAAK,aAAa,IAAI,sCAAiB;AAAA,MACrC,QAAQ,KAAK,QAAQ;AAAA,IACvB,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,UAAM,cAAc,IAAI,0BAAY;AAEpC,UAAM,MAAM,YAAY;AACtB,UAAI;AACF,cAAM,cAAc,UAAM,uBAAK,UAAU;AACzC,cAAM,SAAS,MAAM,KAAK,WAAW,aAAa;AAAA,UAChD,KAAK,QAAQ;AAAA,UACb;AAAA,YACE,MAAM;AAAA,YACN,SAAS,KAAK,QAAQ,WAAW;AAAA,YACjC,cAAc,KAAK,QAAQ,gBAAgB;AAAA,YAC3C,cAAc,KAAK,QAAQ;AAAA,YAC3B,eAAe,KAAK,QAAQ;AAAA,UAC9B;AAAA,QACF;AACA,aAAK,eAAe;AACpB,yBAAiB,SAAS,QAAQ;AAChC,sBAAY,MAAM,KAAK;AAAA,QACzB;AAAA,MACF,SAAS,OAAO;AACd,YAAI,iBAAiB,SAAS,MAAM,SAAS,cAAc;AAAA,QAE3D,OAAO;AACL,sBAAY,KAAK,SAAS,KAAc;AAAA,QAC1C;AAAA,MACF,UAAE;AACA,oBAAY,IAAI;AAChB,aAAK,eAAe;AAAA,MACtB;AAAA,IACF;AACA,QAAI;AAEJ,WAAO;AAAA,EACT;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,aAAc;AACxB,SAAK,IAAI,QAAQ;AACjB,SAAK,aAAa,SAAS;AAC3B,SAAK,eAAe;AAAA,EACtB;AACF;;;AE/DA,IAAAA,iBAAoB;AACpB,IAAAC,iBAAsC;AACtC,gBAAsB;AAWtB,IAAM,wBAAwB;AAEvB,IAAM,gBAAN,cAA4B,mBAAI;AAAA,EAYrC,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAR7B,SAAQ,YAAY;AACpB;AAAA,SAAQ,WAAW;AACnB;AAAA,SAAQ,aAAa;AACrB;AAAA,SAAQ,oBAAoB;AAG5B,SAAQ,WAAW;AAKjB,SAAK,cAAc,KAAK,OAAO,EAAE,MAAM,CAAC,UAAU;AAChD,WAAK,IAAI,qBAAqB,KAAK;AAAA,IACrC,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,SAAK,WAAW;AAChB,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc,IAAI,2BAAY;AACnC,SAAK,YAAY;AACjB,SAAK,aAAa;AAClB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AAGzB,eAAW,GAAG,QAAQ,OAAO,UAAU;AACrC,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AACX,YAAMC,QAAO,MAAM,SAAS,OAAO,EAAE,QAAQ,YAAY,GAAG;AAC5D,YAAM,aAAaA,MAAK,YAAY,GAAG;AACvC,UAAI,eAAe,IAAI;AACrB,aAAK,cAAcA;AAAA,MACrB,OAAO;AACL,aAAK,eAAe,KAAK,aAAaA,MAAK,MAAM,GAAG,aAAa,CAAC,CAAC;AACnE,aAAK,aAAaA,MAAK,MAAM,aAAa,CAAC;AAAA,MAC7C;AAAA,IACF,CAAC;AAED,eAAW,GAAG,SAAS,CAAC,UAAU;AAChC,WAAK,IAAI,6CAA6C,KAAK;AAC3D,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB,CAAC;AAED,eAAW,GAAG,OAAO,YAAY;AAC/B,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AAEX,UAAI,KAAK,WAAW,KAAK,GAAG;AAC1B,aAAK,eAAe,KAAK,aAAa,GAAG;AACzC,aAAK,aAAa;AAAA,MACpB;AACA,WAAK,YAAY;AAEjB,WAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAC5D,WAAK,IAAI,cAAc;AAAA,IACzB,CAAC;AAED,WAAO,KAAK;AAAA,EACd;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,YAAa;AACvB,SAAK,IAAI,QAAQ;AACjB,SAAK,WAAW;AAChB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AACzB,SAAK,YAAY,IAAI;AACrB,SAAK,cAAc;AAAA,EACrB;AAAA,EAEA,UAAU;AACR,QAAI,KAAK,kBAAkB;AACzB,mBAAa,KAAK,gBAAgB;AAClC,WAAK,mBAAmB;AAAA,IAC1B;AACA,QAAI,KAAK,mBAAmB;AAC1B,oBAAc,KAAK,iBAAiB;AACpC,WAAK,oBAAoB;AAAA,IAC3B;AACA,SAAK,QAAQ,mBAAmB;AAChC,QAAI,KAAK,QAAQ,eAAe,UAAAC,QAAU,MAAM;AAC9C,WAAK,QAAQ,MAAM,GAAI;AAAA,IACzB;AACA,SAAK,SAAS;AAEd,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc;AAEnB,UAAM,QAAQ;AAAA,EAChB;AAAA,EAEQ,SAAwB;AAC9B,WAAO,IAAI,QAAQ,CAAC,SAAS,WAAW;AAEtC,YAAM,SAAS,IAAI,gBAAgB;AACnC,aAAO,OAAO,YAAY,KAAK,QAAQ,WAAW,gBAAgB;AAClE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,QAAQ,gBAAgB;AAAA,MAC/B;AACA,aAAO,OAAO,sBAAsB,sBAAsB,SAAS,CAAC;AACpE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,UAAU,KAAK,QAAQ,aAAa;AAAA,MAC3C;AACA,UAAI,KAAK,QAAQ,UAAU;AACzB,eAAO,OAAO,iBAAiB,KAAK,QAAQ,QAAQ;AAAA,MACtD;AAEA,YAAM,MAAM,6CAA6C,KAAK,QAAQ,OAAO,iBAAiB,OAAO,SAAS,CAAC;AAG/G,YAAM,SAAS,IAAI,UAAAA,QAAU,KAAK;AAAA,QAChC,SAAS;AAAA,UACP,cAAc,KAAK,QAAQ;AAAA,QAC7B;AAAA,MACF,CAAC;AACD,WAAK,SAAS;AAEd,aAAO,iBAAiB,QAAQ,MAAM;AACpC,aAAK,IAAI,mBAAmB;AAG5B,aAAK,QAAQ;AAAA,UACX,KAAK,UAAU;AAAA,YACb,MAAM;AAAA,YACN,gBAAgB,KAAK,QAAQ;AAAA,UAC/B,CAAC;AAAA,QACH;AAGA,aAAK,oBAAoB;AAAA,UACvB,MAAM;AACJ,iBAAK,IAAI,4BAA4B;AACrC,iBAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,IAAI,CAAC,CAAC;AAAA,UACjD;AAAA,WACC,wBAAwB,KAAK;AAAA,QAChC;AAEA,gBAAQ;AAAA,MACV,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,UAAU;AAC1C,eAAO,KAAK;AAAA,MACd,CAAC;AAED,aAAO,iBAAiB,WAAW,CAAC,UAAU;AAC5C,YAAI,KAAK,SAAU;AACnB,YAAI;AACF,eAAK,UAAU,KAAK,MAAM,MAAM,KAAK,SAAS,CAAC,CAAC;AAAA,QAClD,SAAS,OAAO;AACd,kBAAQ,MAAM,0BAA0B,KAAK;AAC7C,kBAAQ,MAAM,4CAA4C,MAAM,IAAI;AAAA,QACtE;AAAA,MACF,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,EAAE,MAAM,OAAO,MAAM;AACrD,aAAK,QAAQ,mBAAmB;AAChC,aAAK,SAAS;AAEd,aAAK,aAAa,IAAI;AACtB,aAAK,cAAc;AAEnB,YAAI,KAAK,mBAAmB;AAC1B,wBAAc,KAAK,iBAAiB;AACpC,eAAK,oBAAoB;AAAA,QAC3B;AAEA;AAAA;AAAA,UAEE,SAAS;AAAA,UACT;AACA,eAAK,UAAU;AAAA,QACjB,OAAO;AACL,eAAK,IAAI,qBAAqB,EAAE,MAAM,OAAO,CAAC;AAAA,QAChD;AAAA,MACF,CAAC;AAAA,IACH,CAAC;AAAA,EACH;AAAA,EAEQ,UAAU,SAAqC;AACrD,QAAI,WAAW,WAAW,QAAQ,OAAO;AACvC,WAAK,oBAAoB,OAAO;AAAA,IAClC;AACA,QAAI,aAAa,WAAW,QAAQ,SAAS;AAC3C,WAAK,IAAI,aAAa;AACtB,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB;AACA,QAAI,WAAW,SAAS;AACtB,YAAM,IAAI,MAAM,QAAQ,KAAK;AAAA,IAC/B;AAAA,EACF;AAAA,EAEQ,oBAAoB,SAAgD;AAC1E,UAAM,QAAQ,OAAO,KAAK,QAAQ,OAAO,QAAQ;AAGjD,QAAI,QAAQ,WAAW;AACrB,YAAM,YAAY,QAAQ,UAAU,MAAM,KAAK,EAAE;AACjD,YAAM,oBAAoB,KAAK,oBAAoB;AAGnD,UAAI,KAAK,SAAS,KAAK,EAAE,QAAQ,kBAAkB,KAAK,CAAC,MAAM,IAAI;AACjE,aAAK,IAAI,wBAAwB,SAAS,IAAI;AAC9C;AAAA,MACF;AAEA,WAAK,IAAI,0BAA0B,SAAS,IAAI;AAChD,WAAK,oBAAoB;AAGzB,WAAK,WAAW,OAAO;AAAA,IACzB;AAGA,SAAK,aAAa,MAAM,KAAK;AAAA,EAC/B;AAAA,EAEQ,WAAW,SAAgD;AACjE,QAAI,QAAQ,WAAW,CAAC,KAAK,UAAW;AACxC,QAAI,KAAK,kBAAkB,KAAK,MAAM,KAAK,SAAS,KAAK,GAAG;AAC1D,cAAQ,UAAU;AAAA,IACpB;AAAA,EACF;AAAA,EAEQ,eAAeD,OAAc;AACnC,SAAK,YAAYA;AACjB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAAA,OAAM,wBAAwB,KAAK,CAAC,CAAC;AACxE,SAAK,IAAI,qBAAqBA,KAAI,GAAG;AAAA,EACvC;AAAA,EAEQ,YAAY;AAClB,SAAK,cAAc,IAAI,QAAQ,CAAC,SAAS,WAAW;AAClD,WAAK,IAAI,iBAAiB;AAC1B,WAAK,mBAAmB,WAAW,MAAM;AACvC,aAAK,mBAAmB;AACxB,aAAK,OAAO,EACT,KAAK,OAAO,EACZ,MAAM,CAAC,UAAU;AAChB,eAAK,IAAI,uBAAuB,KAAK;AACrC,iBAAO,KAAK;AAAA,QACd,CAAC;AAAA,MACL,GAAG,GAAI;AAAA,IACT,CAAC;AAAA,EACH;AACF;","names":["import_server","import_stream","text","WebSocket"]}
1
+ {"version":3,"sources":["../src/index.ts","../src/ElevenLabsFetchTTS.ts","../src/types.ts","../src/ElevenLabsTTS.ts"],"sourcesContent":["export * from './ElevenLabsFetchTTS'\nexport * from './ElevenLabsTTS'\nexport * from './types'\n","import { ElevenLabsClient } from '@elevenlabs/elevenlabs-js'\nimport { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport { text } from 'stream/consumers'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n} from './types'\n\nexport class ElevenLabsFetchTTS extends TTS {\n private elevenlabs: ElevenLabsClient\n private speechStream: ReadableStream<Uint8Array> | null = null\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n this.elevenlabs = new ElevenLabsClient({\n apiKey: this.options.apiKey,\n })\n }\n\n speak(textStream: Readable) {\n const audioStream = new PassThrough()\n\n const run = async () => {\n try {\n const textContent = await text(textStream)\n const stream = await this.elevenlabs.textToSpeech.stream(\n this.options.voiceId,\n {\n text: textContent,\n modelId: this.options.modelId || DEFAULT_MODEL_ID,\n outputFormat: this.options.outputFormat || DEFAULT_OUTPUT_FORMAT,\n languageCode: this.options.language,\n voiceSettings: this.options.voiceSettings,\n }\n )\n this.speechStream = stream\n for await (const chunk of stream) {\n audioStream.write(chunk)\n }\n } catch (error) {\n if (error instanceof Error && error.name === 'AbortError') {\n // Stream was cancelled. This is expected.\n } else {\n audioStream.emit('error', error as Error)\n }\n } finally {\n audioStream.end()\n this.speechStream = null\n }\n }\n run()\n\n return audioStream\n }\n\n cancel() {\n if (!this.speechStream) return\n this.log('Cancel')\n this.speechStream.cancel?.()\n this.speechStream = null\n }\n}\n","import {\n TextToSpeechStreamRequestOutputFormat,\n VoiceSettings,\n} from '@elevenlabs/elevenlabs-js/api'\n\nexport interface ElevenLabsTTSOptions {\n apiKey: string\n voiceId: string\n modelId?: 'eleven_multilingual_v2' | 'eleven_turbo_v2_5' | 'eleven_flash_v2_5'\n language?: string\n outputFormat?: TextToSpeechStreamRequestOutputFormat\n voiceSettings?: VoiceSettings\n}\n\nexport const DEFAULT_MODEL_ID = 'eleven_turbo_v2_5'\nexport const DEFAULT_OUTPUT_FORMAT = 'pcm_16000'\n\nexport type ElevenLabsWebSocketMessage =\n | ElevenLabsWebSocketAudioOutputMessage\n | ElevenLabsWebSocketFinalOutputMessage\n | ElevenLabsWebSocketErrorMessage\n\nexport interface ElevenLabsWebSocketAudioOutputMessage {\n audio: string\n normalizedAlignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n alignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n isFinal?: boolean | null\n}\n\nexport interface ElevenLabsWebSocketAudioOutputMessageAlignment {\n chars: string[]\n charStartTimesMs: number[]\n charDurationsMs: number[]\n}\n\nexport interface ElevenLabsWebSocketFinalOutputMessage {\n isFinal: boolean\n}\n\nexport interface ElevenLabsWebSocketErrorMessage {\n message: string\n error: string\n code: number\n}\n","import { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport WebSocket from 'ws'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n ElevenLabsWebSocketAudioOutputMessage,\n ElevenLabsWebSocketMessage,\n} from './types'\n\n// API Reference: https://elevenlabs.io/docs/api-reference/text-to-speech/v-1-text-to-speech-voice-id-stream-input\n\nconst WS_INACTIVITY_TIMEOUT = 180\n\nexport class ElevenLabsTTS extends TTS {\n private socket?: WebSocket\n private initPromise: Promise<void>\n private audioStream?: PassThrough\n private textEnded = false // Whether the text stream has ended\n private textSent = '' // Text sent to ElevenLabs\n private textBuffer = '' // Buffer of text to send to ElevenLabs\n private receivedAudioText = '' // Text of chunks received from ElevenLabs\n private keepAliveInterval?: NodeJS.Timeout\n private reconnectTimeout?: NodeJS.Timeout\n private canceled = false\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n // Setup WebSocket connection\n this.initPromise = this.initWS().catch((error) => {\n console.error('[ElevenLabsTTS] Connection error:', error)\n })\n }\n\n speak(textStream: Readable) {\n this.canceled = false\n this.audioStream?.end()\n this.audioStream = new PassThrough()\n this.textEnded = false\n this.textBuffer = ''\n this.textSent = ''\n this.receivedAudioText = ''\n\n // Forward text chunks coming from the caller to ElevenLabs\n textStream.on('data', async (chunk) => {\n if (this.canceled) return\n await this.initPromise\n const text = chunk.toString('utf-8').replace(/[\\r\\n]+/g, ' ')\n const spaceIndex = text.lastIndexOf(' ')\n if (spaceIndex === -1) {\n this.textBuffer += text\n } else {\n this.sendTranscript(this.textBuffer + text.slice(0, spaceIndex + 1))\n this.textBuffer = text.slice(spaceIndex + 1)\n }\n })\n\n textStream.on('error', (error) => {\n this.log('Error in text stream, ending audio stream', error)\n this.audioStream?.end()\n this.audioStream = undefined\n })\n\n textStream.on('end', async () => {\n if (this.canceled) return\n await this.initPromise\n // Send last buffered text\n if (this.textBuffer.trim()) {\n this.sendTranscript(this.textBuffer + ' ')\n this.textBuffer = ''\n }\n this.textEnded = true\n // Flush buffered text and mark end of utterance.\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n this.log('Flushed text')\n })\n\n return this.audioStream\n }\n\n cancel() {\n if (!this.audioStream) return\n this.log('Cancel')\n this.canceled = true\n this.textSent = ''\n this.receivedAudioText = ''\n this.audioStream.end()\n this.audioStream = undefined\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n }\n\n destroy() {\n if (this.reconnectTimeout) {\n clearTimeout(this.reconnectTimeout)\n this.reconnectTimeout = undefined\n }\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n this.socket?.removeAllListeners()\n if (this.socket?.readyState === WebSocket.OPEN) {\n this.socket?.close(1000)\n }\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n super.destroy()\n }\n\n private initWS(): Promise<void> {\n return new Promise((resolve, reject) => {\n // Build query params\n const params = new URLSearchParams()\n params.append('model_id', this.options.modelId ?? DEFAULT_MODEL_ID)\n params.append(\n 'output_format',\n this.options.outputFormat ?? DEFAULT_OUTPUT_FORMAT\n )\n params.append('inactivity_timeout', WS_INACTIVITY_TIMEOUT.toString())\n params.append(\n 'voice_settings',\n JSON.stringify(this.options.voiceSettings)\n )\n if (this.options.language) {\n params.append('language_code', this.options.language)\n }\n\n const uri = `wss://api.elevenlabs.io/v1/text-to-speech/${this.options.voiceId}/stream-input?${params.toString()}`\n\n // Connect to ElevenLabs\n const socket = new WebSocket(uri, {\n headers: {\n 'xi-api-key': this.options.apiKey,\n },\n })\n this.socket = socket\n\n socket.addEventListener('open', () => {\n this.log('Connection opened')\n\n // Send initialization / keep-alive message with voice settings\n this.socket?.send(\n JSON.stringify({\n text: ' ',\n voice_settings: this.options.voiceSettings,\n })\n )\n\n // Start keep-alive interval\n this.keepAliveInterval = setInterval(\n () => {\n this.log('Sending keep-alive message')\n this.socket?.send(JSON.stringify({ text: ' ' }))\n },\n (WS_INACTIVITY_TIMEOUT - 1) * 1000\n )\n\n resolve()\n })\n\n socket.addEventListener('error', (error) => {\n reject(error)\n })\n\n socket.addEventListener('message', (event) => {\n if (this.canceled) return\n try {\n this.onMessage(JSON.parse(event.data.toString()))\n } catch (error) {\n console.error('[ElevenLabsTTS] Error:', error)\n console.error('[ElevenLabsTTS] Event data during error:', event.data)\n }\n })\n\n socket.addEventListener('close', ({ code, reason }) => {\n this.socket?.removeAllListeners()\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n\n if (\n // Error: voice_id_does_not_exist\n code !== 1008\n ) {\n this.reconnect()\n } else {\n this.log('Connection closed', { code, reason })\n }\n })\n })\n }\n\n private onMessage(message: ElevenLabsWebSocketMessage) {\n if ('audio' in message && message.audio) {\n this.processAudioMessage(message)\n }\n if ('isFinal' in message && message.isFinal) {\n this.log('Audio ended')\n this.audioStream?.end()\n this.audioStream = undefined\n }\n if ('error' in message) {\n throw new Error(message.error)\n }\n }\n\n private processAudioMessage(message: ElevenLabsWebSocketAudioOutputMessage) {\n const chunk = Buffer.from(message.audio, 'base64')\n\n // Check text of received audio chunk\n if (message.alignment) {\n const chunkText = message.alignment.chars.join('')\n const receivedAudioText = this.receivedAudioText + chunkText\n\n // Ignore chunk if it is from previous session\n if (this.textSent.trim().indexOf(receivedAudioText.trim()) === -1) {\n this.log(`Ignore audio chunk (\"${chunkText}\")`)\n return\n }\n\n this.log(`Received audio chunk (\"${chunkText}\")`)\n this.receivedAudioText = receivedAudioText\n\n // Fix isFinal (apparently ElevenLabs doesn't send it like it should)\n this.fixIsFinal(message)\n }\n\n // Send to audio stream\n this.audioStream?.write(chunk)\n }\n\n private fixIsFinal(message: ElevenLabsWebSocketAudioOutputMessage) {\n if (message.isFinal || !this.textEnded) return\n if (this.receivedAudioText.trim() === this.textSent.trim()) {\n message.isFinal = true\n }\n }\n\n private sendTranscript(text: string) {\n this.textSent += text\n this.socket?.send(JSON.stringify({ text, try_trigger_generation: true }))\n this.log(`Sent transcript: \"${text}\"`)\n }\n\n private reconnect() {\n this.initPromise = new Promise((resolve, reject) => {\n this.log('Reconnecting...')\n this.reconnectTimeout = setTimeout(() => {\n this.reconnectTimeout = undefined\n this.initWS()\n .then(resolve)\n .catch((error) => {\n this.log('Reconnection error:', error)\n reject(error)\n })\n }, 1000)\n })\n }\n}\n"],"mappings":";;;;;;;;;;;;;;;;;;;;;;;;;;;;;;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;;;ACAA,2BAAiC;AACjC,oBAAoB;AACpB,oBAAsC;AACtC,uBAAqB;;;ACWd,IAAM,mBAAmB;AACzB,IAAM,wBAAwB;;;ADL9B,IAAM,qBAAN,cAAiC,kBAAI;AAAA,EAI1C,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAF7B,SAAQ,eAAkD;AAIxD,SAAK,aAAa,IAAI,sCAAiB;AAAA,MACrC,QAAQ,KAAK,QAAQ;AAAA,IACvB,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,UAAM,cAAc,IAAI,0BAAY;AAEpC,UAAM,MAAM,YAAY;AACtB,UAAI;AACF,cAAM,cAAc,UAAM,uBAAK,UAAU;AACzC,cAAM,SAAS,MAAM,KAAK,WAAW,aAAa;AAAA,UAChD,KAAK,QAAQ;AAAA,UACb;AAAA,YACE,MAAM;AAAA,YACN,SAAS,KAAK,QAAQ,WAAW;AAAA,YACjC,cAAc,KAAK,QAAQ,gBAAgB;AAAA,YAC3C,cAAc,KAAK,QAAQ;AAAA,YAC3B,eAAe,KAAK,QAAQ;AAAA,UAC9B;AAAA,QACF;AACA,aAAK,eAAe;AACpB,yBAAiB,SAAS,QAAQ;AAChC,sBAAY,MAAM,KAAK;AAAA,QACzB;AAAA,MACF,SAAS,OAAO;AACd,YAAI,iBAAiB,SAAS,MAAM,SAAS,cAAc;AAAA,QAE3D,OAAO;AACL,sBAAY,KAAK,SAAS,KAAc;AAAA,QAC1C;AAAA,MACF,UAAE;AACA,oBAAY,IAAI;AAChB,aAAK,eAAe;AAAA,MACtB;AAAA,IACF;AACA,QAAI;AAEJ,WAAO;AAAA,EACT;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,aAAc;AACxB,SAAK,IAAI,QAAQ;AACjB,SAAK,aAAa,SAAS;AAC3B,SAAK,eAAe;AAAA,EACtB;AACF;;;AE/DA,IAAAA,iBAAoB;AACpB,IAAAC,iBAAsC;AACtC,gBAAsB;AAWtB,IAAM,wBAAwB;AAEvB,IAAM,gBAAN,cAA4B,mBAAI;AAAA,EAYrC,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAR7B,SAAQ,YAAY;AACpB;AAAA,SAAQ,WAAW;AACnB;AAAA,SAAQ,aAAa;AACrB;AAAA,SAAQ,oBAAoB;AAG5B,SAAQ,WAAW;AAKjB,SAAK,cAAc,KAAK,OAAO,EAAE,MAAM,CAAC,UAAU;AAChD,cAAQ,MAAM,qCAAqC,KAAK;AAAA,IAC1D,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,SAAK,WAAW;AAChB,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc,IAAI,2BAAY;AACnC,SAAK,YAAY;AACjB,SAAK,aAAa;AAClB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AAGzB,eAAW,GAAG,QAAQ,OAAO,UAAU;AACrC,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AACX,YAAMC,QAAO,MAAM,SAAS,OAAO,EAAE,QAAQ,YAAY,GAAG;AAC5D,YAAM,aAAaA,MAAK,YAAY,GAAG;AACvC,UAAI,eAAe,IAAI;AACrB,aAAK,cAAcA;AAAA,MACrB,OAAO;AACL,aAAK,eAAe,KAAK,aAAaA,MAAK,MAAM,GAAG,aAAa,CAAC,CAAC;AACnE,aAAK,aAAaA,MAAK,MAAM,aAAa,CAAC;AAAA,MAC7C;AAAA,IACF,CAAC;AAED,eAAW,GAAG,SAAS,CAAC,UAAU;AAChC,WAAK,IAAI,6CAA6C,KAAK;AAC3D,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB,CAAC;AAED,eAAW,GAAG,OAAO,YAAY;AAC/B,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AAEX,UAAI,KAAK,WAAW,KAAK,GAAG;AAC1B,aAAK,eAAe,KAAK,aAAa,GAAG;AACzC,aAAK,aAAa;AAAA,MACpB;AACA,WAAK,YAAY;AAEjB,WAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAC5D,WAAK,IAAI,cAAc;AAAA,IACzB,CAAC;AAED,WAAO,KAAK;AAAA,EACd;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,YAAa;AACvB,SAAK,IAAI,QAAQ;AACjB,SAAK,WAAW;AAChB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AACzB,SAAK,YAAY,IAAI;AACrB,SAAK,cAAc;AACnB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAAA,EAC9D;AAAA,EAEA,UAAU;AACR,QAAI,KAAK,kBAAkB;AACzB,mBAAa,KAAK,gBAAgB;AAClC,WAAK,mBAAmB;AAAA,IAC1B;AACA,QAAI,KAAK,mBAAmB;AAC1B,oBAAc,KAAK,iBAAiB;AACpC,WAAK,oBAAoB;AAAA,IAC3B;AACA,SAAK,QAAQ,mBAAmB;AAChC,QAAI,KAAK,QAAQ,eAAe,UAAAC,QAAU,MAAM;AAC9C,WAAK,QAAQ,MAAM,GAAI;AAAA,IACzB;AACA,SAAK,SAAS;AAEd,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc;AAEnB,UAAM,QAAQ;AAAA,EAChB;AAAA,EAEQ,SAAwB;AAC9B,WAAO,IAAI,QAAQ,CAAC,SAAS,WAAW;AAEtC,YAAM,SAAS,IAAI,gBAAgB;AACnC,aAAO,OAAO,YAAY,KAAK,QAAQ,WAAW,gBAAgB;AAClE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,QAAQ,gBAAgB;AAAA,MAC/B;AACA,aAAO,OAAO,sBAAsB,sBAAsB,SAAS,CAAC;AACpE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,UAAU,KAAK,QAAQ,aAAa;AAAA,MAC3C;AACA,UAAI,KAAK,QAAQ,UAAU;AACzB,eAAO,OAAO,iBAAiB,KAAK,QAAQ,QAAQ;AAAA,MACtD;AAEA,YAAM,MAAM,6CAA6C,KAAK,QAAQ,OAAO,iBAAiB,OAAO,SAAS,CAAC;AAG/G,YAAM,SAAS,IAAI,UAAAA,QAAU,KAAK;AAAA,QAChC,SAAS;AAAA,UACP,cAAc,KAAK,QAAQ;AAAA,QAC7B;AAAA,MACF,CAAC;AACD,WAAK,SAAS;AAEd,aAAO,iBAAiB,QAAQ,MAAM;AACpC,aAAK,IAAI,mBAAmB;AAG5B,aAAK,QAAQ;AAAA,UACX,KAAK,UAAU;AAAA,YACb,MAAM;AAAA,YACN,gBAAgB,KAAK,QAAQ;AAAA,UAC/B,CAAC;AAAA,QACH;AAGA,aAAK,oBAAoB;AAAA,UACvB,MAAM;AACJ,iBAAK,IAAI,4BAA4B;AACrC,iBAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,IAAI,CAAC,CAAC;AAAA,UACjD;AAAA,WACC,wBAAwB,KAAK;AAAA,QAChC;AAEA,gBAAQ;AAAA,MACV,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,UAAU;AAC1C,eAAO,KAAK;AAAA,MACd,CAAC;AAED,aAAO,iBAAiB,WAAW,CAAC,UAAU;AAC5C,YAAI,KAAK,SAAU;AACnB,YAAI;AACF,eAAK,UAAU,KAAK,MAAM,MAAM,KAAK,SAAS,CAAC,CAAC;AAAA,QAClD,SAAS,OAAO;AACd,kBAAQ,MAAM,0BAA0B,KAAK;AAC7C,kBAAQ,MAAM,4CAA4C,MAAM,IAAI;AAAA,QACtE;AAAA,MACF,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,EAAE,MAAM,OAAO,MAAM;AACrD,aAAK,QAAQ,mBAAmB;AAChC,aAAK,SAAS;AAEd,aAAK,aAAa,IAAI;AACtB,aAAK,cAAc;AAEnB,YAAI,KAAK,mBAAmB;AAC1B,wBAAc,KAAK,iBAAiB;AACpC,eAAK,oBAAoB;AAAA,QAC3B;AAEA;AAAA;AAAA,UAEE,SAAS;AAAA,UACT;AACA,eAAK,UAAU;AAAA,QACjB,OAAO;AACL,eAAK,IAAI,qBAAqB,EAAE,MAAM,OAAO,CAAC;AAAA,QAChD;AAAA,MACF,CAAC;AAAA,IACH,CAAC;AAAA,EACH;AAAA,EAEQ,UAAU,SAAqC;AACrD,QAAI,WAAW,WAAW,QAAQ,OAAO;AACvC,WAAK,oBAAoB,OAAO;AAAA,IAClC;AACA,QAAI,aAAa,WAAW,QAAQ,SAAS;AAC3C,WAAK,IAAI,aAAa;AACtB,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB;AACA,QAAI,WAAW,SAAS;AACtB,YAAM,IAAI,MAAM,QAAQ,KAAK;AAAA,IAC/B;AAAA,EACF;AAAA,EAEQ,oBAAoB,SAAgD;AAC1E,UAAM,QAAQ,OAAO,KAAK,QAAQ,OAAO,QAAQ;AAGjD,QAAI,QAAQ,WAAW;AACrB,YAAM,YAAY,QAAQ,UAAU,MAAM,KAAK,EAAE;AACjD,YAAM,oBAAoB,KAAK,oBAAoB;AAGnD,UAAI,KAAK,SAAS,KAAK,EAAE,QAAQ,kBAAkB,KAAK,CAAC,MAAM,IAAI;AACjE,aAAK,IAAI,wBAAwB,SAAS,IAAI;AAC9C;AAAA,MACF;AAEA,WAAK,IAAI,0BAA0B,SAAS,IAAI;AAChD,WAAK,oBAAoB;AAGzB,WAAK,WAAW,OAAO;AAAA,IACzB;AAGA,SAAK,aAAa,MAAM,KAAK;AAAA,EAC/B;AAAA,EAEQ,WAAW,SAAgD;AACjE,QAAI,QAAQ,WAAW,CAAC,KAAK,UAAW;AACxC,QAAI,KAAK,kBAAkB,KAAK,MAAM,KAAK,SAAS,KAAK,GAAG;AAC1D,cAAQ,UAAU;AAAA,IACpB;AAAA,EACF;AAAA,EAEQ,eAAeD,OAAc;AACnC,SAAK,YAAYA;AACjB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAAA,OAAM,wBAAwB,KAAK,CAAC,CAAC;AACxE,SAAK,IAAI,qBAAqBA,KAAI,GAAG;AAAA,EACvC;AAAA,EAEQ,YAAY;AAClB,SAAK,cAAc,IAAI,QAAQ,CAAC,SAAS,WAAW;AAClD,WAAK,IAAI,iBAAiB;AAC1B,WAAK,mBAAmB,WAAW,MAAM;AACvC,aAAK,mBAAmB;AACxB,aAAK,OAAO,EACT,KAAK,OAAO,EACZ,MAAM,CAAC,UAAU;AAChB,eAAK,IAAI,uBAAuB,KAAK;AACrC,iBAAO,KAAK;AAAA,QACd,CAAC;AAAA,MACL,GAAG,GAAI;AAAA,IACT,CAAC;AAAA,EACH;AACF;","names":["import_server","import_stream","text","WebSocket"]}
package/dist/index.mjs CHANGED
@@ -76,7 +76,7 @@ var ElevenLabsTTS = class extends TTS2 {
76
76
  this.receivedAudioText = "";
77
77
  this.canceled = false;
78
78
  this.initPromise = this.initWS().catch((error) => {
79
- this.log("Connection error:", error);
79
+ console.error("[ElevenLabsTTS] Connection error:", error);
80
80
  });
81
81
  }
82
82
  speak(textStream) {
@@ -125,6 +125,7 @@ var ElevenLabsTTS = class extends TTS2 {
125
125
  this.receivedAudioText = "";
126
126
  this.audioStream.end();
127
127
  this.audioStream = void 0;
128
+ this.socket?.send(JSON.stringify({ text: " ", flush: true }));
128
129
  }
129
130
  destroy() {
130
131
  if (this.reconnectTimeout) {
@@ -1 +1 @@
1
- {"version":3,"sources":["../src/ElevenLabsFetchTTS.ts","../src/types.ts","../src/ElevenLabsTTS.ts"],"sourcesContent":["import { ElevenLabsClient } from '@elevenlabs/elevenlabs-js'\nimport { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport { text } from 'stream/consumers'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n} from './types'\n\nexport class ElevenLabsFetchTTS extends TTS {\n private elevenlabs: ElevenLabsClient\n private speechStream: ReadableStream<Uint8Array> | null = null\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n this.elevenlabs = new ElevenLabsClient({\n apiKey: this.options.apiKey,\n })\n }\n\n speak(textStream: Readable) {\n const audioStream = new PassThrough()\n\n const run = async () => {\n try {\n const textContent = await text(textStream)\n const stream = await this.elevenlabs.textToSpeech.stream(\n this.options.voiceId,\n {\n text: textContent,\n modelId: this.options.modelId || DEFAULT_MODEL_ID,\n outputFormat: this.options.outputFormat || DEFAULT_OUTPUT_FORMAT,\n languageCode: this.options.language,\n voiceSettings: this.options.voiceSettings,\n }\n )\n this.speechStream = stream\n for await (const chunk of stream) {\n audioStream.write(chunk)\n }\n } catch (error) {\n if (error instanceof Error && error.name === 'AbortError') {\n // Stream was cancelled. This is expected.\n } else {\n audioStream.emit('error', error as Error)\n }\n } finally {\n audioStream.end()\n this.speechStream = null\n }\n }\n run()\n\n return audioStream\n }\n\n cancel() {\n if (!this.speechStream) return\n this.log('Cancel')\n this.speechStream.cancel?.()\n this.speechStream = null\n }\n}\n","import {\n TextToSpeechStreamRequestOutputFormat,\n VoiceSettings,\n} from '@elevenlabs/elevenlabs-js/api'\n\nexport interface ElevenLabsTTSOptions {\n apiKey: string\n voiceId: string\n modelId?: 'eleven_multilingual_v2' | 'eleven_turbo_v2_5' | 'eleven_flash_v2_5'\n language?: string\n outputFormat?: TextToSpeechStreamRequestOutputFormat\n voiceSettings?: VoiceSettings\n}\n\nexport const DEFAULT_MODEL_ID = 'eleven_turbo_v2_5'\nexport const DEFAULT_OUTPUT_FORMAT = 'pcm_16000'\n\nexport type ElevenLabsWebSocketMessage =\n | ElevenLabsWebSocketAudioOutputMessage\n | ElevenLabsWebSocketFinalOutputMessage\n | ElevenLabsWebSocketErrorMessage\n\nexport interface ElevenLabsWebSocketAudioOutputMessage {\n audio: string\n normalizedAlignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n alignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n isFinal?: boolean | null\n}\n\nexport interface ElevenLabsWebSocketAudioOutputMessageAlignment {\n chars: string[]\n charStartTimesMs: number[]\n charDurationsMs: number[]\n}\n\nexport interface ElevenLabsWebSocketFinalOutputMessage {\n isFinal: boolean\n}\n\nexport interface ElevenLabsWebSocketErrorMessage {\n message: string\n error: string\n code: number\n}\n","import { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport WebSocket from 'ws'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n ElevenLabsWebSocketAudioOutputMessage,\n ElevenLabsWebSocketMessage,\n} from './types'\n\n// API Reference: https://elevenlabs.io/docs/api-reference/text-to-speech/v-1-text-to-speech-voice-id-stream-input\n\nconst WS_INACTIVITY_TIMEOUT = 180\n\nexport class ElevenLabsTTS extends TTS {\n private socket?: WebSocket\n private initPromise: Promise<void>\n private audioStream?: PassThrough\n private textEnded = false // Whether the text stream has ended\n private textSent = '' // Text sent to ElevenLabs\n private textBuffer = '' // Buffer of text to send to ElevenLabs\n private receivedAudioText = '' // Text of chunks received from ElevenLabs\n private keepAliveInterval?: NodeJS.Timeout\n private reconnectTimeout?: NodeJS.Timeout\n private canceled = false\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n // Setup WebSocket connection\n this.initPromise = this.initWS().catch((error) => {\n this.log('Connection error:', error)\n })\n }\n\n speak(textStream: Readable) {\n this.canceled = false\n this.audioStream?.end()\n this.audioStream = new PassThrough()\n this.textEnded = false\n this.textBuffer = ''\n this.textSent = ''\n this.receivedAudioText = ''\n\n // Forward text chunks coming from the caller to ElevenLabs\n textStream.on('data', async (chunk) => {\n if (this.canceled) return\n await this.initPromise\n const text = chunk.toString('utf-8').replace(/[\\r\\n]+/g, ' ')\n const spaceIndex = text.lastIndexOf(' ')\n if (spaceIndex === -1) {\n this.textBuffer += text\n } else {\n this.sendTranscript(this.textBuffer + text.slice(0, spaceIndex + 1))\n this.textBuffer = text.slice(spaceIndex + 1)\n }\n })\n\n textStream.on('error', (error) => {\n this.log('Error in text stream, ending audio stream', error)\n this.audioStream?.end()\n this.audioStream = undefined\n })\n\n textStream.on('end', async () => {\n if (this.canceled) return\n await this.initPromise\n // Send last buffered text\n if (this.textBuffer.trim()) {\n this.sendTranscript(this.textBuffer + ' ')\n this.textBuffer = ''\n }\n this.textEnded = true\n // Flush buffered text and mark end of utterance.\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n this.log('Flushed text')\n })\n\n return this.audioStream\n }\n\n cancel() {\n if (!this.audioStream) return\n this.log('Cancel')\n this.canceled = true\n this.textSent = ''\n this.receivedAudioText = ''\n this.audioStream.end()\n this.audioStream = undefined\n }\n\n destroy() {\n if (this.reconnectTimeout) {\n clearTimeout(this.reconnectTimeout)\n this.reconnectTimeout = undefined\n }\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n this.socket?.removeAllListeners()\n if (this.socket?.readyState === WebSocket.OPEN) {\n this.socket?.close(1000)\n }\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n super.destroy()\n }\n\n private initWS(): Promise<void> {\n return new Promise((resolve, reject) => {\n // Build query params\n const params = new URLSearchParams()\n params.append('model_id', this.options.modelId ?? DEFAULT_MODEL_ID)\n params.append(\n 'output_format',\n this.options.outputFormat ?? DEFAULT_OUTPUT_FORMAT\n )\n params.append('inactivity_timeout', WS_INACTIVITY_TIMEOUT.toString())\n params.append(\n 'voice_settings',\n JSON.stringify(this.options.voiceSettings)\n )\n if (this.options.language) {\n params.append('language_code', this.options.language)\n }\n\n const uri = `wss://api.elevenlabs.io/v1/text-to-speech/${this.options.voiceId}/stream-input?${params.toString()}`\n\n // Connect to ElevenLabs\n const socket = new WebSocket(uri, {\n headers: {\n 'xi-api-key': this.options.apiKey,\n },\n })\n this.socket = socket\n\n socket.addEventListener('open', () => {\n this.log('Connection opened')\n\n // Send initialization / keep-alive message with voice settings\n this.socket?.send(\n JSON.stringify({\n text: ' ',\n voice_settings: this.options.voiceSettings,\n })\n )\n\n // Start keep-alive interval\n this.keepAliveInterval = setInterval(\n () => {\n this.log('Sending keep-alive message')\n this.socket?.send(JSON.stringify({ text: ' ' }))\n },\n (WS_INACTIVITY_TIMEOUT - 1) * 1000\n )\n\n resolve()\n })\n\n socket.addEventListener('error', (error) => {\n reject(error)\n })\n\n socket.addEventListener('message', (event) => {\n if (this.canceled) return\n try {\n this.onMessage(JSON.parse(event.data.toString()))\n } catch (error) {\n console.error('[ElevenLabsTTS] Error:', error)\n console.error('[ElevenLabsTTS] Event data during error:', event.data)\n }\n })\n\n socket.addEventListener('close', ({ code, reason }) => {\n this.socket?.removeAllListeners()\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n\n if (\n // Error: voice_id_does_not_exist\n code !== 1008\n ) {\n this.reconnect()\n } else {\n this.log('Connection closed', { code, reason })\n }\n })\n })\n }\n\n private onMessage(message: ElevenLabsWebSocketMessage) {\n if ('audio' in message && message.audio) {\n this.processAudioMessage(message)\n }\n if ('isFinal' in message && message.isFinal) {\n this.log('Audio ended')\n this.audioStream?.end()\n this.audioStream = undefined\n }\n if ('error' in message) {\n throw new Error(message.error)\n }\n }\n\n private processAudioMessage(message: ElevenLabsWebSocketAudioOutputMessage) {\n const chunk = Buffer.from(message.audio, 'base64')\n\n // Check text of received audio chunk\n if (message.alignment) {\n const chunkText = message.alignment.chars.join('')\n const receivedAudioText = this.receivedAudioText + chunkText\n\n // Ignore chunk if it is from previous session\n if (this.textSent.trim().indexOf(receivedAudioText.trim()) === -1) {\n this.log(`Ignore audio chunk (\"${chunkText}\")`)\n return\n }\n\n this.log(`Received audio chunk (\"${chunkText}\")`)\n this.receivedAudioText = receivedAudioText\n\n // Fix isFinal (apparently ElevenLabs doesn't send it like it should)\n this.fixIsFinal(message)\n }\n\n // Send to audio stream\n this.audioStream?.write(chunk)\n }\n\n private fixIsFinal(message: ElevenLabsWebSocketAudioOutputMessage) {\n if (message.isFinal || !this.textEnded) return\n if (this.receivedAudioText.trim() === this.textSent.trim()) {\n message.isFinal = true\n }\n }\n\n private sendTranscript(text: string) {\n this.textSent += text\n this.socket?.send(JSON.stringify({ text, try_trigger_generation: true }))\n this.log(`Sent transcript: \"${text}\"`)\n }\n\n private reconnect() {\n this.initPromise = new Promise((resolve, reject) => {\n this.log('Reconnecting...')\n this.reconnectTimeout = setTimeout(() => {\n this.reconnectTimeout = undefined\n this.initWS()\n .then(resolve)\n .catch((error) => {\n this.log('Reconnection error:', error)\n reject(error)\n })\n }, 1000)\n })\n }\n}\n"],"mappings":";AAAA,SAAS,wBAAwB;AACjC,SAAS,WAAW;AACpB,SAAS,mBAA6B;AACtC,SAAS,YAAY;;;ACWd,IAAM,mBAAmB;AACzB,IAAM,wBAAwB;;;ADL9B,IAAM,qBAAN,cAAiC,IAAI;AAAA,EAI1C,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAF7B,SAAQ,eAAkD;AAIxD,SAAK,aAAa,IAAI,iBAAiB;AAAA,MACrC,QAAQ,KAAK,QAAQ;AAAA,IACvB,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,UAAM,cAAc,IAAI,YAAY;AAEpC,UAAM,MAAM,YAAY;AACtB,UAAI;AACF,cAAM,cAAc,MAAM,KAAK,UAAU;AACzC,cAAM,SAAS,MAAM,KAAK,WAAW,aAAa;AAAA,UAChD,KAAK,QAAQ;AAAA,UACb;AAAA,YACE,MAAM;AAAA,YACN,SAAS,KAAK,QAAQ,WAAW;AAAA,YACjC,cAAc,KAAK,QAAQ,gBAAgB;AAAA,YAC3C,cAAc,KAAK,QAAQ;AAAA,YAC3B,eAAe,KAAK,QAAQ;AAAA,UAC9B;AAAA,QACF;AACA,aAAK,eAAe;AACpB,yBAAiB,SAAS,QAAQ;AAChC,sBAAY,MAAM,KAAK;AAAA,QACzB;AAAA,MACF,SAAS,OAAO;AACd,YAAI,iBAAiB,SAAS,MAAM,SAAS,cAAc;AAAA,QAE3D,OAAO;AACL,sBAAY,KAAK,SAAS,KAAc;AAAA,QAC1C;AAAA,MACF,UAAE;AACA,oBAAY,IAAI;AAChB,aAAK,eAAe;AAAA,MACtB;AAAA,IACF;AACA,QAAI;AAEJ,WAAO;AAAA,EACT;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,aAAc;AACxB,SAAK,IAAI,QAAQ;AACjB,SAAK,aAAa,SAAS;AAC3B,SAAK,eAAe;AAAA,EACtB;AACF;;;AE/DA,SAAS,OAAAA,YAAW;AACpB,SAAS,eAAAC,oBAA6B;AACtC,OAAO,eAAe;AAWtB,IAAM,wBAAwB;AAEvB,IAAM,gBAAN,cAA4BC,KAAI;AAAA,EAYrC,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAR7B,SAAQ,YAAY;AACpB;AAAA,SAAQ,WAAW;AACnB;AAAA,SAAQ,aAAa;AACrB;AAAA,SAAQ,oBAAoB;AAG5B,SAAQ,WAAW;AAKjB,SAAK,cAAc,KAAK,OAAO,EAAE,MAAM,CAAC,UAAU;AAChD,WAAK,IAAI,qBAAqB,KAAK;AAAA,IACrC,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,SAAK,WAAW;AAChB,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc,IAAIC,aAAY;AACnC,SAAK,YAAY;AACjB,SAAK,aAAa;AAClB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AAGzB,eAAW,GAAG,QAAQ,OAAO,UAAU;AACrC,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AACX,YAAMC,QAAO,MAAM,SAAS,OAAO,EAAE,QAAQ,YAAY,GAAG;AAC5D,YAAM,aAAaA,MAAK,YAAY,GAAG;AACvC,UAAI,eAAe,IAAI;AACrB,aAAK,cAAcA;AAAA,MACrB,OAAO;AACL,aAAK,eAAe,KAAK,aAAaA,MAAK,MAAM,GAAG,aAAa,CAAC,CAAC;AACnE,aAAK,aAAaA,MAAK,MAAM,aAAa,CAAC;AAAA,MAC7C;AAAA,IACF,CAAC;AAED,eAAW,GAAG,SAAS,CAAC,UAAU;AAChC,WAAK,IAAI,6CAA6C,KAAK;AAC3D,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB,CAAC;AAED,eAAW,GAAG,OAAO,YAAY;AAC/B,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AAEX,UAAI,KAAK,WAAW,KAAK,GAAG;AAC1B,aAAK,eAAe,KAAK,aAAa,GAAG;AACzC,aAAK,aAAa;AAAA,MACpB;AACA,WAAK,YAAY;AAEjB,WAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAC5D,WAAK,IAAI,cAAc;AAAA,IACzB,CAAC;AAED,WAAO,KAAK;AAAA,EACd;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,YAAa;AACvB,SAAK,IAAI,QAAQ;AACjB,SAAK,WAAW;AAChB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AACzB,SAAK,YAAY,IAAI;AACrB,SAAK,cAAc;AAAA,EACrB;AAAA,EAEA,UAAU;AACR,QAAI,KAAK,kBAAkB;AACzB,mBAAa,KAAK,gBAAgB;AAClC,WAAK,mBAAmB;AAAA,IAC1B;AACA,QAAI,KAAK,mBAAmB;AAC1B,oBAAc,KAAK,iBAAiB;AACpC,WAAK,oBAAoB;AAAA,IAC3B;AACA,SAAK,QAAQ,mBAAmB;AAChC,QAAI,KAAK,QAAQ,eAAe,UAAU,MAAM;AAC9C,WAAK,QAAQ,MAAM,GAAI;AAAA,IACzB;AACA,SAAK,SAAS;AAEd,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc;AAEnB,UAAM,QAAQ;AAAA,EAChB;AAAA,EAEQ,SAAwB;AAC9B,WAAO,IAAI,QAAQ,CAAC,SAAS,WAAW;AAEtC,YAAM,SAAS,IAAI,gBAAgB;AACnC,aAAO,OAAO,YAAY,KAAK,QAAQ,WAAW,gBAAgB;AAClE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,QAAQ,gBAAgB;AAAA,MAC/B;AACA,aAAO,OAAO,sBAAsB,sBAAsB,SAAS,CAAC;AACpE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,UAAU,KAAK,QAAQ,aAAa;AAAA,MAC3C;AACA,UAAI,KAAK,QAAQ,UAAU;AACzB,eAAO,OAAO,iBAAiB,KAAK,QAAQ,QAAQ;AAAA,MACtD;AAEA,YAAM,MAAM,6CAA6C,KAAK,QAAQ,OAAO,iBAAiB,OAAO,SAAS,CAAC;AAG/G,YAAM,SAAS,IAAI,UAAU,KAAK;AAAA,QAChC,SAAS;AAAA,UACP,cAAc,KAAK,QAAQ;AAAA,QAC7B;AAAA,MACF,CAAC;AACD,WAAK,SAAS;AAEd,aAAO,iBAAiB,QAAQ,MAAM;AACpC,aAAK,IAAI,mBAAmB;AAG5B,aAAK,QAAQ;AAAA,UACX,KAAK,UAAU;AAAA,YACb,MAAM;AAAA,YACN,gBAAgB,KAAK,QAAQ;AAAA,UAC/B,CAAC;AAAA,QACH;AAGA,aAAK,oBAAoB;AAAA,UACvB,MAAM;AACJ,iBAAK,IAAI,4BAA4B;AACrC,iBAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,IAAI,CAAC,CAAC;AAAA,UACjD;AAAA,WACC,wBAAwB,KAAK;AAAA,QAChC;AAEA,gBAAQ;AAAA,MACV,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,UAAU;AAC1C,eAAO,KAAK;AAAA,MACd,CAAC;AAED,aAAO,iBAAiB,WAAW,CAAC,UAAU;AAC5C,YAAI,KAAK,SAAU;AACnB,YAAI;AACF,eAAK,UAAU,KAAK,MAAM,MAAM,KAAK,SAAS,CAAC,CAAC;AAAA,QAClD,SAAS,OAAO;AACd,kBAAQ,MAAM,0BAA0B,KAAK;AAC7C,kBAAQ,MAAM,4CAA4C,MAAM,IAAI;AAAA,QACtE;AAAA,MACF,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,EAAE,MAAM,OAAO,MAAM;AACrD,aAAK,QAAQ,mBAAmB;AAChC,aAAK,SAAS;AAEd,aAAK,aAAa,IAAI;AACtB,aAAK,cAAc;AAEnB,YAAI,KAAK,mBAAmB;AAC1B,wBAAc,KAAK,iBAAiB;AACpC,eAAK,oBAAoB;AAAA,QAC3B;AAEA;AAAA;AAAA,UAEE,SAAS;AAAA,UACT;AACA,eAAK,UAAU;AAAA,QACjB,OAAO;AACL,eAAK,IAAI,qBAAqB,EAAE,MAAM,OAAO,CAAC;AAAA,QAChD;AAAA,MACF,CAAC;AAAA,IACH,CAAC;AAAA,EACH;AAAA,EAEQ,UAAU,SAAqC;AACrD,QAAI,WAAW,WAAW,QAAQ,OAAO;AACvC,WAAK,oBAAoB,OAAO;AAAA,IAClC;AACA,QAAI,aAAa,WAAW,QAAQ,SAAS;AAC3C,WAAK,IAAI,aAAa;AACtB,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB;AACA,QAAI,WAAW,SAAS;AACtB,YAAM,IAAI,MAAM,QAAQ,KAAK;AAAA,IAC/B;AAAA,EACF;AAAA,EAEQ,oBAAoB,SAAgD;AAC1E,UAAM,QAAQ,OAAO,KAAK,QAAQ,OAAO,QAAQ;AAGjD,QAAI,QAAQ,WAAW;AACrB,YAAM,YAAY,QAAQ,UAAU,MAAM,KAAK,EAAE;AACjD,YAAM,oBAAoB,KAAK,oBAAoB;AAGnD,UAAI,KAAK,SAAS,KAAK,EAAE,QAAQ,kBAAkB,KAAK,CAAC,MAAM,IAAI;AACjE,aAAK,IAAI,wBAAwB,SAAS,IAAI;AAC9C;AAAA,MACF;AAEA,WAAK,IAAI,0BAA0B,SAAS,IAAI;AAChD,WAAK,oBAAoB;AAGzB,WAAK,WAAW,OAAO;AAAA,IACzB;AAGA,SAAK,aAAa,MAAM,KAAK;AAAA,EAC/B;AAAA,EAEQ,WAAW,SAAgD;AACjE,QAAI,QAAQ,WAAW,CAAC,KAAK,UAAW;AACxC,QAAI,KAAK,kBAAkB,KAAK,MAAM,KAAK,SAAS,KAAK,GAAG;AAC1D,cAAQ,UAAU;AAAA,IACpB;AAAA,EACF;AAAA,EAEQ,eAAeA,OAAc;AACnC,SAAK,YAAYA;AACjB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAAA,OAAM,wBAAwB,KAAK,CAAC,CAAC;AACxE,SAAK,IAAI,qBAAqBA,KAAI,GAAG;AAAA,EACvC;AAAA,EAEQ,YAAY;AAClB,SAAK,cAAc,IAAI,QAAQ,CAAC,SAAS,WAAW;AAClD,WAAK,IAAI,iBAAiB;AAC1B,WAAK,mBAAmB,WAAW,MAAM;AACvC,aAAK,mBAAmB;AACxB,aAAK,OAAO,EACT,KAAK,OAAO,EACZ,MAAM,CAAC,UAAU;AAChB,eAAK,IAAI,uBAAuB,KAAK;AACrC,iBAAO,KAAK;AAAA,QACd,CAAC;AAAA,MACL,GAAG,GAAI;AAAA,IACT,CAAC;AAAA,EACH;AACF;","names":["TTS","PassThrough","TTS","PassThrough","text"]}
1
+ {"version":3,"sources":["../src/ElevenLabsFetchTTS.ts","../src/types.ts","../src/ElevenLabsTTS.ts"],"sourcesContent":["import { ElevenLabsClient } from '@elevenlabs/elevenlabs-js'\nimport { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport { text } from 'stream/consumers'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n} from './types'\n\nexport class ElevenLabsFetchTTS extends TTS {\n private elevenlabs: ElevenLabsClient\n private speechStream: ReadableStream<Uint8Array> | null = null\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n this.elevenlabs = new ElevenLabsClient({\n apiKey: this.options.apiKey,\n })\n }\n\n speak(textStream: Readable) {\n const audioStream = new PassThrough()\n\n const run = async () => {\n try {\n const textContent = await text(textStream)\n const stream = await this.elevenlabs.textToSpeech.stream(\n this.options.voiceId,\n {\n text: textContent,\n modelId: this.options.modelId || DEFAULT_MODEL_ID,\n outputFormat: this.options.outputFormat || DEFAULT_OUTPUT_FORMAT,\n languageCode: this.options.language,\n voiceSettings: this.options.voiceSettings,\n }\n )\n this.speechStream = stream\n for await (const chunk of stream) {\n audioStream.write(chunk)\n }\n } catch (error) {\n if (error instanceof Error && error.name === 'AbortError') {\n // Stream was cancelled. This is expected.\n } else {\n audioStream.emit('error', error as Error)\n }\n } finally {\n audioStream.end()\n this.speechStream = null\n }\n }\n run()\n\n return audioStream\n }\n\n cancel() {\n if (!this.speechStream) return\n this.log('Cancel')\n this.speechStream.cancel?.()\n this.speechStream = null\n }\n}\n","import {\n TextToSpeechStreamRequestOutputFormat,\n VoiceSettings,\n} from '@elevenlabs/elevenlabs-js/api'\n\nexport interface ElevenLabsTTSOptions {\n apiKey: string\n voiceId: string\n modelId?: 'eleven_multilingual_v2' | 'eleven_turbo_v2_5' | 'eleven_flash_v2_5'\n language?: string\n outputFormat?: TextToSpeechStreamRequestOutputFormat\n voiceSettings?: VoiceSettings\n}\n\nexport const DEFAULT_MODEL_ID = 'eleven_turbo_v2_5'\nexport const DEFAULT_OUTPUT_FORMAT = 'pcm_16000'\n\nexport type ElevenLabsWebSocketMessage =\n | ElevenLabsWebSocketAudioOutputMessage\n | ElevenLabsWebSocketFinalOutputMessage\n | ElevenLabsWebSocketErrorMessage\n\nexport interface ElevenLabsWebSocketAudioOutputMessage {\n audio: string\n normalizedAlignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n alignment: ElevenLabsWebSocketAudioOutputMessageAlignment | null\n isFinal?: boolean | null\n}\n\nexport interface ElevenLabsWebSocketAudioOutputMessageAlignment {\n chars: string[]\n charStartTimesMs: number[]\n charDurationsMs: number[]\n}\n\nexport interface ElevenLabsWebSocketFinalOutputMessage {\n isFinal: boolean\n}\n\nexport interface ElevenLabsWebSocketErrorMessage {\n message: string\n error: string\n code: number\n}\n","import { TTS } from '@micdrop/server'\nimport { PassThrough, Readable } from 'stream'\nimport WebSocket from 'ws'\nimport {\n DEFAULT_MODEL_ID,\n DEFAULT_OUTPUT_FORMAT,\n ElevenLabsTTSOptions,\n ElevenLabsWebSocketAudioOutputMessage,\n ElevenLabsWebSocketMessage,\n} from './types'\n\n// API Reference: https://elevenlabs.io/docs/api-reference/text-to-speech/v-1-text-to-speech-voice-id-stream-input\n\nconst WS_INACTIVITY_TIMEOUT = 180\n\nexport class ElevenLabsTTS extends TTS {\n private socket?: WebSocket\n private initPromise: Promise<void>\n private audioStream?: PassThrough\n private textEnded = false // Whether the text stream has ended\n private textSent = '' // Text sent to ElevenLabs\n private textBuffer = '' // Buffer of text to send to ElevenLabs\n private receivedAudioText = '' // Text of chunks received from ElevenLabs\n private keepAliveInterval?: NodeJS.Timeout\n private reconnectTimeout?: NodeJS.Timeout\n private canceled = false\n\n constructor(private readonly options: ElevenLabsTTSOptions) {\n super()\n // Setup WebSocket connection\n this.initPromise = this.initWS().catch((error) => {\n console.error('[ElevenLabsTTS] Connection error:', error)\n })\n }\n\n speak(textStream: Readable) {\n this.canceled = false\n this.audioStream?.end()\n this.audioStream = new PassThrough()\n this.textEnded = false\n this.textBuffer = ''\n this.textSent = ''\n this.receivedAudioText = ''\n\n // Forward text chunks coming from the caller to ElevenLabs\n textStream.on('data', async (chunk) => {\n if (this.canceled) return\n await this.initPromise\n const text = chunk.toString('utf-8').replace(/[\\r\\n]+/g, ' ')\n const spaceIndex = text.lastIndexOf(' ')\n if (spaceIndex === -1) {\n this.textBuffer += text\n } else {\n this.sendTranscript(this.textBuffer + text.slice(0, spaceIndex + 1))\n this.textBuffer = text.slice(spaceIndex + 1)\n }\n })\n\n textStream.on('error', (error) => {\n this.log('Error in text stream, ending audio stream', error)\n this.audioStream?.end()\n this.audioStream = undefined\n })\n\n textStream.on('end', async () => {\n if (this.canceled) return\n await this.initPromise\n // Send last buffered text\n if (this.textBuffer.trim()) {\n this.sendTranscript(this.textBuffer + ' ')\n this.textBuffer = ''\n }\n this.textEnded = true\n // Flush buffered text and mark end of utterance.\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n this.log('Flushed text')\n })\n\n return this.audioStream\n }\n\n cancel() {\n if (!this.audioStream) return\n this.log('Cancel')\n this.canceled = true\n this.textSent = ''\n this.receivedAudioText = ''\n this.audioStream.end()\n this.audioStream = undefined\n this.socket?.send(JSON.stringify({ text: ' ', flush: true }))\n }\n\n destroy() {\n if (this.reconnectTimeout) {\n clearTimeout(this.reconnectTimeout)\n this.reconnectTimeout = undefined\n }\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n this.socket?.removeAllListeners()\n if (this.socket?.readyState === WebSocket.OPEN) {\n this.socket?.close(1000)\n }\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n super.destroy()\n }\n\n private initWS(): Promise<void> {\n return new Promise((resolve, reject) => {\n // Build query params\n const params = new URLSearchParams()\n params.append('model_id', this.options.modelId ?? DEFAULT_MODEL_ID)\n params.append(\n 'output_format',\n this.options.outputFormat ?? DEFAULT_OUTPUT_FORMAT\n )\n params.append('inactivity_timeout', WS_INACTIVITY_TIMEOUT.toString())\n params.append(\n 'voice_settings',\n JSON.stringify(this.options.voiceSettings)\n )\n if (this.options.language) {\n params.append('language_code', this.options.language)\n }\n\n const uri = `wss://api.elevenlabs.io/v1/text-to-speech/${this.options.voiceId}/stream-input?${params.toString()}`\n\n // Connect to ElevenLabs\n const socket = new WebSocket(uri, {\n headers: {\n 'xi-api-key': this.options.apiKey,\n },\n })\n this.socket = socket\n\n socket.addEventListener('open', () => {\n this.log('Connection opened')\n\n // Send initialization / keep-alive message with voice settings\n this.socket?.send(\n JSON.stringify({\n text: ' ',\n voice_settings: this.options.voiceSettings,\n })\n )\n\n // Start keep-alive interval\n this.keepAliveInterval = setInterval(\n () => {\n this.log('Sending keep-alive message')\n this.socket?.send(JSON.stringify({ text: ' ' }))\n },\n (WS_INACTIVITY_TIMEOUT - 1) * 1000\n )\n\n resolve()\n })\n\n socket.addEventListener('error', (error) => {\n reject(error)\n })\n\n socket.addEventListener('message', (event) => {\n if (this.canceled) return\n try {\n this.onMessage(JSON.parse(event.data.toString()))\n } catch (error) {\n console.error('[ElevenLabsTTS] Error:', error)\n console.error('[ElevenLabsTTS] Event data during error:', event.data)\n }\n })\n\n socket.addEventListener('close', ({ code, reason }) => {\n this.socket?.removeAllListeners()\n this.socket = undefined\n\n this.audioStream?.end()\n this.audioStream = undefined\n\n if (this.keepAliveInterval) {\n clearInterval(this.keepAliveInterval)\n this.keepAliveInterval = undefined\n }\n\n if (\n // Error: voice_id_does_not_exist\n code !== 1008\n ) {\n this.reconnect()\n } else {\n this.log('Connection closed', { code, reason })\n }\n })\n })\n }\n\n private onMessage(message: ElevenLabsWebSocketMessage) {\n if ('audio' in message && message.audio) {\n this.processAudioMessage(message)\n }\n if ('isFinal' in message && message.isFinal) {\n this.log('Audio ended')\n this.audioStream?.end()\n this.audioStream = undefined\n }\n if ('error' in message) {\n throw new Error(message.error)\n }\n }\n\n private processAudioMessage(message: ElevenLabsWebSocketAudioOutputMessage) {\n const chunk = Buffer.from(message.audio, 'base64')\n\n // Check text of received audio chunk\n if (message.alignment) {\n const chunkText = message.alignment.chars.join('')\n const receivedAudioText = this.receivedAudioText + chunkText\n\n // Ignore chunk if it is from previous session\n if (this.textSent.trim().indexOf(receivedAudioText.trim()) === -1) {\n this.log(`Ignore audio chunk (\"${chunkText}\")`)\n return\n }\n\n this.log(`Received audio chunk (\"${chunkText}\")`)\n this.receivedAudioText = receivedAudioText\n\n // Fix isFinal (apparently ElevenLabs doesn't send it like it should)\n this.fixIsFinal(message)\n }\n\n // Send to audio stream\n this.audioStream?.write(chunk)\n }\n\n private fixIsFinal(message: ElevenLabsWebSocketAudioOutputMessage) {\n if (message.isFinal || !this.textEnded) return\n if (this.receivedAudioText.trim() === this.textSent.trim()) {\n message.isFinal = true\n }\n }\n\n private sendTranscript(text: string) {\n this.textSent += text\n this.socket?.send(JSON.stringify({ text, try_trigger_generation: true }))\n this.log(`Sent transcript: \"${text}\"`)\n }\n\n private reconnect() {\n this.initPromise = new Promise((resolve, reject) => {\n this.log('Reconnecting...')\n this.reconnectTimeout = setTimeout(() => {\n this.reconnectTimeout = undefined\n this.initWS()\n .then(resolve)\n .catch((error) => {\n this.log('Reconnection error:', error)\n reject(error)\n })\n }, 1000)\n })\n }\n}\n"],"mappings":";AAAA,SAAS,wBAAwB;AACjC,SAAS,WAAW;AACpB,SAAS,mBAA6B;AACtC,SAAS,YAAY;;;ACWd,IAAM,mBAAmB;AACzB,IAAM,wBAAwB;;;ADL9B,IAAM,qBAAN,cAAiC,IAAI;AAAA,EAI1C,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAF7B,SAAQ,eAAkD;AAIxD,SAAK,aAAa,IAAI,iBAAiB;AAAA,MACrC,QAAQ,KAAK,QAAQ;AAAA,IACvB,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,UAAM,cAAc,IAAI,YAAY;AAEpC,UAAM,MAAM,YAAY;AACtB,UAAI;AACF,cAAM,cAAc,MAAM,KAAK,UAAU;AACzC,cAAM,SAAS,MAAM,KAAK,WAAW,aAAa;AAAA,UAChD,KAAK,QAAQ;AAAA,UACb;AAAA,YACE,MAAM;AAAA,YACN,SAAS,KAAK,QAAQ,WAAW;AAAA,YACjC,cAAc,KAAK,QAAQ,gBAAgB;AAAA,YAC3C,cAAc,KAAK,QAAQ;AAAA,YAC3B,eAAe,KAAK,QAAQ;AAAA,UAC9B;AAAA,QACF;AACA,aAAK,eAAe;AACpB,yBAAiB,SAAS,QAAQ;AAChC,sBAAY,MAAM,KAAK;AAAA,QACzB;AAAA,MACF,SAAS,OAAO;AACd,YAAI,iBAAiB,SAAS,MAAM,SAAS,cAAc;AAAA,QAE3D,OAAO;AACL,sBAAY,KAAK,SAAS,KAAc;AAAA,QAC1C;AAAA,MACF,UAAE;AACA,oBAAY,IAAI;AAChB,aAAK,eAAe;AAAA,MACtB;AAAA,IACF;AACA,QAAI;AAEJ,WAAO;AAAA,EACT;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,aAAc;AACxB,SAAK,IAAI,QAAQ;AACjB,SAAK,aAAa,SAAS;AAC3B,SAAK,eAAe;AAAA,EACtB;AACF;;;AE/DA,SAAS,OAAAA,YAAW;AACpB,SAAS,eAAAC,oBAA6B;AACtC,OAAO,eAAe;AAWtB,IAAM,wBAAwB;AAEvB,IAAM,gBAAN,cAA4BC,KAAI;AAAA,EAYrC,YAA6B,SAA+B;AAC1D,UAAM;AADqB;AAR7B,SAAQ,YAAY;AACpB;AAAA,SAAQ,WAAW;AACnB;AAAA,SAAQ,aAAa;AACrB;AAAA,SAAQ,oBAAoB;AAG5B,SAAQ,WAAW;AAKjB,SAAK,cAAc,KAAK,OAAO,EAAE,MAAM,CAAC,UAAU;AAChD,cAAQ,MAAM,qCAAqC,KAAK;AAAA,IAC1D,CAAC;AAAA,EACH;AAAA,EAEA,MAAM,YAAsB;AAC1B,SAAK,WAAW;AAChB,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc,IAAIC,aAAY;AACnC,SAAK,YAAY;AACjB,SAAK,aAAa;AAClB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AAGzB,eAAW,GAAG,QAAQ,OAAO,UAAU;AACrC,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AACX,YAAMC,QAAO,MAAM,SAAS,OAAO,EAAE,QAAQ,YAAY,GAAG;AAC5D,YAAM,aAAaA,MAAK,YAAY,GAAG;AACvC,UAAI,eAAe,IAAI;AACrB,aAAK,cAAcA;AAAA,MACrB,OAAO;AACL,aAAK,eAAe,KAAK,aAAaA,MAAK,MAAM,GAAG,aAAa,CAAC,CAAC;AACnE,aAAK,aAAaA,MAAK,MAAM,aAAa,CAAC;AAAA,MAC7C;AAAA,IACF,CAAC;AAED,eAAW,GAAG,SAAS,CAAC,UAAU;AAChC,WAAK,IAAI,6CAA6C,KAAK;AAC3D,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB,CAAC;AAED,eAAW,GAAG,OAAO,YAAY;AAC/B,UAAI,KAAK,SAAU;AACnB,YAAM,KAAK;AAEX,UAAI,KAAK,WAAW,KAAK,GAAG;AAC1B,aAAK,eAAe,KAAK,aAAa,GAAG;AACzC,aAAK,aAAa;AAAA,MACpB;AACA,WAAK,YAAY;AAEjB,WAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAC5D,WAAK,IAAI,cAAc;AAAA,IACzB,CAAC;AAED,WAAO,KAAK;AAAA,EACd;AAAA,EAEA,SAAS;AACP,QAAI,CAAC,KAAK,YAAa;AACvB,SAAK,IAAI,QAAQ;AACjB,SAAK,WAAW;AAChB,SAAK,WAAW;AAChB,SAAK,oBAAoB;AACzB,SAAK,YAAY,IAAI;AACrB,SAAK,cAAc;AACnB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,KAAK,OAAO,KAAK,CAAC,CAAC;AAAA,EAC9D;AAAA,EAEA,UAAU;AACR,QAAI,KAAK,kBAAkB;AACzB,mBAAa,KAAK,gBAAgB;AAClC,WAAK,mBAAmB;AAAA,IAC1B;AACA,QAAI,KAAK,mBAAmB;AAC1B,oBAAc,KAAK,iBAAiB;AACpC,WAAK,oBAAoB;AAAA,IAC3B;AACA,SAAK,QAAQ,mBAAmB;AAChC,QAAI,KAAK,QAAQ,eAAe,UAAU,MAAM;AAC9C,WAAK,QAAQ,MAAM,GAAI;AAAA,IACzB;AACA,SAAK,SAAS;AAEd,SAAK,aAAa,IAAI;AACtB,SAAK,cAAc;AAEnB,UAAM,QAAQ;AAAA,EAChB;AAAA,EAEQ,SAAwB;AAC9B,WAAO,IAAI,QAAQ,CAAC,SAAS,WAAW;AAEtC,YAAM,SAAS,IAAI,gBAAgB;AACnC,aAAO,OAAO,YAAY,KAAK,QAAQ,WAAW,gBAAgB;AAClE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,QAAQ,gBAAgB;AAAA,MAC/B;AACA,aAAO,OAAO,sBAAsB,sBAAsB,SAAS,CAAC;AACpE,aAAO;AAAA,QACL;AAAA,QACA,KAAK,UAAU,KAAK,QAAQ,aAAa;AAAA,MAC3C;AACA,UAAI,KAAK,QAAQ,UAAU;AACzB,eAAO,OAAO,iBAAiB,KAAK,QAAQ,QAAQ;AAAA,MACtD;AAEA,YAAM,MAAM,6CAA6C,KAAK,QAAQ,OAAO,iBAAiB,OAAO,SAAS,CAAC;AAG/G,YAAM,SAAS,IAAI,UAAU,KAAK;AAAA,QAChC,SAAS;AAAA,UACP,cAAc,KAAK,QAAQ;AAAA,QAC7B;AAAA,MACF,CAAC;AACD,WAAK,SAAS;AAEd,aAAO,iBAAiB,QAAQ,MAAM;AACpC,aAAK,IAAI,mBAAmB;AAG5B,aAAK,QAAQ;AAAA,UACX,KAAK,UAAU;AAAA,YACb,MAAM;AAAA,YACN,gBAAgB,KAAK,QAAQ;AAAA,UAC/B,CAAC;AAAA,QACH;AAGA,aAAK,oBAAoB;AAAA,UACvB,MAAM;AACJ,iBAAK,IAAI,4BAA4B;AACrC,iBAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAM,IAAI,CAAC,CAAC;AAAA,UACjD;AAAA,WACC,wBAAwB,KAAK;AAAA,QAChC;AAEA,gBAAQ;AAAA,MACV,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,UAAU;AAC1C,eAAO,KAAK;AAAA,MACd,CAAC;AAED,aAAO,iBAAiB,WAAW,CAAC,UAAU;AAC5C,YAAI,KAAK,SAAU;AACnB,YAAI;AACF,eAAK,UAAU,KAAK,MAAM,MAAM,KAAK,SAAS,CAAC,CAAC;AAAA,QAClD,SAAS,OAAO;AACd,kBAAQ,MAAM,0BAA0B,KAAK;AAC7C,kBAAQ,MAAM,4CAA4C,MAAM,IAAI;AAAA,QACtE;AAAA,MACF,CAAC;AAED,aAAO,iBAAiB,SAAS,CAAC,EAAE,MAAM,OAAO,MAAM;AACrD,aAAK,QAAQ,mBAAmB;AAChC,aAAK,SAAS;AAEd,aAAK,aAAa,IAAI;AACtB,aAAK,cAAc;AAEnB,YAAI,KAAK,mBAAmB;AAC1B,wBAAc,KAAK,iBAAiB;AACpC,eAAK,oBAAoB;AAAA,QAC3B;AAEA;AAAA;AAAA,UAEE,SAAS;AAAA,UACT;AACA,eAAK,UAAU;AAAA,QACjB,OAAO;AACL,eAAK,IAAI,qBAAqB,EAAE,MAAM,OAAO,CAAC;AAAA,QAChD;AAAA,MACF,CAAC;AAAA,IACH,CAAC;AAAA,EACH;AAAA,EAEQ,UAAU,SAAqC;AACrD,QAAI,WAAW,WAAW,QAAQ,OAAO;AACvC,WAAK,oBAAoB,OAAO;AAAA,IAClC;AACA,QAAI,aAAa,WAAW,QAAQ,SAAS;AAC3C,WAAK,IAAI,aAAa;AACtB,WAAK,aAAa,IAAI;AACtB,WAAK,cAAc;AAAA,IACrB;AACA,QAAI,WAAW,SAAS;AACtB,YAAM,IAAI,MAAM,QAAQ,KAAK;AAAA,IAC/B;AAAA,EACF;AAAA,EAEQ,oBAAoB,SAAgD;AAC1E,UAAM,QAAQ,OAAO,KAAK,QAAQ,OAAO,QAAQ;AAGjD,QAAI,QAAQ,WAAW;AACrB,YAAM,YAAY,QAAQ,UAAU,MAAM,KAAK,EAAE;AACjD,YAAM,oBAAoB,KAAK,oBAAoB;AAGnD,UAAI,KAAK,SAAS,KAAK,EAAE,QAAQ,kBAAkB,KAAK,CAAC,MAAM,IAAI;AACjE,aAAK,IAAI,wBAAwB,SAAS,IAAI;AAC9C;AAAA,MACF;AAEA,WAAK,IAAI,0BAA0B,SAAS,IAAI;AAChD,WAAK,oBAAoB;AAGzB,WAAK,WAAW,OAAO;AAAA,IACzB;AAGA,SAAK,aAAa,MAAM,KAAK;AAAA,EAC/B;AAAA,EAEQ,WAAW,SAAgD;AACjE,QAAI,QAAQ,WAAW,CAAC,KAAK,UAAW;AACxC,QAAI,KAAK,kBAAkB,KAAK,MAAM,KAAK,SAAS,KAAK,GAAG;AAC1D,cAAQ,UAAU;AAAA,IACpB;AAAA,EACF;AAAA,EAEQ,eAAeA,OAAc;AACnC,SAAK,YAAYA;AACjB,SAAK,QAAQ,KAAK,KAAK,UAAU,EAAE,MAAAA,OAAM,wBAAwB,KAAK,CAAC,CAAC;AACxE,SAAK,IAAI,qBAAqBA,KAAI,GAAG;AAAA,EACvC;AAAA,EAEQ,YAAY;AAClB,SAAK,cAAc,IAAI,QAAQ,CAAC,SAAS,WAAW;AAClD,WAAK,IAAI,iBAAiB;AAC1B,WAAK,mBAAmB,WAAW,MAAM;AACvC,aAAK,mBAAmB;AACxB,aAAK,OAAO,EACT,KAAK,OAAO,EACZ,MAAM,CAAC,UAAU;AAChB,eAAK,IAAI,uBAAuB,KAAK;AACrC,iBAAO,KAAK;AAAA,QACd,CAAC;AAAA,MACL,GAAG,GAAI;AAAA,IACT,CAAC;AAAA,EACH;AACF;","names":["TTS","PassThrough","TTS","PassThrough","text"]}
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@micdrop/elevenlabs",
3
- "version": "1.0.0",
3
+ "version": "1.0.2",
4
4
  "description": "ElevenLabs implementation for @micdrop/server",
5
5
  "author": "Lonestone",
6
6
  "license": "MIT",