@loonylabs/tts-middleware 0.9.0 → 0.11.0

package/README.md

@@ -2,7 +2,7 @@
 
 # TTS Middleware
 
-*Provider-agnostic Text-to-Speech middleware with **GDPR compliance** support. Currently supports Azure Speech Services, EdenAI, Google Cloud TTS, Fish Audio, Inworld AI, and Gemini TTS. Features EU data residency via Azure and Google Cloud, pluggable logging, character-based billing, and comprehensive error handling.*
+*Provider-agnostic Text-to-Speech middleware with **GDPR compliance** support. Currently supports Azure Speech Services, EdenAI, Google Cloud TTS, Fish Audio, Inworld AI, and Vertex AI TTS. Features EU data residency via Azure and Google Cloud, pluggable logging, character-based billing, and comprehensive error handling.*
 
 <!-- Horizontal Badge Navigation Bar -->
 [![npm version](https://img.shields.io/npm/v/@loonylabs/tts-middleware.svg?style=for-the-badge&logo=npm&logoColor=white)](https://www.npmjs.com/package/@loonylabs/tts-middleware)
@@ -43,7 +43,7 @@
   - **Google Cloud TTS**: Neural2, WaveNet, Studio voices with EU data residency
   - **Fish Audio**: S1 model with 13 languages & 64+ emotions (test/admin only)
   - **Inworld AI**: TTS 1.5 Max/Mini with 15 languages & voice cloning (test/admin only)
-  - **Gemini TTS**: Flash/Pro models with 30 voices, 90+ languages & style prompts (test/admin only)
+  - **Vertex AI TTS**: Gemini Flash/Pro models with 30 voices, 90+ languages & style prompts (test/admin only)
   - **Ready for:** OpenAI, ElevenLabs, Deepgram (interfaces prepared)
 - **GDPR/DSGVO Compliance**: Built-in EU region support for Azure and Google Cloud
 - **SSML Abstraction**: Auto-generates provider-specific SSML from simple JSON options
@@ -139,10 +139,10 @@ const inworld = await ttsService.synthesize({
   providerOptions: { modelId: 'inworld-tts-1.5-max', temperature: 1.1 },
 });
 
-// Gemini TTS via Vertex AI (test/admin only)
-const gemini = await ttsService.synthesize({
+// Vertex AI TTS (test/admin only)
+const vertexAI = await ttsService.synthesize({
   text: 'Have a wonderful day!',
-  provider: TTSProvider.GEMINI,
+  provider: TTSProvider.VERTEX_AI,
   voice: { id: 'Kore' },
   providerOptions: { model: 'gemini-2.5-flash-preview-tts', stylePrompt: 'Say cheerfully:' },
 });
@@ -220,6 +220,30 @@ const response = await ttsService.synthesize({
 
 </details>
 
+<details>
+<summary><strong>ffmpeg (for Vertex AI TTS MP3 output)</strong></summary>
+
+The Vertex AI TTS provider outputs raw PCM audio which is converted to MP3 using ffmpeg.
+The provider resolves the ffmpeg binary automatically using this priority chain:
+
+| Priority | Source | Example |
+|----------|--------|---------|
+| 1 | `ffmpegPath` in config | `new VertexAITTSProvider({ ffmpegPath: '/usr/bin/ffmpeg' })` |
+| 2 | `FFMPEG_PATH` env var | `FFMPEG_PATH=/opt/ffmpeg/bin/ffmpeg` |
+| 3 | `ffmpeg-static` npm package | `npm install ffmpeg-static` (recommended for containers) |
+| 4 | System `ffmpeg` in PATH | `apt install ffmpeg` or `brew install ffmpeg` |
+| 5 | WAV fallback | No ffmpeg needed — outputs WAV instead of MP3 |
+
+**Recommended for containerized deployments** (Railway, Docker, etc.):
+
+```bash
+npm install ffmpeg-static
+```
+
+This bundles a static ffmpeg binary with your app — no system package needed.
+
+</details>
+
 ## Configuration
 
 <details>
@@ -249,9 +273,9 @@ FISH_AUDIO_API_KEY=your-fish-audio-api-key
 # Inworld AI (test/admin only – no EU data residency)
 INWORLD_API_KEY=your-inworld-api-key
 
-# Gemini TTS via Vertex AI (test/admin only – no EU data residency)
+# Vertex AI TTS (test/admin only – no EU data residency)
 # Reuses GOOGLE_APPLICATION_CREDENTIALS and GOOGLE_CLOUD_PROJECT from above
-GEMINI_REGION=us-central1
+VERTEX_AI_TTS_REGION=us-central1
 
 # Logging
 TTS_DEBUG=false
@@ -317,18 +341,19 @@ LOG_LEVEL=info
 | **Pricing** | $10/1M chars (Max), $5/1M chars (Mini) |
 | **EU Compliance** | No data residency guarantees |
 
-### Gemini TTS (Test/Admin Only)
+### Vertex AI TTS (Test/Admin Only)
 
 | Feature | Details |
 |---------|---------|
-| **Models** | Flash (budget, fast) and Pro (premium, natural) |
+| **Models** | `gemini-2.5-flash-preview-tts` (budget, fast), `gemini-2.5-pro-preview-tts` (premium, natural) |
 | **Languages** | 90+ with auto-detection |
 | **Voices** | 30 multilingual: Kore, Puck, Charon, Zephyr, Fenrir, Sulafat, etc. |
 | **Style Control** | Natural language prompts: "Say cheerfully:", "Read in a spooky whisper:" |
-| **Audio** | MP3 (via ffmpeg), WAV (fallback) |
-| **Auth** | Vertex AI Service Account (reuses `GOOGLE_APPLICATION_CREDENTIALS`) |
+| **Audio** | MP3 (via ffmpeg — auto-detected from `ffmpeg-static`, `FFMPEG_PATH`, config, or system PATH), WAV (fallback) |
+| **Auth** | Service Account OAuth2 (reuses `GOOGLE_APPLICATION_CREDENTIALS`) |
+| **Region** | `VERTEX_AI_TTS_REGION` env var (default: `us-central1`) |
 | **Pricing** | $0.50-1.00/M input tokens + $10-20/M audio output tokens |
-| **EU Compliance** | No data residency guarantees |
+| **EU Compliance** | Preview models currently `us-central1` only — no EU data residency yet |
 
 ## GDPR / Compliance
 
@@ -341,10 +366,12 @@ LOG_LEVEL=info
 | **EdenAI** | Yes | Depends* | Depends* | Depends on underlying provider |
 | **Fish Audio** | No | No | No | Test/admin only |
 | **Inworld AI** | No | No | No | Test/admin only |
-| **Gemini TTS** | No | No | No | Test/admin only |
+| **Vertex AI TTS** | Yes (Vertex DPA) | Partial | No* | Test/admin only |
 
 *EdenAI is an aggregator - compliance depends on the underlying provider.
 
+\*Vertex AI TTS: DPA available, no model training on customer data — but preview models are currently `us-central1` only (no EU data residency until GA with EU region support).
+
 ## API Reference
 
 ### TTSService
@@ -530,14 +557,14 @@ graph TD
     Registry -->|Select| Eden[EdenAIProvider]
     Registry -->|Select| Fish[FishAudioProvider]
     Registry -->|Select| Inworld[InworldProvider]
-    Registry -->|Select| Gemini[GeminiProvider]
+    Registry -->|Select| VertexAI[VertexAITTSProvider]
 
     Azure -->|SSML/SDK| AzureAPI[Azure Speech API]
     GCloud -->|gRPC/SDK| GoogleAPI[Google Cloud TTS API]
     Eden -->|REST| EdenAPI[EdenAI API]
     Fish -->|REST| FishAPI[Fish Audio API]
     Inworld -->|REST| InworldAPI[Inworld AI API]
-    Gemini -->|REST/OAuth2| GeminiAPI[Vertex AI Gemini API]
+    VertexAI -->|REST/OAuth2| VertexAPI[Vertex AI API]
 
     GoogleAPI -->|EU Endpoint| EU[eu-texttospeech.googleapis.com]
     EdenAPI -.-> OpenAI[OpenAI TTS]
@@ -547,7 +574,7 @@ graph TD
 ## Testing
 
 ```bash
-# Run all tests (540+ tests, >90% coverage)
+# Run all tests (600+ tests, >90% coverage)
 npm test
 
 # Unit tests only
@@ -564,7 +591,7 @@ npx ts-node scripts/manual-test-edenai.ts
 npx ts-node scripts/manual-test-google-cloud-tts.ts
 npx ts-node scripts/manual-test-fish-audio.ts [en] [de]
 npx ts-node scripts/manual-test-inworld.ts [en] [de] [mini]
-npx ts-node scripts/manual-test-gemini.ts [en] [de] [pro] [style]
+npx ts-node scripts/manual-test-vertex-ai.ts [en] [de] [pro] [style]
 
 # List available Google Cloud voices
 npx ts-node scripts/list-google-voices.ts de-DE

package/dist/middleware/services/tts/index.d.ts

@@ -20,9 +20,10 @@
  */
 export { TTSService, ttsService } from './tts.service';
 export { TTSProvider, TTSErrorCode, AudioFormat, } from './types';
-export type { AudioOptions, VoiceConfig, TTSSynthesizeRequest, TTSResponse, TTSResponseMetadata, TTSBillingInfo, TTSVoice, TTSVoiceMetadata, AzureProviderOptions, OpenAIProviderOptions, ElevenLabsProviderOptions, GoogleCloudProviderOptions, GoogleCloudTTSProviderOptions, DeepgramProviderOptions, EdenAIProviderOptions, FishAudioProviderOptions, InworldProviderOptions, GeminiProviderOptions, ProviderOptions, } from './types';
-export { isAzureOptions, isOpenAIOptions, isElevenLabsOptions, isGoogleCloudOptions, isGoogleCloudTTSOptions, isDeepgramOptions, isEdenAIOptions, isFishAudioOptions, isInworldOptions, isGeminiOptions, } from './types';
-export { BaseTTSProvider, AzureProvider, EdenAIProvider, FishAudioProvider, GoogleCloudTTSProvider, InworldProvider, GeminiProvider, } from './providers';
+export type { AudioOptions, VoiceConfig, TTSSynthesizeRequest, TTSResponse, TTSResponseMetadata, TTSBillingInfo, TTSVoice, TTSVoiceMetadata, AzureProviderOptions, OpenAIProviderOptions, ElevenLabsProviderOptions, GoogleCloudProviderOptions, GoogleCloudTTSProviderOptions, DeepgramProviderOptions, EdenAIProviderOptions, FishAudioProviderOptions, InworldProviderOptions, VertexAITTSProviderOptions, ProviderOptions, } from './types';
+export { isAzureOptions, isOpenAIOptions, isElevenLabsOptions, isGoogleCloudOptions, isGoogleCloudTTSOptions, isDeepgramOptions, isEdenAIOptions, isFishAudioOptions, isInworldOptions, isVertexAITTSOptions, } from './types';
+export { BaseTTSProvider, AzureProvider, EdenAIProvider, FishAudioProvider, GoogleCloudTTSProvider, InworldProvider, VertexAITTSProvider, } from './providers';
+export type { VertexAITTSConfig } from './providers';
 export type { GoogleCloudTTSRegion, GoogleCloudTTSConfig, } from './providers';
 export { TTSError, InvalidConfigError, InvalidVoiceError, QuotaExceededError, ProviderUnavailableError, SynthesisFailedError, NetworkError, } from './providers';
 export { countCharacters, countCharactersWithoutSSML, validateCharacterCount, countBillableCharacters, estimateAudioDuration, formatCharacterCount, } from './utils';

package/dist/middleware/services/tts/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../../../src/middleware/services/tts/index.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;GAmBG;AAGH,OAAO,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,eAAe,CAAC;AAGvD,OAAO,EACL,WAAW,EACX,YAAY,EACZ,WAAW,GACZ,MAAM,SAAS,CAAC;AAEjB,YAAY,EACV,YAAY,EACZ,WAAW,EACX,oBAAoB,EACpB,WAAW,EACX,mBAAmB,EACnB,cAAc,EACd,QAAQ,EACR,gBAAgB,EAChB,oBAAoB,EACpB,qBAAqB,EACrB,yBAAyB,EACzB,0BAA0B,EAC1B,6BAA6B,EAC7B,uBAAuB,EACvB,qBAAqB,EACrB,wBAAwB,EACxB,sBAAsB,EACtB,qBAAqB,EACrB,eAAe,GAChB,MAAM,SAAS,CAAC;AAEjB,OAAO,EACL,cAAc,EACd,eAAe,EACf,mBAAmB,EACnB,oBAAoB,EACpB,uBAAuB,EACvB,iBAAiB,EACjB,eAAe,EACf,kBAAkB,EAClB,gBAAgB,EAChB,eAAe,GAChB,MAAM,SAAS,CAAC;AAGjB,OAAO,EACL,eAAe,EACf,aAAa,EACb,cAAc,EACd,iBAAiB,EACjB,sBAAsB,EACtB,eAAe,EACf,cAAc,GACf,MAAM,aAAa,CAAC;AAErB,YAAY,EACV,oBAAoB,EACpB,oBAAoB,GACrB,MAAM,aAAa,CAAC;AAGrB,OAAO,EACL,QAAQ,EACR,kBAAkB,EAClB,iBAAiB,EACjB,kBAAkB,EAClB,wBAAwB,EACxB,oBAAoB,EACpB,YAAY,GACb,MAAM,aAAa,CAAC;AAGrB,OAAO,EACL,eAAe,EACf,0BAA0B,EAC1B,sBAAsB,EACtB,uBAAuB,EACvB,qBAAqB,EACrB,oBAAoB,GACrB,MAAM,SAAS,CAAC;AAGjB,OAAO,EACL,SAAS,EACT,SAAS,EACT,WAAW,EACX,WAAW,EACX,WAAW,EACX,YAAY,GACb,MAAM,SAAS,CAAC;AAEjB,YAAY,EAAE,SAAS,EAAE,QAAQ,EAAE,MAAM,SAAS,CAAC;AAGnD,OAAO,EACL,gBAAgB,EAChB,gBAAgB,EAChB,oBAAoB,GACrB,MAAM,SAAS,CAAC;AAEjB,YAAY,EAAE,WAAW,EAAE,WAAW,EAAE,MAAM,SAAS,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../../../src/middleware/services/tts/index.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;GAmBG;AAGH,OAAO,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,eAAe,CAAC;AAGvD,OAAO,EACL,WAAW,EACX,YAAY,EACZ,WAAW,GACZ,MAAM,SAAS,CAAC;AAEjB,YAAY,EACV,YAAY,EACZ,WAAW,EACX,oBAAoB,EACpB,WAAW,EACX,mBAAmB,EACnB,cAAc,EACd,QAAQ,EACR,gBAAgB,EAChB,oBAAoB,EACpB,qBAAqB,EACrB,yBAAyB,EACzB,0BAA0B,EAC1B,6BAA6B,EAC7B,uBAAuB,EACvB,qBAAqB,EACrB,wBAAwB,EACxB,sBAAsB,EACtB,0BAA0B,EAC1B,eAAe,GAChB,MAAM,SAAS,CAAC;AAEjB,OAAO,EACL,cAAc,EACd,eAAe,EACf,mBAAmB,EACnB,oBAAoB,EACpB,uBAAuB,EACvB,iBAAiB,EACjB,eAAe,EACf,kBAAkB,EAClB,gBAAgB,EAChB,oBAAoB,GACrB,MAAM,SAAS,CAAC;AAGjB,OAAO,EACL,eAAe,EACf,aAAa,EACb,cAAc,EACd,iBAAiB,EACjB,sBAAsB,EACtB,eAAe,EACf,mBAAmB,GACpB,MAAM,aAAa,CAAC;AAErB,YAAY,EAAE,iBAAiB,EAAE,MAAM,aAAa,CAAC;AAErD,YAAY,EACV,oBAAoB,EACpB,oBAAoB,GACrB,MAAM,aAAa,CAAC;AAGrB,OAAO,EACL,QAAQ,EACR,kBAAkB,EAClB,iBAAiB,EACjB,kBAAkB,EAClB,wBAAwB,EACxB,oBAAoB,EACpB,YAAY,GACb,MAAM,aAAa,CAAC;AAGrB,OAAO,EACL,eAAe,EACf,0BAA0B,EAC1B,sBAAsB,EACtB,uBAAuB,EACvB,qBAAqB,EACrB,oBAAoB,GACrB,MAAM,SAAS,CAAC;AAGjB,OAAO,EACL,SAAS,EACT,SAAS,EACT,WAAW,EACX,WAAW,EACX,WAAW,EACX,YAAY,GACb,MAAM,SAAS,CAAC;AAEjB,YAAY,EAAE,SAAS,EAAE,QAAQ,EAAE,MAAM,SAAS,CAAC;AAGnD,OAAO,EACL,gBAAgB,EAChB,gBAAgB,EAChB,oBAAoB,GACrB,MAAM,SAAS,CAAC;AAEjB,YAAY,EAAE,WAAW,EAAE,WAAW,EAAE,MAAM,SAAS,CAAC"}

package/dist/middleware/services/tts/index.js

@@ -20,7 +20,7 @@
  * @module @loonylabs/tts-middleware
  */
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.DEFAULT_RETRY_CONFIG = exports.isRetryableError = exports.executeWithRetry = exports.silentLogger = exports.getLogLevel = exports.setLogLevel = exports.resetLogger = exports.getLogger = exports.setLogger = exports.formatCharacterCount = exports.estimateAudioDuration = exports.countBillableCharacters = exports.validateCharacterCount = exports.countCharactersWithoutSSML = exports.countCharacters = exports.NetworkError = exports.SynthesisFailedError = exports.ProviderUnavailableError = exports.QuotaExceededError = exports.InvalidVoiceError = exports.InvalidConfigError = exports.TTSError = exports.GeminiProvider = exports.InworldProvider = exports.GoogleCloudTTSProvider = exports.FishAudioProvider = exports.EdenAIProvider = exports.AzureProvider = exports.BaseTTSProvider = exports.isGeminiOptions = exports.isInworldOptions = exports.isFishAudioOptions = exports.isEdenAIOptions = exports.isDeepgramOptions = exports.isGoogleCloudTTSOptions = exports.isGoogleCloudOptions = exports.isElevenLabsOptions = exports.isOpenAIOptions = exports.isAzureOptions = exports.TTSErrorCode = exports.TTSProvider = exports.ttsService = exports.TTSService = void 0;
+exports.DEFAULT_RETRY_CONFIG = exports.isRetryableError = exports.executeWithRetry = exports.silentLogger = exports.getLogLevel = exports.setLogLevel = exports.resetLogger = exports.getLogger = exports.setLogger = exports.formatCharacterCount = exports.estimateAudioDuration = exports.countBillableCharacters = exports.validateCharacterCount = exports.countCharactersWithoutSSML = exports.countCharacters = exports.NetworkError = exports.SynthesisFailedError = exports.ProviderUnavailableError = exports.QuotaExceededError = exports.InvalidVoiceError = exports.InvalidConfigError = exports.TTSError = exports.VertexAITTSProvider = exports.InworldProvider = exports.GoogleCloudTTSProvider = exports.FishAudioProvider = exports.EdenAIProvider = exports.AzureProvider = exports.BaseTTSProvider = exports.isVertexAITTSOptions = exports.isInworldOptions = exports.isFishAudioOptions = exports.isEdenAIOptions = exports.isDeepgramOptions = exports.isGoogleCloudTTSOptions = exports.isGoogleCloudOptions = exports.isElevenLabsOptions = exports.isOpenAIOptions = exports.isAzureOptions = exports.TTSErrorCode = exports.TTSProvider = exports.ttsService = exports.TTSService = void 0;
 // ===== Main Service =====
 var tts_service_1 = require("./tts.service");
 Object.defineProperty(exports, "TTSService", { enumerable: true, get: function () { return tts_service_1.TTSService; } });
@@ -39,7 +39,7 @@ Object.defineProperty(exports, "isDeepgramOptions", { enumerable: true, get: fun
 Object.defineProperty(exports, "isEdenAIOptions", { enumerable: true, get: function () { return types_2.isEdenAIOptions; } });
 Object.defineProperty(exports, "isFishAudioOptions", { enumerable: true, get: function () { return types_2.isFishAudioOptions; } });
 Object.defineProperty(exports, "isInworldOptions", { enumerable: true, get: function () { return types_2.isInworldOptions; } });
-Object.defineProperty(exports, "isGeminiOptions", { enumerable: true, get: function () { return types_2.isGeminiOptions; } });
+Object.defineProperty(exports, "isVertexAITTSOptions", { enumerable: true, get: function () { return types_2.isVertexAITTSOptions; } });
 // ===== Providers =====
 var providers_1 = require("./providers");
 Object.defineProperty(exports, "BaseTTSProvider", { enumerable: true, get: function () { return providers_1.BaseTTSProvider; } });
@@ -48,7 +48,7 @@ Object.defineProperty(exports, "EdenAIProvider", { enumerable: true, get: functi
 Object.defineProperty(exports, "FishAudioProvider", { enumerable: true, get: function () { return providers_1.FishAudioProvider; } });
 Object.defineProperty(exports, "GoogleCloudTTSProvider", { enumerable: true, get: function () { return providers_1.GoogleCloudTTSProvider; } });
 Object.defineProperty(exports, "InworldProvider", { enumerable: true, get: function () { return providers_1.InworldProvider; } });
-Object.defineProperty(exports, "GeminiProvider", { enumerable: true, get: function () { return providers_1.GeminiProvider; } });
+Object.defineProperty(exports, "VertexAITTSProvider", { enumerable: true, get: function () { return providers_1.VertexAITTSProvider; } });
 // ===== Errors =====
 var providers_2 = require("./providers");
 Object.defineProperty(exports, "TTSError", { enumerable: true, get: function () { return providers_2.TTSError; } });

package/dist/middleware/services/tts/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../../src/middleware/services/tts/index.ts"],"names":[],"mappings":";AAAA;;;;;;;;;;;;;;;;;;;GAmBG;;;AAEH,2BAA2B;AAC3B,6CAAuD;AAA9C,yGAAA,UAAU,OAAA;AAAE,yGAAA,UAAU,OAAA;AAE/B,oBAAoB;AACpB,iCAIiB;AAHf,oGAAA,WAAW,OAAA;AACX,qGAAA,YAAY,OAAA;AA0Bd,iCAWiB;AAVf,uGAAA,cAAc,OAAA;AACd,wGAAA,eAAe,OAAA;AACf,4GAAA,mBAAmB,OAAA;AACnB,6GAAA,oBAAoB,OAAA;AACpB,gHAAA,uBAAuB,OAAA;AACvB,0GAAA,iBAAiB,OAAA;AACjB,wGAAA,eAAe,OAAA;AACf,2GAAA,kBAAkB,OAAA;AAClB,yGAAA,gBAAgB,OAAA;AAChB,wGAAA,eAAe,OAAA;AAGjB,wBAAwB;AACxB,yCAQqB;AAPnB,4GAAA,eAAe,OAAA;AACf,0GAAA,aAAa,OAAA;AACb,2GAAA,cAAc,OAAA;AACd,8GAAA,iBAAiB,OAAA;AACjB,mHAAA,sBAAsB,OAAA;AACtB,4GAAA,eAAe,OAAA;AACf,2GAAA,cAAc,OAAA;AAQhB,qBAAqB;AACrB,yCAQqB;AAPnB,qGAAA,QAAQ,OAAA;AACR,+GAAA,kBAAkB,OAAA;AAClB,8GAAA,iBAAiB,OAAA;AACjB,+GAAA,kBAAkB,OAAA;AAClB,qHAAA,wBAAwB,OAAA;AACxB,iHAAA,oBAAoB,OAAA;AACpB,yGAAA,YAAY,OAAA;AAGd,wBAAwB;AACxB,iCAOiB;AANf,wGAAA,eAAe,OAAA;AACf,mHAAA,0BAA0B,OAAA;AAC1B,+GAAA,sBAAsB,OAAA;AACtB,gHAAA,uBAAuB,OAAA;AACvB,8GAAA,qBAAqB,OAAA;AACrB,6GAAA,oBAAoB,OAAA;AAGtB,qBAAqB;AACrB,iCAOiB;AANf,kGAAA,SAAS,OAAA;AACT,kGAAA,SAAS,OAAA;AACT,oGAAA,WAAW,OAAA;AACX,oGAAA,WAAW,OAAA;AACX,oGAAA,WAAW,OAAA;AACX,qGAAA,YAAY,OAAA;AAKd,oBAAoB;AACpB,iCAIiB;AAHf,yGAAA,gBAAgB,OAAA;AAChB,yGAAA,gBAAgB,OAAA;AAChB,6GAAA,oBAAoB,OAAA"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../../src/middleware/services/tts/index.ts"],"names":[],"mappings":";AAAA;;;;;;;;;;;;;;;;;;;GAmBG;;;AAEH,2BAA2B;AAC3B,6CAAuD;AAA9C,yGAAA,UAAU,OAAA;AAAE,yGAAA,UAAU,OAAA;AAE/B,oBAAoB;AACpB,iCAIiB;AAHf,oGAAA,WAAW,OAAA;AACX,qGAAA,YAAY,OAAA;AA0Bd,iCAWiB;AAVf,uGAAA,cAAc,OAAA;AACd,wGAAA,eAAe,OAAA;AACf,4GAAA,mBAAmB,OAAA;AACnB,6GAAA,oBAAoB,OAAA;AACpB,gHAAA,uBAAuB,OAAA;AACvB,0GAAA,iBAAiB,OAAA;AACjB,wGAAA,eAAe,OAAA;AACf,2GAAA,kBAAkB,OAAA;AAClB,yGAAA,gBAAgB,OAAA;AAChB,6GAAA,oBAAoB,OAAA;AAGtB,wBAAwB;AACxB,yCAQqB;AAPnB,4GAAA,eAAe,OAAA;AACf,0GAAA,aAAa,OAAA;AACb,2GAAA,cAAc,OAAA;AACd,8GAAA,iBAAiB,OAAA;AACjB,mHAAA,sBAAsB,OAAA;AACtB,4GAAA,eAAe,OAAA;AACf,gHAAA,mBAAmB,OAAA;AAUrB,qBAAqB;AACrB,yCAQqB;AAPnB,qGAAA,QAAQ,OAAA;AACR,+GAAA,kBAAkB,OAAA;AAClB,8GAAA,iBAAiB,OAAA;AACjB,+GAAA,kBAAkB,OAAA;AAClB,qHAAA,wBAAwB,OAAA;AACxB,iHAAA,oBAAoB,OAAA;AACpB,yGAAA,YAAY,OAAA;AAGd,wBAAwB;AACxB,iCAOiB;AANf,wGAAA,eAAe,OAAA;AACf,mHAAA,0BAA0B,OAAA;AAC1B,+GAAA,sBAAsB,OAAA;AACtB,gHAAA,uBAAuB,OAAA;AACvB,8GAAA,qBAAqB,OAAA;AACrB,6GAAA,oBAAoB,OAAA;AAGtB,qBAAqB;AACrB,iCAOiB;AANf,kGAAA,SAAS,OAAA;AACT,kGAAA,SAAS,OAAA;AACT,oGAAA,WAAW,OAAA;AACX,oGAAA,WAAW,OAAA;AACX,oGAAA,WAAW,OAAA;AACX,qGAAA,YAAY,OAAA;AAKd,oBAAoB;AACpB,iCAIiB;AAHf,yGAAA,gBAAgB,OAAA;AAChB,yGAAA,gBAAgB,OAAA;AAChB,6GAAA,oBAAoB,OAAA"}

package/dist/middleware/services/tts/providers/index.d.ts

@@ -10,5 +10,6 @@ export { GoogleCloudTTSProvider } from './google-cloud-tts-provider';
 export type { GoogleCloudTTSRegion, GoogleCloudTTSConfig } from './google-cloud-tts-provider';
 export { FishAudioProvider } from './fish-audio-provider';
 export { InworldProvider } from './inworld-provider';
-export { GeminiProvider } from './gemini-provider';
+export { VertexAITTSProvider } from './vertex-ai-tts-provider';
+export type { VertexAITTSConfig } from './vertex-ai-tts-provider';
 //# sourceMappingURL=index.d.ts.map

package/dist/middleware/services/tts/providers/index.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../../../../src/middleware/services/tts/providers/index.ts"],"names":[],"mappings":"AAAA;;;;GAIG;AAGH,OAAO,EACL,eAAe,EACf,QAAQ,EACR,kBAAkB,EAClB,iBAAiB,EACjB,kBAAkB,EAClB,wBAAwB,EACxB,oBAAoB,EACpB,YAAY,GACb,MAAM,qBAAqB,CAAC;AAG7B,OAAO,EAAE,aAAa,EAAE,MAAM,kBAAkB,CAAC;AACjD,OAAO,EAAE,cAAc,EAAE,MAAM,mBAAmB,CAAC;AACnD,OAAO,EAAE,sBAAsB,EAAE,MAAM,6BAA6B,CAAC;AACrE,YAAY,EAAE,oBAAoB,EAAE,oBAAoB,EAAE,MAAM,6BAA6B,CAAC;AAC9F,OAAO,EAAE,iBAAiB,EAAE,MAAM,uBAAuB,CAAC;AAC1D,OAAO,EAAE,eAAe,EAAE,MAAM,oBAAoB,CAAC;AACrD,OAAO,EAAE,cAAc,EAAE,MAAM,mBAAmB,CAAC"}
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../../../../src/middleware/services/tts/providers/index.ts"],"names":[],"mappings":"AAAA;;;;GAIG;AAGH,OAAO,EACL,eAAe,EACf,QAAQ,EACR,kBAAkB,EAClB,iBAAiB,EACjB,kBAAkB,EAClB,wBAAwB,EACxB,oBAAoB,EACpB,YAAY,GACb,MAAM,qBAAqB,CAAC;AAG7B,OAAO,EAAE,aAAa,EAAE,MAAM,kBAAkB,CAAC;AACjD,OAAO,EAAE,cAAc,EAAE,MAAM,mBAAmB,CAAC;AACnD,OAAO,EAAE,sBAAsB,EAAE,MAAM,6BAA6B,CAAC;AACrE,YAAY,EAAE,oBAAoB,EAAE,oBAAoB,EAAE,MAAM,6BAA6B,CAAC;AAC9F,OAAO,EAAE,iBAAiB,EAAE,MAAM,uBAAuB,CAAC;AAC1D,OAAO,EAAE,eAAe,EAAE,MAAM,oBAAoB,CAAC;AACrD,OAAO,EAAE,mBAAmB,EAAE,MAAM,0BAA0B,CAAC;AAC/D,YAAY,EAAE,iBAAiB,EAAE,MAAM,0BAA0B,CAAC"}

package/dist/middleware/services/tts/providers/index.js

@@ -5,7 +5,7 @@
  * Export all provider classes and error types
  */
 Object.defineProperty(exports, "__esModule", { value: true });
-exports.GeminiProvider = exports.InworldProvider = exports.FishAudioProvider = exports.GoogleCloudTTSProvider = exports.EdenAIProvider = exports.AzureProvider = exports.NetworkError = exports.SynthesisFailedError = exports.ProviderUnavailableError = exports.QuotaExceededError = exports.InvalidVoiceError = exports.InvalidConfigError = exports.TTSError = exports.BaseTTSProvider = void 0;
+exports.VertexAITTSProvider = exports.InworldProvider = exports.FishAudioProvider = exports.GoogleCloudTTSProvider = exports.EdenAIProvider = exports.AzureProvider = exports.NetworkError = exports.SynthesisFailedError = exports.ProviderUnavailableError = exports.QuotaExceededError = exports.InvalidVoiceError = exports.InvalidConfigError = exports.TTSError = exports.BaseTTSProvider = void 0;
 // Base provider and errors
 var base_tts_provider_1 = require("./base-tts-provider");
 Object.defineProperty(exports, "BaseTTSProvider", { enumerable: true, get: function () { return base_tts_provider_1.BaseTTSProvider; } });
@@ -27,8 +27,8 @@ var fish_audio_provider_1 = require("./fish-audio-provider");
 Object.defineProperty(exports, "FishAudioProvider", { enumerable: true, get: function () { return fish_audio_provider_1.FishAudioProvider; } });
 var inworld_provider_1 = require("./inworld-provider");
 Object.defineProperty(exports, "InworldProvider", { enumerable: true, get: function () { return inworld_provider_1.InworldProvider; } });
-var gemini_provider_1 = require("./gemini-provider");
-Object.defineProperty(exports, "GeminiProvider", { enumerable: true, get: function () { return gemini_provider_1.GeminiProvider; } });
+var vertex_ai_tts_provider_1 = require("./vertex-ai-tts-provider");
+Object.defineProperty(exports, "VertexAITTSProvider", { enumerable: true, get: function () { return vertex_ai_tts_provider_1.VertexAITTSProvider; } });
 // Future provider implementations will be exported here:
 // export { OpenAIProvider } from './openai-provider';
 // export { ElevenLabsProvider } from './elevenlabs-provider';

package/dist/middleware/services/tts/providers/index.js.map

@@ -1 +1 @@
-{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../../../src/middleware/services/tts/providers/index.ts"],"names":[],"mappings":";AAAA;;;;GAIG;;;AAEH,2BAA2B;AAC3B,yDAS6B;AAR3B,oHAAA,eAAe,OAAA;AACf,6GAAA,QAAQ,OAAA;AACR,uHAAA,kBAAkB,OAAA;AAClB,sHAAA,iBAAiB,OAAA;AACjB,uHAAA,kBAAkB,OAAA;AAClB,6HAAA,wBAAwB,OAAA;AACxB,yHAAA,oBAAoB,OAAA;AACpB,iHAAA,YAAY,OAAA;AAGd,2BAA2B;AAC3B,mDAAiD;AAAxC,+GAAA,aAAa,OAAA;AACtB,qDAAmD;AAA1C,iHAAA,cAAc,OAAA;AACvB,yEAAqE;AAA5D,mIAAA,sBAAsB,OAAA;AAE/B,6DAA0D;AAAjD,wHAAA,iBAAiB,OAAA;AAC1B,uDAAqD;AAA5C,mHAAA,eAAe,OAAA;AACxB,qDAAmD;AAA1C,iHAAA,cAAc,OAAA;AAEvB,yDAAyD;AACzD,sDAAsD;AACtD,8DAA8D;AAC9D,0DAA0D"}
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../../../../src/middleware/services/tts/providers/index.ts"],"names":[],"mappings":";AAAA;;;;GAIG;;;AAEH,2BAA2B;AAC3B,yDAS6B;AAR3B,oHAAA,eAAe,OAAA;AACf,6GAAA,QAAQ,OAAA;AACR,uHAAA,kBAAkB,OAAA;AAClB,sHAAA,iBAAiB,OAAA;AACjB,uHAAA,kBAAkB,OAAA;AAClB,6HAAA,wBAAwB,OAAA;AACxB,yHAAA,oBAAoB,OAAA;AACpB,iHAAA,YAAY,OAAA;AAGd,2BAA2B;AAC3B,mDAAiD;AAAxC,+GAAA,aAAa,OAAA;AACtB,qDAAmD;AAA1C,iHAAA,cAAc,OAAA;AACvB,yEAAqE;AAA5D,mIAAA,sBAAsB,OAAA;AAE/B,6DAA0D;AAAjD,wHAAA,iBAAiB,OAAA;AAC1B,uDAAqD;AAA5C,mHAAA,eAAe,OAAA;AACxB,mEAA+D;AAAtD,6HAAA,mBAAmB,OAAA;AAG5B,yDAAyD;AACzD,sDAAsD;AACtD,8DAA8D;AAC9D,0DAA0D"}

package/dist/middleware/services/tts/providers/vertex-ai-tts-provider.d.ts

@@ -0,0 +1,190 @@
+/**
+ * Vertex AI TTS Provider
+ *
+ * @description Provider for Google Vertex AI TTS via the generateContent
+ * endpoint with responseModalities: ['AUDIO']. Authenticates via Service Account
+ * (same as Google Cloud TTS — reuses GOOGLE_APPLICATION_CREDENTIALS).
+ *
+ * Supports 30 multilingual voices with auto-detect language and natural language
+ * style control. Output is raw PCM (24kHz, 16-bit, mono) which is converted to
+ * MP3 via ffmpeg (auto-detected from ffmpeg-static, FFMPEG_PATH, config, or system PATH)
+ * or WAV as fallback.
+ *
+ * Test/Admin only -- no EU data residency guarantees.
+ *
+ * @see https://cloud.google.com/vertex-ai/generative-ai/docs/text-to-speech
+ */
+import type { TTSSynthesizeRequest, TTSResponse } from '../types';
+import { BaseTTSProvider } from './base-tts-provider';
+import type { RegionRotationConfig } from '../types/provider-options.types';
+/**
+ * Vertex AI TTS configuration
+ */
+export interface VertexAITTSConfig {
+    /**
+     * Path to Service Account JSON file
+     * @env GOOGLE_APPLICATION_CREDENTIALS
+     */
+    keyFilename?: string;
+    /**
+     * Google Cloud Project ID
+     * @env GOOGLE_CLOUD_PROJECT
+     */
+    projectId?: string;
+    /**
+     * Vertex AI region
+     * @env VERTEX_AI_TTS_REGION
+     * @default 'us-central1'
+     */
+    region?: string;
+    /**
+     * Path to ffmpeg binary for PCM-to-MP3 conversion.
+     *
+     * Resolution order (first match wins):
+     * 1. This config value
+     * 2. `FFMPEG_PATH` environment variable
+     * 3. `ffmpeg-static` npm package (if installed)
+     * 4. System `ffmpeg` in PATH
+     *
+     * If ffmpeg is not available, the provider falls back to WAV output.
+     */
+    ffmpegPath?: string;
+    /**
+     * Optional region rotation for quota management (429 / Resource Exhausted)
+     *
+     * @description When configured, the provider automatically rotates through the
+     * specified regions on quota errors. Same pattern as llm-middleware and tti-middleware.
+     *
+     * @example
+     * ```typescript
+     * {
+     *   regions: ['europe-west4', 'europe-west1'],
+     *   fallback: 'us-central1',
+     * }
+     * ```
+     */
+    regionRotation?: RegionRotationConfig;
+}
+/**
+ * Vertex AI TTS provider implementation
+ *
+ * @description Provides TTS synthesis using Google's Vertex AI generateContent API.
+ * Authenticates with Service Account OAuth2 (same credentials as Google Cloud TTS).
+ * Outputs raw PCM which is converted to MP3 (via ffmpeg) or WAV (pure Node.js fallback).
+ *
+ * Billing: Token-based ($0.50-1.00/M input + $10-20/M audio output tokens).
+ * For billing compatibility, reports character count like all other providers.
+ *
+ * @example
+ * ```typescript
+ * const provider = new VertexAITTSProvider();
+ * const response = await provider.synthesize(
+ *   "Hello World",
+ *   "Kore",
+ *   {
+ *     text: "Hello World",
+ *     voice: { id: "Kore" },
+ *     audio: { format: "mp3" },
+ *     providerOptions: {
+ *       model: "gemini-2.5-flash-preview-tts",
+ *       stylePrompt: "Say cheerfully:"
+ *     }
+ *   }
+ * );
+ * ```
+ */
+export declare class VertexAITTSProvider extends BaseTTSProvider {
+    private config;
+    private authClient;
+    private readonly ffmpegPath;
+    /**
+     * Creates a new Vertex AI TTS provider
+     *
+     * @param config - Optional configuration (uses env vars if not provided)
+     * @throws {InvalidConfigError} If credentials are missing
+     */
+    constructor(config?: Partial<VertexAITTSConfig>);
+    /**
+     * Validate Vertex AI configuration
+     *
+     * @private
+     * @throws {InvalidConfigError} If configuration is invalid
+     */
+    private validateVertexAIConfig;
+    /**
+     * Get an authenticated access token via Service Account
+     *
+     * @private
+     * @returns OAuth2 access token
+     */
+    private getAccessToken;
+    /**
+     * Synthesize text to speech using Vertex AI TTS
+     *
+     * @param text - The input text to synthesize
+     * @param voiceId - The voice name (e.g. "Kore", "Puck", "Charon")
+     * @param request - The full synthesis request with options
+     * @returns Promise resolving to the synthesis response
+     */
+    synthesize(text: string, voiceId: string, request: TTSSynthesizeRequest): Promise<TTSResponse>;
+    /**
+     * Build Vertex AI generateContent request payload
+     *
+     * @private
+     */
+    private buildRequest;
+    /**
+     * Call the Vertex AI API with optional region rotation on quota errors
+     *
+     * @private
+     * @param requestBody - The request payload
+     * @param model - The model to use
+     * @param regionOverride - Optional per-request region override (skips rotation)
+     * @returns The PCM audio buffer and the region that processed the request
+     */
+    private callAPIWithRegionRotation;
+    /**
+     * Call Vertex AI generateContent API
+     *
+     * @private
+     * @param requestBody - The request payload
+     * @param model - The model to use
+     * @param region - The Vertex AI region to use
+     * @returns Promise resolving to raw PCM audio buffer
+     */
+    private callAPI;
+    /**
+     * Resolve ffmpeg binary path with fallback chain:
+     * 1. Explicit config value
+     * 2. FFMPEG_PATH environment variable
+     * 3. ffmpeg-static npm package (optional peer dependency)
+     * 4. System ffmpeg in PATH
+     */
+    private resolveFfmpegPath;
+    /**
+     * Convert raw PCM audio to the requested format
+     *
+     * @private
+     * @param pcmBuffer - Raw PCM buffer (24kHz, 16-bit, mono, little-endian)
+     * @param requestedFormat - The desired output format ('mp3', 'wav', etc.)
+     * @returns The converted audio buffer and actual format used
+     */
+    private convertPcmAudio;
+    /**
+     * Convert raw PCM to MP3 using ffmpeg via child_process
+     *
+     * @private
+     * @param pcmBuffer - Raw PCM buffer (24kHz, 16-bit, mono, little-endian)
+     * @returns Promise resolving to MP3 buffer
+     */
+    private pcmToMp3;
+    /**
+     * Convert raw PCM to WAV by prepending a 44-byte WAV header
+     *
+     * @private
+     * @param pcmBuffer - Raw PCM buffer (24kHz, 16-bit, mono, little-endian)
+     * @returns WAV buffer
+     */
+    private pcmToWav;
+}
+//# sourceMappingURL=vertex-ai-tts-provider.d.ts.map

package/dist/middleware/services/tts/providers/vertex-ai-tts-provider.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"vertex-ai-tts-provider.d.ts","sourceRoot":"","sources":["../../../../../src/middleware/services/tts/providers/vertex-ai-tts-provider.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAGH,OAAO,KAAK,EAAE,oBAAoB,EAAE,WAAW,EAAE,MAAM,UAAU,CAAC;AAGlE,OAAO,EACL,eAAe,EAEhB,MAAM,qBAAqB,CAAC;AAC7B,OAAO,KAAK,EAA8B,oBAAoB,EAAE,MAAM,iCAAiC,CAAC;AAGxG;;GAEG;AACH,MAAM,WAAW,iBAAiB;IAChC;;;OAGG;IACH,WAAW,CAAC,EAAE,MAAM,CAAC;IAErB;;;OAGG;IACH,SAAS,CAAC,EAAE,MAAM,CAAC;IAEnB;;;;OAIG;IACH,MAAM,CAAC,EAAE,MAAM,CAAC;IAEhB;;;;;;;;;;OAUG;IACH,UAAU,CAAC,EAAE,MAAM,CAAC;IAEpB;;;;;;;;;;;;;OAaG;IACH,cAAc,CAAC,EAAE,oBAAoB,CAAC;CACvC;AAMD;;;;;;;;;;;;;;;;;;;;;;;;;;;GA2BG;AACH,qBAAa,mBAAoB,SAAQ,eAAe;IACtD,OAAO,CAAC,MAAM,CAAoB;IAClC,OAAO,CAAC,UAAU,CAA6E;IAC/F,OAAO,CAAC,QAAQ,CAAC,UAAU,CAAS;IAEpC;;;;;OAKG;gBACS,MAAM,CAAC,EAAE,OAAO,CAAC,iBAAiB,CAAC;IAsB/C;;;;;OAKG;IACH,OAAO,CAAC,sBAAsB;IAgB9B;;;;;OAKG;YACW,cAAc;IAqB5B;;;;;;;OAOG;IACG,UAAU,CACd,IAAI,EAAE,MAAM,EACZ,OAAO,EAAE,MAAM,EACf,OAAO,EAAE,oBAAoB,GAC5B,OAAO,CAAC,WAAW,CAAC;IA4DvB;;;;OAIG;IACH,OAAO,CAAC,YAAY;IA6BpB;;;;;;;;OAQG;YACW,yBAAyB;IAsDvC;;;;;;;;OAQG;YACW,OAAO;IA6CrB;;;;;;OAMG;IACH,OAAO,CAAC,iBAAiB;IAyBzB;;;;;;;OAOG;YACW,eAAe;IA0B7B;;;;;;OAMG;IACH,OAAO,CAAC,QAAQ;IAkChB;;;;;;OAMG;IACH,OAAO,CAAC,QAAQ;CAwBjB"}