@mrgoonie/multix 0.0.6 → 0.0.7

package/CHANGELOG.md

@@ -5,6 +5,25 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.0.7] - 2026-05-05
+
+### Added
+- **ElevenLabs provider** — full integration with 13 subcommands:
+  - `tts` — text-to-speech (sync audio bytes) with voice settings, language code, seed, context continuity, and `--no-speaker-boost` opt-out.
+  - `voices list|get|search|design|create-from-preview|delete` — voice library management and prompt-based voice design.
+  - `clone` — instant voice cloning via multipart audio sample upload.
+  - `voice-changer` — speech-to-speech voice conversion.
+  - `transcribe` — Scribe STT with diarization, audio-event tagging, and `text|json|srt|vtt` output.
+  - `sfx` — sound effects generation with prompt influence and looping.
+  - `music` — music generation (`music_v1`) from prompt or composition plan.
+  - `dub` / `dub-status` — async dubbing with `--wait` / `--download` polling and per-language audio download.
+  - `isolate` — voice isolator (background noise removal).
+  - `align` — forced alignment (transcript ↔ audio timing).
+  - `account` / `models` — usage / subscription tier and model catalog.
+- `ELEVENLABS_RECOMMENDED_VOICES` with 11 verified conversational voice IDs (Alexandra default).
+- TTS models: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`. STT: `scribe_v1`, `scribe_v1_experimental`. Voice changer: `eleven_multilingual_sts_v2`. Output formats: `mp3_*`, `pcm_*`, `ulaw_8000`.
+- `multix check` and `.env.example` document `ELEVENLABS_API_KEY`.
+
 ## [0.0.6] - 2026-05-05
 
 ### Added

package/README.md

@@ -2,7 +2,7 @@
 
 AI multimodal CLI — generate images/video/speech/music, analyze and transcribe media files, convert documents to Markdown, and optimize media with ffmpeg/ImageMagick.
 
-Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), and **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D).
+Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D), and **ElevenLabs** (TTS, voice cloning, STT, voice changer, SFX, music, dubbing, isolation, alignment).
 
 ## Install
 
@@ -47,6 +47,7 @@ Set at least one provider key. Add to `.env` in your project root or `~/.multix/
 | `LEONARDO_DEFAULT_MODEL` | No | Default Leonardo image model UUID |
 | `LEONARDO_VIDEO_MODEL` | No | Default Leonardo video model (default `MOTION2`) |
 | `BYTEPLUS_API_KEY` | For BytePlus | [BytePlus](https://console.byteplus.com/auth/api-keys) |
+| `ELEVENLABS_API_KEY` | For ElevenLabs | [ElevenLabs](https://elevenlabs.io/app/settings/api-keys) |
 | `ARK_API_KEY` | No | Fallback for `BYTEPLUS_API_KEY` (Volcengine ARK shared name) |
 | `BYTEPLUS_BASE_URL` | No | Override BytePlus base (default `https://ark.ap-southeast.bytepluses.com/api/v3`) |
 | `BYTEPLUS_IMAGE_MODEL` | No | Default Seedream model (default `seedream-4-0-250828`) |
@@ -251,6 +252,77 @@ multix byteplus status <taskId> [--wait] [--wait-timeout 600000] [--download] [-
 - `multix byteplus status <taskId> --download` works for both video (`content.video_url`) and 3D (`content.file_url`) tasks.
 - **Task cancellation is not supported** — there is no verified DELETE endpoint on the ARK API. Submitted tasks must run to completion.
 
+### `multix elevenlabs`
+
+```bash
+# Text-to-speech (sync, returns audio bytes)
+multix elevenlabs tts --text "Hello world" [--voice <voiceId>] [--model eleven_multilingual_v2] \
+  [--format mp3_44100_128] [--stability 0.5] [--similarity-boost 0.75] [--style 0.0] \
+  [--no-speaker-boost] [--language-code en] [--seed <n>] [--output out.mp3] [-v]
+
+# Voices: list / get / search shared / design / persist / delete
+multix elevenlabs voices list [--category cloned|generated|premade|professional]
+multix elevenlabs voices get <voiceId>
+multix elevenlabs voices search [--search "calm female"] [--language en] [--gender female] [--age young] [--accent american]
+multix elevenlabs voices design --description "friendly female narrator" [--text "sample text"] [--auto-text]
+multix elevenlabs voices create-from-preview --generated-voice-id <id> --name "My Voice" --description "..."
+multix elevenlabs voices delete <voiceId>
+
+# Instant voice cloning (multipart upload of 1-3 minutes of samples)
+multix elevenlabs clone --name "My Voice" --files sample1.wav sample2.wav [--description "..."] [--remove-background-noise]
+
+# Speech-to-speech voice changer
+multix elevenlabs voice-changer --input source.mp3 --voice <voiceId> [--model eleven_multilingual_sts_v2] \
+  [--format mp3_44100_128] [--remove-background-noise] [--output changed.mp3] [-v]
+
+# Speech-to-text (Scribe)
+multix elevenlabs transcribe --input audio.mp3 [--model scribe_v1] [--language en] [--diarize] \
+  [--num-speakers 2] [--tag-audio-events] [--timestamps-granularity word] [--format text|json|srt|vtt] [--output out.txt]
+
+# Sound effects
+multix elevenlabs sfx --text "car engine starting" [--duration-seconds 5] [--prompt-influence 0.3] [--loop] \
+  [--format mp3_44100_128] [--output sfx.mp3]
+
+# Music generation
+multix elevenlabs music --prompt "dreamy synthwave loop" [--music-length-ms 30000] [--model music_v1] \
+  [--format mp3_44100_128] [--output song.mp3]
+# OR with a structured composition plan
+multix elevenlabs music --plan ./plan.json [--output song.mp3]
+
+# Dubbing (async — submit and poll, then optionally --download)
+multix elevenlabs dub --input video.mp4 --target-lang es [--source-lang en] [--num-speakers 2] \
+  [--watermark] [--start-time 0] [--end-time 60] [--highest-resolution] [--name "My Dub"] \
+  [--async] [--wait] [--download] [--poll-interval 10] [--wait-timeout 1800000] [--output dubbed.mp4]
+multix elevenlabs dub-status <dubbingId> [--download <lang>] [--output dubbed.mp4]
+
+# Voice isolator (strip background noise)
+multix elevenlabs isolate --input noisy.mp3 [--output clean.mp3]
+
+# Forced alignment (transcript ↔ audio timing)
+multix elevenlabs align --input audio.mp3 --text "transcript here" [--output alignment.json]
+# Or read transcript from file:
+multix elevenlabs align --input audio.mp3 --text-file transcript.txt
+
+# Account info / available models
+multix elevenlabs account
+multix elevenlabs models
+```
+
+**ElevenLabs models:**
+- TTS: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`
+- STT: `scribe_v1`, `scribe_v1_experimental`
+- Voice changer: `eleven_multilingual_sts_v2` (default)
+- Music: `music_v1`
+
+**Recommended voices** (verified from ElevenLabs conversational voice design guide):
+`Alexandra` `kdmDKE6EkgrWrrykO9Qt` (default), `Archer` `L0Dsvb3SLTyegXwtm47J`, `Jessica Anne Bogart` `g6xIsTj2HwM6VR4iXFCw`, `Hope` `OYTbf65OHHFELVut7v2H`, `Eryn` `dj3G1R1ilKoFKhBnWOzG`, `Stuart` `HDA9tsk27wYi3uq0fPcK`, `Mark` `1SM7GgM6IMuvQlz2BwM3`, `Angela` `PT4nqlKZfc06VW1BuClj`, `Finn` `vBKc2FfBKJfcZNyEt1n6`, `Cassidy` `56AoDkrOh6qfVPDXZ7Pt`, `Grandpa Spuds Oxley` `NOpBlnGInO9m6vDvFkFC`. Use `multix elevenlabs voices list` for the full library.
+
+**Notes:**
+- Auth header is `xi-api-key`; base URL is `https://api.elevenlabs.io/v1`.
+- Most generation endpoints (TTS, SFX, Music, Voice Changer, Isolation) return audio bytes synchronously.
+- Dubbing is async: submit → poll → download per-language tracks.
+- Output format strings combine codec + sample rate + bitrate, e.g. `mp3_44100_128`, `pcm_24000`, `ulaw_8000`.
+
 ### `multix media`
 
 Requires `ffmpeg` (video/audio) and `magick` (images) on PATH.