@mrgoonie/multix 0.0.6 → 0.0.8

package/CHANGELOG.md

@@ -5,6 +5,42 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.0.8] - 2026-05-11
+
+### Fixed
+- `multix openrouter image-to-image` previously failed for any non-Gemini text+image model (e.g. `openai/gpt-5.4-image-2`, `openai/gpt-5-image-mini`, `recraft/recraft-v3`) because the `modalities` heuristic forced `["image"]` for non-Gemini models. The new default is `["image","text"]`, with `["image"]` only emitted for verified image-only families (`black-forest-labs/`, `bytedance-seed/seedream`, `sourceful/`).
+- "No images in response" errors now include the model id, `finish_reason`, the model's text reply (if any), and a hint about modalities — previously a single generic line.
+
+### Added
+- `multix openrouter image-to-image --strength <0..1>` — Recraft init-image strength control.
+- `OPENROUTER_FALLBACK_MODELS` (CSV) now applies to `image-to-image` (previously `generate` only). Sends `models: [primary, ...fallbacks]` so OpenRouter can route on availability.
+- New shared module `src/providers/openrouter/payload.ts` — `resolveModalities`, `buildOpenRouterHeaders`, `extractImagesFromResponse`, `formatNoImagesError`, `buildI2IPayload`. DRY across `generate` + `image-to-image`.
+
+### Changed
+- README and `skill/SKILL.md` document the OpenRouter model-family matrix (Gemini / OpenAI gpt-image / Recraft → text+image; Flux 2.x / Seedream 4.5 / Sourceful → image-only) and the new flags.
+
+### Verified live
+`openai/gpt-5.4-image-2`, `openai/gpt-5-image-mini`, `google/gemini-2.5-flash-image`, `black-forest-labs/flux.2-pro`, `flux.2-max`, `flux.2-flex`, `bytedance-seed/seedream-4.5`.
+
+## [0.0.7] - 2026-05-05
+
+### Added
+- **ElevenLabs provider** — full integration with 13 subcommands:
+  - `tts` — text-to-speech (sync audio bytes) with voice settings, language code, seed, context continuity, and `--no-speaker-boost` opt-out.
+  - `voices list|get|search|design|create-from-preview|delete` — voice library management and prompt-based voice design.
+  - `clone` — instant voice cloning via multipart audio sample upload.
+  - `voice-changer` — speech-to-speech voice conversion.
+  - `transcribe` — Scribe STT with diarization, audio-event tagging, and `text|json|srt|vtt` output.
+  - `sfx` — sound effects generation with prompt influence and looping.
+  - `music` — music generation (`music_v1`) from prompt or composition plan.
+  - `dub` / `dub-status` — async dubbing with `--wait` / `--download` polling and per-language audio download.
+  - `isolate` — voice isolator (background noise removal).
+  - `align` — forced alignment (transcript ↔ audio timing).
+  - `account` / `models` — usage / subscription tier and model catalog.
+- `ELEVENLABS_RECOMMENDED_VOICES` with 11 verified conversational voice IDs (Alexandra default).
+- TTS models: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`. STT: `scribe_v1`, `scribe_v1_experimental`. Voice changer: `eleven_multilingual_sts_v2`. Output formats: `mp3_*`, `pcm_*`, `ulaw_8000`.
+- `multix check` and `.env.example` document `ELEVENLABS_API_KEY`.
+
 ## [0.0.6] - 2026-05-05
 
 ### Added

package/README.md

@@ -2,7 +2,7 @@
 
 AI multimodal CLI — generate images/video/speech/music, analyze and transcribe media files, convert documents to Markdown, and optimize media with ffmpeg/ImageMagick.
 
-Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), and **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D).
+Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D), and **ElevenLabs** (TTS, voice cloning, STT, voice changer, SFX, music, dubbing, isolation, alignment).
 
 ## Install
 
@@ -47,6 +47,7 @@ Set at least one provider key. Add to `.env` in your project root or `~/.multix/
 | `LEONARDO_DEFAULT_MODEL` | No | Default Leonardo image model UUID |
 | `LEONARDO_VIDEO_MODEL` | No | Default Leonardo video model (default `MOTION2`) |
 | `BYTEPLUS_API_KEY` | For BytePlus | [BytePlus](https://console.byteplus.com/auth/api-keys) |
+| `ELEVENLABS_API_KEY` | For ElevenLabs | [ElevenLabs](https://elevenlabs.io/app/settings/api-keys) |
 | `ARK_API_KEY` | No | Fallback for `BYTEPLUS_API_KEY` (Volcengine ARK shared name) |
 | `BYTEPLUS_BASE_URL` | No | Override BytePlus base (default `https://ark.ap-southeast.bytepluses.com/api/v3`) |
 | `BYTEPLUS_IMAGE_MODEL` | No | Default Seedream model (default `seedream-4-0-250828`) |
@@ -145,7 +146,7 @@ multix minimax generate-music [--lyrics <str>] [--prompt <str>] [--model music-2
 multix openrouter generate --prompt "Retro robot" [--model google/gemini-3.1-flash-image-preview] [--aspect-ratio 1:1] [--image-size <sz>] [--num-images 1] [-v]
 
 # Image-to-image (alias: i2i) — refs accept URL or local path
-multix openrouter image-to-image --prompt "make it cyberpunk" --ref ./photo.jpg [--ref https://...] [--model google/gemini-2.5-flash-image] [--output <path>] [-v]
+multix openrouter image-to-image --prompt "make it cyberpunk" --ref ./photo.jpg [--ref https://...] [--model google/gemini-2.5-flash-image] [--strength 0.7] [--output <path>] [-v]
 
 # Image-to-video (async — returns job id; image input is URL only)
 multix openrouter image-to-video --prompt "camera pans left" --image-url https://... [--last-frame-url <url>] [--model google/veo-3.1] [--resolution 720p] [--aspect-ratio 16:9] [--duration <n>] [--seed <n>] [-v]
@@ -158,7 +159,9 @@ multix openrouter video-status <jobId> [--download] [--output <path>] [-v]
 multix openrouter video-models
 ```
 
-Fallback models from `OPENROUTER_FALLBACK_MODELS` (CSV) are appended to the chat-image payload automatically. Override the default video model with `OPENROUTER_VIDEO_MODEL` (default `google/veo-3.1`).
+**Supported i2i model families:** Gemini (default) and OpenAI gpt-image return `text+image` (modalities `["image","text"]`); Recraft accepts `--strength` (init-image strength 0..1); Flux / Sourceful are image-only (`["image"]`). The CLI picks the right `modalities` automatically based on the model id prefix.
+
+Fallback models from `OPENROUTER_FALLBACK_MODELS` (CSV) are appended to the chat-image payload automatically — applies to both `generate` and `image-to-image`. Override the default video model with `OPENROUTER_VIDEO_MODEL` (default `google/veo-3.1`).
 
 ### `multix leonardo`
 
@@ -251,6 +254,77 @@ multix byteplus status <taskId> [--wait] [--wait-timeout 600000] [--download] [-
 - `multix byteplus status <taskId> --download` works for both video (`content.video_url`) and 3D (`content.file_url`) tasks.
 - **Task cancellation is not supported** — there is no verified DELETE endpoint on the ARK API. Submitted tasks must run to completion.
 
+### `multix elevenlabs`
+
+```bash
+# Text-to-speech (sync, returns audio bytes)
+multix elevenlabs tts --text "Hello world" [--voice <voiceId>] [--model eleven_multilingual_v2] \
+  [--format mp3_44100_128] [--stability 0.5] [--similarity-boost 0.75] [--style 0.0] \
+  [--no-speaker-boost] [--language-code en] [--seed <n>] [--output out.mp3] [-v]
+
+# Voices: list / get / search shared / design / persist / delete
+multix elevenlabs voices list [--category cloned|generated|premade|professional]
+multix elevenlabs voices get <voiceId>
+multix elevenlabs voices search [--search "calm female"] [--language en] [--gender female] [--age young] [--accent american]
+multix elevenlabs voices design --description "friendly female narrator" [--text "sample text"] [--auto-text]
+multix elevenlabs voices create-from-preview --generated-voice-id <id> --name "My Voice" --description "..."
+multix elevenlabs voices delete <voiceId>
+
+# Instant voice cloning (multipart upload of 1-3 minutes of samples)
+multix elevenlabs clone --name "My Voice" --files sample1.wav sample2.wav [--description "..."] [--remove-background-noise]
+
+# Speech-to-speech voice changer
+multix elevenlabs voice-changer --input source.mp3 --voice <voiceId> [--model eleven_multilingual_sts_v2] \
+  [--format mp3_44100_128] [--remove-background-noise] [--output changed.mp3] [-v]
+
+# Speech-to-text (Scribe)
+multix elevenlabs transcribe --input audio.mp3 [--model scribe_v1] [--language en] [--diarize] \
+  [--num-speakers 2] [--tag-audio-events] [--timestamps-granularity word] [--format text|json|srt|vtt] [--output out.txt]
+
+# Sound effects
+multix elevenlabs sfx --text "car engine starting" [--duration-seconds 5] [--prompt-influence 0.3] [--loop] \
+  [--format mp3_44100_128] [--output sfx.mp3]
+
+# Music generation
+multix elevenlabs music --prompt "dreamy synthwave loop" [--music-length-ms 30000] [--model music_v1] \
+  [--format mp3_44100_128] [--output song.mp3]
+# OR with a structured composition plan
+multix elevenlabs music --plan ./plan.json [--output song.mp3]
+
+# Dubbing (async — submit and poll, then optionally --download)
+multix elevenlabs dub --input video.mp4 --target-lang es [--source-lang en] [--num-speakers 2] \
+  [--watermark] [--start-time 0] [--end-time 60] [--highest-resolution] [--name "My Dub"] \
+  [--async] [--wait] [--download] [--poll-interval 10] [--wait-timeout 1800000] [--output dubbed.mp4]
+multix elevenlabs dub-status <dubbingId> [--download <lang>] [--output dubbed.mp4]
+
+# Voice isolator (strip background noise)
+multix elevenlabs isolate --input noisy.mp3 [--output clean.mp3]
+
+# Forced alignment (transcript ↔ audio timing)
+multix elevenlabs align --input audio.mp3 --text "transcript here" [--output alignment.json]
+# Or read transcript from file:
+multix elevenlabs align --input audio.mp3 --text-file transcript.txt
+
+# Account info / available models
+multix elevenlabs account
+multix elevenlabs models
+```
+
+**ElevenLabs models:**
+- TTS: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`
+- STT: `scribe_v1`, `scribe_v1_experimental`
+- Voice changer: `eleven_multilingual_sts_v2` (default)
+- Music: `music_v1`
+
+**Recommended voices** (verified from ElevenLabs conversational voice design guide):
+`Alexandra` `kdmDKE6EkgrWrrykO9Qt` (default), `Archer` `L0Dsvb3SLTyegXwtm47J`, `Jessica Anne Bogart` `g6xIsTj2HwM6VR4iXFCw`, `Hope` `OYTbf65OHHFELVut7v2H`, `Eryn` `dj3G1R1ilKoFKhBnWOzG`, `Stuart` `HDA9tsk27wYi3uq0fPcK`, `Mark` `1SM7GgM6IMuvQlz2BwM3`, `Angela` `PT4nqlKZfc06VW1BuClj`, `Finn` `vBKc2FfBKJfcZNyEt1n6`, `Cassidy` `56AoDkrOh6qfVPDXZ7Pt`, `Grandpa Spuds Oxley` `NOpBlnGInO9m6vDvFkFC`. Use `multix elevenlabs voices list` for the full library.
+
+**Notes:**
+- Auth header is `xi-api-key`; base URL is `https://api.elevenlabs.io/v1`.
+- Most generation endpoints (TTS, SFX, Music, Voice Changer, Isolation) return audio bytes synchronously.
+- Dubbing is async: submit → poll → download per-language tracks.
+- Output format strings combine codec + sample rate + bitrate, e.g. `mp3_44100_128`, `pcm_24000`, `ulaw_8000`.
+
 ### `multix media`
 
 Requires `ffmpeg` (video/audio) and `magick` (images) on PATH.