@mrgoonie/multix 0.0.5 → 0.0.7

package/CHANGELOG.md

@@ -5,6 +5,32 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.0.7] - 2026-05-05
+
+### Added
+- **ElevenLabs provider** — full integration with 13 subcommands:
+  - `tts` — text-to-speech (sync audio bytes) with voice settings, language code, seed, context continuity, and `--no-speaker-boost` opt-out.
+  - `voices list|get|search|design|create-from-preview|delete` — voice library management and prompt-based voice design.
+  - `clone` — instant voice cloning via multipart audio sample upload.
+  - `voice-changer` — speech-to-speech voice conversion.
+  - `transcribe` — Scribe STT with diarization, audio-event tagging, and `text|json|srt|vtt` output.
+  - `sfx` — sound effects generation with prompt influence and looping.
+  - `music` — music generation (`music_v1`) from prompt or composition plan.
+  - `dub` / `dub-status` — async dubbing with `--wait` / `--download` polling and per-language audio download.
+  - `isolate` — voice isolator (background noise removal).
+  - `align` — forced alignment (transcript ↔ audio timing).
+  - `account` / `models` — usage / subscription tier and model catalog.
+- `ELEVENLABS_RECOMMENDED_VOICES` with 11 verified conversational voice IDs (Alexandra default).
+- TTS models: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`. STT: `scribe_v1`, `scribe_v1_experimental`. Voice changer: `eleven_multilingual_sts_v2`. Output formats: `mp3_*`, `pcm_*`, `ulaw_8000`.
+- `multix check` and `.env.example` document `ELEVENLABS_API_KEY`.
+
+## [0.0.6] - 2026-05-05
+
+### Added
+- `multix byteplus generate-3d` (alias `3d`) — BytePlus Hyper3D / Hitem3d 3D generation on the ARK async tasks endpoint. Models: `hyper3d-gen2-260112` (text-to-3D + image-to-3D, 1–5 refs), `hitem3d-2-0-251223` (image-to-3D). Provider-specific knobs (`--mesh_mode`, `--hd_texture`, `--material`, `--ff`, `--resolution`, …) passed via `--flags <raw>` pass-through. Auto-detects output extension (`.glb` / `.gltf` / `.zip` …) from response URL.
+- `multix byteplus status --download` extended to also fetch `content.file_url` for 3D tasks alongside `content.video_url` for video.
+- New env override: `BYTEPLUS_3D_MODEL` (default `hyper3d-gen2-260112`).
+
 ## [0.0.5] - 2026-05-05
 
 ### Added

package/README.md

@@ -2,7 +2,7 @@
 
 AI multimodal CLI — generate images/video/speech/music, analyze and transcribe media files, convert documents to Markdown, and optimize media with ffmpeg/ImageMagick.
 
-Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), and **BytePlus** (Seedream image, Seedance video).
+Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D), and **ElevenLabs** (TTS, voice cloning, STT, voice changer, SFX, music, dubbing, isolation, alignment).
 
 ## Install
 
@@ -47,11 +47,13 @@ Set at least one provider key. Add to `.env` in your project root or `~/.multix/
 | `LEONARDO_DEFAULT_MODEL` | No | Default Leonardo image model UUID |
 | `LEONARDO_VIDEO_MODEL` | No | Default Leonardo video model (default `MOTION2`) |
 | `BYTEPLUS_API_KEY` | For BytePlus | [BytePlus](https://console.byteplus.com/auth/api-keys) |
+| `ELEVENLABS_API_KEY` | For ElevenLabs | [ElevenLabs](https://elevenlabs.io/app/settings/api-keys) |
 | `ARK_API_KEY` | No | Fallback for `BYTEPLUS_API_KEY` (Volcengine ARK shared name) |
 | `BYTEPLUS_BASE_URL` | No | Override BytePlus base (default `https://ark.ap-southeast.bytepluses.com/api/v3`) |
 | `BYTEPLUS_IMAGE_MODEL` | No | Default Seedream model (default `seedream-4-0-250828`) |
 | `BYTEPLUS_VIDEO_MODEL` | No | Default Seedance model (default `seedance-2.0`) |
 | `BYTEPLUS_VIDEO_PARAMS_MODE` | No | `flags` (default) or `structured` — how video params are encoded |
+| `BYTEPLUS_3D_MODEL` | No | Default 3D model (default `hyper3d-gen2-260112`) |
 | `MULTIX_OUTPUT_DIR` | No | Override default output dir (`./multix-output`) |
 | `OPENROUTER_IMAGE_MODEL` | No | Default OpenRouter model |
 | `OPENROUTER_FALLBACK_MODELS` | No | Comma-separated fallback model ids |
@@ -220,6 +222,19 @@ multix byteplus reference-to-video --prompt "..." \
   [video flags] [-v]
 # On Windows, escape literal colons in paths with `\:` or use URLs.
 
+# 3D model generation (alias: 3d) — Hyper3D / Hitem3d, async with auto-poll + download
+multix byteplus generate-3d --prompt "Quadrupedal mech robot" \
+  --flags "--mesh_mode Raw --hd_texture true --material PBR" \
+  [--model hyper3d-gen2-260112] [--seed 8648] [--async] [--output model.glb] [-v]
+
+# Image-to-3D (1–5 reference images, path or URL)
+multix byteplus 3d --input-image ./front.png ./side.png ./back.png \
+  --prompt "Generate from these views" [--model hyper3d-gen2-260112]
+
+# Hitem3d uses different flags
+multix byteplus 3d --input-image ./cat.png --model hitem3d-2-0-251223 \
+  --flags "--ff 2 --resolution 1536pro"
+
 # Poll a task / download MP4
 multix byteplus status <taskId> [--wait] [--wait-timeout 600000] [--download] [--output <path>] [-v]
 ```
@@ -227,12 +242,87 @@ multix byteplus status <taskId> [--wait] [--wait-timeout 600000] [--download] [-
 **BytePlus models:**
 - Image: `seedream-4-0-250828`
 - Video: `seedance-2.0-fast`, `seedance-2.0` (default), `seedance-2.0-pro`
+- 3D: `hyper3d-gen2-260112` (Hyper3D Gen2, default — text-to-3D + image-to-3D), `hitem3d-2-0-251223` (Hitem3d 2.0 — image-to-3D)
 
 **Notes:**
 - Auth: `BYTEPLUS_API_KEY` is preferred; `ARK_API_KEY` is accepted as a fallback for compatibility with the Volcengine ARK SDK ecosystem.
 - Video params can be encoded as flags inside the prompt text (default, e.g. `--rs 1080p --dur 8 --rt 16:9`) or as a top-level `parameters` object — set `BYTEPLUS_VIDEO_PARAMS_MODE=structured` to switch.
+- 3D model knobs are passed via `--flags <raw>`, appended to the prompt text. Hyper3D supports `--mesh_mode`, `--hd_texture`, `--material`, `--addons`, `--quality_override`, `--use_original_alpha`, `--bbox_condition`, `--TAPose`. Hitem3d supports `--ff`, `--resolution`. See [BytePlus 3D docs](https://docs.byteplus.com/en/docs/ModelArk/2279947).
+- 3D output is a textured model file (`.glb`/`.gltf`/`.zip` depending on flags). The CLI auto-detects the extension from the response URL.
+- `multix byteplus status <taskId> --download` works for both video (`content.video_url`) and 3D (`content.file_url`) tasks.
 - **Task cancellation is not supported** — there is no verified DELETE endpoint on the ARK API. Submitted tasks must run to completion.
 
+### `multix elevenlabs`
+
+```bash
+# Text-to-speech (sync, returns audio bytes)
+multix elevenlabs tts --text "Hello world" [--voice <voiceId>] [--model eleven_multilingual_v2] \
+  [--format mp3_44100_128] [--stability 0.5] [--similarity-boost 0.75] [--style 0.0] \
+  [--no-speaker-boost] [--language-code en] [--seed <n>] [--output out.mp3] [-v]
+
+# Voices: list / get / search shared / design / persist / delete
+multix elevenlabs voices list [--category cloned|generated|premade|professional]
+multix elevenlabs voices get <voiceId>
+multix elevenlabs voices search [--search "calm female"] [--language en] [--gender female] [--age young] [--accent american]
+multix elevenlabs voices design --description "friendly female narrator" [--text "sample text"] [--auto-text]
+multix elevenlabs voices create-from-preview --generated-voice-id <id> --name "My Voice" --description "..."
+multix elevenlabs voices delete <voiceId>
+
+# Instant voice cloning (multipart upload of 1-3 minutes of samples)
+multix elevenlabs clone --name "My Voice" --files sample1.wav sample2.wav [--description "..."] [--remove-background-noise]
+
+# Speech-to-speech voice changer
+multix elevenlabs voice-changer --input source.mp3 --voice <voiceId> [--model eleven_multilingual_sts_v2] \
+  [--format mp3_44100_128] [--remove-background-noise] [--output changed.mp3] [-v]
+
+# Speech-to-text (Scribe)
+multix elevenlabs transcribe --input audio.mp3 [--model scribe_v1] [--language en] [--diarize] \
+  [--num-speakers 2] [--tag-audio-events] [--timestamps-granularity word] [--format text|json|srt|vtt] [--output out.txt]
+
+# Sound effects
+multix elevenlabs sfx --text "car engine starting" [--duration-seconds 5] [--prompt-influence 0.3] [--loop] \
+  [--format mp3_44100_128] [--output sfx.mp3]
+
+# Music generation
+multix elevenlabs music --prompt "dreamy synthwave loop" [--music-length-ms 30000] [--model music_v1] \
+  [--format mp3_44100_128] [--output song.mp3]
+# OR with a structured composition plan
+multix elevenlabs music --plan ./plan.json [--output song.mp3]
+
+# Dubbing (async — submit and poll, then optionally --download)
+multix elevenlabs dub --input video.mp4 --target-lang es [--source-lang en] [--num-speakers 2] \
+  [--watermark] [--start-time 0] [--end-time 60] [--highest-resolution] [--name "My Dub"] \
+  [--async] [--wait] [--download] [--poll-interval 10] [--wait-timeout 1800000] [--output dubbed.mp4]
+multix elevenlabs dub-status <dubbingId> [--download <lang>] [--output dubbed.mp4]
+
+# Voice isolator (strip background noise)
+multix elevenlabs isolate --input noisy.mp3 [--output clean.mp3]
+
+# Forced alignment (transcript ↔ audio timing)
+multix elevenlabs align --input audio.mp3 --text "transcript here" [--output alignment.json]
+# Or read transcript from file:
+multix elevenlabs align --input audio.mp3 --text-file transcript.txt
+
+# Account info / available models
+multix elevenlabs account
+multix elevenlabs models
+```
+
+**ElevenLabs models:**
+- TTS: `eleven_multilingual_v2` (default), `eleven_flash_v2_5`, `eleven_flash_v2`, `eleven_turbo_v2_5`, `eleven_turbo_v2`, `eleven_v3`
+- STT: `scribe_v1`, `scribe_v1_experimental`
+- Voice changer: `eleven_multilingual_sts_v2` (default)
+- Music: `music_v1`
+
+**Recommended voices** (verified from ElevenLabs conversational voice design guide):
+`Alexandra` `kdmDKE6EkgrWrrykO9Qt` (default), `Archer` `L0Dsvb3SLTyegXwtm47J`, `Jessica Anne Bogart` `g6xIsTj2HwM6VR4iXFCw`, `Hope` `OYTbf65OHHFELVut7v2H`, `Eryn` `dj3G1R1ilKoFKhBnWOzG`, `Stuart` `HDA9tsk27wYi3uq0fPcK`, `Mark` `1SM7GgM6IMuvQlz2BwM3`, `Angela` `PT4nqlKZfc06VW1BuClj`, `Finn` `vBKc2FfBKJfcZNyEt1n6`, `Cassidy` `56AoDkrOh6qfVPDXZ7Pt`, `Grandpa Spuds Oxley` `NOpBlnGInO9m6vDvFkFC`. Use `multix elevenlabs voices list` for the full library.
+
+**Notes:**
+- Auth header is `xi-api-key`; base URL is `https://api.elevenlabs.io/v1`.
+- Most generation endpoints (TTS, SFX, Music, Voice Changer, Isolation) return audio bytes synchronously.
+- Dubbing is async: submit → poll → download per-language tracks.
+- Output format strings combine codec + sample rate + bitrate, e.g. `mp3_44100_128`, `pcm_24000`, `ulaw_8000`.
+
 ### `multix media`
 
 Requires `ffmpeg` (video/audio) and `magick` (images) on PATH.