@mrgoonie/multix 0.0.7 → 0.1.0-beta

package/CHANGELOG.md

@@ -5,6 +5,30 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.1.0-beta](https://github.com/mrgoonie/multix-cli/compare/v0.0.8...v0.1.0-beta) (2026-05-19)
+
+
+### Added
+
+* **openai:** add provider media commands ([#9](https://github.com/mrgoonie/multix-cli/issues/9)) ([4622102](https://github.com/mrgoonie/multix-cli/commit/46221029ac98f6da03653397d20e2e604f7f39c1))
+
+## [0.0.8] - 2026-05-11
+
+### Fixed
+- `multix openrouter image-to-image` previously failed for any non-Gemini text+image model (e.g. `openai/gpt-5.4-image-2`, `openai/gpt-5-image-mini`, `recraft/recraft-v3`) because the `modalities` heuristic forced `["image"]` for non-Gemini models. The new default is `["image","text"]`, with `["image"]` only emitted for verified image-only families (`black-forest-labs/`, `bytedance-seed/seedream`, `sourceful/`).
+- "No images in response" errors now include the model id, `finish_reason`, the model's text reply (if any), and a hint about modalities — previously a single generic line.
+
+### Added
+- `multix openrouter image-to-image --strength <0..1>` — Recraft init-image strength control.
+- `OPENROUTER_FALLBACK_MODELS` (CSV) now applies to `image-to-image` (previously `generate` only). Sends `models: [primary, ...fallbacks]` so OpenRouter can route on availability.
+- New shared module `src/providers/openrouter/payload.ts` — `resolveModalities`, `buildOpenRouterHeaders`, `extractImagesFromResponse`, `formatNoImagesError`, `buildI2IPayload`. DRY across `generate` + `image-to-image`.
+
+### Changed
+- README and `skill/SKILL.md` document the OpenRouter model-family matrix (Gemini / OpenAI gpt-image / Recraft → text+image; Flux 2.x / Seedream 4.5 / Sourceful → image-only) and the new flags.
+
+### Verified live
+`openai/gpt-5.4-image-2`, `openai/gpt-5-image-mini`, `google/gemini-2.5-flash-image`, `black-forest-labs/flux.2-pro`, `flux.2-max`, `flux.2-flex`, `bytedance-seed/seedream-4.5`.
+
 ## [0.0.7] - 2026-05-05
 
 ### Added

package/README.md

@@ -2,7 +2,7 @@
 
 AI multimodal CLI — generate images/video/speech/music, analyze and transcribe media files, convert documents to Markdown, and optimize media with ffmpeg/ImageMagick.
 
-Supports **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D), and **ElevenLabs** (TTS, voice cloning, STT, voice changer, SFX, music, dubbing, isolation, alignment).
+Supports **OpenAI** (image, image edits, TTS, STT, optional Codex image driver), **Gemini** (analyze, transcribe, generate, Veo video, Flash TTS), **MiniMax** (image, video, speech, music), **OpenRouter** (image generation), **Leonardo.Ai** (image, video, upscale), **BytePlus** (Seedream image, Seedance video, Hyper3D / Hitem3d 3D), and **ElevenLabs** (TTS, voice cloning, STT, voice changer, SFX, music, dubbing, isolation, alignment).
 
 ## Install
 
@@ -14,6 +14,11 @@ npx -p @mrgoonie/multix multix --help
 
 **Requirements:** Node >= 20. For media commands: `ffmpeg` and `magick` (ImageMagick 7+) on PATH.
 
+## Release channels
+
+- `main` uses Release Please for stable releases. It creates release PRs from conventional commits, bumps semver, updates `CHANGELOG.md`, tags `vX.Y.Z`, and publishes npm with dist-tag `latest`.
+- `dev` uses Release Please for beta releases. It creates prerelease PRs like `vX.Y.Z-beta.N` from conventional commits and publishes npm with dist-tag `beta`.
+
 ## Quick start
 
 ```bash
@@ -23,6 +28,9 @@ multix check
 # Generate an image with Gemini
 multix gemini generate --prompt "A sunset over mountains" --aspect-ratio 16:9
 
+# Generate an image with OpenAI
+multix openai generate --prompt "A clean product photo of a glass espresso cup"
+
 # Analyze an image
 multix gemini analyze --files photo.jpg --prompt "Describe this"
 
@@ -40,6 +48,7 @@ Set at least one provider key. Add to `.env` in your project root or `~/.multix/
 | Variable | Required | Purpose |
 |---|---|---|
 | `GEMINI_API_KEY` | For Gemini | [AI Studio](https://aistudio.google.com/apikey) |
+| `OPENAI_API_KEY` | For OpenAI API | [OpenAI](https://platform.openai.com/api-keys) |
 | `OPENROUTER_API_KEY` | For OpenRouter | [OpenRouter](https://openrouter.ai/settings/keys) |
 | `MINIMAX_API_KEY` | For MiniMax | [MiniMax](https://platform.minimax.io/user-center/basic-information/interface-key) |
 | `LEONARDO_API_KEY` | For Leonardo | [Leonardo](https://app.leonardo.ai/settings/api-keys) |
@@ -57,6 +66,9 @@ Set at least one provider key. Add to `.env` in your project root or `~/.multix/
 | `MULTIX_OUTPUT_DIR` | No | Override default output dir (`./multix-output`) |
 | `OPENROUTER_IMAGE_MODEL` | No | Default OpenRouter model |
 | `OPENROUTER_FALLBACK_MODELS` | No | Comma-separated fallback model ids |
+| `OPENAI_IMAGE_MODEL` | No | Default OpenAI image model (default `gpt-image-2`) |
+| `OPENAI_TTS_MODEL` | No | Default OpenAI TTS model (default `gpt-4o-mini-tts`) |
+| `OPENAI_STT_MODEL` | No | Default OpenAI STT model (default `gpt-4o-transcribe`) |
 | `IMAGE_GEN_MODEL` | No | Override Gemini image generation model |
 | `VIDEO_GEN_MODEL` | No | Override Gemini video generation model |
 | `MULTIMODAL_MODEL` | No | Override Gemini analysis model |
@@ -68,13 +80,13 @@ Priority: `process.env` > `cwd/.env` > `~/.multix/.env`.
 
 ### `multix check`
 
-Validate setup: tooling (ffmpeg, magick), API keys, Gemini live ping.
+Validate setup: tooling (ffmpeg, magick), API keys, Gemini live ping, and experimental authenticated Codex image capability. Codex is checked when no API key is configured, or in `--verbose` mode.
 
 ```
 multix check [--verbose]
 ```
 
-Exits 0 if at least one provider key is configured. Exits 1 if no keys found or Gemini auth fails.
+Exits 0 if at least one provider key is configured, or authenticated Codex image capability is available. Exits 1 if no provider is usable or Gemini auth fails.
 
 ### `multix gemini`
 
@@ -146,7 +158,7 @@ multix minimax generate-music [--lyrics <str>] [--prompt <str>] [--model music-2
 multix openrouter generate --prompt "Retro robot" [--model google/gemini-3.1-flash-image-preview] [--aspect-ratio 1:1] [--image-size <sz>] [--num-images 1] [-v]
 
 # Image-to-image (alias: i2i) — refs accept URL or local path
-multix openrouter image-to-image --prompt "make it cyberpunk" --ref ./photo.jpg [--ref https://...] [--model google/gemini-2.5-flash-image] [--output <path>] [-v]
+multix openrouter image-to-image --prompt "make it cyberpunk" --ref ./photo.jpg [--ref https://...] [--model google/gemini-2.5-flash-image] [--strength 0.7] [--output <path>] [-v]
 
 # Image-to-video (async — returns job id; image input is URL only)
 multix openrouter image-to-video --prompt "camera pans left" --image-url https://... [--last-frame-url <url>] [--model google/veo-3.1] [--resolution 720p] [--aspect-ratio 16:9] [--duration <n>] [--seed <n>] [-v]
@@ -159,7 +171,50 @@ multix openrouter video-status <jobId> [--download] [--output <path>] [-v]
 multix openrouter video-models
 ```
 
-Fallback models from `OPENROUTER_FALLBACK_MODELS` (CSV) are appended to the chat-image payload automatically. Override the default video model with `OPENROUTER_VIDEO_MODEL` (default `google/veo-3.1`).
+**Supported i2i model families:** Gemini (default) and OpenAI gpt-image return `text+image` (modalities `["image","text"]`); Recraft accepts `--strength` (init-image strength 0..1); Flux / Sourceful are image-only (`["image"]`). The CLI picks the right `modalities` automatically based on the model id prefix.
+
+Fallback models from `OPENROUTER_FALLBACK_MODELS` (CSV) are appended to the chat-image payload automatically — applies to both `generate` and `image-to-image`. Override the default video model with `OPENROUTER_VIDEO_MODEL` (default `google/veo-3.1`).
+
+### `multix openai`
+
+```bash
+# Image generation via OpenAI Images API
+multix openai generate --prompt "A product photo of a titanium travel mug" \
+  [--model gpt-image-2] [--size 1024x1024] [--quality medium] [--format png] [--num-images 1] [--output <path>] [-v]
+
+# Use authenticated Codex CLI as an experimental image driver.
+# Requires manual `codex` login outside multix.
+multix openai generate --prompt "A poster for a midnight jazz club" --driver codex --output poster.png
+
+# Auto chooses OpenAI API when OPENAI_API_KEY exists, otherwise tries authenticated Codex.
+multix openai generate --prompt "Editorial portrait lighting" --driver auto
+
+# Image-to-image edits with one or more local/URL refs
+multix openai image-to-image --prompt "turn this into a watercolor travel sketch" --ref ./photo.jpg [--ref https://...] [--output sketch.png]
+
+# Text-to-speech
+multix openai generate-speech --text "Welcome to multix." [--voice alloy] [--output-format mp3|wav|aac|flac|opus|pcm] [--output speech.mp3]
+
+# Speech-to-text
+multix openai transcribe --input meeting.mp3 [--format text|json|diarized_json] [--language vi]
+
+# Known speaker refs must be paired by name and reference audio path/URL.
+multix openai transcribe --input call.mp3 --format json \
+  --known-speaker-name Alice --known-speaker-reference ./alice.wav \
+  --known-speaker-name Bob --known-speaker-reference ./bob.wav
+```
+
+**OpenAI models:** image `gpt-image-2` (default), TTS `gpt-4o-mini-tts` (default), STT `gpt-4o-transcribe` (default). The Codex driver is experimental and only handles image generation; `multix` does not authenticate Codex for you.
+
+**OpenAI STT format behavior:**
+
+| CLI format | Non-diarize GPT transcription models | Diarize model |
+|---|---|---|
+| `text` | Requests JSON from API, writes returned `text` | Requests JSON from API, writes returned `text` |
+| `json` | Requests JSON | Requests JSON |
+| `diarized_json` | Not supported | Requires `gpt-4o-transcribe-diarize` and defaults `chunking_strategy=auto` |
+
+Known-speaker diarization uses paired `--known-speaker-name` and `--known-speaker-reference` flags; names and references must have the same count.
 
 ### `multix leonardo`