cue-ai 0.9.2 → 0.9.4

package/resources/skills/skills/media/social-pack/SKILL.md

@@ -0,0 +1,58 @@
+---
+slug: muapi-social-pack
+name: muapi-social-pack
+version: "1.0.0"
+description: Re-render a hero image into Instagram, TikTok, YouTube-shorts and Twitter/X aspect ratios.
+acceptLicenseTerms: true
+---
+
+
+# Social Media Pack
+
+**Re-render a hero image into Instagram, TikTok, YouTube-shorts and Twitter/X aspect ratios.**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `source_image` | image_url | yes | — | URL of the hero image (or asset_id from this session). |
+| `caption_idea` | text | no | — | Optional caption / overlay direction (kept short). |
+| `formats` | list | no | 1:1, 9:16, 4:5, 16:9 | Aspect ratios to produce. |
+
+
+## Steps
+
+Use the plan to fan out one node per format.
+
+1. For each requested aspect ratio in `{{formats}}`:
+   - Call `muapi image edit` (model=nano-banana-2-edit) with the source image.
+   - Prompt: "Reframe the composition to {{aspect_ratio}} for social media.
+     Keep the subject centred and uncropped. Match the original lighting
+     and palette. {{caption_idea_hint}}".
+   - Where `{{caption_idea_hint}}` = "Leave headroom at the top for a
+     caption: '<caption_idea>'." (only if caption_idea is non-empty).
+2. All formats run in parallel (no inter-node dependencies).
+3. Return one asset id per format, labelled with the platform it suits:
+   - 1:1   → Instagram feed
+   - 9:16  → TikTok / IG Reels / YT Shorts
+   - 4:5   → Instagram portrait
+   - 16:9  → Twitter / X / YouTube
+   - 21:9  → cinematic banner
+
+## Notes
+- Don't generate fresh images — only reframe / re-edit the source.
+- If the source already matches a format, skip that node and surface the
+  original asset id for it.
+
+## Trigger Keywords
+
+`social pack`, `resize for social`, `cross-post`, `multi-platform`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.

package/resources/skills/skills/media/storyboard/SKILL.md

@@ -0,0 +1,57 @@
+---
+slug: muapi-storyboard
+name: muapi-storyboard
+version: "1.0.0"
+description: Generate N keyframes for a short story or scene sequence (image only, no video).
+acceptLicenseTerms: true
+---
+
+
+# Storyboard Generator
+
+**Generate N keyframes for a short story or scene sequence (image only, no video).**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `premise` | text | yes | — | One-line story premise (e.g. "lonely robot finds a tiny mechanical bird friend"). |
+| `scenes` | int | no | 6 | Number of keyframes to produce. |
+| `style` | text | no | cinematic, photoreal, soft lighting, 16:9 | Visual style tags applied to every keyframe. |
+
+
+## Steps
+
+Use the plan to dispatch all N keyframes in a single parallel layer.
+
+1. Decompose `premise` into `{{scenes}}` story beats with a clear arc:
+   setup → inciting moment → escalation → climax → resolution.
+   - Each beat gets a one-paragraph visual description.
+   - Maintain character / object continuity across beats (same character
+     appearance, same world).
+2. For each beat, create a `muapi image generate` node (model=nano-banana-2, aspect_ratio=16:9):
+   - Prompt = `"<beat description>. {{style}}"`.
+   - Tier: balanced (these are reference keyframes, not finals).
+   - Aspect ratio: 16:9.
+3. Run the plan in parallel (no `depends_on` between keyframes).
+4. Return the asset ids in beat order with a one-line caption per scene.
+
+## Notes
+- Don't animate, upscale, or add audio — this skill is keyframes only.
+  If the user wants video, suggest the `music-video` skill afterward.
+- For consistency, repeat character description verbatim in every prompt
+  ("a small rusty humanoid robot with…") rather than relying on the model
+  to remember.
+
+## Trigger Keywords
+
+`storyboard`, `keyframes`, `scene sequence`, `story panels`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.

package/resources/skills/skills/media/storyboard-to-cooking-video/SKILL.md

@@ -0,0 +1,143 @@
+---
+slug: muapi-storyboard-to-cooking-video
+name: muapi-storyboard-to-cooking-video
+version: "1.0.0"
+description: Turn a single photo of a person into a 15-second cinematic pasta-making (or other cuisine) tutorial video. First builds a composite reference sheet (character + kitchen + 9-step action board), then animates the full cooking sequence with audio in a single continuous shot.
+acceptLicenseTerms: true
+---
+
+
+# Storyboard to Cooking Video
+
+**Turn a single photo of a person into a polished 15-second cinematic cooking tutorial. The skill first generates a high-end production reference sheet — character look, kitchen environment, and a 9-panel action board — then drives a continuous reference-to-video render that keeps the subject's face, outfit, and kitchen consistent across every frame.**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `person_image` | image_url | yes | — | URL of the person photo. Used as identity reference in BOTH the reference sheet and the final video. |
+| `dish` | text | no | fresh pasta | The cooking subject (e.g. "fresh pasta", "sushi rolls", "wood-fired pizza", "matcha latte"). Drives the 9-step action board. |
+| `kitchen_style` | text | no | warm rustic-modern Italian | The kitchen aesthetic (e.g. "warm rustic-modern Italian", "minimalist Tokyo", "bright Scandinavian", "moody industrial"). |
+| `outfit` | text | no | white t-shirt, olive green apron, dark trousers | What the person wears throughout the video. |
+| `duration_seconds` | int | no | 15 | Final video duration. Use 15 for the full 9-step arc; 10 collapses to ~6 beats. |
+| `aspect_ratio` | text | no | 16:9 | Output aspect ratio. Use `9:16` for vertical/Reels. |
+| `resolution` | text | no | 720p | Video resolution. Options: `480p`, `720p`. |
+
+
+## Steps
+
+Submit the plan with TWO sequential steps. Step 2 depends on the output of Step 1.
+
+### Step 1 — Reference Sheet (Composite Storyboard)
+
+Generate the composite "production reference board" image. This is a single image, NOT a video frame — it bundles character sheet + location reference + 9-panel action board.
+
+**Endpoint:** `gpt-image-v2-edit`
+**CLI:**
+
+```bash
+muapi image edit \
+  --model gpt-image-v2-edit \
+  --image "{{person_image}}" \
+  --image-size "3840x2160" \
+  --quality auto \
+  --background auto \
+  --moderation low \
+  --output-format png \
+  --prompt "Create one single composite reference sheet for a {{duration_seconds}}-second realistic {{dish}}-making tutorial video. The image should be a clean, high-end production reference board, not a poster with heavy text. Format: {{aspect_ratio}} wide reference sheet, elegant white margins, clean grid layout, realistic cinematic photography style. Concept: {{dish}} tutorial in a {{kitchen_style}} kitchen.
+
+Top row: motion / choreography guide with 9 numbered cinematic action panels showing the {{dish}} process step-by-step from raw ingredients to final plated dish.
+
+Middle-left: realistic character reference sheet of the uploaded person — preserve their exact face, hair color, hair texture, eye color, skin tone, and all facial features with 100% accuracy. Show the same person in: face close-up, full-body front view, side/action working pose, and back view. Dress them in {{outfit}}. Keep them grounded, approachable, skilled, and cinematic.
+
+Middle-right / background: location reference sheet of an elegant {{kitchen_style}} kitchen with tactile surfaces, natural daylight from a large window, hanging cookware, herbs, and premium cooking atmosphere appropriate to the cuisine.
+
+Style: realistic, cinematic, warm natural light, shallow depth of field, tactile food photography, premium cooking show aesthetic, rich surface textures.
+
+Bottom strip: simple visual icons only for {{duration_seconds}} seconds, {{aspect_ratio}}, realistic, cinematic, tasty, natural camera. Minimal text, no dense paragraphs. Let the visuals do the heavy lifting."
+```
+
+Wait for completion and capture the output URL as `{{reference_sheet_url}}`. Show it to the user and confirm the character likeness + kitchen mood before moving to Step 2 — Step 2 is the expensive call.
+
+### Step 2 — Cooking Video (Reference-to-Video)
+
+Animate the full sequence using both the original person photo (identity anchor) and the reference sheet (narrative + environment guide) as dual references.
+
+**Endpoint:** `bytedance-seedance-2-0-reference-to-video-fast`
+**CLI:**
+
+```bash
+muapi video generate \
+  --model bytedance-seedance-2-0-reference-to-video-fast \
+  --image "{{person_image}}" \
+  --image "{{reference_sheet_url}}" \
+  --aspect-ratio "{{aspect_ratio}}" \
+  --duration "{{duration_seconds}}" \
+  --resolution "{{resolution}}" \
+  --generate-audio true \
+  --prompt "The person in @Image1 is the subject — preserve their exact face, hair, eye color, skin tone, and all facial features with 100% accuracy throughout the entire video.
+Use @Image2 as the visual and narrative guide — follow the cooking steps, kitchen setting, outfit, and atmosphere shown in the reference sheet exactly.
+A single continuous cinematic video of the person from @Image1 making {{dish}} in the {{kitchen_style}} kitchen shown in @Image2. They wear {{outfit}} throughout.
+
+VIDEO STRUCTURE
+Follow the exact 9-step sequence as shown in @Image2, beat by beat, from raw ingredients through preparation to a final plated close-up.
+
+MOTION STYLE
+- Slow, deliberate, satisfying transitions between each step
+- Natural hand and body movement with clear culinary intent
+- Continuous flow with no jump cuts
+- Warm and immersive pacing
+
+CAMERA & CINEMATOGRAPHY
+- Close-up shots for hands during mixing, kneading, cutting, plating
+- Medium shots showing the person working at the counter
+- Pull back slightly for the final plating to reveal the full kitchen
+- Shallow depth of field — focus on hands and food, soft background blur
+- No abrupt cuts — smooth match cuts and fluid transitions
+
+VISUAL STYLE
+- Warm natural daylight from a large kitchen window
+- Rich tactile textures matching @Image2's environment
+- Full color, warm cinematic color grading
+
+CONSISTENCY RULES
+- Same character throughout — face of @Image1 in every frame
+- Same outfit across entire video
+- Same kitchen environment as shown in @Image2
+
+AUDIO
+- Soft kitchen ambience, gentle culinary SFX (chopping, sizzling, pouring), light cinematic underscore
+- No dialogue, no narration
+
+OUTPUT STYLE
+- Duration: exactly {{duration_seconds}} seconds
+- Polished, cinematic, premium cooking show quality
+- Ends with a beautiful close-up of the finished plated {{dish}}"
+```
+
+After generation:
+- Present the final video URL to the user.
+- Offer follow-ups: vertical 9:16 re-render for Reels, a longer 30s extended cut, or swap `{{dish}}` for a different cuisine using the same person image.
+
+## Notes
+
+- **Two-image reference is the whole trick.** `@Image1` locks identity, `@Image2` locks choreography + environment. Never drop one — single-reference runs lose either the face or the kitchen.
+- The reference sheet at Step 1 must be wide (3840x2160). Smaller resolutions blur the 9 action panels and the video model can't read them.
+- `bytedance-seedance-2-0-reference-to-video-fast` natively generates audio when `generate_audio=true`. Always include an audio direction in the prompt; otherwise the soundtrack is random.
+- Real human faces ARE supported here because the person photo is the user's own subject and we route through the reference-to-video endpoint (not the restricted i2v variants).
+- If the user wants a non-cooking sequence (e.g., latte art, plating tutorial, mixology), keep the same two-step structure — only `{{dish}}` and the 9-step description change.
+- For shorter pieces (<= 8s), reduce the action board to 5–6 panels in Step 1; cramming 9 beats into 8s degrades motion quality (single-beat rule).
+
+## Trigger Keywords
+
+`cooking video`, `cooking tutorial`, `pasta video`, `recipe video`, `food video`, `chef video`, `cooking storyboard`, `kitchen tutorial`, `cooking reel`, `tutorial video from photo`, `storyboard to video`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.
+- Step 1 must complete and return an output image URL before Step 2 fires — pass that URL as the second `--image` to the video step.

package/resources/skills/skills/media/talking-baby-video/SKILL.md

@@ -0,0 +1,57 @@
+---
+slug: muapi-talking-baby-video
+name: muapi-talking-baby-video
+version: "1.0.0"
+description: Create a viral-style video of a talking baby with custom costumes and scripts.
+acceptLicenseTerms: true
+---
+
+
+# Talking Baby Video
+
+**Create a viral-style video of a talking baby with custom costumes and scripts.**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `baby_costume` | text | no | a pilot uniform | The costume the baby is wearing (e.g., doctor, chef, pilot). |
+| `dialogue` | text | no | Airbus A380 big plane! Go zoom! Have lots seats. People like fly in it. Best plane ever! | The script for the baby to say. |
+| `baby_description` | text | no | A cute 6 months old male baby | Description of the baby. |
+
+
+## Steps
+
+### Phase A — Baby Character Generation
+
+Submit the plan with ONE step to create the baby character:
+
+1. **Baby Image Generation** — `muapi image generate` (model=`nano-banana` or `wan2.5-text-to-image`):
+   - Prompt: `{{baby_description}} sitting and wearing {{baby_costume}}. High-quality photography, soft natural lighting, adorable expression, detailed fabric textures, shallow depth of field, Pixar-like charm but realistic.`
+   - Aspect ratio: 9:16 or 1:1
+
+Present the baby image to the user for approval.
+
+### Phase B — Talking Animation
+
+Once the image is approved, submit the plan to animate the baby talking:
+
+1. **Talking Animation** — `muapi video from-image` (model=`grok-imagine-image-to-video`):
+   - Reference Image: The baby image from Phase A.
+   - Prompt: `A viral-style talking baby video. The baby is expressive, moving their mouth and head naturally while speaking the following lines: "{{dialogue}}". Subtle facial expressions like blinking and smiling. High-quality animation, smooth movements.`
+   - Aspect ratio: 9:16 or 1:1
+
+After generation, present the final talking baby video.
+
+## Trigger Keywords
+
+`talking baby`, `viral baby video`, `baby pilot`, `baby doctor`, `funny baby animation`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.

package/resources/skills/skills/media/ugc-ads-workflow/SKILL.md

@@ -0,0 +1,70 @@
+---
+slug: muapi-ugc-ads-workflow
+name: muapi-ugc-ads-workflow
+version: "1.0.0"
+description: Create a User-Generated Content (UGC) video ad by combining a human selfie and a product image, then generating a video script and an animated ad.
+acceptLicenseTerms: true
+---
+
+
+# UGC Ads Workflow
+
+**Create a User-Generated Content (UGC) video ad by combining a human selfie and a product image, then generating a video script and an animated ad.**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `product_name` | text | yes | — | The name of the product being advertised (e.g. "Blume SuperBalm in plum"). |
+| `human_image` | image_url | no | — | A selfie or photo of the human influencer. |
+| `product_image` | image_url | no | — | A clear photo of the product. |
+
+
+## Steps
+
+### Phase A — Image Combination
+
+If `{{human_image}}` or `{{product_image}}` is not provided, ask the user to upload them or offer to generate them.
+
+Once both images are available, submit the plan with ONE step to combine them:
+
+1. **Image Generation** — `muapi image edit` (model=`gpt-image-2-text-to-image`):
+   - Reference Images: Use both `{{human_image}}` and `{{product_image}}`.
+   - Prompt: `A natural, candid UGC-style photo of the influencer from the first reference image holding and showcasing the product from the second reference image. The influencer is smiling genuinely at the camera, holding the product up. Natural indoor lighting, lifestyle aesthetic, high quality.`
+   - Aspect ratio: 9:16 (vertical for TikTok/Reels/Shorts).
+
+Present the combined image to the user for approval.
+
+### Phase B — Script & Video Generation
+
+1. **Research & Scripting**: Use your web search tools to find details about `{{product_name}}` to understand its key benefits.
+2. Based on the research, craft a UGC-style video script with timestamps, similar to this format:
+
+   *(0-2s) Influencer is holding the {{product_name}}, smiling genuinely to the camera.*
+   "Okay, so you know how I'm always looking for that perfect everyday product?"
+   *(2-7s) Influencer shows the product closer to the camera...*
+   "Well, I found it! This {{product_name}} is seriously so good."
+   *(7-12s) Influencer uses/applies the product.*
+   "It feels amazing and actually works."
+   *(12-15s) Influencer smiles, slightly pouts, and casually shrugs or nods in approval.*
+   "It’s totally become my go-to. You have to try it!"
+
+3. **Video Generation**: Submit the plan using an image-to-video model (e.g. `sd-2-omni-reference` or `veo3.1-image-to-video`).
+   - Reference Image: The combined image from Phase A.
+   - Prompt: Use the visual actions from the script you generated. For example: `A UGC-style video. The influencer holds the {{product_name}}, smiling genuinely. She brings it closer to the camera to show the label, then applies it smoothly. She nods in approval and smiles. Natural movements, talking to the camera, lifestyle vlog style.`
+   - Aspect ratio: 9:16
+
+After generating the video, present it along with the written script so the user can record their own voiceover or use a lipsync tool later.
+
+## Trigger Keywords
+
+`ugc ad`, `ugc video`, `influencer ad`, `product ad video`, `combine product and human`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.

package/resources/skills/skills/media/ugc-lifestyle-try-on/SKILL.md

@@ -0,0 +1,65 @@
+---
+slug: muapi-ugc-lifestyle-try-on
+name: muapi-ugc-lifestyle-try-on
+version: "1.0.0"
+description: Generate UGC-style (User Generated Content) lifestyle photos of a person wearing or using your product — authentic, relatable, social-media-native imagery.
+acceptLicenseTerms: true
+---
+
+
+# UGC Lifestyle Try-On
+
+**Generate UGC-style (User Generated Content) lifestyle photos of a person wearing or using your product — authentic, relatable, social-media-native imagery.**
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `product_name` | text | yes | — | The product to feature (e.g. "white oversized hoodie", "blue light blocking glasses", "leather crossbody bag"). |
+| `product_image` | image_url | yes | — | Product image or photo URL to use as reference for the try-on. |
+| `model_description` | text | no | woman, 25-30 years old, natural look, diverse | Description of the model (e.g. "man, athletic build, 20s", "woman, curvy, 30s, warm skin tone"). |
+| `setting` | text | no | casual lifestyle, natural lighting | Scene and mood (e.g. "urban street style", "cozy home morning routine", "gym workout", "coffee shop"). |
+| `platform` | text | no | instagram | Target platform — "instagram", "tiktok", "pinterest", "amazon". |
+
+
+## Steps
+
+Submit the plan with TWO steps:
+
+### Step 1 — Outfit/Product Try-On
+
+1. **Try-on generation** — `muapi image edit` (model=`ai-dress-change`) if product is wearable clothing, otherwise `muapi image edit` (model=`flux-kontext-pro-i2i`):
+   - For clothing/wearables with `ai-dress-change`:
+     - Product: `{{product_image}}`
+     - Prompt: `{{model_description}} wearing the product naturally in a {{setting}} environment. Authentic UGC-style photo, candid pose, natural expression.`
+   - For accessories/non-clothing with `flux-kontext-pro-i2i`:
+     - Prompt: `{{model_description}} using/wearing {{product_name}} in a {{setting}}. The product from the reference image is clearly visible and featured. Natural UGC-style lifestyle photography, authentic candid feel.`
+   - Aspect ratio: 4:5 for Instagram, 9:16 for TikTok, 2:3 for Pinterest
+
+### Step 2 — UGC Lifestyle Variant
+
+2. **Lifestyle context shot** — `muapi image edit` (model=`gpt4o-edit`) using the output from Step 1:
+   - Prompt: `Make this look like authentic UGC content — add realistic environment context for {{setting}}, adjust lighting to feel natural and unposed, subtle film grain, candid photography style. Keep product {{product_name}} clearly visible and well-lit.`
+
+After generation:
+- Present both the try-on and lifestyle variant
+- Offer to generate a 3-image carousel set with different poses/settings
+- Suggest adding a short UGC-style video with `kling-v3.0-pro-image-to-video`
+
+## Notes
+- UGC performs best when it looks "accidental" — avoid overly polished or symmetrical compositions.
+- For TikTok/Reels, suggest animating the best static shot into a video.
+- For Amazon, refer back to the `amazon-product-listing` skill for white-background variants.
+
+## Trigger Keywords
+
+`ugc`, `try on`, `lifestyle photo`, `model wearing`, `outfit photo`, `wear product`, `user generated`, `ugc content`, `lifestyle try on`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Use `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For model IDs without a CLI alias yet, fall back to the raw endpoint via `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'` and poll with `muapi predict wait <request_id>`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.

package/resources/skills/skills/media/ugc-video-factory/SKILL.md

@@ -0,0 +1,134 @@
+---
+slug: muapi-ugc-video-factory
+name: muapi-ugc-video-factory
+version: "1.0.0"
+description: Turn a person photo + a product photo + an optional script into a vertical 9:16 UGC-style video ad. Generates a lifestyle hero image (Nano-Banana Pro Edit), then animates it with native audio using Seedance 2.0 VIP image-to-video.
+acceptLicenseTerms: true
+---
+
+
+# UGC Video Factory
+
+**Turn a person photo + product photo (+ optional script & environment) into a vertical 9:16 UGC-style video ad with native dialogue audio.**
+
+A three-stage pipeline:
+1. **GPT** writes a director-grade ultra-realistic lifestyle photography prompt from your inputs.
+2. **Nano-Banana Pro Edit** fuses the person + product into a single hero photo (1K, 9:16).
+3. **Seedance 2.0 VIP Image-to-Video** animates the hero photo into a 10s vertical UGC clip with synced spoken audio.
+
+## Inputs
+
+| Name | Type | Required | Default | Description |
+|:---|:---|:---|:---|:---|
+| `person` | image_url | yes | — | Photo of the person who will appear in the ad (face + upper body works best). |
+| `product` | image_url | yes | — | Clear photo of the product (preferably on neutral background, logo/text legible). |
+| `script` | text | no | `Okay… first of all, ship happens. And this hat is honestly my favorite. It also comes in navy and black, so you can pick your vibe.` | The exact line the on-screen person will say (kept short — 1–2 sentences fit 10s comfortably). |
+| `environment` | text | no | `study room, laptop in front of it` | Scene / context where the person is using the product (e.g. "bathroom mirror, morning routine", "coffee shop window seat"). |
+
+If `person` or `product` is missing, ask the user to upload them (`muapi upload file <path>`) or offer to generate placeholders before continuing.
+
+
+## Steps
+
+Run the three steps sequentially — each step's output feeds the next.
+
+### Step 1 — Director Prompt (GPT)
+
+Use a GPT model (`gpt-5.1` or whichever chat model is available to the executing agent) with **temperature 0** and **max ~200 tokens** to produce the hero-image prompt.
+
+**System prompt:** `You are a helpful assistant.`
+
+**User prompt** (substitute `{{person}}`, `{{product}}`, `{{environment}}`):
+
+```
+Uploaded images are being analyzed. Ultra-realistic lifestyle photography with {{person}} and {{product}} and {{environment}}.
+
+If the product is wearable (e.g., hat, glasses, hooded sweatshirt), the person wears the product naturally.
+
+If the product is carried in the hand (e.g., cream, bottle, thermos), the person holds the product naturally.
+
+The product is clearly visible and is the main focus of the image. The logo or text on the product must be legible.
+
+The person has a natural and modern look with a minimalist style.
+
+The scene is consistent with the context of the product's use: {{environment}}.
+
+Lighting: soft natural daylight.
+Background: clean, aesthetic, slightly blurred (shallow depth of field).
+Style: high-end commercial lifestyle photography, realistic textures, 4K quality, vertical 9:16 composition, social-media advertising style. The background and environment should be appropriate to the product (e.g. a woman with a serum could be at home). The person's facial details and the product must remain unchanged.
+```
+
+Capture the GPT response as `{{step1_prompt}}`.
+
+### Step 2 — Hero Image (Nano-Banana Pro Edit)
+
+Submit a `muapi image edit` call against the `nano-banana-pro-edit` model:
+
+- **Reference images** (`image_urls`): `[ {{person}}, {{product}} ]` — order matters; person first.
+- **Prompt**: `{{step1_prompt}}` from Step 1.
+- **Aspect ratio**: `9:16`
+- **Num images**: `1`
+- **Resolution**: `1K`
+- **Output format**: `jpeg`
+
+Capture the resulting image URL as `{{hero_image}}`. Briefly show it to the user for approval before kicking off the video step.
+
+### Step 3 — UGC Video (Seedance 2.0 VIP Image-to-Video)
+
+Submit a `muapi video from-image` call against **`seedance-2-vip-image-to-video`** (or the `-fast` variant if the executing agent wants lower latency).
+
+- **Start image**: `{{hero_image}}` from Step 2.
+- **Aspect ratio**: `9:16`
+- **Duration**: `10` seconds.
+- **Generate audio**: `true` (native dialogue).
+- **CFG scale**: `0.5`
+- **Negative prompt**: `blur, distort, low quality`
+- **Prompt** (substitute `{{script}}`):
+
+```
+Create a 10-second vertical UGC-style video (9:16).
+
+A person is interacting naturally with their setting and product.
+
+The product is used naturally:
+- If wearable → the person is wearing it.
+- If handheld → the person is holding or applying it.
+
+The video is a single, uninterrupted shot. No cuts. No color changes. No text on screen.
+
+The person looks directly at the camera with a relaxed and natural expression.
+They interact comfortably with the product using their hands (adjusting, holding, pointing).
+
+They say in a natural, conversational tone:
+
+"{{script}}"
+
+Subtle hand gestures while speaking.
+End with a small smile or nod.
+
+Style: authentic UGC, handheld phone feel, light natural movement, soft daylight, shallow depth of field, TikTok/Reels aesthetic.
+```
+
+Poll the result with `muapi predict wait <request_id>` and download to the user's outputs directory.
+
+## Notes
+
+- VIP tier supports 9:16 and durations 4–15s; 10s is the sweet spot for a 1–2 sentence script.
+- Keep the script short — Seedance 2.0 will compress longer scripts and clip words.
+- Seedance VIP tolerates realistic human faces in references (unlike Chinese tier), making it the right choice for UGC.
+- If you want lower latency at the same quality, swap to `seedance-2-vip-image-to-video-fast`.
+- For multi-shot ads, generate several `{{hero_image}}` variations in Step 2 and animate each independently — Seedance VIP does not multi-image i2v at 9:16 + audio.
+
+## Trigger Keywords
+
+`ugc video factory`, `ugc video ad`, `person plus product video`, `talking product ad`, `ugc reel`, `lifestyle product video`, `vertical ugc video`
+
+
+---
+
+## Notes for the Executing Agent
+
+- This recipe is LLM-orchestrated: read each phase, gather any missing inputs from the user, then call `muapi` CLI commands. Run `muapi auth configure` first if `MUAPI_API_KEY` is unset.
+- For local files supplied by the user, upload them first: `muapi upload file <path> --output-json --jq '.url'`.
+- Substitute `{{input_name}}` placeholders with the user's actual inputs before issuing each call.
+- If the `muapi` CLI does not yet alias `nano-banana-pro-edit` or `seedance-2-vip-image-to-video`, fall back to the raw API: `curl -X POST https://api.muapi.ai/api/v1/<endpoint> -H "x-api-key: $MUAPI_API_KEY" -H 'content-type: application/json' -d '{...}'`, then poll with `muapi predict wait <request_id>`.