@hienlh/ppm 0.9.81 → 0.9.83

package/.opencode/skills/ai-multimodal/references/video-generation.md

@@ -1,457 +0,0 @@
-# Video Generation Reference
-
-Comprehensive guide for video creation using Veo models via Gemini API.
-
-## Core Capabilities
-
-- **Text-to-Video**: Generate 8-second videos from text prompts
-- **Image-to-Video**: Animate images with text direction
-- **Video Extension**: Continue previously generated videos
-- **Frame Control**: Precise camera movements and effects
-- **Native Audio**: Synchronized audio generation
-- **Multiple Resolutions**: 720p and 1080p output
-- **Aspect Ratios**: 16:9, 9:16, 1:1
-
-## Models
-
-### Veo 3.1 Preview (Latest)
-
-**veo-3.1-generate-preview** - Latest with advanced controls
-- Frame-specific generation
-- Up to 3 reference images for image-to-video
-- Video extension capability
-- Native audio generation
-- Resolution: 720p, 1080p
-- Duration: 8 seconds at 24fps
-- Status: Preview (API may change)
-- Updated: September 2025
-
-**veo-3.1-fast-generate-preview** - Speed-optimized
-- Optimized for business use cases
-- Programmatic ad creation
-- Social media content
-- Same features as standard but faster
-- Status: Preview
-- Updated: September 2025
-
-### Veo 3.0 Stable
-
-**veo-3.0-generate-001** - Production-ready
-- Native audio generation
-- Text-to-video and image-to-video
-- 720p and 1080p (16:9 only)
-- 8 seconds at 24fps
-- Status: Stable
-- Updated: July 2025
-
-**veo-3.0-fast-generate-001** - Stable fast variant
-- Speed-optimized stable version
-- Same reliability as 3.0
-- Status: Stable
-- Updated: July 2025
-
-## Model Comparison
-
-| Model | Speed | Features | Audio | Status | Best For |
-|-------|-------|----------|-------|--------|----------|
-| veo-3.1-preview | Medium | All | ✓ | Preview | Latest features |
-| veo-3.1-fast | Fast | All | ✓ | Preview | Business/speed |
-| veo-3.0-001 | Medium | Standard | ✓ | Stable | Production |
-| veo-3.0-fast | Fast | Standard | ✓ | Stable | Production/speed |
-
-## Quick Start
-
-### Text-to-Video
-
-```python
-from google import genai
-from google.genai import types
-import os
-
-client = genai.Client(api_key=os.getenv('GEMINI_API_KEY'))
-
-# Basic generation
-response = client.models.generate_video(
-    model='veo-3.1-generate-preview',
-    prompt='A serene beach at sunset with gentle waves rolling onto the shore',
-    config=types.VideoGenerationConfig(
-        resolution='1080p',
-        aspect_ratio='16:9'
-    )
-)
-
-# Save video
-with open('output.mp4', 'wb') as f:
-    f.write(response.video.data)
-```
-
-### Image-to-Video
-
-```python
-import PIL.Image
-
-# Load reference image
-ref_image = PIL.Image.open('beach.jpg')
-
-# Animate the image
-response = client.models.generate_video(
-    model='veo-3.1-generate-preview',
-    prompt='Camera slowly pans across the scene from left to right',
-    reference_images=[ref_image],
-    config=types.VideoGenerationConfig(
-        resolution='1080p'
-    )
-)
-```
-
-### Multiple Reference Images
-
-```python
-# Use up to 3 reference images for complex scenes
-img1 = PIL.Image.open('foreground.jpg')
-img2 = PIL.Image.open('background.jpg')
-img3 = PIL.Image.open('subject.jpg')
-
-response = client.models.generate_video(
-    model='veo-3.1-generate-preview',
-    prompt='Combine these elements into a cohesive animated scene',
-    reference_images=[img1, img2, img3],
-    config=types.VideoGenerationConfig(
-        resolution='1080p',
-        aspect_ratio='16:9'
-    )
-)
-```
-
-## Advanced Features
-
-### Video Extension
-
-```python
-# Continue from previously generated video
-previous_video = open('part1.mp4', 'rb').read()
-
-response = client.models.extend_video(
-    model='veo-3.1-generate-preview',
-    video=previous_video,
-    prompt='The scene transitions to nighttime with stars appearing'
-)
-```
-
-### Frame Control
-
-```python
-# Precise camera movements
-response = client.models.generate_video(
-    model='veo-3.1-generate-preview',
-    prompt='A mountain landscape',
-    config=types.VideoGenerationConfig(
-        resolution='1080p',
-        camera_motion='zoom_in',  # Options: zoom_in, zoom_out, pan_left, pan_right, tilt_up, tilt_down, static
-        motion_speed='slow'  # Options: slow, medium, fast
-    )
-)
-```
-
-## Prompt Engineering
-
-### Effective Video Prompts
-
-**Structure**:
-1. **Subject**: What's in the scene
-2. **Action**: What's happening
-3. **Camera**: How it's filmed
-4. **Style**: Visual treatment
-5. **Timing**: Pacing details
-
-**Example**:
-```
-"A hummingbird [subject] hovers near a red flower, then flies away [action].
-Slow-motion close-up shot [camera] with vibrant colors and soft focus background [style].
-Gentle, peaceful pacing [timing]."
-```
-
-### Action Verbs
-
-**Movement**:
-- "walks", "runs", "flies", "swims", "dances"
-- "rotates", "spins", "rolls", "bounces"
-- "emerges", "disappears", "transforms"
-
-**Camera**:
-- "zoom in on", "pull back from", "follow"
-- "orbit around", "track alongside"
-- "tilt up to reveal", "pan across"
-
-**Transitions**:
-- "gradually changes from... to..."
-- "morphs into", "dissolves into"
-- "cuts to", "fades to"
-
-### Timing Control
-
-```python
-# Explicit timing in prompt
-prompt = '''
-0-2s: Close-up of a seed in soil
-2-4s: Time-lapse of sprout emerging
-4-6s: Growing into a small plant
-6-8s: Zoom out to show garden context
-'''
-```
-
-## Configuration Options
-
-### Resolution
-
-```python
-config = types.VideoGenerationConfig(
-    resolution='1080p'  # Options: 720p, 1080p
-)
-```
-
-**Considerations**:
-- 1080p: Higher quality, longer generation time, larger file
-- 720p: Faster generation, smaller file, good for drafts
-
-### Aspect Ratios
-
-```python
-config = types.VideoGenerationConfig(
-    aspect_ratio='16:9'  # Options: 16:9, 9:16, 1:1
-)
-```
-
-**Use Cases**:
-- 16:9: Landscape, YouTube, traditional video
-- 9:16: Mobile, TikTok, Instagram Stories
-- 1:1: Square, Instagram feed, versatile
-
-### Audio Control
-
-```python
-config = types.VideoGenerationConfig(
-    include_audio=True  # Default: True
-)
-```
-
-Native audio is generated automatically and synchronized with video content.
-
-## Best Practices
-
-### 1. Prompt Quality
-
-**Be specific**:
-- ❌ "A person walking"
-- ✅ "A young woman in a red coat walking through a park in autumn"
-
-**Include motion**:
-- ❌ "A city street"
-- ✅ "A busy city street with cars passing and people crossing"
-
-**Specify camera**:
-- ❌ "A mountain"
-- ✅ "Aerial drone shot slowly ascending over a snow-capped mountain"
-
-### 2. Reference Images
-
-**Quality**:
-- Use high-resolution images (1080p+)
-- Clear, well-lit subjects
-- Minimal motion blur
-
-**Composition**:
-- Match desired final aspect ratio
-- Leave room for motion/movement
-- Consider camera angle in prompt
-
-### 3. Performance Optimization
-
-**Generation Time**:
-- 720p: ~30-60 seconds
-- 1080p: ~60-120 seconds
-- Fast models: 30-50% faster
-
-**Strategies**:
-- Use 720p for iteration/drafts
-- Use fast models for rapid feedback
-- Batch multiple requests
-- Use async processing for UI responsiveness
-
-## Common Use Cases
-
-### 1. Product Demos
-
-```python
-response = client.models.generate_video(
-    model='veo-3.0-fast-generate-001',
-    prompt='''
-    Professional product video:
-    - Sleek smartphone rotating on a pedestal
-    - Clean white background with soft shadows
-    - Slow 360-degree rotation
-    - Spotlight highlighting premium design
-    - Modern, minimalist aesthetic
-    ''',
-    config=types.VideoGenerationConfig(
-        resolution='1080p',
-        aspect_ratio='1:1'
-    )
-)
-```
-
-### 2. Social Media Content
-
-```python
-response = client.models.generate_video(
-    model='veo-3.1-fast-generate-preview',
-    prompt='''
-    Trendy social media clip:
-    - Text overlay "NEW ARRIVAL" appears
-    - Fashion product showcase
-    - Quick cuts and dynamic camera
-    - Vibrant colors, high energy
-    - Upbeat pacing
-    ''',
-    config=types.VideoGenerationConfig(
-        resolution='1080p',
-        aspect_ratio='9:16'  # Mobile
-    )
-)
-```
-
-### 3. Explainer Animations
-
-```python
-response = client.models.generate_video(
-    model='veo-3.1-generate-preview',
-    prompt='''
-    Educational animation:
-    - Simple diagram illustrating data flow
-    - Arrows and icons animating in sequence
-    - Clean, clear visual hierarchy
-    - Smooth transitions between steps
-    - Professional corporate style
-    ''',
-    config=types.VideoGenerationConfig(
-        resolution='720p',
-        aspect_ratio='16:9'
-    )
-)
-```
-
-## Safety & Content Policy
-
-### Safety Settings
-
-```python
-config = types.VideoGenerationConfig(
-    safety_settings=[
-        types.SafetySetting(
-            category=types.HarmCategory.HARM_CATEGORY_DANGEROUS_CONTENT,
-            threshold=types.HarmBlockThreshold.BLOCK_MEDIUM_AND_ABOVE
-        )
-    ]
-)
-```
-
-### Prohibited Content
-
-- Violence, gore, harm
-- Sexually explicit content
-- Hate speech, harassment
-- Copyrighted characters/brands
-- Real people (without consent)
-- Misleading/deceptive content
-
-## Limitations
-
-- **Duration**: Fixed 8 seconds (as of Sept 2025)
-- **Frame Rate**: 24fps only
-- **File Size**: ~5-20MB per video
-- **Generation Time**: 30s-2min depending on resolution
-- **Reference Images**: Max 3 images
-- **Preview Status**: API may change (3.1 models)
-- **Audio**: Cannot upload custom audio (native only)
-- **No real-time**: Pre-generation required
-
-## Troubleshooting
-
-### Long Generation Times
-
-```python
-import time
-
-# Track generation progress
-start = time.time()
-response = client.models.generate_video(...)
-duration = time.time() - start
-print(f"Generated in {duration:.1f}s")
-```
-
-**Expected times**:
-- Fast models + 720p: 30-45s
-- Standard models + 720p: 45-90s
-- Fast models + 1080p: 45-60s
-- Standard models + 1080p: 60-120s
-
-### Safety Filter Blocking
-
-```python
-try:
-    response = client.models.generate_video(...)
-except Exception as e:
-    if 'safety' in str(e).lower():
-        print("Video blocked by safety filters")
-        # Modify prompt and retry
-```
-
-### Quota Exceeded
-
-```python
-# Implement exponential backoff
-import time
-
-def generate_with_retry(model, prompt, max_retries=3):
-    for attempt in range(max_retries):
-        try:
-            return client.models.generate_video(model=model, prompt=prompt)
-        except Exception as e:
-            if '429' in str(e):  # Rate limit
-                wait = 2 ** attempt
-                print(f"Rate limited, waiting {wait}s...")
-                time.sleep(wait)
-            else:
-                raise
-    raise Exception("Max retries exceeded")
-```
-
-## Cost Estimation
-
-**Pricing**: TBD (preview models)
-
-**Estimated based on compute**:
-- Fast + 720p: ~$0.05-$0.10 per video
-- Standard + 1080p: ~$0.15-$0.25 per video
-
-**Monitor**: https://ai.google.dev/pricing
-
-## Resources
-
-- [Veo API Docs](https://ai.google.dev/gemini-api/docs/video)
-- [Video Generation Guide](https://ai.google.dev/gemini-api/docs/video#model-versions)
-- [Content Policy](https://ai.google.dev/gemini-api/docs/safety)
-- [Get API Key](https://aistudio.google.com/apikey)
-
----
-
-## Related References
-
-**Current**: Video Generation
-
-**Related Capabilities**:
-- [Video Analysis](./video-analysis.md) - Understanding existing videos
-- [Image Generation](./image-generation.md) - Creating static images
-- [Image Understanding](./vision-understanding.md) - Analyzing reference images
-
-**Back to**: [AI Multimodal Skill](../SKILL.md)