@imgly/plugin-ai-video-generation-web 0.2.8 → 0.2.10

package/CHANGELOG.md

@@ -2,6 +2,49 @@
 
 ## [Unreleased]
 
+## [0.2.10] - 2025-10-22
+
+### New Features
+
+-   [video-generation] **Google Veo 3.1 Provider Suite**: Added comprehensive Google Veo 3.1 video generation providers via fal.ai, offering multiple models optimized for different use cases:
+    - **Text-to-Video Providers**:
+        - `Veo31TextToVideo`: Standard quality text-to-video with configurable aspect ratios (16:9, 9:16, 1:1), variable duration (4s, 6s, 8s), resolution options (720p, 1080p), and optional audio generation
+        - `Veo31FastTextToVideo`: Faster and more cost-effective text-to-video variant with same capabilities as standard version
+    - **Image-to-Video Providers**:
+        - `Veo31ImageToVideo`: Standard quality image-to-video with auto aspect ratio detection, multiple preset options (16:9, 9:16, 1:1), resolution options (720p, 1080p), fixed 8-second duration, and optional audio generation
+        - `Veo31FastImageToVideo`: Faster and more cost-effective image-to-video variant with same capabilities
+    - **First-Last Frame Providers** (experimental dual-image transformation):
+        - `Veo31FirstLastFrameToVideo`: Standard quality interpolation between two images (first and last frame)
+        - `Veo31FastFirstLastFrameToVideo`: Faster variant with dual image input UI, multiple aspect ratios (16:9, 9:16, 1:1, 4:3, 3:4), resolution options (480p, 720p, 1080p), adjustable duration (2-8 seconds), optional prompt guidance, and optional audio generation
+    - **Quick Action Support**: Added "Animate Between Images" quick action for creating smooth transitions between two selected images using the first-last-frame providers
+
+## [0.2.9] - 2025-10-16
+
+### New Features
+
+-   [image-generation] **GeminiFlash25 Provider**: Added Google Gemini Flash 2.5 text-to-image provider via fal.ai with fast generation times, multiple aspect ratios (1:1, 3:4, 4:3, 9:16, 16:9), custom dimensions support, and multiple output formats (JPEG, PNG, WEBP)
+-   [image-generation] **Gemini25FlashImageEdit Provider**: Added Google Gemini 2.5 Flash Image Edit provider via fal.ai for advanced image editing with multi-image support (1-10 images), comprehensive quick actions support (editImage, swapBackground, styleTransfer, artistTransfer, createVariant, combineImages, remixPage, remixPageWithPrompt), text-based editing instructions, and fast processing times
+
+### Improvements
+
+-   [generation-web] **Middleware preventDefault() API**: Added `options.preventDefault()` method to suppress default UI feedback (notifications, block states, console logging) when handling errors in custom middleware
+-   [all] **Internationalization Support**: All hardcoded strings across AI plugins have been removed and replaced with translation keys, enabling full localization support for plugin labels, actions, styles, and error messages
+-   [all] **Translation Keys Available**: Added comprehensive translation keys for:
+    -   Panel and dock labels (AI Image, AI Video, AI Sticker, AI Voice, Sound Generation)
+    -   Action labels (Generate Image, Generate Video, Generate Sticker)
+    -   Style transfer options (None, Anime, Cyberpunk, Kodak 400, Watercolor, Dark Fantasy, Vaporwave, Vector Flat, 3D Animation, Ukiyo-e, Surreal, Steampunk, Night Bokeh, Pop Art)
+    -   Error messages and UI elements
+-   [all] **Backwards Compatibility**: Translation system automatically detects CE.SDK version and gracefully falls back to English strings for CE.SDK versions < 1.59.0, ensuring no breaking changes for existing integrations
+
+### Fixed
+
+-   [generation-web] **Placeholder Block Error State**: Fixed placeholder blocks getting stuck in Pending state when generation fails or is aborted. Blocks are now properly destroyed when generation is aborted, or moved to Error state when generation fails, preventing perpetual loading spinners in the UI.
+-   [generation-web] **Middleware Block Targeting**: Fixed middleware to correctly receive block IDs for placeholder blocks and quick action targets. Previously, middleware would fall back to `findAllSelected()` which could target incorrect blocks if the selection changed during generation. Now placeholder blocks created during panel generation and target blocks from quick actions are explicitly passed to middleware, ensuring operations like pending state, locking, and highlighting affect the correct blocks.
+
+### Changed
+
+-   [generation-web] **BlockIds Type Refinement**: Removed unused `| null` type from `blockIds` parameter in `GenerationOptions` and `Generate` function signature. The `null` value was documented but never implemented or used. Use an empty array `[]` instead of `null` to explicitly target no blocks.
+
 ## [0.2.8] - 2025-09-29
 
 ### New Features

package/README.md

@@ -364,6 +364,140 @@ Key features:
 -   Fixed duration of 8 seconds
 -   Optional audio generation via `generate_audio`
 
+#### 9. Veo31TextToVideo (Text-to-Video)
+
+Google's Veo 3.1 text-to-video model with enhanced capabilities:
+
+```typescript
+text2video: FalAiVideo.Veo31TextToVideo({
+    proxyUrl: 'http://your-proxy-server.com/api/proxy',
+    // Optional: Configure default property values
+    properties: {
+        aspect_ratio: { default: '16:9' },     // Options: '16:9', '9:16', '1:1'
+        duration: { default: '8s' },           // Options: '4s', '6s', '8s'
+        resolution: { default: '720p' },       // Options: '720p', '1080p'
+        generate_audio: { default: true }      // Enable audio generation
+    }
+});
+```
+
+Key features:
+
+-   Generate videos from text descriptions
+-   Supports aspect ratios 16:9, 9:16 and 1:1 (defaults to 16:9)
+-   Variable duration options: 4s, 6s, or 8s
+-   Resolution options: 720p (1280×720) or 1080p (1920×1080)
+-   Optional audio generation
+
+#### 10. Veo31FastTextToVideo (Text-to-Video)
+
+Faster and more cost-effective version of Google's Veo 3.1 text-to-video model:
+
+```typescript
+text2video: FalAiVideo.Veo31FastTextToVideo({
+    proxyUrl: 'http://your-proxy-server.com/api/proxy',
+    // Optional: Configure default property values
+    properties: {
+        aspect_ratio: { default: '16:9' },     // Options: '16:9', '9:16', '1:1'
+        duration: { default: '8s' },           // Options: '4s', '6s', '8s'
+        resolution: { default: '720p' },       // Options: '720p', '1080p'
+        generate_audio: { default: true }      // Enable audio generation
+    }
+});
+```
+
+Key features:
+
+-   Generate videos from text descriptions with faster processing
+-   Supports aspect ratios 16:9, 9:16 and 1:1 (defaults to 16:9)
+-   Variable duration options: 4s, 6s, or 8s
+-   Resolution options: 720p (1280×720) or 1080p (1920×1080)
+-   Optional audio generation
+-   More cost-effective than the standard Veo 3.1 model
+
+#### 11. Veo31ImageToVideo (Image-to-Video)
+
+A model that transforms still images into videos using Google's Veo 3.1:
+
+```typescript
+image2video: FalAiVideo.Veo31ImageToVideo({
+    proxyUrl: 'http://your-proxy-server.com/api/proxy',
+    // Optional: Configure default property values
+    properties: {
+        aspect_ratio: { default: 'auto' },     // Options: 'auto', '9:16', '16:9', '1:1'
+        resolution: { default: '720p' },       // Options: '720p', '1080p'
+        duration: { default: '8s' },           // Fixed at 8 seconds
+        generate_audio: { default: true }      // Enable audio generation
+    }
+});
+```
+
+Key features:
+
+-   Transform existing images into videos
+-   Multiple aspect ratio options (auto, 9:16, 16:9, 1:1)
+-   Resolution options: 720p (1280×720) or 1080p (1920×1080)
+-   Fixed duration of 8 seconds
+-   Optional audio generation
+-   Canvas quick-action integration
+-   Auto aspect ratio preserves source image dimensions
+
+#### 12. Veo31FastImageToVideo (Image-to-Video)
+
+Faster and more cost-effective version of Google's Veo 3.1 image-to-video model:
+
+```typescript
+image2video: FalAiVideo.Veo31FastImageToVideo({
+    proxyUrl: 'http://your-proxy-server.com/api/proxy',
+    // Optional: Configure default property values
+    properties: {
+        aspect_ratio: { default: 'auto' },     // Options: 'auto', '9:16', '16:9', '1:1'
+        resolution: { default: '720p' },       // Options: '720p', '1080p'
+        duration: { default: '8s' },           // Fixed at 8 seconds
+        generate_audio: { default: true }      // Enable audio generation
+    }
+});
+```
+
+Key features:
+
+-   Transform existing images into videos with faster processing
+-   Multiple aspect ratio options (auto, 9:16, 16:9, 1:1)
+-   Resolution options: 720p (1280×720) or 1080p (1920×1080)
+-   Fixed duration of 8 seconds
+-   Optional audio generation
+-   Canvas quick-action integration
+-   More cost-effective than the standard Veo 3.1 model
+-   Auto aspect ratio preserves source image dimensions
+
+#### 13. Veo31FastFirstLastFrameToVideo (Image-to-Video)
+
+An experimental dual-image transformation model using Veo 3.1 Fast that creates videos by interpolating between two images:
+
+```typescript
+image2video: FalAiVideo.Veo31FastFirstLastFrameToVideo({
+    proxyUrl: 'http://your-proxy-server.com/api/proxy',
+    // Optional: Configure default property values
+    properties: {
+        aspect_ratio: { default: 'auto' },     // Options: 'auto', '9:16', '16:9', '1:1'
+        resolution: { default: '720p' },       // Options: '720p', '1080p'
+        duration: { default: '8s' }            // Fixed at 8 seconds
+    }
+});
+```
+
+Key features:
+
+-   Transform two images (first frame and last frame) into smooth video transitions
+-   Multiple aspect ratio options (auto, 9:16, 16:9, 1:1)
+-   Resolution options (720p, 1080p)
+-   Fixed duration of 8 seconds
+-   Custom UI with dual image selectors for first and last frames
+-   Optional prompt guidance for transition control
+-   Optional audio generation
+
+**Note:** This provider uses a custom UI implementation with two image input fields (first_frame_url and last_frame_url) instead of the standard single image selector. This is a proof-of-concept implementation for handling multiple image inputs in video generation.
+
 ### Feature Control
 
 You can control various aspects of the video generation plugin using the Feature API:
@@ -515,6 +649,43 @@ Built-in middleware options:
 
 You can also create custom middleware functions to meet your specific needs.
 
+#### Preventing Default Feedback
+
+Middleware can suppress default UI feedback behaviors using `options.preventDefault()`:
+
+```typescript
+const customErrorMiddleware = async (input, options, next) => {
+  try {
+    return await next(input, options);
+  } catch (error) {
+    // Prevent default error notification
+    options.preventDefault();
+
+    // Show custom error notification
+    options.cesdk?.ui.showNotification({
+      type: 'error',
+      message: `Video generation failed: ${error.message}`,
+      action: {
+        label: 'Try Again',
+        onClick: () => {/* retry logic */}
+      }
+    });
+
+    throw error;
+  }
+};
+```
+
+**What gets prevented:**
+- Error/success notifications
+- Block error state
+- Console error logging
+
+**What is NOT prevented:**
+- Pending → Ready transition (loading spinner always stops)
+
+For more details, see the [@imgly/plugin-ai-generation-web documentation](https://github.com/imgly/plugins/tree/main/packages/plugin-ai-generation-web#preventing-default-feedback).
+
 ### Using a Proxy
 
 For security reasons, it's recommended to use a proxy server to handle API requests to fal.ai. The proxy URL is required when configuring providers:
@@ -655,6 +826,51 @@ FalAiVideo.Veo3TextToVideo(config: {
 }): AiVideoProvider
 ```
 
+#### Veo31TextToVideo
+
+```typescript
+FalAiVideo.Veo31TextToVideo(config: {
+  proxyUrl: string;
+  debug?: boolean;
+}): AiVideoProvider
+```
+
+#### Veo31FastTextToVideo
+
+```typescript
+FalAiVideo.Veo31FastTextToVideo(config: {
+  proxyUrl: string;
+  debug?: boolean;
+}): AiVideoProvider
+```
+
+#### Veo31ImageToVideo
+
+```typescript
+FalAiVideo.Veo31ImageToVideo(config: {
+  proxyUrl: string;
+  debug?: boolean;
+}): AiVideoProvider
+```
+
+#### Veo31FastImageToVideo
+
+```typescript
+FalAiVideo.Veo31FastImageToVideo(config: {
+  proxyUrl: string;
+  debug?: boolean;
+}): AiVideoProvider
+```
+
+#### Veo31FastFirstLastFrameToVideo
+
+```typescript
+FalAiVideo.Veo31FastFirstLastFrameToVideo(config: {
+  proxyUrl: string;
+  debug?: boolean;
+}): AiVideoProvider
+```
+
 ## UI Integration
 
 The plugin automatically registers the following UI components:
@@ -678,6 +894,11 @@ The plugin automatically registers the following UI components:
     -   ByteDanceSeedanceV1ProImageToVideo: `ly.img.ai.fal-ai/bytedance/seedance/v1/pro/image-to-video`
     -   ByteDanceSeedanceV1ProTextToVideo: `ly.img.ai.fal-ai/bytedance/seedance/v1/pro/text-to-video`
     -   Veo3TextToVideo: `ly.img.ai.fal-ai/veo3`
+    -   Veo31TextToVideo: `ly.img.ai.fal-ai/veo3.1`
+    -   Veo31FastTextToVideo: `ly.img.ai.fal-ai/veo3.1/fast`
+    -   Veo31ImageToVideo: `ly.img.ai.fal-ai/veo3.1/image-to-video`
+    -   Veo31FastImageToVideo: `ly.img.ai.fal-ai/veo3.1/fast/image-to-video`
+    -   Veo31FastFirstLastFrameToVideo: `ly.img.ai.fal-ai/veo3.1/fast/first-last-frame-to-video`
 
 ### Asset History
 
@@ -692,6 +913,11 @@ Generated videos are automatically stored in asset sources with the following ID
 -   ByteDanceSeedanceV1ProImageToVideo: `fal-ai/bytedance/seedance/v1/pro/image-to-video.history`
 -   ByteDanceSeedanceV1ProTextToVideo: `fal-ai/bytedance/seedance/v1/pro/text-to-video.history`
 -   Veo3TextToVideo: `fal-ai/veo3.history`
+-   Veo31TextToVideo: `fal-ai/veo3.1.history`
+-   Veo31FastTextToVideo: `fal-ai/veo3.1/fast.history`
+-   Veo31ImageToVideo: `fal-ai/veo3.1/image-to-video.history`
+-   Veo31FastImageToVideo: `fal-ai/veo3.1/fast/image-to-video.history`
+-   Veo31FastFirstLastFrameToVideo: `fal-ai/veo3.1/fast/first-last-frame-to-video.history`
 
 ### Dock Integration