@imgly/plugin-ai-image-generation-web 0.2.7 → 0.2.9

package/CHANGELOG.md

@@ -2,6 +2,44 @@
 
 ## [Unreleased]
 
+## [0.2.9] - 2025-10-16
+
+### New Features
+
+-   [image-generation] **GeminiFlash25 Provider**: Added Google Gemini Flash 2.5 text-to-image provider via fal.ai with fast generation times, multiple aspect ratios (1:1, 3:4, 4:3, 9:16, 16:9), custom dimensions support, and multiple output formats (JPEG, PNG, WEBP)
+-   [image-generation] **Gemini25FlashImageEdit Provider**: Added Google Gemini 2.5 Flash Image Edit provider via fal.ai for advanced image editing with multi-image support (1-10 images), comprehensive quick actions support (editImage, swapBackground, styleTransfer, artistTransfer, createVariant, combineImages, remixPage, remixPageWithPrompt), text-based editing instructions, and fast processing times
+
+### Improvements
+
+-   [generation-web] **Middleware preventDefault() API**: Added `options.preventDefault()` method to suppress default UI feedback (notifications, block states, console logging) when handling errors in custom middleware
+-   [all] **Internationalization Support**: All hardcoded strings across AI plugins have been removed and replaced with translation keys, enabling full localization support for plugin labels, actions, styles, and error messages
+-   [all] **Translation Keys Available**: Added comprehensive translation keys for:
+    -   Panel and dock labels (AI Image, AI Video, AI Sticker, AI Voice, Sound Generation)
+    -   Action labels (Generate Image, Generate Video, Generate Sticker)
+    -   Style transfer options (None, Anime, Cyberpunk, Kodak 400, Watercolor, Dark Fantasy, Vaporwave, Vector Flat, 3D Animation, Ukiyo-e, Surreal, Steampunk, Night Bokeh, Pop Art)
+    -   Error messages and UI elements
+-   [all] **Backwards Compatibility**: Translation system automatically detects CE.SDK version and gracefully falls back to English strings for CE.SDK versions < 1.59.0, ensuring no breaking changes for existing integrations
+
+### Fixed
+
+-   [generation-web] **Placeholder Block Error State**: Fixed placeholder blocks getting stuck in Pending state when generation fails or is aborted. Blocks are now properly destroyed when generation is aborted, or moved to Error state when generation fails, preventing perpetual loading spinners in the UI.
+-   [generation-web] **Middleware Block Targeting**: Fixed middleware to correctly receive block IDs for placeholder blocks and quick action targets. Previously, middleware would fall back to `findAllSelected()` which could target incorrect blocks if the selection changed during generation. Now placeholder blocks created during panel generation and target blocks from quick actions are explicitly passed to middleware, ensuring operations like pending state, locking, and highlighting affect the correct blocks.
+
+### Changed
+
+-   [generation-web] **BlockIds Type Refinement**: Removed unused `| null` type from `blockIds` parameter in `GenerationOptions` and `Generate` function signature. The `null` value was documented but never implemented or used. Use an empty array `[]` instead of `null` to explicitly target no blocks.
+
+## [0.2.8] - 2025-09-29
+
+### New Features
+
+-   [image-generation] **SeedreamV4 Provider**: Added ByteDance Seedream 4.0 text-to-image provider via fal.ai for high-quality image generation with multiple size presets (square HD 2048×2048, square 1024×1024, portrait/landscape variants), custom dimensions support (1024-4096 pixels), and safety checker enabled by default
+-   [image-generation] **SeedreamV4Edit Provider**: Added ByteDance Seedream 4.0 image-to-image provider via fal.ai for advanced image editing with unified generation/editing architecture, support for multiple input images (up to 10), and full canvas quick actions support (editImage, swapBackground, styleTransfer, artistTransfer, createVariant, combineImages, remixPage, remixPageWithPrompt)
+
+### Fixed
+
+-   [sticker-generation] **Fixed Input Types Not Enabled**: Fixed an issue where the sticker generation panel would show "No input types are enabled" error by properly enabling the `fromText` and `fromImage` feature flags during plugin initialization
+
 ## [0.2.7] - 2025-09-26
 
 ### New Features

package/README.md

@@ -179,8 +179,8 @@ text2image: FalAiImage.RecraftV3({
   },
   // Optional: Configure default property values
   properties: {
-    style: 'realistic_image',  // Default style
-    image_size: 'square_hd'     // Default size
+    style: { default: 'realistic_image' },  // Default style
+    image_size: { default: 'square_hd' }     // Default size
   }
 })
 ```
@@ -265,17 +265,19 @@ Key features:
 text2image: FalAiImage.RecraftV3({
   proxyUrl: 'http://your-proxy-server.com/api/proxy',
   properties: {
-    prompt: '',  // User will fill this
-    style: 'realistic_image/natural_light',
-    image_size: 'landscape_16_9',
+    prompt: { default: '' },  // User will fill this
+    style: { default: 'realistic_image/natural_light' },
+    image_size: { default: 'landscape_16_9' },
 
     // Dynamic style based on context
-    style: (context) => {
-      const hour = new Date().getHours();
-      if (hour < 6 || hour > 18) {
-        return 'realistic_image/evening_light';
+    style: {
+      default: (context) => {
+        const hour = new Date().getHours();
+        if (hour < 6 || hour > 18) {
+          return 'realistic_image/evening_light';
+        }
+        return 'realistic_image/natural_light';
       }
-      return 'realistic_image/natural_light';
     }
   }
 })
@@ -319,13 +321,15 @@ text2image: FalAiImage.Recraft20b({
   // Optional: Configure default property values
   properties: {
     // Dynamic style defaults based on style type
-    style: (context) => {
-      // Different defaults for different style categories
-      // This is handled internally by the provider
-      return 'broken_line';  // Default for icon styles
+    style: {
+      default: (context) => {
+        // Different defaults for different style categories
+        // This is handled internally by the provider
+        return 'broken_line';  // Default for icon styles
+      }
     },
-    image_size: 'square_hd',
-    n_colors: 4  // Default color count for icon styles
+    image_size: { default: 'square_hd' },
+    n_colors: { default: 4 }  // Default color count for icon styles
   }
 })
 ```
@@ -380,17 +384,19 @@ Key features:
 text2image: FalAiImage.Recraft20b({
   proxyUrl: 'http://your-proxy-server.com/api/proxy',
   properties: {
-    prompt: '',  // User will fill this
-    style: 'icon/colored_outline',  // Default to icon style
-    image_size: 'square',
-    n_colors: 3,  // Number of colors for icon styles
+    prompt: { default: '' },  // User will fill this
+    style: { default: 'icon/colored_outline' },  // Default to icon style
+    image_size: { default: 'square' },
+    n_colors: { default: 3 },  // Number of colors for icon styles
 
     // Dynamic style based on use case
-    style: (context) => {
-      // You could check block type or other context
-      const engine = context.engine;
-      // Return appropriate style
-      return 'icon/broken_line';
+    style: {
+      default: (context) => {
+        // You could check block type or other context
+        const engine = context.engine;
+        // Return appropriate style
+        return 'icon/broken_line';
+      }
     }
   }
 })
@@ -437,9 +443,9 @@ text2image: OpenAiImage.GptImage1.Text2Image({
   },
   // Optional: Configure default property values
   properties: {
-    size: '1024x1024',  // Options: '1024x1024', '1792x1024', '1024x1792'
-    quality: 'standard', // Options: 'standard', 'hd'
-    style: 'vivid'      // Options: 'vivid', 'natural'
+    size: { default: '1024x1024' },  // Options: '1024x1024', '1792x1024', '1024x1792'
+    quality: { default: 'standard' }, // Options: 'standard', 'hd'
+    style: { default: 'vivid' }      // Options: 'vivid', 'natural'
   }
 })
 ```
@@ -451,7 +457,62 @@ Key features:
 - Automatic prompt optimization
 - Custom headers support for API requests
 
-#### 4. GeminiFlashEdit (Image-to-Image)
+#### 4. GeminiFlash25 (Text-to-Image)
+
+A fast and efficient text-to-image model from Google's Gemini Flash 2.5 via fal.ai:
+
+```typescript
+text2image: FalAiImage.GeminiFlash25({
+  proxyUrl: 'http://your-proxy-server.com/api/proxy',
+  headers: {
+    'x-custom-header': 'value',
+    'x-client-version': '1.0.0'
+  },
+  // Optional: Configure default property values
+  properties: {
+    aspect_ratio: { default: '1:1' },  // Options: '1:1', '3:4', '4:3', '9:16', '16:9'
+    output_format: { default: 'jpeg' }  // Options: 'jpeg', 'png', 'webp'
+  }
+})
+```
+
+Key features:
+- Fast generation times with Google's Gemini Flash 2.5 model
+- Multiple aspect ratios: 1:1, 3:4, 4:3, 9:16, 16:9
+- Custom dimensions support
+- Multiple output formats (JPEG, PNG, WEBP)
+- Configurable number of images (1-4)
+- Custom headers support for API requests
+
+**Available Property Values:**
+
+```typescript
+// aspect_ratio options:
+'1:1'   // Square (1024×1024)
+'3:4'   // Portrait (768×1024)
+'4:3'   // Landscape (1024×768)
+'9:16'  // Tall Portrait (576×1024)
+'16:9'  // Wide Landscape (1024×576)
+
+// output_format options:
+'jpeg'  // JPEG format (default)
+'png'   // PNG format
+'webp'  // WebP format
+```
+
+**Custom Translations:**
+```typescript
+cesdk.i18n.setTranslations({
+  en: {
+    'ly.img.plugin-ai-image-generation-web.fal-ai/gemini-flash-2.5.property.prompt': 'Describe your image',
+    'ly.img.plugin-ai-image-generation-web.fal-ai/gemini-flash-2.5.property.aspect_ratio': 'Aspect Ratio',
+    'ly.img.plugin-ai-image-generation-web.fal-ai/gemini-flash-2.5.property.aspect_ratio.1:1': 'Square (1:1)',
+    'ly.img.plugin-ai-image-generation-web.fal-ai/gemini-flash-2.5.property.aspect_ratio.16:9': 'Wide (16:9)'
+  }
+});
+```
+
+#### 5. GeminiFlashEdit (Image-to-Image)
 
 An image modification model from fal.ai that transforms existing images:
 
@@ -464,18 +525,19 @@ image2image: FalAiImage.GeminiFlashEdit({
   },
   // Optional: Configure default property values
   properties: {
-    strength: 0.8,        // Transformation strength (0.0-1.0)
-    guidance_scale: 7.5,  // Guidance scale (0-20)
-    num_inference_steps: 50  // Number of inference steps
+    strength: { default: 0.8 },        // Transformation strength (0.0-1.0)
+    guidance_scale: { default: 7.5 },  // Guidance scale (0-20)
+    num_inference_steps: { default: 50 }  // Number of inference steps
   }
 })
 ```
 
 Key features:
 - Transform existing images with text prompts
-- Available directly through canvas quick actions
+- Comprehensive quick actions support: edit image, swap background, style transfer, artist styles, create variants, upscale, outpaint, and combine images
 - Maintains original image dimensions
 - Includes style presets and artist-specific transformations
+- Supports multi-image inputs via combineImages quick action
 - Custom headers support for API requests
 
 **Custom Translations:**
@@ -522,9 +584,9 @@ text2image: FalAiImage.IdeogramV3({
   },
   // Optional: Configure default property values
   properties: {
-    style: 'GENERAL',    // Options: 'AUTO', 'GENERAL', 'REALISTIC', 'DESIGN'
-    image_size: 'square_hd', // Same options as Recraft
-    seed: 12345         // Fixed seed for reproducibility
+    style: { default: 'GENERAL' },    // Options: 'AUTO', 'GENERAL', 'REALISTIC', 'DESIGN'
+    image_size: { default: 'square_hd' }, // Same options as Recraft
+    seed: { default: 12345 }         // Fixed seed for reproducibility
   }
 })
 ```
@@ -547,9 +609,9 @@ image2image: FalAiImage.IdeogramV3Remix({
   },
   // Optional: Configure default property values
   properties: {
-    style: 'AUTO',       // Options: 'AUTO', 'GENERAL', 'REALISTIC', 'DESIGN'
-    image_size: 'square_hd',
-    remix_strength: 0.7  // How much to transform (0.0-1.0)
+    style: { default: 'AUTO' },       // Options: 'AUTO', 'GENERAL', 'REALISTIC', 'DESIGN'
+    image_size: { default: 'square_hd' },
+    remix_strength: { default: 0.7 }  // How much to transform (0.0-1.0)
   }
 })
 ```
@@ -573,8 +635,8 @@ image2image: FalAiImage.QwenImageEdit({
   },
   // Optional: Configure default property values
   properties: {
-    seed: 12345,         // Fixed seed for reproducibility
-    guidance_scale: 7.5  // Guidance strength (0-20)
+    seed: { default: 12345 },         // Fixed seed for reproducibility
+    guidance_scale: { default: 7.5 }  // Guidance strength (0-20)
   }
 })
 ```
@@ -631,7 +693,7 @@ text2image: FalAiImage.NanoBanana({
   },
   // Optional: Configure default property values
   properties: {
-    output_format: 'PNG'  // Options: 'PNG', 'JPEG'
+    output_format: { default: 'PNG' }  // Options: 'PNG', 'JPEG'
   }
 })
 ```
@@ -656,7 +718,53 @@ cesdk.i18n.setTranslations({
 });
 ```
 
-#### 10. NanoBananaEdit (Image-to-Image)
+#### 10. SeedreamV4 (Text-to-Image)
+
+A powerful text-to-image model from ByteDance's Seedream 4.0 available through fal.ai:
+
+```typescript
+text2image: FalAiImage.SeedreamV4({
+  proxyUrl: 'http://your-proxy-server.com/api/proxy',
+  headers: {
+    'x-custom-header': 'value',
+    'x-client-version': '1.0.0'
+  },
+  // Optional: Configure default property values
+  properties: {
+    image_size: { default: 'square_hd' }  // Options: square_hd, square, portrait/landscape variants
+  }
+})
+```
+
+Key features:
+- High-quality image generation with ByteDance's Seedream 4.0 model
+- Multiple image size presets: square HD (2048×2048), square (1024×1024), portrait 4:3/16:9, landscape 4:3/16:9
+- Custom dimensions support (1024-4096 pixels)
+- Fast generation times
+- Safety checker enabled by default
+
+#### 11. SeedreamV4Edit (Image-to-Image)
+
+An advanced image editing model from ByteDance's Seedream 4.0 for transforming existing images:
+
+```typescript
+image2image: FalAiImage.SeedreamV4Edit({
+  proxyUrl: 'http://your-proxy-server.com/api/proxy',
+  headers: {
+    'x-custom-header': 'value',
+    'x-client-version': '1.0.0'
+  }
+})
+```
+
+Key features:
+- Unified architecture for both generation and editing
+- Supports multiple input images (up to 10)
+- Full canvas quick actions support: edit image, swap background, style transfer, artist styles, create variants, combine images, remix page
+- Maintains original image dimensions
+- Custom headers support for API requests
+
+#### 12. NanoBananaEdit (Image-to-Image)
 
 An image editing model from fal.ai that transforms existing images using text prompts:
 
@@ -669,8 +777,8 @@ image2image: FalAiImage.NanoBananaEdit({
   },
   // Optional: Configure default property values
   properties: {
-    strength: 0.7,        // Edit strength (0.0-1.0)
-    output_format: 'PNG'  // Options: 'PNG', 'JPEG'
+    strength: { default: 0.7 },        // Edit strength (0.0-1.0)
+    output_format: { default: 'PNG' }  // Options: 'PNG', 'JPEG'
   }
 })
 ```
@@ -869,24 +977,75 @@ Custom middleware functions follow this pattern:
 const customMiddleware = async (input, options, next) => {
   // Pre-processing logic
   console.log('Before generation:', input);
-  
+
   // Add custom fields or modify the input if needed
   const modifiedInput = {
     ...input,
     customField: 'custom value'
   };
-  
+
   // Call the next middleware or generation function
   const result = await next(modifiedInput, options);
-  
+
   // Post-processing logic
   console.log('After generation:', result);
-  
+
   // You can also modify the result before returning it
   return result;
 };
 ```
 
+#### Preventing Default Feedback
+
+Middleware can suppress default UI feedback behaviors using `options.preventDefault()`:
+
+```typescript
+const customErrorMiddleware = async (input, options, next) => {
+  try {
+    return await next(input, options);
+  } catch (error) {
+    // Prevent default error notification and block error state
+    options.preventDefault();
+
+    // When preventDefault() is called, you need to handle the block state yourself.
+    // Here we set the error state to mimic the default behavior:
+    options.blockIds?.forEach(blockId => {
+      if (options.engine.block.isValid(blockId)) {
+        options.engine.block.setState(blockId, { type: 'Error', error: 'Unknown' });
+      }
+    });
+    // Alternative: Delete the placeholder block instead
+    // options.blockIds?.forEach(blockId => {
+    //   if (options.engine.block.isValid(blockId)) {
+    //     options.engine.block.destroy(blockId);
+    //   }
+    // });
+
+    // Show custom error notification
+    options.cesdk?.ui.showNotification({
+      type: 'error',
+      message: `Custom error: ${error.message}`,
+      action: {
+        label: 'Contact Support',
+        onClick: () => window.open('mailto:support@example.com')
+      }
+    });
+
+    throw error;
+  }
+};
+```
+
+**What gets prevented:**
+- Error/success notifications
+- Block error state
+- Console error logging
+
+**What is NOT prevented:**
+- Pending → Ready transition (loading spinner always stops)
+
+For more details, see the [@imgly/plugin-ai-generation-web documentation](https://github.com/imgly/plugins/tree/main/packages/plugin-ai-generation-web#preventing-default-feedback).
+
 The middleware function signature is:
 
 ```typescript
@@ -1009,6 +1168,16 @@ FalAiImage.IdeogramV3Remix(config: {
 })
 ```
 
+#### GeminiFlash25
+
+```typescript
+FalAiImage.GeminiFlash25(config: {
+  proxyUrl: string;
+  headers?: Record<string, string>;
+  debug?: boolean;
+})
+```
+
 #### GeminiFlashEdit
 
 ```typescript
@@ -1019,6 +1188,16 @@ FalAiImage.GeminiFlashEdit(config: {
 })
 ```
 
+#### Gemini25FlashImageEdit
+
+```typescript
+FalAiImage.Gemini25FlashImageEdit(config: {
+  proxyUrl: string;
+  headers?: Record<string, string>;
+  debug?: boolean;
+})
+```
+
 #### QwenImageEdit
 
 ```typescript
@@ -1089,6 +1268,26 @@ FalAiImage.NanoBananaEdit(config: {
 })
 ```
 
+#### SeedreamV4
+
+```typescript
+FalAiImage.SeedreamV4(config: {
+  proxyUrl: string;
+  headers?: Record<string, string>;
+  debug?: boolean;
+})
+```
+
+#### SeedreamV4Edit
+
+```typescript
+FalAiImage.SeedreamV4Edit(config: {
+  proxyUrl: string;
+  headers?: Record<string, string>;
+  debug?: boolean;
+})
+```
+
 ## UI Integration
 
 The plugin automatically registers the following UI components:
@@ -1176,6 +1375,7 @@ const myImageProvider = {
   - Recraft20b: `ly.img.ai.fal-ai/recraft/v2/text-to-image`
   - IdeogramV3: `ly.img.ai.fal-ai/ideogram/v3`
   - IdeogramV3Remix: `ly.img.ai.fal-ai/ideogram/v3/remix`
+  - GeminiFlash25: `ly.img.ai.fal-ai/gemini-flash-2.5`
   - GeminiFlashEdit: `ly.img.ai.fal-ai/gemini-flash-edit`
   - QwenImageEdit: `ly.img.ai.fal-ai/qwen-image-edit`
   - GptImage1.Text2Image: `ly.img.ai.open-ai/gpt-image-1/text2image`
@@ -1184,6 +1384,8 @@ const myImageProvider = {
   - FluxProKontextMaxEdit: `ly.img.ai.fal-ai/flux-pro/kontext/max`
   - NanoBanana: `ly.img.ai.fal-ai/nano-banana`
   - NanoBananaEdit: `ly.img.ai.fal-ai/nano-banana/edit`
+  - SeedreamV4: `ly.img.ai.fal-ai/bytedance/seedream/v4/text-to-image`
+  - SeedreamV4Edit: `ly.img.ai.fal-ai/bytedance/seedream/v4/edit`
 
 ### Asset History
 
@@ -1192,6 +1394,7 @@ Generated images are automatically stored in asset sources with the following ID
 - Recraft20b: `fal-ai/recraft/v2/text-to-image.history`
 - IdeogramV3: `fal-ai/ideogram/v3.history`
 - IdeogramV3Remix: `fal-ai/ideogram/v3/remix.history`
+- GeminiFlash25: `fal-ai/gemini-flash-2.5.history`
 - GeminiFlashEdit: `fal-ai/gemini-flash-edit.history`
 - QwenImageEdit: `fal-ai/qwen-image-edit.history`
 - GptImage1.Text2Image: `open-ai/gpt-image-1/text2image.history`
@@ -1200,6 +1403,8 @@ Generated images are automatically stored in asset sources with the following ID
 - FluxProKontextMaxEdit: `fal-ai/flux-pro/kontext/max.history`
 - NanoBanana: `fal-ai/nano-banana.history`
 - NanoBananaEdit: `fal-ai/nano-banana/edit.history`
+- SeedreamV4: `fal-ai/bytedance/seedream/v4/text-to-image.history`
+- SeedreamV4Edit: `fal-ai/bytedance/seedream/v4/edit.history`
 
 ### Dock Integration