@imgly/plugin-ai-video-generation-web 0.2.11 → 0.2.14
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +12 -0
- package/README.md +157 -0
- package/dist/.tsbuildinfo +1 -1
- package/dist/fal-ai/index.mjs.map +2 -2
- package/dist/index.mjs +1 -1
- package/dist/index.mjs.map +2 -2
- package/dist/runware/Sora2.image2video.d.ts +32 -0
- package/dist/runware/Sora2.text2video.d.ts +30 -0
- package/dist/runware/Sora2Pro.image2video.d.ts +32 -0
- package/dist/runware/Sora2Pro.text2video.d.ts +30 -0
- package/dist/runware/Veo31.image2video.d.ts +33 -0
- package/dist/runware/Veo31.text2video.d.ts +31 -0
- package/dist/runware/Veo31Fast.image2video.d.ts +34 -0
- package/dist/runware/Veo31Fast.text2video.d.ts +32 -0
- package/dist/runware/createRunwareClient.d.ts +57 -0
- package/dist/runware/createVideoProvider.d.ts +109 -0
- package/dist/runware/index.d.ts +28 -0
- package/dist/runware/index.mjs +142 -0
- package/dist/runware/index.mjs.map +7 -0
- package/dist/runware/types.d.ts +10 -0
- package/dist/runware/utils.d.ts +5 -0
- package/package.json +39 -24
package/CHANGELOG.md
CHANGED
|
@@ -2,6 +2,18 @@
|
|
|
2
2
|
|
|
3
3
|
## [Unreleased]
|
|
4
4
|
|
|
5
|
+
## [0.2.14] - 2025-12-15
|
|
6
|
+
|
|
7
|
+
## [0.2.13] - 2025-12-15
|
|
8
|
+
|
|
9
|
+
### New Features
|
|
10
|
+
|
|
11
|
+
- [all] **Runware Partner Integration**: Added Runware as a new AI provider service, offering access to multiple image and video generation models through a unified API. Runware provides a single endpoint for accessing various AI models with consistent configuration.
|
|
12
|
+
- **Image Generation**: FLUX.2 [dev], FLUX.2 [pro], FLUX.2 [flex], Seedream 4.0, Seedream 4.5, Nano Banana 2 Pro, GPT Image 1, GPT Image 1 Mini (all with text-to-image and image-to-image variants)
|
|
13
|
+
- **Video Generation**: Google Veo 3.1, Veo 3.1 Fast, OpenAI Sora 2, Sora 2 Pro (all with text-to-video and image-to-video variants)
|
|
14
|
+
|
|
15
|
+
## [0.2.12] - 2025-11-21
|
|
16
|
+
|
|
5
17
|
## [0.2.11] - 2025-11-21
|
|
6
18
|
|
|
7
19
|
### New Features
|
package/README.md
CHANGED
|
@@ -33,6 +33,8 @@ To use the plugin, import it and configure it with your preferred providers:
|
|
|
33
33
|
import CreativeEditorSDK from '@cesdk/cesdk-js';
|
|
34
34
|
import VideoGeneration from '@imgly/plugin-ai-video-generation-web';
|
|
35
35
|
import FalAiVideo from '@imgly/plugin-ai-video-generation-web/fal-ai';
|
|
36
|
+
// For Runware providers
|
|
37
|
+
import RunwareVideo from '@imgly/plugin-ai-video-generation-web/runware';
|
|
36
38
|
|
|
37
39
|
// Initialize CreativeEditor SDK
|
|
38
40
|
CreativeEditorSDK.create(domElement, {
|
|
@@ -498,6 +500,104 @@ Key features:
|
|
|
498
500
|
|
|
499
501
|
**Note:** This provider uses a custom UI implementation with two image input fields (first_frame_url and last_frame_url) instead of the standard single image selector. This is a proof-of-concept implementation for handling multiple image inputs in video generation.
|
|
500
502
|
|
|
503
|
+
### Runware Providers
|
|
504
|
+
|
|
505
|
+
Runware provides access to multiple AI video models through a unified API. These providers require a Runware proxy URL for authentication.
|
|
506
|
+
|
|
507
|
+
#### 14. Veo31 (Text-to-Video & Image-to-Video) via Runware
|
|
508
|
+
|
|
509
|
+
Google's Veo 3.1 model accessed through Runware:
|
|
510
|
+
|
|
511
|
+
```typescript
|
|
512
|
+
// Text-to-Video
|
|
513
|
+
text2video: RunwareVideo.Veo31.Text2Video({
|
|
514
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
515
|
+
})
|
|
516
|
+
|
|
517
|
+
// Image-to-Video
|
|
518
|
+
image2video: RunwareVideo.Veo31.Image2Video({
|
|
519
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
520
|
+
})
|
|
521
|
+
```
|
|
522
|
+
|
|
523
|
+
Key features:
|
|
524
|
+
- Google's latest video generation model via Runware
|
|
525
|
+
- Text-to-video and image-to-video support
|
|
526
|
+
- Aspect ratios: 16:9, 9:16
|
|
527
|
+
- Duration: Fixed at 8 seconds
|
|
528
|
+
- Optional audio generation
|
|
529
|
+
- Async delivery with polling
|
|
530
|
+
|
|
531
|
+
#### 15. Veo31Fast (Text-to-Video & Image-to-Video) via Runware
|
|
532
|
+
|
|
533
|
+
Faster version of Google's Veo 3.1 model:
|
|
534
|
+
|
|
535
|
+
```typescript
|
|
536
|
+
// Text-to-Video
|
|
537
|
+
text2video: RunwareVideo.Veo31Fast.Text2Video({
|
|
538
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
539
|
+
})
|
|
540
|
+
|
|
541
|
+
// Image-to-Video
|
|
542
|
+
image2video: RunwareVideo.Veo31Fast.Image2Video({
|
|
543
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
544
|
+
})
|
|
545
|
+
```
|
|
546
|
+
|
|
547
|
+
Key features:
|
|
548
|
+
- Faster generation times
|
|
549
|
+
- Same capabilities as Veo31
|
|
550
|
+
- More cost-effective
|
|
551
|
+
- Aspect ratios: 16:9, 9:16
|
|
552
|
+
- Duration: Fixed at 8 seconds
|
|
553
|
+
|
|
554
|
+
#### 16. Sora2 (Text-to-Video & Image-to-Video) via Runware
|
|
555
|
+
|
|
556
|
+
OpenAI's Sora 2 video generation model:
|
|
557
|
+
|
|
558
|
+
```typescript
|
|
559
|
+
// Text-to-Video
|
|
560
|
+
text2video: RunwareVideo.Sora2.Text2Video({
|
|
561
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
562
|
+
})
|
|
563
|
+
|
|
564
|
+
// Image-to-Video
|
|
565
|
+
image2video: RunwareVideo.Sora2.Image2Video({
|
|
566
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
567
|
+
})
|
|
568
|
+
```
|
|
569
|
+
|
|
570
|
+
Key features:
|
|
571
|
+
- OpenAI's advanced video generation model
|
|
572
|
+
- Text-to-video and image-to-video support
|
|
573
|
+
- Accurate physics simulation
|
|
574
|
+
- Synchronized dialogue and high-fidelity visuals
|
|
575
|
+
- Resolutions: 1280×720, 720×1280
|
|
576
|
+
- Durations: 4, 8, or 12 seconds
|
|
577
|
+
|
|
578
|
+
#### 17. Sora2Pro (Text-to-Video & Image-to-Video) via Runware
|
|
579
|
+
|
|
580
|
+
Professional version of OpenAI's Sora 2:
|
|
581
|
+
|
|
582
|
+
```typescript
|
|
583
|
+
// Text-to-Video
|
|
584
|
+
text2video: RunwareVideo.Sora2Pro.Text2Video({
|
|
585
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
586
|
+
})
|
|
587
|
+
|
|
588
|
+
// Image-to-Video
|
|
589
|
+
image2video: RunwareVideo.Sora2Pro.Image2Video({
|
|
590
|
+
proxyUrl: 'http://your-runware-proxy.com/api/proxy'
|
|
591
|
+
})
|
|
592
|
+
```
|
|
593
|
+
|
|
594
|
+
Key features:
|
|
595
|
+
- Enhanced quality over standard Sora 2
|
|
596
|
+
- Text-to-video and image-to-video support
|
|
597
|
+
- Professional-grade output
|
|
598
|
+
- Resolutions: 1280×720, 720×1280, 1792×1024 (7:4), 1024×1792 (4:7)
|
|
599
|
+
- Durations: 4, 8, or 12 seconds
|
|
600
|
+
|
|
501
601
|
### Feature Control
|
|
502
602
|
|
|
503
603
|
You can control various aspects of the video generation plugin using the Feature API:
|
|
@@ -871,6 +971,47 @@ FalAiVideo.Veo31FastFirstLastFrameToVideo(config: {
|
|
|
871
971
|
}): AiVideoProvider
|
|
872
972
|
```
|
|
873
973
|
|
|
974
|
+
### Runware Providers
|
|
975
|
+
|
|
976
|
+
All Runware video providers use the following configuration:
|
|
977
|
+
|
|
978
|
+
```typescript
|
|
979
|
+
interface RunwareProviderConfiguration {
|
|
980
|
+
proxyUrl: string; // HTTP endpoint URL for the Runware proxy
|
|
981
|
+
debug?: boolean; // Enable debug logging
|
|
982
|
+
middlewares?: any[]; // Optional middleware functions
|
|
983
|
+
history?: false | '@imgly/local' | '@imgly/indexedDB' | (string & {});
|
|
984
|
+
}
|
|
985
|
+
```
|
|
986
|
+
|
|
987
|
+
#### Veo31.Text2Video / Veo31.Image2Video
|
|
988
|
+
|
|
989
|
+
```typescript
|
|
990
|
+
RunwareVideo.Veo31.Text2Video(config: RunwareProviderConfiguration)
|
|
991
|
+
RunwareVideo.Veo31.Image2Video(config: RunwareProviderConfiguration)
|
|
992
|
+
```
|
|
993
|
+
|
|
994
|
+
#### Veo31Fast.Text2Video / Veo31Fast.Image2Video
|
|
995
|
+
|
|
996
|
+
```typescript
|
|
997
|
+
RunwareVideo.Veo31Fast.Text2Video(config: RunwareProviderConfiguration)
|
|
998
|
+
RunwareVideo.Veo31Fast.Image2Video(config: RunwareProviderConfiguration)
|
|
999
|
+
```
|
|
1000
|
+
|
|
1001
|
+
#### Sora2.Text2Video / Sora2.Image2Video
|
|
1002
|
+
|
|
1003
|
+
```typescript
|
|
1004
|
+
RunwareVideo.Sora2.Text2Video(config: RunwareProviderConfiguration)
|
|
1005
|
+
RunwareVideo.Sora2.Image2Video(config: RunwareProviderConfiguration)
|
|
1006
|
+
```
|
|
1007
|
+
|
|
1008
|
+
#### Sora2Pro.Text2Video / Sora2Pro.Image2Video
|
|
1009
|
+
|
|
1010
|
+
```typescript
|
|
1011
|
+
RunwareVideo.Sora2Pro.Text2Video(config: RunwareProviderConfiguration)
|
|
1012
|
+
RunwareVideo.Sora2Pro.Image2Video(config: RunwareProviderConfiguration)
|
|
1013
|
+
```
|
|
1014
|
+
|
|
874
1015
|
## UI Integration
|
|
875
1016
|
|
|
876
1017
|
The plugin automatically registers the following UI components:
|
|
@@ -899,6 +1040,14 @@ The plugin automatically registers the following UI components:
|
|
|
899
1040
|
- Veo31ImageToVideo: `ly.img.ai.fal-ai/veo3.1/image-to-video`
|
|
900
1041
|
- Veo31FastImageToVideo: `ly.img.ai.fal-ai/veo3.1/fast/image-to-video`
|
|
901
1042
|
- Veo31FastFirstLastFrameToVideo: `ly.img.ai.fal-ai/veo3.1/fast/first-last-frame-to-video`
|
|
1043
|
+
- Runware Veo31.Text2Video: `ly.img.ai.runware/google/veo-3-1`
|
|
1044
|
+
- Runware Veo31.Image2Video: `ly.img.ai.runware/google/veo-3-1/image2video`
|
|
1045
|
+
- Runware Veo31Fast.Text2Video: `ly.img.ai.runware/google/veo-3-1-fast`
|
|
1046
|
+
- Runware Veo31Fast.Image2Video: `ly.img.ai.runware/google/veo-3-1-fast/image2video`
|
|
1047
|
+
- Runware Sora2.Text2Video: `ly.img.ai.runware/openai/sora-2`
|
|
1048
|
+
- Runware Sora2.Image2Video: `ly.img.ai.runware/openai/sora-2/image2video`
|
|
1049
|
+
- Runware Sora2Pro.Text2Video: `ly.img.ai.runware/openai/sora-2-pro`
|
|
1050
|
+
- Runware Sora2Pro.Image2Video: `ly.img.ai.runware/openai/sora-2-pro/image2video`
|
|
902
1051
|
|
|
903
1052
|
### Asset History
|
|
904
1053
|
|
|
@@ -918,6 +1067,14 @@ Generated videos are automatically stored in asset sources with the following ID
|
|
|
918
1067
|
- Veo31ImageToVideo: `fal-ai/veo3.1/image-to-video.history`
|
|
919
1068
|
- Veo31FastImageToVideo: `fal-ai/veo3.1/fast/image-to-video.history`
|
|
920
1069
|
- Veo31FastFirstLastFrameToVideo: `fal-ai/veo3.1/fast/first-last-frame-to-video.history`
|
|
1070
|
+
- Runware Veo31.Text2Video: `runware/google/veo-3-1.history`
|
|
1071
|
+
- Runware Veo31.Image2Video: `runware/google/veo-3-1/image2video.history`
|
|
1072
|
+
- Runware Veo31Fast.Text2Video: `runware/google/veo-3-1-fast.history`
|
|
1073
|
+
- Runware Veo31Fast.Image2Video: `runware/google/veo-3-1-fast/image2video.history`
|
|
1074
|
+
- Runware Sora2.Text2Video: `runware/openai/sora-2.history`
|
|
1075
|
+
- Runware Sora2.Image2Video: `runware/openai/sora-2/image2video.history`
|
|
1076
|
+
- Runware Sora2Pro.Text2Video: `runware/openai/sora-2-pro.history`
|
|
1077
|
+
- Runware Sora2Pro.Image2Video: `runware/openai/sora-2-pro/image2video.history`
|
|
921
1078
|
|
|
922
1079
|
### Dock Integration
|
|
923
1080
|
|