@henjicc/ai-sdk 0.2.8 → 0.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +153 -143
- package/README.md +486 -461
- package/dist/capabilities/embedding/bailian.d.ts +23 -0
- package/dist/capabilities/embedding/bailian.js +10 -0
- package/dist/capabilities/embedding/bigmodel.d.ts +9 -0
- package/dist/capabilities/embedding/bigmodel.js +5 -0
- package/dist/capabilities/embedding/index.d.ts +1 -0
- package/dist/capabilities/embedding/index.js +1 -0
- package/dist/capabilities/embedding/ppio.d.ts +7 -0
- package/dist/capabilities/embedding/ppio.js +5 -0
- package/dist/capabilities/embedding/siliconflow.d.ts +21 -0
- package/dist/capabilities/embedding/siliconflow.js +10 -0
- package/dist/capabilities/embedding/volcengine.d.ts +10 -0
- package/dist/capabilities/embedding/volcengine.js +6 -0
- package/dist/capabilities/rerank/bailian.d.ts +21 -0
- package/dist/capabilities/rerank/bailian.js +14 -0
- package/dist/capabilities/rerank/bigmodel.d.ts +9 -0
- package/dist/capabilities/rerank/bigmodel.js +5 -0
- package/dist/capabilities/rerank/index.d.ts +1 -0
- package/dist/capabilities/rerank/index.js +1 -0
- package/dist/capabilities/rerank/ppio.d.ts +7 -0
- package/dist/capabilities/rerank/ppio.js +5 -0
- package/dist/capabilities/rerank/siliconflow.d.ts +21 -0
- package/dist/capabilities/rerank/siliconflow.js +10 -0
- package/dist/capabilities/retrieval/http.d.ts +3 -0
- package/dist/capabilities/retrieval/http.js +48 -0
- package/dist/capabilities/retrieval/module.d.ts +11 -0
- package/dist/capabilities/retrieval/module.js +110 -0
- package/dist/capabilities/retrieval/types.d.ts +54 -0
- package/dist/capabilities/retrieval/types.js +1 -0
- package/dist/capabilities/retrieval/validation.d.ts +10 -0
- package/dist/capabilities/retrieval/validation.js +65 -0
- package/dist/capabilities/types.d.ts +1 -1
- package/dist/catalog/apimart/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/apimart/gpt-image-2.5.model.js +51 -0
- package/dist/catalog/fal/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/fal/gpt-image-2.5.model.js +53 -0
- package/dist/catalog/fal/ic-light-v2.model.js +9 -13
- package/dist/catalog/grsai/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/grsai/gpt-image-2.5.model.js +54 -0
- package/dist/catalog/grsai/gptImage25Sizes.d.ts +1 -0
- package/dist/catalog/grsai/gptImage25Sizes.js +76 -0
- package/dist/catalog/index.js +112 -104
- package/dist/catalog/kie/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/kie/gpt-image-2.5.model.js +38 -0
- package/dist/catalog/shared/gptImage25.d.ts +16 -0
- package/dist/catalog/shared/gptImage25.js +48 -0
- package/dist/catalog/shared/gptImage25Pricing.d.ts +12 -0
- package/dist/catalog/shared/gptImage25Pricing.js +508 -0
- package/dist/llm/defaults.d.ts +1 -1
- package/dist/llm/defaults.js +1 -1
- package/dist/llm/modelCatalogEntries.js +16 -0
- package/dist/llm/providerPresets.js +2 -2
- package/dist/packs/models/apimart/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/apimart/gpt-image-2.5.js +7 -0
- package/dist/packs/models/fal/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/fal/gpt-image-2.5.js +7 -0
- package/dist/packs/models/grsai/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/grsai/gpt-image-2.5.js +7 -0
- package/dist/packs/models/kie/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/kie/gpt-image-2.5.js +7 -0
- package/dist/packs/provider-packs/apimart.d.ts +1 -1
- package/dist/packs/provider-packs/apimart.js +21 -20
- package/dist/packs/provider-packs/fal.d.ts +1 -1
- package/dist/packs/provider-packs/fal.js +37 -36
- package/dist/packs/provider-packs/grsai.d.ts +1 -1
- package/dist/packs/provider-packs/grsai.js +6 -5
- package/dist/packs/provider-packs/kie.d.ts +1 -1
- package/dist/packs/provider-packs/kie.js +28 -27
- package/dist/packs/tool-models/fal/{qwen-image-edit-2509-multiple-angles.d.ts → qwen-image-edit-2511-multiple-angles.d.ts} +1 -1
- package/dist/packs/tool-models/fal/{qwen-image-edit-2509-multiple-angles.js → qwen-image-edit-2511-multiple-angles.js} +1 -1
- package/dist/packs/tool-packs/fal-multi-angle-tools.js +1 -1
- package/dist/tool-packs/fal-multi-angle/models/qwen-image-edit-2511-multiple-angles.model.d.ts +2 -0
- package/dist/tool-packs/fal-multi-angle/models/{qwen-image-edit-2509-multiple-angles.model.js → qwen-image-edit-2511-multiple-angles.model.js} +20 -17
- package/docs/README.md +26 -26
- package/docs/consumers.md +54 -48
- package/docs/llm-adaptation/README.md +139 -139
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/DeepSeek.md +103 -91
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/Kimi.md +75 -75
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/MiniMax.md +84 -84
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//345/260/217/347/261/263MiMo.md +85 -85
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//346/231/272/350/260/261GLM.md +232 -232
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//347/201/253/345/261/261/345/274/225/346/223/216.md +87 -87
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//347/231/276/347/202/274Qwen.md +84 -84
- package/docs/llm-adaptation//346/226/207/346/241/243/351/207/207/351/233/206/346/211/213/345/206/214.md +88 -88
- package/docs/model-adaptation/Bria-Eraser/Bria-Eraser_Fal.md +32 -32
- package/docs/model-adaptation/Bria-/345/210/233/346/204/217/346/224/276/345/244/247/Bria-/345/210/233/346/204/217/346/224/276/345/244/247_Fal.md +31 -31
- package/docs/model-adaptation/ControlLight/ControlLight_Fal.md +85 -85
- package/docs/model-adaptation/FLUX-2-/345/244/232/350/247/222/345/272/246/FLUX-2-/345/244/232/350/247/222/345/272/246_Fal.md +107 -107
- package/docs/model-adaptation/Finegrain-Eraser/Finegrain-Eraser_Fal.md +31 -31
- package/docs/model-adaptation/Flux-Pro-Erase/Flux-Pro-Erase_Fal.md +34 -34
- package/docs/model-adaptation/Fun-ASR/Fun-ASR_/347/231/276/347/202/274.md +43 -43
- package/docs/model-adaptation/Fun-ASR-Flash-2026-06-15/Fun-ASR-Flash-2026-06-15_/347/231/276/347/202/274.md +41 -41
- package/docs/model-adaptation/Fun-ASR-Realtime/Fun-ASR-Realtime_/347/231/276/347/202/274.md +37 -37
- package/docs/model-adaptation/Fun-ASR-Realtime-2026-02-28/Fun-ASR-Realtime-2026-02-28_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/GLM-5.3-Flash/GLM-5.3-Flash_/346/231/272/350/260/261.md +207 -207
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_APIMart.md +173 -173
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_Fal.md +94 -94
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_Grsai.md +137 -137
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_KIE.md +93 -93
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_APIMart.md +66 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_Fal.md +55 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_Grsai.md +53 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_KIE.md +55 -0
- package/docs/model-adaptation/GPT-OSS-20B/GPT-OSS-20B_Groq.md +62 -62
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_APIMart.md +124 -124
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_Fal.md +84 -84
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_KIE.md +129 -129
- package/docs/model-adaptation/Grok-Imagine/Grok-Imagine_KIE.md +36 -36
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_APIMart.md +250 -250
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_Fal.md +84 -84
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_KIE.md +105 -105
- package/docs/model-adaptation/Hailuo-02/Hailuo-02_Fal.md +93 -93
- package/docs/model-adaptation/Hailuo-02/Hailuo-02_KIE.md +56 -56
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_Fal.md +88 -88
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_KIE.md +51 -51
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_/346/264/276/346/254/247/344/272/221.md +70 -70
- package/docs/model-adaptation/IC-Light-v2/IC-Light-v2_Fal.md +97 -94
- package/docs/model-adaptation/Ideogram-/345/233/276/347/211/207/346/224/276/345/244/247/Ideogram-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +41 -41
- package/docs/model-adaptation/Image-Apps-v2-/345/225/206/345/223/201/346/221/204/345/275/261/Image-Apps-v2-/345/225/206/345/223/201/346/221/204/345/275/261_Fal.md +72 -72
- package/docs/model-adaptation/Image-Apps-v2-/346/211/251/345/233/276/Image-Apps-v2-/346/211/251/345/233/276_Fal.md +93 -93
- package/docs/model-adaptation/Image-Apps-v2-/347/205/247/347/211/207/344/277/256/345/244/215/Image-Apps-v2-/347/205/247/347/211/207/344/277/256/345/244/215_Fal.md +86 -86
- package/docs/model-adaptation/Image-Apps-v2-/351/207/215/346/211/223/345/205/211/Image-Apps-v2-/351/207/215/346/211/223/345/205/211_Fal.md +84 -84
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_APIMart.md +112 -112
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_Fal.md +89 -89
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_KIE.md +106 -106
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_/346/264/276/346/254/247/344/272/221.md +119 -119
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_APIMart.md +125 -125
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_Fal.md +107 -107
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_KIE.md +143 -143
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_APIMart.md +85 -85
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_Fal.md +83 -83
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_KIE.md +84 -84
- package/docs/model-adaptation/Midjourney/Midjourney_APIMart.md +396 -396
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_APIMart.md +234 -234
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_Fal.md +108 -108
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_KIE.md +111 -111
- package/docs/model-adaptation/MiniMax-Speech/MiniMax-Speech_/346/264/276/346/254/247/344/272/221.md +170 -170
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_APIMart.md +89 -89
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_Fal.md +99 -99
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_Grsai.md +82 -82
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_KIE.md +70 -70
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_APIMart.md +79 -79
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_Grsai.md +65 -65
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_KIE.md +64 -64
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_APIMart.md +83 -83
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_Fal.md +89 -89
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_Grsai.md +82 -82
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_KIE.md +64 -64
- package/docs/model-adaptation/Pixelcut-/350/203/214/346/231/257/347/247/273/351/231/244/Pixelcut-/350/203/214/346/231/257/347/247/273/351/231/244_Fal.md +79 -79
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_APIMart.md +117 -117
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_Fal.md +84 -84
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_KIE.md +103 -103
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_/347/231/276/347/202/274.md +138 -138
- package/docs/model-adaptation/Qwen-Image-Edit-2511-/345/244/232/350/247/222/345/272/246/Qwen-Image-Edit-2511-/345/244/232/350/247/222/345/272/246_Fal.md +57 -0
- package/docs/model-adaptation/Qwen-MT-Flash/Qwen-MT-Flash_/347/231/276/347/202/274.md +47 -47
- package/docs/model-adaptation/Qwen-MT-Lite/Qwen-MT-Lite_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/Qwen-MT-Plus/Qwen-MT-Plus_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/Qwen3-ASR-Flash/Qwen3-ASR-Flash_/347/231/276/347/202/274.md +40 -40
- package/docs/model-adaptation/Qwen3-ASR-Flash-2026-02-10/Qwen3-ASR-Flash-2026-02-10_/347/231/276/347/202/274.md +33 -33
- package/docs/model-adaptation/Qwen3-ASR-Flash-Filetrans/Qwen3-ASR-Flash-Filetrans_/347/231/276/347/202/274.md +41 -41
- package/docs/model-adaptation/Qwen3-ASR-Flash-Realtime/Qwen3-ASR-Flash-Realtime_/347/231/276/347/202/274.md +35 -35
- package/docs/model-adaptation/Qwen3-ASR-Flash-Realtime-2026-02-10/Qwen3-ASR-Flash-Realtime-2026-02-10_/347/231/276/347/202/274.md +37 -37
- package/docs/model-adaptation/README.md +313 -295
- package/docs/model-adaptation/SeedASR-2.0-File/SeedASR-2.0-File_/347/201/253/345/261/261/345/274/225/346/223/216.md +115 -115
- package/docs/model-adaptation/SeedASR-2.0-Realtime/SeedASR-2.0-Realtime_/347/201/253/345/261/261/345/274/225/346/223/216.md +143 -143
- package/docs/model-adaptation/SeedVR2-/345/233/276/347/211/207/346/224/276/345/244/247/SeedVR2-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +45 -45
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_APIMart.md +121 -121
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_Fal.md +97 -97
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_KIE.md +86 -86
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_APIMart.md +89 -89
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_Fal.md +95 -95
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_KIE.md +78 -78
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_APIMart.md +89 -89
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_Fal.md +96 -96
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_KIE.md +78 -78
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_APIMart.md +212 -212
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_Fal.md +94 -94
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_KIE.md +89 -89
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_APIMart.md +106 -106
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_Fal.md +91 -91
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_KIE.md +89 -89
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_/347/201/253/345/261/261/345/274/225/346/223/216.md +108 -108
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_APIMart.md +194 -194
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_Fal.md +100 -100
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_KIE.md +141 -141
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_/347/201/253/345/261/261/345/274/225/346/223/216.md +137 -137
- package/docs/model-adaptation/SenseVoiceSmall/SenseVoiceSmall_/347/241/205/345/237/272/346/265/201/345/212/250.md +69 -69
- package/docs/model-adaptation/TeleSpeechASR/TeleSpeechASR_/347/241/205/345/237/272/346/265/201/345/212/250.md +72 -72
- package/docs/model-adaptation/Topaz-/345/233/276/347/211/207/346/224/276/345/244/247/Topaz-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +87 -87
- package/docs/model-adaptation/Topaz-/351/200/217/346/230/216/345/233/276/346/224/276/345/244/247/Topaz-/351/200/217/346/230/216/345/233/276/346/224/276/345/244/247_Fal.md +34 -34
- package/docs/model-adaptation/Wan-2.5-Preview/Wan-2.5-Preview_/346/264/276/346/254/247/344/272/221.md +82 -82
- package/docs/model-adaptation/Wan-2.6/Wan-2.6_/346/264/276/346/254/247/344/272/221.md +84 -84
- package/docs/model-adaptation/Wan-2.7/Wan-2.7_/346/264/276/346/254/247/344/272/221.md +122 -122
- package/docs/model-adaptation/Whisper-Large-v3/Whisper-Large-v3_Groq.md +76 -76
- package/docs/model-adaptation/Whisper-Large-v3-Turbo/Whisper-Large-v3-Turbo_Groq.md +75 -75
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_APIMart.md +88 -88
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_Fal.md +95 -95
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_KIE.md +71 -71
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_/347/231/276/347/202/274.md +122 -122
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_/351/255/224/346/220/255.md +97 -97
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/APIMart.md +238 -238
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Fal.md +172 -172
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Groq.md +121 -121
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Grsai.md +217 -217
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/KIE.md +131 -131
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//345/200/231/351/200/211/344/276/233/345/272/224/345/225/206/350/260/203/347/240/224-/345/233/276/347/211/207/345/267/245/345/205/267.md +151 -151
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//345/277/253/351/200/237/351/200/202/351/205/215/344/276/233/345/272/224/345/225/206.md +65 -65
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//346/264/276/346/254/247/344/272/221.md +147 -138
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/201/253/345/261/261/345/274/225/346/223/216.md +181 -171
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/231/276/347/202/274.md +237 -227
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/241/205/345/237/272/346/265/201/345/212/250.md +110 -88
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//351/255/224/346/220/255.md +207 -207
- package/docs/model-adaptation//346/226/207/346/241/243/351/207/207/351/233/206/346/211/213/345/206/214.md +338 -311
- package/docs/model-adaptation//351/200/217/350/247/206/345/217/230/346/215/242//351/200/217/350/247/206/345/217/230/346/215/242_Fal.md +59 -59
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/Electron.md +77 -77
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/Tauri.md +81 -81
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/UXP.md +169 -169
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227//344/276/233/345/272/224/345/225/206/345/237/237/345/220/215.md +83 -83
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227//351/224/231/350/257/257/345/244/204/347/220/206.md +72 -72
- package/examples/form-renderer/README.md +17 -17
- package/examples/form-renderer/cli.ts +32 -32
- package/examples/form-renderer/index.ts +144 -144
- package/examples/form-renderer/package.json +16 -16
- package/examples/form-renderer/tsconfig.json +14 -14
- package/examples/llm-chat/README.md +32 -32
- package/examples/llm-chat/index.ts +100 -100
- package/examples/llm-chat/package.json +19 -19
- package/examples/llm-chat/tsconfig.json +14 -14
- package/examples/minimal-node/README.md +31 -31
- package/examples/minimal-node/index.ts +138 -138
- package/examples/minimal-node/package.json +17 -17
- package/examples/minimal-node/tsconfig.json +14 -14
- package/package.json +252 -197
- package/dist/tool-packs/fal-multi-angle/models/qwen-image-edit-2509-multiple-angles.model.d.ts +0 -2
- package/docs/model-adaptation/Qwen-Image-Edit-2509-/345/244/232/350/247/222/345/272/246/Qwen-Image-Edit-2509-/345/244/232/350/247/222/345/272/246_Fal.md +0 -116
|
@@ -1,84 +1,84 @@
|
|
|
1
|
-
# Gemini Omni Flash · Fal
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-22 |
|
|
6
|
-
| 模态 | 视频 |
|
|
7
|
-
| 供应商 | fal.ai(聚合平台) |
|
|
8
|
-
| 平台模型 ID | `google/gemini-omni-flash/image-to-video`、`google/gemini-omni-flash/reference-to-video` |
|
|
9
|
-
| 接口形态 | 队列异步(推荐)或同步直连 |
|
|
10
|
-
| 文档可见性 | 公开,无需登录 |
|
|
11
|
-
| 价格可见性 | 公开,无需登录 |
|
|
12
|
-
|
|
13
|
-
> **Fal 上没有 `google/gemini-omni-flash/text-to-video` 端点**(2026-08-22 实测返回 404)。纯文生视频只能走 APIMart 或 KIE。
|
|
14
|
-
|
|
15
|
-
## 1. 接入协议(Fal 通用)
|
|
16
|
-
|
|
17
|
-
- **鉴权**:`Authorization: Key $FAL_KEY`
|
|
18
|
-
- **同步**:`POST https://fal.run/<endpoint-id>`;**队列**:`POST https://queue.fal.run/<endpoint-id>`,`GET .../requests/{id}/status`(`IN_QUEUE` / `IN_PROGRESS` / `COMPLETED`)、`GET .../requests/{id}`
|
|
19
|
-
- **权威 schema**:`https://fal.ai/models/<endpoint-id>/llms.txt`
|
|
20
|
-
|
|
21
|
-
## 2. 能力清单
|
|
22
|
-
|
|
23
|
-
| 能力 | endpoint id |
|
|
24
|
-
|---|---|
|
|
25
|
-
| 图生视频 | `google/gemini-omni-flash/image-to-video` |
|
|
26
|
-
| 参考生视频(多参考图) | `google/gemini-omni-flash/reference-to-video` |
|
|
27
|
-
|
|
28
|
-
## 3. 请求参数
|
|
29
|
-
|
|
30
|
-
### 3.1 `google/gemini-omni-flash/image-to-video`
|
|
31
|
-
|
|
32
|
-
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
33
|
-
|---|---|---|---|---|
|
|
34
|
-
| `prompt` | string | **必填** | — | 描述图片应如何被动画化 |
|
|
35
|
-
| `image_url` | string | **必填** | — | 待动画化的输入图 URL |
|
|
36
|
-
| `aspect_ratio` | string | 可选 | `16:9` | **仅 `16:9` / `9:16`** |
|
|
37
|
-
| `duration` | integer | 可选 | **`8`** | **3 ~ 10 秒**(整数,注意 APIMart Ext / KIE 只允许 4/6/8/10) |
|
|
38
|
-
|
|
39
|
-
### 3.2 `google/gemini-omni-flash/reference-to-video`
|
|
40
|
-
|
|
41
|
-
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
42
|
-
|---|---|---|---|---|
|
|
43
|
-
| `prompt` | string | **必填** | — | 视频描述。**可用 `<IMAGE_REF_0>` 这样的标签把参考图内联绑定到角色**(见 Fal 的 Omni Flash prompt guide) |
|
|
44
|
-
| `image_urls` | string[] | **必填** | — | 要融入视频的参考图 URL 列表 |
|
|
45
|
-
| `aspect_ratio` | string | 可选 | `16:9` | `16:9` / `9:16` |
|
|
46
|
-
| `duration` | integer | 可选 | `8` | 3 ~ 10 秒 |
|
|
47
|
-
|
|
48
|
-
## 4. 响应结构
|
|
49
|
-
|
|
50
|
-
```json
|
|
51
|
-
{ "video": { "url": "https://v3b.fal.media/files/.../output.mp4" } }
|
|
52
|
-
```
|
|
53
|
-
|
|
54
|
-
## 5. 价格(按 token)
|
|
55
|
-
|
|
56
|
-
来源:两个端点的 `llms.txt`(2026-08-22 读取)。
|
|
57
|
-
|
|
58
|
-
| 计费项 | 单价 |
|
|
59
|
-
|---|---|
|
|
60
|
-
| 输入 token(文本 / 音频 / 视频) | **$1.875 / 1M tokens** |
|
|
61
|
-
| 输出 token | **$21.875 / 1M tokens** |
|
|
62
|
-
|
|
63
|
-
**720p 视频约合 $0.13 / 秒。**
|
|
64
|
-
|
|
65
|
-
## 6. 适配要点
|
|
66
|
-
|
|
67
|
-
- 本项目默认**绝对不显示**:`seed`、负面提示词。Fal 本端点两个字段都没有。
|
|
68
|
-
- **Fal 没有纯文生视频端点**,产品若要文生视频必须走别的供应商。
|
|
69
|
-
- **`duration` 是整数且支持 3–10 的连续取值**,默认 8;而 APIMart 的 Ext 渠道与 KIE 都只允许 4/6/8/10——跨供应商的时长选项必须分别裁剪。
|
|
70
|
-
- `aspect_ratio` 只有横竖两种,没有 1:1。
|
|
71
|
-
- 参考图的角色绑定用 `<IMAGE_REF_0>` 标签,与 APIMart 官方渠道(自然语言描述)、KIE(character_ids 资产)都不同。
|
|
72
|
-
- 按 token 计费,成本估算不能按次或按秒简单换算。
|
|
73
|
-
- Fal 上没有 KIE 那套语音 / 角色资产端点。
|
|
74
|
-
|
|
75
|
-
## 7. 原始链接索引
|
|
76
|
-
|
|
77
|
-
| 信息 | 链接 | 是否需登录 |
|
|
78
|
-
|---|---|---|
|
|
79
|
-
| 图生视频模型页 | https://fal.ai/models/google/gemini-omni-flash/image-to-video | 否 |
|
|
80
|
-
| 图生视频 schema + 价格 | https://fal.ai/models/google/gemini-omni-flash/image-to-video/llms.txt | 否 |
|
|
81
|
-
| 参考生视频模型页 | https://fal.ai/models/google/gemini-omni-flash/reference-to-video | 否 |
|
|
82
|
-
| 参考生视频 schema + 价格 | https://fal.ai/models/google/gemini-omni-flash/reference-to-video/llms.txt | 否 |
|
|
83
|
-
| 队列协议 | https://fal.ai/docs/documentation/model-apis/inference/queue | 否 |
|
|
84
|
-
| API Key 创建 | https://fal.ai/dashboard/keys | **是** |
|
|
1
|
+
# Gemini Omni Flash · Fal
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-22 |
|
|
6
|
+
| 模态 | 视频 |
|
|
7
|
+
| 供应商 | fal.ai(聚合平台) |
|
|
8
|
+
| 平台模型 ID | `google/gemini-omni-flash/image-to-video`、`google/gemini-omni-flash/reference-to-video` |
|
|
9
|
+
| 接口形态 | 队列异步(推荐)或同步直连 |
|
|
10
|
+
| 文档可见性 | 公开,无需登录 |
|
|
11
|
+
| 价格可见性 | 公开,无需登录 |
|
|
12
|
+
|
|
13
|
+
> **Fal 上没有 `google/gemini-omni-flash/text-to-video` 端点**(2026-08-22 实测返回 404)。纯文生视频只能走 APIMart 或 KIE。
|
|
14
|
+
|
|
15
|
+
## 1. 接入协议(Fal 通用)
|
|
16
|
+
|
|
17
|
+
- **鉴权**:`Authorization: Key $FAL_KEY`
|
|
18
|
+
- **同步**:`POST https://fal.run/<endpoint-id>`;**队列**:`POST https://queue.fal.run/<endpoint-id>`,`GET .../requests/{id}/status`(`IN_QUEUE` / `IN_PROGRESS` / `COMPLETED`)、`GET .../requests/{id}`
|
|
19
|
+
- **权威 schema**:`https://fal.ai/models/<endpoint-id>/llms.txt`
|
|
20
|
+
|
|
21
|
+
## 2. 能力清单
|
|
22
|
+
|
|
23
|
+
| 能力 | endpoint id |
|
|
24
|
+
|---|---|
|
|
25
|
+
| 图生视频 | `google/gemini-omni-flash/image-to-video` |
|
|
26
|
+
| 参考生视频(多参考图) | `google/gemini-omni-flash/reference-to-video` |
|
|
27
|
+
|
|
28
|
+
## 3. 请求参数
|
|
29
|
+
|
|
30
|
+
### 3.1 `google/gemini-omni-flash/image-to-video`
|
|
31
|
+
|
|
32
|
+
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
33
|
+
|---|---|---|---|---|
|
|
34
|
+
| `prompt` | string | **必填** | — | 描述图片应如何被动画化 |
|
|
35
|
+
| `image_url` | string | **必填** | — | 待动画化的输入图 URL |
|
|
36
|
+
| `aspect_ratio` | string | 可选 | `16:9` | **仅 `16:9` / `9:16`** |
|
|
37
|
+
| `duration` | integer | 可选 | **`8`** | **3 ~ 10 秒**(整数,注意 APIMart Ext / KIE 只允许 4/6/8/10) |
|
|
38
|
+
|
|
39
|
+
### 3.2 `google/gemini-omni-flash/reference-to-video`
|
|
40
|
+
|
|
41
|
+
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
42
|
+
|---|---|---|---|---|
|
|
43
|
+
| `prompt` | string | **必填** | — | 视频描述。**可用 `<IMAGE_REF_0>` 这样的标签把参考图内联绑定到角色**(见 Fal 的 Omni Flash prompt guide) |
|
|
44
|
+
| `image_urls` | string[] | **必填** | — | 要融入视频的参考图 URL 列表 |
|
|
45
|
+
| `aspect_ratio` | string | 可选 | `16:9` | `16:9` / `9:16` |
|
|
46
|
+
| `duration` | integer | 可选 | `8` | 3 ~ 10 秒 |
|
|
47
|
+
|
|
48
|
+
## 4. 响应结构
|
|
49
|
+
|
|
50
|
+
```json
|
|
51
|
+
{ "video": { "url": "https://v3b.fal.media/files/.../output.mp4" } }
|
|
52
|
+
```
|
|
53
|
+
|
|
54
|
+
## 5. 价格(按 token)
|
|
55
|
+
|
|
56
|
+
来源:两个端点的 `llms.txt`(2026-08-22 读取)。
|
|
57
|
+
|
|
58
|
+
| 计费项 | 单价 |
|
|
59
|
+
|---|---|
|
|
60
|
+
| 输入 token(文本 / 音频 / 视频) | **$1.875 / 1M tokens** |
|
|
61
|
+
| 输出 token | **$21.875 / 1M tokens** |
|
|
62
|
+
|
|
63
|
+
**720p 视频约合 $0.13 / 秒。**
|
|
64
|
+
|
|
65
|
+
## 6. 适配要点
|
|
66
|
+
|
|
67
|
+
- 本项目默认**绝对不显示**:`seed`、负面提示词。Fal 本端点两个字段都没有。
|
|
68
|
+
- **Fal 没有纯文生视频端点**,产品若要文生视频必须走别的供应商。
|
|
69
|
+
- **`duration` 是整数且支持 3–10 的连续取值**,默认 8;而 APIMart 的 Ext 渠道与 KIE 都只允许 4/6/8/10——跨供应商的时长选项必须分别裁剪。
|
|
70
|
+
- `aspect_ratio` 只有横竖两种,没有 1:1。
|
|
71
|
+
- 参考图的角色绑定用 `<IMAGE_REF_0>` 标签,与 APIMart 官方渠道(自然语言描述)、KIE(character_ids 资产)都不同。
|
|
72
|
+
- 按 token 计费,成本估算不能按次或按秒简单换算。
|
|
73
|
+
- Fal 上没有 KIE 那套语音 / 角色资产端点。
|
|
74
|
+
|
|
75
|
+
## 7. 原始链接索引
|
|
76
|
+
|
|
77
|
+
| 信息 | 链接 | 是否需登录 |
|
|
78
|
+
|---|---|---|
|
|
79
|
+
| 图生视频模型页 | https://fal.ai/models/google/gemini-omni-flash/image-to-video | 否 |
|
|
80
|
+
| 图生视频 schema + 价格 | https://fal.ai/models/google/gemini-omni-flash/image-to-video/llms.txt | 否 |
|
|
81
|
+
| 参考生视频模型页 | https://fal.ai/models/google/gemini-omni-flash/reference-to-video | 否 |
|
|
82
|
+
| 参考生视频 schema + 价格 | https://fal.ai/models/google/gemini-omni-flash/reference-to-video/llms.txt | 否 |
|
|
83
|
+
| 队列协议 | https://fal.ai/docs/documentation/model-apis/inference/queue | 否 |
|
|
84
|
+
| API Key 创建 | https://fal.ai/dashboard/keys | **是** |
|
|
@@ -1,129 +1,129 @@
|
|
|
1
|
-
# Gemini Omni Flash · KIE
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-22 |
|
|
6
|
-
| 模态 | 视频(配套语音与角色能力) |
|
|
7
|
-
| 供应商 | KIE.ai(聚合平台) |
|
|
8
|
-
| 平台模型 ID / 端点 | `gemini-omni-video`(任务)、`POST /api/v1/omni/audio/create`、`POST /api/v1/omni/character/create` |
|
|
9
|
-
| 接口形态 | 视频走**异步任务**;语音与角色是**独立的同步创建端点** |
|
|
10
|
-
| 文档可见性 | 公开,无需登录 |
|
|
11
|
-
| 价格可见性 | 公开,无需登录 |
|
|
12
|
-
|
|
13
|
-
> ⚠️ KIE 的 Gemini Omni 是**三个端点组成的一套体系**:先用 `omni/audio/create` 造语音、用 `omni/character/create` 造角色,再把拿到的 `audio_ids` / `character_ids` 喂给 `gemini-omni-video`。上一版适配只做了视频生成,**语音与角色两块完全遗漏**。
|
|
14
|
-
|
|
15
|
-
## 1. 接入协议
|
|
16
|
-
|
|
17
|
-
- **Base URL**:`https://api.kie.ai`
|
|
18
|
-
- **鉴权**:`Authorization: Bearer <API_KEY>`
|
|
19
|
-
- **视频提交**:`POST /api/v1/jobs/createTask`,体为 `{ model: "gemini-omni-video", callBackUrl?, input }`
|
|
20
|
-
- **视频查询**:`GET /api/v1/jobs/recordInfo?taskId=...`,`JSON.parse(resultJson)` → `{ resultUrls: [...] }`
|
|
21
|
-
- **语音创建**:`POST /api/v1/omni/audio/create`
|
|
22
|
-
- **角色创建**:`POST /api/v1/omni/character/create`
|
|
23
|
-
|
|
24
|
-
## 2. 端点 A:`gemini-omni-video`(多模态视频生成)
|
|
25
|
-
|
|
26
|
-
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
27
|
-
|---|---|---|---|---|
|
|
28
|
-
| `input.prompt` | string | **必填** | — | 视频提示词,最多 **20000** 字符。描述画面内容、风格、镜头语言或角色行为 |
|
|
29
|
-
| `input.image_urls` | array | 可选 | — | 参考图片。单个文件 ≤ **20 MB**;须公开可访问;**最多 7 张** |
|
|
30
|
-
| `input.audio_ids` | array | 可选 | — | 由 **`gemini-omni-audio`** 接口生成的音频 ID 数组,用于旁白 / 对白 / 配乐 / 声音参考。**最多 3 个** |
|
|
31
|
-
| `input.video_list` | array | 可选 | — | 视频片段数组。**最多 1 个,且占用 2 张图片额度**。每项 `{ url, start, ends }`:单个文件 ≤ **100 MB**、视频时长 ≤ **30 s**、`ends > start` 且 **`ends - start` ≤ 10 s** |
|
|
32
|
-
| `input.character_ids` | array | 可选 | — | 由 **`gemini-omni-character`** 接口生成的角色 ID 数组。**每个 `character_id` 占用 1 个 image slot;基础最多 7 个;若同时传 `video_list`(占 2 个 slot),`character_ids` 最多 3 个** |
|
|
33
|
-
| `input.duration` | string | **必填** | — | **`"4"` / `"6"` / `"8"` / `"10"`(字符串)**。**仅在无视频输入时生效**;有视频输入时输出时长由模型决定,本参数被忽略 |
|
|
34
|
-
| `input.aspect_ratio` | string | 可选 | — | `16:9`(横屏)/ `9:16`(竖屏) |
|
|
35
|
-
| `input.seed` | integer | 可选 | 自动 | `[0, 2147483647]`。**本项目规则:绝对不显示**,不下发 |
|
|
36
|
-
| `input.resolution` | string | 可选 | `720p` | `720p` / `1080p` / `4k` |
|
|
37
|
-
|
|
38
|
-
### image slot 计算(关键约束)
|
|
39
|
-
|
|
40
|
-
图片额度总共 **7 个 slot**,被以下三者共同占用:
|
|
41
|
-
- 每张 `image_urls` 图片:1 slot
|
|
42
|
-
- 每个 `character_ids`:1 slot
|
|
43
|
-
- `video_list`(最多 1 个):**2 slot**
|
|
44
|
-
|
|
45
|
-
因此有视频输入时,`character_ids` 最多 3 个。UI 计数必须按这个规则统一算。
|
|
46
|
-
|
|
47
|
-
## 3. 端点 B:`POST /api/v1/omni/audio/create`(生语音)
|
|
48
|
-
|
|
49
|
-
| 字段 | 类型 | 必填 | 说明 |
|
|
50
|
-
|---|---|---|---|
|
|
51
|
-
| `audio_id` | string | **必填** | 预设语音角色枚举(30 个,见下) |
|
|
52
|
-
| `name` | string | **必填** | 语音名称,最长 **210** 字符 |
|
|
53
|
-
| `voice_description` | string | 可选 | 语音特征描述(音色、风格、语速、情绪),最长 **20000** 字符 |
|
|
54
|
-
| `example_dialogue` | string | 可选 | 对话示例(如「你好,我是Adam」),最长 **120** 字符 |
|
|
55
|
-
|
|
56
|
-
### `audio_id` 预设音色全表
|
|
57
|
-
|
|
58
|
-
| ID | 描述 | ID | 描述 |
|
|
59
|
-
|---|---|---|---|
|
|
60
|
-
| `achernar` | 女声,柔和,高音调 | `laomedeia` | 女声,欢快,中高音调 |
|
|
61
|
-
| `achird` | 男声,友好,中音调 | `leda` | 女声,年轻,中高音调 |
|
|
62
|
-
| `algenib` | 男声,沙哑,低音调 | `orus` | 男声,沉稳,中低音调 |
|
|
63
|
-
| `algieba` | 男声,随和,中低音调 | `puck` | 男声,欢快,中音调 |
|
|
64
|
-
| `alnilam` | 男声,沉稳,中低音调 | `pulcherrima` | 无性别,前置感,中高音调 |
|
|
65
|
-
| `aoede` | 女声,轻快,中音调 | `rasalgethi` | 男声,知性,中音调 |
|
|
66
|
-
| `autonoe` | 女声,明亮,中音调 | `sadachbia` | 男声,生动,低音调 |
|
|
67
|
-
| `callirrhoe` | 女声,随和,中音调 | `sadaltager` | 男声,博学,中音调 |
|
|
68
|
-
| `charon` | 男声,知性,低音调 | `schedar` | 男声,平稳,中低音调 |
|
|
69
|
-
| `despina` | 女声,流畅,中音调 | `sulafat` | 女声,温暖,中音调 |
|
|
70
|
-
| `enceladus` | 男声,气声,低音调 | `umbriel` | 男声,流畅,低音调 |
|
|
71
|
-
| `erinome` | 女声,清晰,中音调 | `vindemiatrix` | 女声,温柔,中音调 |
|
|
72
|
-
| `fenrir` | 男声,活泼,偏年轻音调 | `zephyr` | 女声,明亮,中高音调 |
|
|
73
|
-
| `gacrux` | 女声,成熟,中音调 | `zubenelgenubi` | 男声,随性,中低音调 |
|
|
74
|
-
| `iapetus` | 男声,清晰,中低音调 | `kore` | 女声,干练,中音调 |
|
|
75
|
-
|
|
76
|
-
## 4. 端点 C:`POST /api/v1/omni/character/create`(生角色)
|
|
77
|
-
|
|
78
|
-
| 字段 | 类型 | 必填 | 说明 |
|
|
79
|
-
|---|---|---|---|
|
|
80
|
-
| `descriptions` | string | **必填** | 角色描述:外观、身份、风格、服饰或性格设定 |
|
|
81
|
-
| `image_urls` | array | **必填** | 角色参考图,**仅支持 1 张**。单张 ≤ **20 MB**,须公开可访问 |
|
|
82
|
-
| `audio_ids` | array | 可选 | 由 `gemini-omni-audio` 生成的音频 ID,用于补充声音特征、语气或人设参考 |
|
|
83
|
-
| `character_name` | string | 可选 | 角色名称 |
|
|
84
|
-
|
|
85
|
-
## 5. 价格
|
|
86
|
-
|
|
87
|
-
来源:[KIE 定价页](https://kie.ai/pricing)(2026-08-22 读取,搜索 `gemini-omni`;1 Credit = $0.005)。**按次(per video)计费,不是按秒。**
|
|
88
|
-
|
|
89
|
-
| 规格 | 积分 | 我们的价格 | 官方 / Fal 参考价 | 节省 |
|
|
90
|
-
|---|---|---|---|---|
|
|
91
|
-
| 720p 4s 无视频输入 | 63 /条 | **$0.315/条** | $0.5 | 37.0% |
|
|
92
|
-
| 720p 6s 无视频输入 | 84 /条 | **$0.42/条** | $0.75 | 44.0% |
|
|
93
|
-
| 720p 8s 无视频输入 | 105 /条 | **$0.525/条** | $1 | 47.5% |
|
|
94
|
-
| 720p 10s 无视频输入 | 126 /条 | **$0.63/条** | $1.25 | 49.6% |
|
|
95
|
-
| 1080p 4s 无视频输入 | 63 /条 | **$0.315/条** | N/A | — |
|
|
96
|
-
| 1080p 6s 无视频输入 | 84 /条 | **$0.42/条** | N/A | — |
|
|
97
|
-
| 1080p 8s 无视频输入 | 105 /条 | **$0.525/条** | N/A | — |
|
|
98
|
-
| 1080p 10s 无视频输入 | 126 /条 | **$0.63/条** | N/A | — |
|
|
99
|
-
| 4k 4s 无视频输入 | 147 /条 | **$0.735/条** | N/A | — |
|
|
100
|
-
| 4k 6s 无视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
101
|
-
| 4k 8s 无视频输入 | 189 /条 | **$0.945/条** | N/A | — |
|
|
102
|
-
| 4k 10s 无视频输入 | 210 /条 | **$1.05/条** | N/A | — |
|
|
103
|
-
| 720p 有视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
104
|
-
| 1080p 有视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
105
|
-
| 4k 有视频输入 | 252 /条 | **$1.26/条** | N/A | — |
|
|
106
|
-
|
|
107
|
-
定价页未列出 `omni/audio/create` 与 `omni/character/create` 的价格,接入前需确认这两个端点是否单独计费。
|
|
108
|
-
|
|
109
|
-
## 6. 适配要点
|
|
110
|
-
|
|
111
|
-
- 本项目默认**绝对不显示**:`seed`、负面提示词。KIE 的 `gemini-omni-video` **有 `seed`**,必须主动不注册、不下发。
|
|
112
|
-
- **这是一套三端点体系**,语音与角色是可复用资产(先创建拿 ID,再在视频里引用),需要独立的资产管理交互,不能塞进单次生成的参数面板。
|
|
113
|
-
- **image slot 是共享额度**(图片 1 / 角色 1 / 视频 2,总计 7),前端计数必须统一。
|
|
114
|
-
- `duration` 是**字符串**且只有 4/6/8/10;**有视频输入时该参数静默失效**。
|
|
115
|
-
- **按次计费**:720p 与 1080p 同价,4k 更贵;有视频输入时价格固定且明显更高。
|
|
116
|
-
- `video_list` 的截取窗口 `ends - start` 必须 ≤ 10 秒。
|
|
117
|
-
- `resultJson` 是 JSON 字符串,必须二次 parse。
|
|
118
|
-
|
|
119
|
-
## 7. 原始链接索引
|
|
120
|
-
|
|
121
|
-
| 信息 | 链接 | 是否需登录 |
|
|
122
|
-
|---|---|---|
|
|
123
|
-
| Gemini Omni 生视频 | https://docs.kie.ai/cn/market/gemini-omni-video | 否 |
|
|
124
|
-
| Gemini Omni Audio 生语音 | https://docs.kie.ai/cn/market/gemini-omni-audio | 否 |
|
|
125
|
-
| Gemini Omni Character 生角色 | https://docs.kie.ai/cn/market/gemini-omni-character | 否 |
|
|
126
|
-
| 获取任务详情 | https://docs.kie.ai/cn/market/common/get-task-detail | 否 |
|
|
127
|
-
| 通用 API 快速入门 | https://docs.kie.ai/cn/common-api/quickstart | 否 |
|
|
128
|
-
| 定价页(搜 `gemini-omni`) | https://kie.ai/pricing | 否 |
|
|
129
|
-
| API Key 管理 | https://kie.ai/api-key | **是** |
|
|
1
|
+
# Gemini Omni Flash · KIE
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-22 |
|
|
6
|
+
| 模态 | 视频(配套语音与角色能力) |
|
|
7
|
+
| 供应商 | KIE.ai(聚合平台) |
|
|
8
|
+
| 平台模型 ID / 端点 | `gemini-omni-video`(任务)、`POST /api/v1/omni/audio/create`、`POST /api/v1/omni/character/create` |
|
|
9
|
+
| 接口形态 | 视频走**异步任务**;语音与角色是**独立的同步创建端点** |
|
|
10
|
+
| 文档可见性 | 公开,无需登录 |
|
|
11
|
+
| 价格可见性 | 公开,无需登录 |
|
|
12
|
+
|
|
13
|
+
> ⚠️ KIE 的 Gemini Omni 是**三个端点组成的一套体系**:先用 `omni/audio/create` 造语音、用 `omni/character/create` 造角色,再把拿到的 `audio_ids` / `character_ids` 喂给 `gemini-omni-video`。上一版适配只做了视频生成,**语音与角色两块完全遗漏**。
|
|
14
|
+
|
|
15
|
+
## 1. 接入协议
|
|
16
|
+
|
|
17
|
+
- **Base URL**:`https://api.kie.ai`
|
|
18
|
+
- **鉴权**:`Authorization: Bearer <API_KEY>`
|
|
19
|
+
- **视频提交**:`POST /api/v1/jobs/createTask`,体为 `{ model: "gemini-omni-video", callBackUrl?, input }`
|
|
20
|
+
- **视频查询**:`GET /api/v1/jobs/recordInfo?taskId=...`,`JSON.parse(resultJson)` → `{ resultUrls: [...] }`
|
|
21
|
+
- **语音创建**:`POST /api/v1/omni/audio/create`
|
|
22
|
+
- **角色创建**:`POST /api/v1/omni/character/create`
|
|
23
|
+
|
|
24
|
+
## 2. 端点 A:`gemini-omni-video`(多模态视频生成)
|
|
25
|
+
|
|
26
|
+
| 字段 | 类型 | 必填 | 默认 | 取值与说明 |
|
|
27
|
+
|---|---|---|---|---|
|
|
28
|
+
| `input.prompt` | string | **必填** | — | 视频提示词,最多 **20000** 字符。描述画面内容、风格、镜头语言或角色行为 |
|
|
29
|
+
| `input.image_urls` | array | 可选 | — | 参考图片。单个文件 ≤ **20 MB**;须公开可访问;**最多 7 张** |
|
|
30
|
+
| `input.audio_ids` | array | 可选 | — | 由 **`gemini-omni-audio`** 接口生成的音频 ID 数组,用于旁白 / 对白 / 配乐 / 声音参考。**最多 3 个** |
|
|
31
|
+
| `input.video_list` | array | 可选 | — | 视频片段数组。**最多 1 个,且占用 2 张图片额度**。每项 `{ url, start, ends }`:单个文件 ≤ **100 MB**、视频时长 ≤ **30 s**、`ends > start` 且 **`ends - start` ≤ 10 s** |
|
|
32
|
+
| `input.character_ids` | array | 可选 | — | 由 **`gemini-omni-character`** 接口生成的角色 ID 数组。**每个 `character_id` 占用 1 个 image slot;基础最多 7 个;若同时传 `video_list`(占 2 个 slot),`character_ids` 最多 3 个** |
|
|
33
|
+
| `input.duration` | string | **必填** | — | **`"4"` / `"6"` / `"8"` / `"10"`(字符串)**。**仅在无视频输入时生效**;有视频输入时输出时长由模型决定,本参数被忽略 |
|
|
34
|
+
| `input.aspect_ratio` | string | 可选 | — | `16:9`(横屏)/ `9:16`(竖屏) |
|
|
35
|
+
| `input.seed` | integer | 可选 | 自动 | `[0, 2147483647]`。**本项目规则:绝对不显示**,不下发 |
|
|
36
|
+
| `input.resolution` | string | 可选 | `720p` | `720p` / `1080p` / `4k` |
|
|
37
|
+
|
|
38
|
+
### image slot 计算(关键约束)
|
|
39
|
+
|
|
40
|
+
图片额度总共 **7 个 slot**,被以下三者共同占用:
|
|
41
|
+
- 每张 `image_urls` 图片:1 slot
|
|
42
|
+
- 每个 `character_ids`:1 slot
|
|
43
|
+
- `video_list`(最多 1 个):**2 slot**
|
|
44
|
+
|
|
45
|
+
因此有视频输入时,`character_ids` 最多 3 个。UI 计数必须按这个规则统一算。
|
|
46
|
+
|
|
47
|
+
## 3. 端点 B:`POST /api/v1/omni/audio/create`(生语音)
|
|
48
|
+
|
|
49
|
+
| 字段 | 类型 | 必填 | 说明 |
|
|
50
|
+
|---|---|---|---|
|
|
51
|
+
| `audio_id` | string | **必填** | 预设语音角色枚举(30 个,见下) |
|
|
52
|
+
| `name` | string | **必填** | 语音名称,最长 **210** 字符 |
|
|
53
|
+
| `voice_description` | string | 可选 | 语音特征描述(音色、风格、语速、情绪),最长 **20000** 字符 |
|
|
54
|
+
| `example_dialogue` | string | 可选 | 对话示例(如「你好,我是Adam」),最长 **120** 字符 |
|
|
55
|
+
|
|
56
|
+
### `audio_id` 预设音色全表
|
|
57
|
+
|
|
58
|
+
| ID | 描述 | ID | 描述 |
|
|
59
|
+
|---|---|---|---|
|
|
60
|
+
| `achernar` | 女声,柔和,高音调 | `laomedeia` | 女声,欢快,中高音调 |
|
|
61
|
+
| `achird` | 男声,友好,中音调 | `leda` | 女声,年轻,中高音调 |
|
|
62
|
+
| `algenib` | 男声,沙哑,低音调 | `orus` | 男声,沉稳,中低音调 |
|
|
63
|
+
| `algieba` | 男声,随和,中低音调 | `puck` | 男声,欢快,中音调 |
|
|
64
|
+
| `alnilam` | 男声,沉稳,中低音调 | `pulcherrima` | 无性别,前置感,中高音调 |
|
|
65
|
+
| `aoede` | 女声,轻快,中音调 | `rasalgethi` | 男声,知性,中音调 |
|
|
66
|
+
| `autonoe` | 女声,明亮,中音调 | `sadachbia` | 男声,生动,低音调 |
|
|
67
|
+
| `callirrhoe` | 女声,随和,中音调 | `sadaltager` | 男声,博学,中音调 |
|
|
68
|
+
| `charon` | 男声,知性,低音调 | `schedar` | 男声,平稳,中低音调 |
|
|
69
|
+
| `despina` | 女声,流畅,中音调 | `sulafat` | 女声,温暖,中音调 |
|
|
70
|
+
| `enceladus` | 男声,气声,低音调 | `umbriel` | 男声,流畅,低音调 |
|
|
71
|
+
| `erinome` | 女声,清晰,中音调 | `vindemiatrix` | 女声,温柔,中音调 |
|
|
72
|
+
| `fenrir` | 男声,活泼,偏年轻音调 | `zephyr` | 女声,明亮,中高音调 |
|
|
73
|
+
| `gacrux` | 女声,成熟,中音调 | `zubenelgenubi` | 男声,随性,中低音调 |
|
|
74
|
+
| `iapetus` | 男声,清晰,中低音调 | `kore` | 女声,干练,中音调 |
|
|
75
|
+
|
|
76
|
+
## 4. 端点 C:`POST /api/v1/omni/character/create`(生角色)
|
|
77
|
+
|
|
78
|
+
| 字段 | 类型 | 必填 | 说明 |
|
|
79
|
+
|---|---|---|---|
|
|
80
|
+
| `descriptions` | string | **必填** | 角色描述:外观、身份、风格、服饰或性格设定 |
|
|
81
|
+
| `image_urls` | array | **必填** | 角色参考图,**仅支持 1 张**。单张 ≤ **20 MB**,须公开可访问 |
|
|
82
|
+
| `audio_ids` | array | 可选 | 由 `gemini-omni-audio` 生成的音频 ID,用于补充声音特征、语气或人设参考 |
|
|
83
|
+
| `character_name` | string | 可选 | 角色名称 |
|
|
84
|
+
|
|
85
|
+
## 5. 价格
|
|
86
|
+
|
|
87
|
+
来源:[KIE 定价页](https://kie.ai/pricing)(2026-08-22 读取,搜索 `gemini-omni`;1 Credit = $0.005)。**按次(per video)计费,不是按秒。**
|
|
88
|
+
|
|
89
|
+
| 规格 | 积分 | 我们的价格 | 官方 / Fal 参考价 | 节省 |
|
|
90
|
+
|---|---|---|---|---|
|
|
91
|
+
| 720p 4s 无视频输入 | 63 /条 | **$0.315/条** | $0.5 | 37.0% |
|
|
92
|
+
| 720p 6s 无视频输入 | 84 /条 | **$0.42/条** | $0.75 | 44.0% |
|
|
93
|
+
| 720p 8s 无视频输入 | 105 /条 | **$0.525/条** | $1 | 47.5% |
|
|
94
|
+
| 720p 10s 无视频输入 | 126 /条 | **$0.63/条** | $1.25 | 49.6% |
|
|
95
|
+
| 1080p 4s 无视频输入 | 63 /条 | **$0.315/条** | N/A | — |
|
|
96
|
+
| 1080p 6s 无视频输入 | 84 /条 | **$0.42/条** | N/A | — |
|
|
97
|
+
| 1080p 8s 无视频输入 | 105 /条 | **$0.525/条** | N/A | — |
|
|
98
|
+
| 1080p 10s 无视频输入 | 126 /条 | **$0.63/条** | N/A | — |
|
|
99
|
+
| 4k 4s 无视频输入 | 147 /条 | **$0.735/条** | N/A | — |
|
|
100
|
+
| 4k 6s 无视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
101
|
+
| 4k 8s 无视频输入 | 189 /条 | **$0.945/条** | N/A | — |
|
|
102
|
+
| 4k 10s 无视频输入 | 210 /条 | **$1.05/条** | N/A | — |
|
|
103
|
+
| 720p 有视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
104
|
+
| 1080p 有视频输入 | 168 /条 | **$0.84/条** | N/A | — |
|
|
105
|
+
| 4k 有视频输入 | 252 /条 | **$1.26/条** | N/A | — |
|
|
106
|
+
|
|
107
|
+
定价页未列出 `omni/audio/create` 与 `omni/character/create` 的价格,接入前需确认这两个端点是否单独计费。
|
|
108
|
+
|
|
109
|
+
## 6. 适配要点
|
|
110
|
+
|
|
111
|
+
- 本项目默认**绝对不显示**:`seed`、负面提示词。KIE 的 `gemini-omni-video` **有 `seed`**,必须主动不注册、不下发。
|
|
112
|
+
- **这是一套三端点体系**,语音与角色是可复用资产(先创建拿 ID,再在视频里引用),需要独立的资产管理交互,不能塞进单次生成的参数面板。
|
|
113
|
+
- **image slot 是共享额度**(图片 1 / 角色 1 / 视频 2,总计 7),前端计数必须统一。
|
|
114
|
+
- `duration` 是**字符串**且只有 4/6/8/10;**有视频输入时该参数静默失效**。
|
|
115
|
+
- **按次计费**:720p 与 1080p 同价,4k 更贵;有视频输入时价格固定且明显更高。
|
|
116
|
+
- `video_list` 的截取窗口 `ends - start` 必须 ≤ 10 秒。
|
|
117
|
+
- `resultJson` 是 JSON 字符串,必须二次 parse。
|
|
118
|
+
|
|
119
|
+
## 7. 原始链接索引
|
|
120
|
+
|
|
121
|
+
| 信息 | 链接 | 是否需登录 |
|
|
122
|
+
|---|---|---|
|
|
123
|
+
| Gemini Omni 生视频 | https://docs.kie.ai/cn/market/gemini-omni-video | 否 |
|
|
124
|
+
| Gemini Omni Audio 生语音 | https://docs.kie.ai/cn/market/gemini-omni-audio | 否 |
|
|
125
|
+
| Gemini Omni Character 生角色 | https://docs.kie.ai/cn/market/gemini-omni-character | 否 |
|
|
126
|
+
| 获取任务详情 | https://docs.kie.ai/cn/market/common/get-task-detail | 否 |
|
|
127
|
+
| 通用 API 快速入门 | https://docs.kie.ai/cn/common-api/quickstart | 否 |
|
|
128
|
+
| 定价页(搜 `gemini-omni`) | https://kie.ai/pricing | 否 |
|
|
129
|
+
| API Key 管理 | https://kie.ai/api-key | **是** |
|
|
@@ -1,36 +1,36 @@
|
|
|
1
|
-
# Grok Imagine · KIE
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-30 |
|
|
6
|
-
| 模态 | 图片 |
|
|
7
|
-
| 供应商 | KIE.ai |
|
|
8
|
-
| 平台模型 ID | `grok-imagine/text-to-image`、`grok-imagine/image-to-image` |
|
|
9
|
-
| 接口形态 | `POST /api/v1/jobs/createTask` + `GET /api/v1/jobs/recordInfo` |
|
|
10
|
-
| 价格可见性 | 公开,无需登录 |
|
|
11
|
-
|
|
12
|
-
## 1. 模式
|
|
13
|
-
|
|
14
|
-
- 文生图使用 `grok-imagine/text-to-image`,`enable_pro=false` 是 Standard,`enable_pro=true` 是 Quality。
|
|
15
|
-
- 图生图使用 `grok-imagine/image-to-image`,输入 1 张图片。
|
|
16
|
-
|
|
17
|
-
## 2. 价格与输出单位
|
|
18
|
-
|
|
19
|
-
KIE 定价使用 `1 Credit = $0.005`。
|
|
20
|
-
|
|
21
|
-
| 模式 | Credits | 总价 | 计价输出单位 |
|
|
22
|
-
|---|---:|---:|---|
|
|
23
|
-
| Standard 文生图 | 4 / 次 | $0.02 / 次 | 2 张图 |
|
|
24
|
-
| Quality 文生图 | 5 / 次 | $0.025 / 次 | **4 张图** |
|
|
25
|
-
| 图生图 | 4 / 张 | $0.02 / 张 | 1 张图 |
|
|
26
|
-
|
|
27
|
-
SDK calculator 返回的是整次请求价格:Quality 仍是 `$0.025`,但说明必须写明该次输出 4 张,不能写成 2 张。
|
|
28
|
-
|
|
29
|
-
## 3. 原始链接索引
|
|
30
|
-
|
|
31
|
-
| 信息 | 链接 | 登录 |
|
|
32
|
-
|---|---|---|
|
|
33
|
-
| Grok Imagine 文生图 | https://docs.kie.ai/cn/market/grok-imagine/text-to-image | 否 |
|
|
34
|
-
| Grok Imagine 图生图 | https://docs.kie.ai/cn/market/grok-imagine/image-to-image | 否 |
|
|
35
|
-
| 模型专页 | https://kie.ai/grok-imagine | 否 |
|
|
36
|
-
| 当前定价 | https://kie.ai/pricing | 否 |
|
|
1
|
+
# Grok Imagine · KIE
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-30 |
|
|
6
|
+
| 模态 | 图片 |
|
|
7
|
+
| 供应商 | KIE.ai |
|
|
8
|
+
| 平台模型 ID | `grok-imagine/text-to-image`、`grok-imagine/image-to-image` |
|
|
9
|
+
| 接口形态 | `POST /api/v1/jobs/createTask` + `GET /api/v1/jobs/recordInfo` |
|
|
10
|
+
| 价格可见性 | 公开,无需登录 |
|
|
11
|
+
|
|
12
|
+
## 1. 模式
|
|
13
|
+
|
|
14
|
+
- 文生图使用 `grok-imagine/text-to-image`,`enable_pro=false` 是 Standard,`enable_pro=true` 是 Quality。
|
|
15
|
+
- 图生图使用 `grok-imagine/image-to-image`,输入 1 张图片。
|
|
16
|
+
|
|
17
|
+
## 2. 价格与输出单位
|
|
18
|
+
|
|
19
|
+
KIE 定价使用 `1 Credit = $0.005`。
|
|
20
|
+
|
|
21
|
+
| 模式 | Credits | 总价 | 计价输出单位 |
|
|
22
|
+
|---|---:|---:|---|
|
|
23
|
+
| Standard 文生图 | 4 / 次 | $0.02 / 次 | 2 张图 |
|
|
24
|
+
| Quality 文生图 | 5 / 次 | $0.025 / 次 | **4 张图** |
|
|
25
|
+
| 图生图 | 4 / 张 | $0.02 / 张 | 1 张图 |
|
|
26
|
+
|
|
27
|
+
SDK calculator 返回的是整次请求价格:Quality 仍是 `$0.025`,但说明必须写明该次输出 4 张,不能写成 2 张。
|
|
28
|
+
|
|
29
|
+
## 3. 原始链接索引
|
|
30
|
+
|
|
31
|
+
| 信息 | 链接 | 登录 |
|
|
32
|
+
|---|---|---|
|
|
33
|
+
| Grok Imagine 文生图 | https://docs.kie.ai/cn/market/grok-imagine/text-to-image | 否 |
|
|
34
|
+
| Grok Imagine 图生图 | https://docs.kie.ai/cn/market/grok-imagine/image-to-image | 否 |
|
|
35
|
+
| 模型专页 | https://kie.ai/grok-imagine | 否 |
|
|
36
|
+
| 当前定价 | https://kie.ai/pricing | 否 |
|