@henjicc/ai-sdk 0.2.8 → 0.4.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +157 -141
- package/README.md +497 -455
- package/dist/capabilities/embedding/bailian.d.ts +23 -0
- package/dist/capabilities/embedding/bailian.js +10 -0
- package/dist/capabilities/embedding/bigmodel.d.ts +9 -0
- package/dist/capabilities/embedding/bigmodel.js +5 -0
- package/dist/capabilities/embedding/index.d.ts +1 -0
- package/dist/capabilities/embedding/index.js +1 -0
- package/dist/capabilities/embedding/ppio.d.ts +7 -0
- package/dist/capabilities/embedding/ppio.js +5 -0
- package/dist/capabilities/embedding/siliconflow.d.ts +21 -0
- package/dist/capabilities/embedding/siliconflow.js +10 -0
- package/dist/capabilities/embedding/volcengine.d.ts +10 -0
- package/dist/capabilities/embedding/volcengine.js +6 -0
- package/dist/capabilities/rerank/bailian.d.ts +21 -0
- package/dist/capabilities/rerank/bailian.js +14 -0
- package/dist/capabilities/rerank/bigmodel.d.ts +9 -0
- package/dist/capabilities/rerank/bigmodel.js +5 -0
- package/dist/capabilities/rerank/index.d.ts +1 -0
- package/dist/capabilities/rerank/index.js +1 -0
- package/dist/capabilities/rerank/ppio.d.ts +7 -0
- package/dist/capabilities/rerank/ppio.js +5 -0
- package/dist/capabilities/rerank/siliconflow.d.ts +21 -0
- package/dist/capabilities/rerank/siliconflow.js +10 -0
- package/dist/capabilities/retrieval/http.d.ts +3 -0
- package/dist/capabilities/retrieval/http.js +48 -0
- package/dist/capabilities/retrieval/module.d.ts +11 -0
- package/dist/capabilities/retrieval/module.js +110 -0
- package/dist/capabilities/retrieval/types.d.ts +54 -0
- package/dist/capabilities/retrieval/types.js +1 -0
- package/dist/capabilities/retrieval/validation.d.ts +10 -0
- package/dist/capabilities/retrieval/validation.js +65 -0
- package/dist/capabilities/types.d.ts +1 -1
- package/dist/catalog/apimart/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/apimart/gpt-image-2.5.model.js +51 -0
- package/dist/catalog/fal/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/fal/gpt-image-2.5.model.js +53 -0
- package/dist/catalog/fal/ic-light-v2.model.js +9 -13
- package/dist/catalog/grsai/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/grsai/gpt-image-2.5.model.js +54 -0
- package/dist/catalog/grsai/gptImage25Sizes.d.ts +1 -0
- package/dist/catalog/grsai/gptImage25Sizes.js +76 -0
- package/dist/catalog/index.js +112 -104
- package/dist/catalog/kie/gpt-image-2.5.model.d.ts +2 -0
- package/dist/catalog/kie/gpt-image-2.5.model.js +38 -0
- package/dist/catalog/shared/gptImage25.d.ts +16 -0
- package/dist/catalog/shared/gptImage25.js +48 -0
- package/dist/catalog/shared/gptImage25Pricing.d.ts +12 -0
- package/dist/catalog/shared/gptImage25Pricing.js +508 -0
- package/dist/llm/defaults.d.ts +1 -1
- package/dist/llm/defaults.js +1 -1
- package/dist/llm/discovery.d.ts +2 -0
- package/dist/llm/discovery.js +16 -5
- package/dist/llm/modelCatalogEntries.js +32 -0
- package/dist/llm/providerPresets.d.ts +3 -1
- package/dist/llm/providerPresets.js +6 -3
- package/dist/llm/providerReasoningRequest.js +14 -1
- package/dist/llm/siliconflow/index.d.ts +21 -0
- package/dist/llm/siliconflow/index.js +32 -0
- package/dist/llm/siliconflow/preset.d.ts +6 -0
- package/dist/llm/siliconflow/preset.js +33 -0
- package/dist/packs/models/apimart/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/apimart/gpt-image-2.5.js +7 -0
- package/dist/packs/models/fal/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/fal/gpt-image-2.5.js +7 -0
- package/dist/packs/models/grsai/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/grsai/gpt-image-2.5.js +7 -0
- package/dist/packs/models/kie/gpt-image-2.5.d.ts +6 -0
- package/dist/packs/models/kie/gpt-image-2.5.js +7 -0
- package/dist/packs/provider-packs/apimart.d.ts +1 -1
- package/dist/packs/provider-packs/apimart.js +21 -20
- package/dist/packs/provider-packs/fal.d.ts +1 -1
- package/dist/packs/provider-packs/fal.js +37 -36
- package/dist/packs/provider-packs/grsai.d.ts +1 -1
- package/dist/packs/provider-packs/grsai.js +6 -5
- package/dist/packs/provider-packs/kie.d.ts +1 -1
- package/dist/packs/provider-packs/kie.js +28 -27
- package/dist/packs/tool-models/fal/{qwen-image-edit-2509-multiple-angles.d.ts → qwen-image-edit-2511-multiple-angles.d.ts} +1 -1
- package/dist/packs/tool-models/fal/{qwen-image-edit-2509-multiple-angles.js → qwen-image-edit-2511-multiple-angles.js} +1 -1
- package/dist/packs/tool-packs/fal-multi-angle-tools.js +1 -1
- package/dist/tool-packs/fal-multi-angle/models/qwen-image-edit-2511-multiple-angles.model.d.ts +2 -0
- package/dist/tool-packs/fal-multi-angle/models/{qwen-image-edit-2509-multiple-angles.model.js → qwen-image-edit-2511-multiple-angles.model.js} +20 -17
- package/docs/README.md +26 -26
- package/docs/consumers.md +56 -48
- package/docs/llm-adaptation/README.md +139 -137
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/DeepSeek.md +103 -91
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/Kimi.md +75 -75
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206/MiniMax.md +84 -84
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//345/260/217/347/261/263MiMo.md +85 -85
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//346/231/272/350/260/261GLM.md +232 -232
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//347/201/253/345/261/261/345/274/225/346/223/216.md +87 -87
- package/docs/llm-adaptation//344/276/233/345/272/224/345/225/206//347/231/276/347/202/274Qwen.md +84 -84
- package/docs/llm-adaptation//346/226/207/346/241/243/351/207/207/351/233/206/346/211/213/345/206/214.md +88 -88
- package/docs/model-adaptation/Bria-Eraser/Bria-Eraser_Fal.md +32 -32
- package/docs/model-adaptation/Bria-/345/210/233/346/204/217/346/224/276/345/244/247/Bria-/345/210/233/346/204/217/346/224/276/345/244/247_Fal.md +31 -31
- package/docs/model-adaptation/ControlLight/ControlLight_Fal.md +85 -85
- package/docs/model-adaptation/FLUX-2-/345/244/232/350/247/222/345/272/246/FLUX-2-/345/244/232/350/247/222/345/272/246_Fal.md +107 -107
- package/docs/model-adaptation/Finegrain-Eraser/Finegrain-Eraser_Fal.md +31 -31
- package/docs/model-adaptation/Flux-Pro-Erase/Flux-Pro-Erase_Fal.md +34 -34
- package/docs/model-adaptation/Fun-ASR/Fun-ASR_/347/231/276/347/202/274.md +43 -43
- package/docs/model-adaptation/Fun-ASR-Flash-2026-06-15/Fun-ASR-Flash-2026-06-15_/347/231/276/347/202/274.md +41 -41
- package/docs/model-adaptation/Fun-ASR-Realtime/Fun-ASR-Realtime_/347/231/276/347/202/274.md +37 -37
- package/docs/model-adaptation/Fun-ASR-Realtime-2026-02-28/Fun-ASR-Realtime-2026-02-28_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/GLM-5.3-Flash/GLM-5.3-Flash_/346/231/272/350/260/261.md +207 -207
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_APIMart.md +173 -173
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_Fal.md +94 -94
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_Grsai.md +137 -137
- package/docs/model-adaptation/GPT-Image-2/GPT-Image-2_KIE.md +93 -93
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_APIMart.md +66 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_Fal.md +55 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_Grsai.md +53 -0
- package/docs/model-adaptation/GPT-Image-2.5/GPT-Image-2.5_KIE.md +55 -0
- package/docs/model-adaptation/GPT-OSS-20B/GPT-OSS-20B_Groq.md +62 -62
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_APIMart.md +124 -124
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_Fal.md +84 -84
- package/docs/model-adaptation/Gemini-Omni-Flash/Gemini-Omni-Flash_KIE.md +129 -129
- package/docs/model-adaptation/Grok-Imagine/Grok-Imagine_KIE.md +36 -36
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_APIMart.md +250 -250
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_Fal.md +84 -84
- package/docs/model-adaptation/Grok-Imagine-2.0/Grok-Imagine-2.0_KIE.md +105 -105
- package/docs/model-adaptation/Hailuo-02/Hailuo-02_Fal.md +93 -93
- package/docs/model-adaptation/Hailuo-02/Hailuo-02_KIE.md +56 -56
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_Fal.md +88 -88
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_KIE.md +51 -51
- package/docs/model-adaptation/Hailuo-2.3/Hailuo-2.3_/346/264/276/346/254/247/344/272/221.md +70 -70
- package/docs/model-adaptation/IC-Light-v2/IC-Light-v2_Fal.md +97 -94
- package/docs/model-adaptation/Ideogram-/345/233/276/347/211/207/346/224/276/345/244/247/Ideogram-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +41 -41
- package/docs/model-adaptation/Image-Apps-v2-/345/225/206/345/223/201/346/221/204/345/275/261/Image-Apps-v2-/345/225/206/345/223/201/346/221/204/345/275/261_Fal.md +72 -72
- package/docs/model-adaptation/Image-Apps-v2-/346/211/251/345/233/276/Image-Apps-v2-/346/211/251/345/233/276_Fal.md +93 -93
- package/docs/model-adaptation/Image-Apps-v2-/347/205/247/347/211/207/344/277/256/345/244/215/Image-Apps-v2-/347/205/247/347/211/207/344/277/256/345/244/215_Fal.md +86 -86
- package/docs/model-adaptation/Image-Apps-v2-/351/207/215/346/211/223/345/205/211/Image-Apps-v2-/351/207/215/346/211/223/345/205/211_Fal.md +84 -84
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_APIMart.md +112 -112
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_Fal.md +89 -89
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_KIE.md +106 -106
- package/docs/model-adaptation/Kling-3.0/Kling-3.0_/346/264/276/346/254/247/344/272/221.md +119 -119
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_APIMart.md +125 -125
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_Fal.md +107 -107
- package/docs/model-adaptation/Kling-3.0-Omni/Kling-3.0-Omni_KIE.md +143 -143
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_APIMart.md +85 -85
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_Fal.md +83 -83
- package/docs/model-adaptation/Kling-3.0-Turbo/Kling-3.0-Turbo_KIE.md +84 -84
- package/docs/model-adaptation/Midjourney/Midjourney_APIMart.md +396 -396
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_APIMart.md +234 -234
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_Fal.md +108 -108
- package/docs/model-adaptation/MiniMax-H3/MiniMax-H3_KIE.md +111 -111
- package/docs/model-adaptation/MiniMax-Speech/MiniMax-Speech_/346/264/276/346/254/247/344/272/221.md +170 -170
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_APIMart.md +89 -89
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_Fal.md +99 -99
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_Grsai.md +82 -82
- package/docs/model-adaptation/Nano-Banana-2/Nano-Banana-2_KIE.md +70 -70
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_APIMart.md +79 -79
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_Grsai.md +65 -65
- package/docs/model-adaptation/Nano-Banana-2-Lite/Nano-Banana-2-Lite_KIE.md +64 -64
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_APIMart.md +83 -83
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_Fal.md +89 -89
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_Grsai.md +82 -82
- package/docs/model-adaptation/Nano-Banana-Pro/Nano-Banana-Pro_KIE.md +64 -64
- package/docs/model-adaptation/Pixelcut-/350/203/214/346/231/257/347/247/273/351/231/244/Pixelcut-/350/203/214/346/231/257/347/247/273/351/231/244_Fal.md +79 -79
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_APIMart.md +117 -117
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_Fal.md +84 -84
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_KIE.md +103 -103
- package/docs/model-adaptation/Qwen-Image-3.0/Qwen-Image-3.0_/347/231/276/347/202/274.md +138 -138
- package/docs/model-adaptation/Qwen-Image-Edit-2511-/345/244/232/350/247/222/345/272/246/Qwen-Image-Edit-2511-/345/244/232/350/247/222/345/272/246_Fal.md +57 -0
- package/docs/model-adaptation/Qwen-MT-Flash/Qwen-MT-Flash_/347/231/276/347/202/274.md +47 -47
- package/docs/model-adaptation/Qwen-MT-Lite/Qwen-MT-Lite_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/Qwen-MT-Plus/Qwen-MT-Plus_/347/231/276/347/202/274.md +39 -39
- package/docs/model-adaptation/Qwen3-ASR-Flash/Qwen3-ASR-Flash_/347/231/276/347/202/274.md +40 -40
- package/docs/model-adaptation/Qwen3-ASR-Flash-2026-02-10/Qwen3-ASR-Flash-2026-02-10_/347/231/276/347/202/274.md +33 -33
- package/docs/model-adaptation/Qwen3-ASR-Flash-Filetrans/Qwen3-ASR-Flash-Filetrans_/347/231/276/347/202/274.md +41 -41
- package/docs/model-adaptation/Qwen3-ASR-Flash-Realtime/Qwen3-ASR-Flash-Realtime_/347/231/276/347/202/274.md +35 -35
- package/docs/model-adaptation/Qwen3-ASR-Flash-Realtime-2026-02-10/Qwen3-ASR-Flash-Realtime-2026-02-10_/347/231/276/347/202/274.md +37 -37
- package/docs/model-adaptation/README.md +313 -295
- package/docs/model-adaptation/SeedASR-2.0-File/SeedASR-2.0-File_/347/201/253/345/261/261/345/274/225/346/223/216.md +115 -115
- package/docs/model-adaptation/SeedASR-2.0-Realtime/SeedASR-2.0-Realtime_/347/201/253/345/261/261/345/274/225/346/223/216.md +143 -143
- package/docs/model-adaptation/SeedVR2-/345/233/276/347/211/207/346/224/276/345/244/247/SeedVR2-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +45 -45
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_APIMart.md +121 -121
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_Fal.md +97 -97
- package/docs/model-adaptation/Seedance-2.0/Seedance-2.0_KIE.md +86 -86
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_APIMart.md +89 -89
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_Fal.md +95 -95
- package/docs/model-adaptation/Seedance-2.0-Fast/Seedance-2.0-Fast_KIE.md +78 -78
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_APIMart.md +89 -89
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_Fal.md +96 -96
- package/docs/model-adaptation/Seedance-2.0-Mini/Seedance-2.0-Mini_KIE.md +78 -78
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_APIMart.md +212 -212
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_Fal.md +94 -94
- package/docs/model-adaptation/Seedance-2.5/Seedance-2.5_KIE.md +89 -89
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_APIMart.md +106 -106
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_Fal.md +91 -91
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_KIE.md +89 -89
- package/docs/model-adaptation/Seedream-5.0-Lite/Seedream-5.0-Lite_/347/201/253/345/261/261/345/274/225/346/223/216.md +108 -108
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_APIMart.md +194 -194
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_Fal.md +100 -100
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_KIE.md +141 -141
- package/docs/model-adaptation/Seedream-5.0-Pro/Seedream-5.0-Pro_/347/201/253/345/261/261/345/274/225/346/223/216.md +137 -137
- package/docs/model-adaptation/SenseVoiceSmall/SenseVoiceSmall_/347/241/205/345/237/272/346/265/201/345/212/250.md +69 -69
- package/docs/model-adaptation/TeleSpeechASR/TeleSpeechASR_/347/241/205/345/237/272/346/265/201/345/212/250.md +72 -72
- package/docs/model-adaptation/Topaz-/345/233/276/347/211/207/346/224/276/345/244/247/Topaz-/345/233/276/347/211/207/346/224/276/345/244/247_Fal.md +87 -87
- package/docs/model-adaptation/Topaz-/351/200/217/346/230/216/345/233/276/346/224/276/345/244/247/Topaz-/351/200/217/346/230/216/345/233/276/346/224/276/345/244/247_Fal.md +34 -34
- package/docs/model-adaptation/Wan-2.5-Preview/Wan-2.5-Preview_/346/264/276/346/254/247/344/272/221.md +82 -82
- package/docs/model-adaptation/Wan-2.6/Wan-2.6_/346/264/276/346/254/247/344/272/221.md +84 -84
- package/docs/model-adaptation/Wan-2.7/Wan-2.7_/346/264/276/346/254/247/344/272/221.md +122 -122
- package/docs/model-adaptation/Whisper-Large-v3/Whisper-Large-v3_Groq.md +76 -76
- package/docs/model-adaptation/Whisper-Large-v3-Turbo/Whisper-Large-v3-Turbo_Groq.md +75 -75
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_APIMart.md +88 -88
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_Fal.md +95 -95
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_KIE.md +71 -71
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_/347/231/276/347/202/274.md +122 -122
- package/docs/model-adaptation/Z-Image-Turbo/Z-Image-Turbo_/351/255/224/346/220/255.md +97 -97
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/APIMart.md +238 -238
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Fal.md +172 -172
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Groq.md +121 -121
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/Grsai.md +217 -217
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206/KIE.md +131 -131
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//345/200/231/351/200/211/344/276/233/345/272/224/345/225/206/350/260/203/347/240/224-/345/233/276/347/211/207/345/267/245/345/205/267.md +151 -151
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//345/277/253/351/200/237/351/200/202/351/205/215/344/276/233/345/272/224/345/225/206.md +65 -65
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//346/264/276/346/254/247/344/272/221.md +147 -138
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/201/253/345/261/261/345/274/225/346/223/216.md +181 -171
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/231/276/347/202/274.md +237 -227
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//347/241/205/345/237/272/346/265/201/345/212/250.md +140 -75
- package/docs/model-adaptation//344/276/233/345/272/224/345/225/206//351/255/224/346/220/255.md +207 -207
- package/docs/model-adaptation//346/226/207/346/241/243/351/207/207/351/233/206/346/211/213/345/206/214.md +338 -311
- package/docs/model-adaptation//351/200/217/350/247/206/345/217/230/346/215/242//351/200/217/350/247/206/345/217/230/346/215/242_Fal.md +59 -59
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/Electron.md +77 -77
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/Tauri.md +81 -81
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227/UXP.md +169 -169
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227//344/276/233/345/272/224/345/225/206/345/237/237/345/220/215.md +83 -83
- package/docs//346/216/245/345/205/245/346/214/207/345/215/227//351/224/231/350/257/257/345/244/204/347/220/206.md +72 -72
- package/examples/form-renderer/README.md +17 -17
- package/examples/form-renderer/cli.ts +32 -32
- package/examples/form-renderer/index.ts +144 -144
- package/examples/form-renderer/package.json +16 -16
- package/examples/form-renderer/tsconfig.json +14 -14
- package/examples/llm-chat/README.md +32 -32
- package/examples/llm-chat/index.ts +100 -100
- package/examples/llm-chat/package.json +19 -19
- package/examples/llm-chat/tsconfig.json +14 -14
- package/examples/minimal-node/README.md +31 -31
- package/examples/minimal-node/index.ts +138 -138
- package/examples/minimal-node/package.json +17 -17
- package/examples/minimal-node/tsconfig.json +14 -14
- package/package.json +255 -195
- package/dist/tool-packs/fal-multi-angle/models/qwen-image-edit-2509-multiple-angles.model.d.ts +0 -2
- package/docs/model-adaptation/Qwen-Image-Edit-2509-/345/244/232/350/247/222/345/272/246/Qwen-Image-Edit-2509-/345/244/232/350/247/222/345/272/246_Fal.md +0 -116
|
@@ -1,43 +1,43 @@
|
|
|
1
|
-
# Fun-ASR · 百炼
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-28 |
|
|
6
|
-
| 能力 | 长音频/录音文件异步识别 |
|
|
7
|
-
| 平台模型 ID | `fun-asr`(稳定别名,官方当前等同 `fun-asr-2025-11-07`) |
|
|
8
|
-
| 输入上限 | 12 小时 / 2 GB;单次 1 个 URL |
|
|
9
|
-
| 文档/价格 | 公开,无需登录 |
|
|
10
|
-
|
|
11
|
-
## 1. 提交、轮询与结果
|
|
12
|
-
|
|
13
|
-
```text
|
|
14
|
-
POST https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/services/audio/asr/transcription
|
|
15
|
-
Authorization: Bearer <API Key>
|
|
16
|
-
X-DashScope-Async: enable
|
|
17
|
-
GET https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/tasks/{task_id}
|
|
18
|
-
```
|
|
19
|
-
|
|
20
|
-
提交体使用 `model="fun-asr"` 和 `input.file_urls=["<public-url>"]`。返回 `output.task_id/task_status`;状态为 `PENDING/RUNNING/SUCCEEDED/FAILED/UNKNOWN`。多子任务时顶层成功不代表每个子任务成功,必须查 `results[].subtask_status`。
|
|
21
|
-
|
|
22
|
-
成功后 `output.results[].transcription_url` 指向 JSON,需二次下载。结果含 `transcript/sentences/words/begin_time/end_time/speaker_id`,顶层 `usage.duration` 是计量秒数。
|
|
23
|
-
|
|
24
|
-
## 2. 能力、上传与价格
|
|
25
|
-
|
|
26
|
-
- 多语种/方言、热词、说话人分离;不支持情感识别。说话人分离建议音频 ≤ 2 小时。
|
|
27
|
-
- 格式 `aac/amr/avi/flac/flv/m4a/mkv/mov/mp3/mp4/mpeg/ogg/opus/wav/webm/wma/wmv`,采样率任意。
|
|
28
|
-
- 公网 HTTP(S) URL;REST 也可用 48 小时百炼 `oss://` 临时 URL,需 `X-DashScope-OssResourceResolve: enable`。上传凭证与模型/主账号绑定,不可复用到别的模型。
|
|
29
|
-
- 北京原价 0.00022 元/有效语音秒,非语音不计费;官方列 36,000 秒/10 小时限时免费额度。
|
|
30
|
-
|
|
31
|
-
## 3. 适配要点
|
|
32
|
-
|
|
33
|
-
宿主桥负责上传、轮询、取消和将转写 JSON 落地;SDK 负责协议与结果解析。不得把 `transcription_url` 或用户原始音频 URL 写入普通日志。最近 24 小时任务可查询,不代表结果 URL 可长期存储。
|
|
34
|
-
|
|
35
|
-
## 4. 原始链接索引
|
|
36
|
-
|
|
37
|
-
| 信息 | 链接 | 登录 |
|
|
38
|
-
|---|---|---|
|
|
39
|
-
| HTTP API/结果 | https://help.aliyun.com/zh/model-studio/fun-asr-recorded-speech-recognition-http-api | 否 |
|
|
40
|
-
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
41
|
-
| 临时上传 | https://help.aliyun.com/zh/model-studio/get-temporary-file-url | 否 |
|
|
42
|
-
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
43
|
-
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
1
|
+
# Fun-ASR · 百炼
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-28 |
|
|
6
|
+
| 能力 | 长音频/录音文件异步识别 |
|
|
7
|
+
| 平台模型 ID | `fun-asr`(稳定别名,官方当前等同 `fun-asr-2025-11-07`) |
|
|
8
|
+
| 输入上限 | 12 小时 / 2 GB;单次 1 个 URL |
|
|
9
|
+
| 文档/价格 | 公开,无需登录 |
|
|
10
|
+
|
|
11
|
+
## 1. 提交、轮询与结果
|
|
12
|
+
|
|
13
|
+
```text
|
|
14
|
+
POST https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/services/audio/asr/transcription
|
|
15
|
+
Authorization: Bearer <API Key>
|
|
16
|
+
X-DashScope-Async: enable
|
|
17
|
+
GET https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/tasks/{task_id}
|
|
18
|
+
```
|
|
19
|
+
|
|
20
|
+
提交体使用 `model="fun-asr"` 和 `input.file_urls=["<public-url>"]`。返回 `output.task_id/task_status`;状态为 `PENDING/RUNNING/SUCCEEDED/FAILED/UNKNOWN`。多子任务时顶层成功不代表每个子任务成功,必须查 `results[].subtask_status`。
|
|
21
|
+
|
|
22
|
+
成功后 `output.results[].transcription_url` 指向 JSON,需二次下载。结果含 `transcript/sentences/words/begin_time/end_time/speaker_id`,顶层 `usage.duration` 是计量秒数。
|
|
23
|
+
|
|
24
|
+
## 2. 能力、上传与价格
|
|
25
|
+
|
|
26
|
+
- 多语种/方言、热词、说话人分离;不支持情感识别。说话人分离建议音频 ≤ 2 小时。
|
|
27
|
+
- 格式 `aac/amr/avi/flac/flv/m4a/mkv/mov/mp3/mp4/mpeg/ogg/opus/wav/webm/wma/wmv`,采样率任意。
|
|
28
|
+
- 公网 HTTP(S) URL;REST 也可用 48 小时百炼 `oss://` 临时 URL,需 `X-DashScope-OssResourceResolve: enable`。上传凭证与模型/主账号绑定,不可复用到别的模型。
|
|
29
|
+
- 北京原价 0.00022 元/有效语音秒,非语音不计费;官方列 36,000 秒/10 小时限时免费额度。
|
|
30
|
+
|
|
31
|
+
## 3. 适配要点
|
|
32
|
+
|
|
33
|
+
宿主桥负责上传、轮询、取消和将转写 JSON 落地;SDK 负责协议与结果解析。不得把 `transcription_url` 或用户原始音频 URL 写入普通日志。最近 24 小时任务可查询,不代表结果 URL 可长期存储。
|
|
34
|
+
|
|
35
|
+
## 4. 原始链接索引
|
|
36
|
+
|
|
37
|
+
| 信息 | 链接 | 登录 |
|
|
38
|
+
|---|---|---|
|
|
39
|
+
| HTTP API/结果 | https://help.aliyun.com/zh/model-studio/fun-asr-recorded-speech-recognition-http-api | 否 |
|
|
40
|
+
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
41
|
+
| 临时上传 | https://help.aliyun.com/zh/model-studio/get-temporary-file-url | 否 |
|
|
42
|
+
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
43
|
+
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
@@ -1,41 +1,41 @@
|
|
|
1
|
-
# Fun-ASR-Flash-2026-06-15 · 百炼
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-28 |
|
|
6
|
-
| 能力 | 短音频同步识别(HTTP) |
|
|
7
|
-
| 平台模型 ID | `fun-asr-flash-2026-06-15` |
|
|
8
|
-
| 输入上限 | 5 分钟 / 2 GB,单次 1 个音频 |
|
|
9
|
-
| 文档/价格 | 公开,无需登录 |
|
|
10
|
-
|
|
11
|
-
## 1. 端点与请求
|
|
12
|
-
|
|
13
|
-
```text
|
|
14
|
-
POST https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
|
|
15
|
-
Authorization: Bearer <API Key>
|
|
16
|
-
Content-Type: application/json
|
|
17
|
-
```
|
|
18
|
-
|
|
19
|
-
`model` 取上述 ID;`input.messages[].content[]` 最后一条为 `{type:"input_audio", input_audio:{data}}`,`data` 支持公网 URL 或 `data:<mime>;base64,...`。`parameters.format` 必填,`sample_rate/language_hints/vocabulary_id` 等可选。
|
|
20
|
-
|
|
21
|
-
`X-DashScope-SSE: enable` 开启 SSE,但音频至少 1 分钟才会分段返回中间结果;否则只有最终结果。官方明确该协议不支持 DashScope SDK,TypeScript SDK 需直连 HTTP/SSE。
|
|
22
|
-
|
|
23
|
-
## 2. 结果、能力与价格
|
|
24
|
-
|
|
25
|
-
- `output.text` 为累积文本,`output.sentence` 含句子、时间戳、`sentence_end`,`usage.duration` 为用量。
|
|
26
|
-
- 支持多语种/方言与 Prompt 上下文;不支持情感识别和说话人分离。
|
|
27
|
-
- 北京原价 0.00022 元/秒,输出不计费;官方列 36,000 秒/10 小时限时免费额度。
|
|
28
|
-
|
|
29
|
-
## 3. 上传与适配要点
|
|
30
|
-
|
|
31
|
-
小文件优先 Base64;大文件用公网 URL 或百炼临时 OSS。临时上传凭证为 `GET https://dashscope.aliyuncs.com/api/v1/uploads?action=getPolicy&model=fun-asr-flash-2026-06-15`,上传后得 `oss://` URL,调用时需 `X-DashScope-OssResourceResolve: enable`;URL 48 小时过期,不用于生产托管。
|
|
32
|
-
|
|
33
|
-
## 4. 原始链接索引
|
|
34
|
-
|
|
35
|
-
| 信息 | 链接 | 登录 |
|
|
36
|
-
|---|---|---|
|
|
37
|
-
| API | https://help.aliyun.com/zh/model-studio/non-real-time-speech-recognition-for-fun-asr-flash | 否 |
|
|
38
|
-
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
39
|
-
| 临时上传 | https://help.aliyun.com/zh/model-studio/get-temporary-file-url | 否 |
|
|
40
|
-
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
41
|
-
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
1
|
+
# Fun-ASR-Flash-2026-06-15 · 百炼
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-28 |
|
|
6
|
+
| 能力 | 短音频同步识别(HTTP) |
|
|
7
|
+
| 平台模型 ID | `fun-asr-flash-2026-06-15` |
|
|
8
|
+
| 输入上限 | 5 分钟 / 2 GB,单次 1 个音频 |
|
|
9
|
+
| 文档/价格 | 公开,无需登录 |
|
|
10
|
+
|
|
11
|
+
## 1. 端点与请求
|
|
12
|
+
|
|
13
|
+
```text
|
|
14
|
+
POST https://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api/v1/services/aigc/multimodal-generation/generation
|
|
15
|
+
Authorization: Bearer <API Key>
|
|
16
|
+
Content-Type: application/json
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
`model` 取上述 ID;`input.messages[].content[]` 最后一条为 `{type:"input_audio", input_audio:{data}}`,`data` 支持公网 URL 或 `data:<mime>;base64,...`。`parameters.format` 必填,`sample_rate/language_hints/vocabulary_id` 等可选。
|
|
20
|
+
|
|
21
|
+
`X-DashScope-SSE: enable` 开启 SSE,但音频至少 1 分钟才会分段返回中间结果;否则只有最终结果。官方明确该协议不支持 DashScope SDK,TypeScript SDK 需直连 HTTP/SSE。
|
|
22
|
+
|
|
23
|
+
## 2. 结果、能力与价格
|
|
24
|
+
|
|
25
|
+
- `output.text` 为累积文本,`output.sentence` 含句子、时间戳、`sentence_end`,`usage.duration` 为用量。
|
|
26
|
+
- 支持多语种/方言与 Prompt 上下文;不支持情感识别和说话人分离。
|
|
27
|
+
- 北京原价 0.00022 元/秒,输出不计费;官方列 36,000 秒/10 小时限时免费额度。
|
|
28
|
+
|
|
29
|
+
## 3. 上传与适配要点
|
|
30
|
+
|
|
31
|
+
小文件优先 Base64;大文件用公网 URL 或百炼临时 OSS。临时上传凭证为 `GET https://dashscope.aliyuncs.com/api/v1/uploads?action=getPolicy&model=fun-asr-flash-2026-06-15`,上传后得 `oss://` URL,调用时需 `X-DashScope-OssResourceResolve: enable`;URL 48 小时过期,不用于生产托管。
|
|
32
|
+
|
|
33
|
+
## 4. 原始链接索引
|
|
34
|
+
|
|
35
|
+
| 信息 | 链接 | 登录 |
|
|
36
|
+
|---|---|---|
|
|
37
|
+
| API | https://help.aliyun.com/zh/model-studio/non-real-time-speech-recognition-for-fun-asr-flash | 否 |
|
|
38
|
+
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
39
|
+
| 临时上传 | https://help.aliyun.com/zh/model-studio/get-temporary-file-url | 否 |
|
|
40
|
+
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
41
|
+
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
@@ -1,37 +1,37 @@
|
|
|
1
|
-
# Fun-ASR-Realtime · 百炼
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-28 |
|
|
6
|
-
| 能力 | 实时语音识别(WebSocket) |
|
|
7
|
-
| 平台模型 ID | `fun-asr-realtime`(稳定别名,官方当前等同 `fun-asr-realtime-2025-11-07`) |
|
|
8
|
-
| 地域 | 华北2(北京)、新加坡 |
|
|
9
|
-
| 文档/价格 | 公开,无需登录 |
|
|
10
|
-
|
|
11
|
-
## 1. 协议与结果
|
|
12
|
-
|
|
13
|
-
`wss://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api-ws/v1/inference`,握手 `Authorization: Bearer <API Key>`。流程为 `run-task/task-started` → 发二进制音频并接收 `result-generated` → `finish-task/task-finished`。`task_id` 由客户端产生 UUID。
|
|
14
|
-
|
|
15
|
-
`task-failed` 后 socket 废弃;等 `task-finished` 后可用不同 `task_id` 复用连接,空闲 60 秒自动断开。`result-generated.payload.output.sentence` 提供文本、句末标志和时间戳,句末 `usage.duration` 为计费时长。
|
|
16
|
-
|
|
17
|
-
官方服务端事件示例明确包含一种合法的空文本中间事件:新句开始时会返回 `sentence_begin=true`、`sentence_end=false`、`text=""`、`words=[]`。客户端应把它当作句子生命周期通知并继续等待,不能报响应无效。相反,`sentence_end=true` 的最终结果仍必须有有效文本;`task-finished` 自身的 `payload` 通常为空,只负责结束任务,也不能覆盖已经累计的最终文本。如果整个任务直到 `task-finished` 都没有任何有效最终文本,SDK 应报 `invalid_response`。
|
|
18
|
-
|
|
19
|
-
## 2. 能力、限制与价格
|
|
20
|
-
|
|
21
|
-
- 格式 `pcm/wav/mp3/opus/speex/aac/amr`,采样率任意,单声道,时长无限制。
|
|
22
|
-
- 支持多语种及中文方言/口音、热词;不支持说话人分离和情感识别。
|
|
23
|
-
- 北京原价 0.00033 元/秒;官方列 36,000 秒/10 小时限时免费额度。
|
|
24
|
-
|
|
25
|
-
## 3. 适配要点
|
|
26
|
-
|
|
27
|
-
Say-It 保留该稳定别名与 2026-02-28 快照供用户选择;SDK 不应自行把稳定别名锁定为某快照。空 `sentence_begin` 事件只推进状态,不产生 partial/final;重复 final 只累计一次。取消时主动关闭 socket,密钥和原始音频不记日志。
|
|
28
|
-
|
|
29
|
-
## 4. 原始链接索引
|
|
30
|
-
|
|
31
|
-
| 信息 | 链接 | 登录 |
|
|
32
|
-
|---|---|---|
|
|
33
|
-
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
34
|
-
| WebSocket 交互 | https://help.aliyun.com/zh/model-studio/fun-asr-realtime-websocket-api | 否 |
|
|
35
|
-
| 事件 | https://help.aliyun.com/zh/model-studio/fun-asr-client-events ; https://help.aliyun.com/zh/model-studio/fun-asr-server-events | 否 |
|
|
36
|
-
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
37
|
-
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
1
|
+
# Fun-ASR-Realtime · 百炼
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-28 |
|
|
6
|
+
| 能力 | 实时语音识别(WebSocket) |
|
|
7
|
+
| 平台模型 ID | `fun-asr-realtime`(稳定别名,官方当前等同 `fun-asr-realtime-2025-11-07`) |
|
|
8
|
+
| 地域 | 华北2(北京)、新加坡 |
|
|
9
|
+
| 文档/价格 | 公开,无需登录 |
|
|
10
|
+
|
|
11
|
+
## 1. 协议与结果
|
|
12
|
+
|
|
13
|
+
`wss://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api-ws/v1/inference`,握手 `Authorization: Bearer <API Key>`。流程为 `run-task/task-started` → 发二进制音频并接收 `result-generated` → `finish-task/task-finished`。`task_id` 由客户端产生 UUID。
|
|
14
|
+
|
|
15
|
+
`task-failed` 后 socket 废弃;等 `task-finished` 后可用不同 `task_id` 复用连接,空闲 60 秒自动断开。`result-generated.payload.output.sentence` 提供文本、句末标志和时间戳,句末 `usage.duration` 为计费时长。
|
|
16
|
+
|
|
17
|
+
官方服务端事件示例明确包含一种合法的空文本中间事件:新句开始时会返回 `sentence_begin=true`、`sentence_end=false`、`text=""`、`words=[]`。客户端应把它当作句子生命周期通知并继续等待,不能报响应无效。相反,`sentence_end=true` 的最终结果仍必须有有效文本;`task-finished` 自身的 `payload` 通常为空,只负责结束任务,也不能覆盖已经累计的最终文本。如果整个任务直到 `task-finished` 都没有任何有效最终文本,SDK 应报 `invalid_response`。
|
|
18
|
+
|
|
19
|
+
## 2. 能力、限制与价格
|
|
20
|
+
|
|
21
|
+
- 格式 `pcm/wav/mp3/opus/speex/aac/amr`,采样率任意,单声道,时长无限制。
|
|
22
|
+
- 支持多语种及中文方言/口音、热词;不支持说话人分离和情感识别。
|
|
23
|
+
- 北京原价 0.00033 元/秒;官方列 36,000 秒/10 小时限时免费额度。
|
|
24
|
+
|
|
25
|
+
## 3. 适配要点
|
|
26
|
+
|
|
27
|
+
Say-It 保留该稳定别名与 2026-02-28 快照供用户选择;SDK 不应自行把稳定别名锁定为某快照。空 `sentence_begin` 事件只推进状态,不产生 partial/final;重复 final 只累计一次。取消时主动关闭 socket,密钥和原始音频不记日志。
|
|
28
|
+
|
|
29
|
+
## 4. 原始链接索引
|
|
30
|
+
|
|
31
|
+
| 信息 | 链接 | 登录 |
|
|
32
|
+
|---|---|---|
|
|
33
|
+
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
34
|
+
| WebSocket 交互 | https://help.aliyun.com/zh/model-studio/fun-asr-realtime-websocket-api | 否 |
|
|
35
|
+
| 事件 | https://help.aliyun.com/zh/model-studio/fun-asr-client-events ; https://help.aliyun.com/zh/model-studio/fun-asr-server-events | 否 |
|
|
36
|
+
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
37
|
+
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
@@ -1,39 +1,39 @@
|
|
|
1
|
-
# Fun-ASR-Realtime-2026-02-28 · 百炼
|
|
2
|
-
|
|
3
|
-
| 项目 | 内容 |
|
|
4
|
-
|---|---|
|
|
5
|
-
| 最后更新 | 2026-08-28 |
|
|
6
|
-
| 能力 | 实时语音识别(WebSocket) |
|
|
7
|
-
| 平台模型 ID | `fun-asr-realtime-2026-02-28`(官方标注的最新快照版) |
|
|
8
|
-
| 地域 | 华北2(北京)、新加坡 |
|
|
9
|
-
| 文档/价格 | 公开,无需登录 |
|
|
10
|
-
|
|
11
|
-
## 1. 协议
|
|
12
|
-
|
|
13
|
-
`wss://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api-ws/v1/inference`,握手头 `Authorization: Bearer <API Key>`。事件顺序:`run-task` → `task-started` → 单声道二进制音频 / `result-generated` → `finish-task` → `task-finished`。客户端生成 UUID `task_id`,每任务唯一。
|
|
14
|
-
|
|
15
|
-
`task-failed` 后连接不可复用;必须等 `task-finished` 才可开下一任务,完成后空闲 60 秒自动断开。
|
|
16
|
-
|
|
17
|
-
## 2. 音频、结果与价格
|
|
18
|
-
|
|
19
|
-
- 格式:`pcm/wav/mp3/opus/speex/aac/amr`;采样率任意;单声道;时长无限制。
|
|
20
|
-
- 语言:中文(多方言/口音)、英语、日语。
|
|
21
|
-
- 热词:支持。不支持说话人分离和情感识别。
|
|
22
|
-
- `result-generated.payload.output.sentence` 含中间/最终文本与时间戳;句末时 `usage.duration` 为计费时长。
|
|
23
|
-
- 新句开始的首个中间事件可为 `sentence_begin=true`、`sentence_end=false`、`text=""`、`words=[]`;这是官方定义的合法生命周期事件,应继续等待文本。`sentence_end=true` 的 final 仍必须非空。
|
|
24
|
-
- `task-finished.payload` 通常为空,只表示任务正常结束;不能把它当作识别结果,也不能覆盖已累计 final。若此前始终没有有效 final,任务结束时应报无有效转写。
|
|
25
|
-
- 北京原价:0.00033 元/秒,输出不计费;官方页列 36,000 秒/10 小时限时免费额度(以账号实际为准)。
|
|
26
|
-
|
|
27
|
-
## 3. 适配要点
|
|
28
|
-
|
|
29
|
-
与稳定别名 `fun-asr-realtime` 并列保留,不自动改写 ID。两者共用传输实现,但能力元数据和显示名分开注册。空 `sentence_begin` 不产生 partial/final,重复 final 只累计一次。取消必须停止送音频、关闭当前 socket,不得把该连接放回池。
|
|
30
|
-
|
|
31
|
-
## 4. 原始链接索引
|
|
32
|
-
|
|
33
|
-
| 信息 | 链接 | 登录 |
|
|
34
|
-
|---|---|---|
|
|
35
|
-
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
36
|
-
| WebSocket 交互 | https://help.aliyun.com/zh/model-studio/fun-asr-realtime-websocket-api | 否 |
|
|
37
|
-
| 客户端/服务端事件 | https://help.aliyun.com/zh/model-studio/fun-asr-client-events ; https://help.aliyun.com/zh/model-studio/fun-asr-server-events | 否 |
|
|
38
|
-
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
39
|
-
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|
|
1
|
+
# Fun-ASR-Realtime-2026-02-28 · 百炼
|
|
2
|
+
|
|
3
|
+
| 项目 | 内容 |
|
|
4
|
+
|---|---|
|
|
5
|
+
| 最后更新 | 2026-08-28 |
|
|
6
|
+
| 能力 | 实时语音识别(WebSocket) |
|
|
7
|
+
| 平台模型 ID | `fun-asr-realtime-2026-02-28`(官方标注的最新快照版) |
|
|
8
|
+
| 地域 | 华北2(北京)、新加坡 |
|
|
9
|
+
| 文档/价格 | 公开,无需登录 |
|
|
10
|
+
|
|
11
|
+
## 1. 协议
|
|
12
|
+
|
|
13
|
+
`wss://{WorkspaceId}.cn-beijing.maas.aliyuncs.com/api-ws/v1/inference`,握手头 `Authorization: Bearer <API Key>`。事件顺序:`run-task` → `task-started` → 单声道二进制音频 / `result-generated` → `finish-task` → `task-finished`。客户端生成 UUID `task_id`,每任务唯一。
|
|
14
|
+
|
|
15
|
+
`task-failed` 后连接不可复用;必须等 `task-finished` 才可开下一任务,完成后空闲 60 秒自动断开。
|
|
16
|
+
|
|
17
|
+
## 2. 音频、结果与价格
|
|
18
|
+
|
|
19
|
+
- 格式:`pcm/wav/mp3/opus/speex/aac/amr`;采样率任意;单声道;时长无限制。
|
|
20
|
+
- 语言:中文(多方言/口音)、英语、日语。
|
|
21
|
+
- 热词:支持。不支持说话人分离和情感识别。
|
|
22
|
+
- `result-generated.payload.output.sentence` 含中间/最终文本与时间戳;句末时 `usage.duration` 为计费时长。
|
|
23
|
+
- 新句开始的首个中间事件可为 `sentence_begin=true`、`sentence_end=false`、`text=""`、`words=[]`;这是官方定义的合法生命周期事件,应继续等待文本。`sentence_end=true` 的 final 仍必须非空。
|
|
24
|
+
- `task-finished.payload` 通常为空,只表示任务正常结束;不能把它当作识别结果,也不能覆盖已累计 final。若此前始终没有有效 final,任务结束时应报无有效转写。
|
|
25
|
+
- 北京原价:0.00033 元/秒,输出不计费;官方页列 36,000 秒/10 小时限时免费额度(以账号实际为准)。
|
|
26
|
+
|
|
27
|
+
## 3. 适配要点
|
|
28
|
+
|
|
29
|
+
与稳定别名 `fun-asr-realtime` 并列保留,不自动改写 ID。两者共用传输实现,但能力元数据和显示名分开注册。空 `sentence_begin` 不产生 partial/final,重复 final 只累计一次。取消必须停止送音频、关闭当前 socket,不得把该连接放回池。
|
|
30
|
+
|
|
31
|
+
## 4. 原始链接索引
|
|
32
|
+
|
|
33
|
+
| 信息 | 链接 | 登录 |
|
|
34
|
+
|---|---|---|
|
|
35
|
+
| 模型/音频规格 | https://help.aliyun.com/zh/model-studio/asr-model/ | 否 |
|
|
36
|
+
| WebSocket 交互 | https://help.aliyun.com/zh/model-studio/fun-asr-realtime-websocket-api | 否 |
|
|
37
|
+
| 客户端/服务端事件 | https://help.aliyun.com/zh/model-studio/fun-asr-client-events ; https://help.aliyun.com/zh/model-studio/fun-asr-server-events | 否 |
|
|
38
|
+
| 价格 | https://help.aliyun.com/zh/model-studio/model-pricing | 否 |
|
|
39
|
+
| API Key | https://bailian.console.aliyun.com/?apiKey=1#/api-key | **是** |
|