ai 7.0.161 → 7.0.163
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +79 -0
- package/dist/index.d.ts +210 -41
- package/dist/index.d.ts.map +1 -1
- package/dist/index.js +551 -114
- package/dist/index.js.map +1 -1
- package/dist/internal/index.d.ts +87 -10
- package/dist/internal/index.d.ts.map +1 -1
- package/dist/internal/index.js +221 -26
- package/dist/internal/index.js.map +1 -1
- package/dist/test/index.d.ts +3 -1
- package/dist/test/index.d.ts.map +1 -1
- package/dist/test/index.js +2 -1
- package/dist/test/index.js.map +1 -1
- package/docs/02-foundations/02-providers-and-models.mdx +2 -0
- package/docs/03-agents/04-loop-control.mdx +34 -0
- package/docs/03-agents/06-memory.mdx +42 -0
- package/docs/03-agents/06-tool-approvals.mdx +2 -0
- package/docs/03-ai-sdk-core/05-generating-text.mdx +1 -0
- package/docs/03-ai-sdk-core/36-realtime.mdx +74 -1
- package/docs/03-ai-sdk-core/36-transcription.mdx +51 -4
- package/docs/03-ai-sdk-core/40-middleware.mdx +7 -2
- package/docs/03-ai-sdk-core/60-telemetry.mdx +85 -4
- package/docs/04-ai-sdk-ui/50-stream-protocol.mdx +13 -0
- package/docs/06-advanced/04-caching.mdx +13 -4
- package/docs/07-reference/01-ai-sdk-core/01-generate-text.mdx +33 -28
- package/docs/07-reference/01-ai-sdk-core/02-stream-text.mdx +58 -1
- package/docs/07-reference/01-ai-sdk-core/11-transcribe.mdx +17 -2
- package/docs/07-reference/01-ai-sdk-core/13-generate-video.mdx +8 -1
- package/docs/07-reference/01-ai-sdk-core/31-ui-message.mdx +23 -0
- package/docs/07-reference/02-ai-sdk-ui/05-use-realtime.mdx +37 -8
- package/docs/07-reference/04-ai-sdk-workflow/01-workflow-agent.mdx +1 -49
- package/docs/08-migration-guides/23-migration-guide-7-0.mdx +36 -34
- package/package.json +12 -12
- package/src/generate-object/generate-object.ts +2 -1
- package/src/generate-object/stream-object.ts +7 -3
- package/src/generate-text/generate-text.ts +23 -3
- package/src/generate-text/is-output-chunk.ts +1 -0
- package/src/generate-text/language-model-events.ts +3 -0
- package/src/generate-text/output.ts +90 -37
- package/src/generate-text/smooth-stream.ts +5 -0
- package/src/generate-text/steering.ts +5 -4
- package/src/generate-text/stream-language-model-call.ts +16 -1
- package/src/generate-text/stream-text-result.ts +29 -1
- package/src/generate-text/stream-text.ts +25 -1
- package/src/generate-text/to-response-messages.ts +6 -2
- package/src/generate-text/validate-tool-approvals.ts +21 -3
- package/src/generate-video/generate-video-result.ts +11 -2
- package/src/generate-video/generate-video.ts +26 -2
- package/src/model/as-transcription-model-v4.ts +25 -0
- package/src/prompt/convert-to-language-model-prompt.ts +86 -14
- package/src/realtime/index.ts +3 -0
- package/src/realtime/realtime-attempt.ts +1 -0
- package/src/realtime/realtime-session.ts +142 -21
- package/src/telemetry/create-telemetry-dispatcher.ts +8 -1
- package/src/telemetry/filter-telemetry-event.ts +165 -0
- package/src/telemetry/get-request-origin.ts +25 -0
- package/src/telemetry/index.ts +6 -1
- package/src/telemetry/telemetry.ts +62 -0
- package/src/telemetry/tracing-channel-publisher.ts +19 -4
- package/src/test/mock-transcription-model-v4.ts +4 -0
- package/src/transcribe/transcribe-result.ts +20 -0
- package/src/transcribe/transcribe.ts +107 -20
- package/src/transcribe/transcription-events.ts +28 -8
- package/src/types/language-model-request-metadata.ts +3 -0
- package/src/types/realtime-model.ts +9 -0
- package/src/ui/convert-to-model-messages.ts +36 -28
- package/src/ui/index.ts +1 -0
- package/src/ui/process-ui-message-stream.ts +10 -0
- package/src/ui/ui-messages.ts +20 -0
- package/src/ui/validate-ui-messages.ts +21 -0
- package/src/ui-message-stream/to-ui-message-chunk.ts +72 -1
- package/src/ui-message-stream/ui-message-chunks.ts +31 -0
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,84 @@
|
|
|
1
1
|
# ai
|
|
2
2
|
|
|
3
|
+
## 7.0.163
|
|
4
|
+
|
|
5
|
+
### Patch Changes
|
|
6
|
+
|
|
7
|
+
- 5d18351: fix(ai): detect downloaded audio types from bytes when servers return a generic or non-audio content type such as application/octet-stream
|
|
8
|
+
- 8da48db: Respect `recordInputs` and `recordOutputs` when delivering telemetry events to integrations and the `ai:telemetry` channel. Filter nested content and omit raw span results when content recording is disabled, while preserving application results.
|
|
9
|
+
- fd7e8a7: Preserve the order of text and complete function calls in streamed Google responses, including standalone thought signatures on empty text or reasoning parts.
|
|
10
|
+
|
|
11
|
+
Keep provider metadata on empty text parts when converting results to response messages so it can be passed back in subsequent requests.
|
|
12
|
+
|
|
13
|
+
Omit foreign-provider empty signature text when replaying history through Anthropic or Bedrock, preserving Bedrock’s existing native reasoning-history handling.
|
|
14
|
+
|
|
15
|
+
- 36802d4: Support native URL transcription with an optional provider capability, keeping existing file-generation contracts unchanged. Groq sends HTTP(S) audio URLs through its `url` parameter without downloading and re-uploading them, avoiding the attachment upload limit. Supplying a custom `download` function retains local download behavior.
|
|
16
|
+
|
|
17
|
+
For telemetry integrations, `TranscriptionEndEvent.audio.byteLength` and `audio.mediaType` can now be `undefined` when a provider fetches the audio URL natively. Check for missing values before using them as a number or string. Downloaded and inline audio continue to report their metadata; streaming transcription metadata is unchanged.
|
|
18
|
+
|
|
19
|
+
Strip media fragments before sending URLs to Groq. If Groq rejects a redirect, fall back to the existing secure local downloader and file upload rather than failing previously working URL inputs. Other provider errors are preserved.
|
|
20
|
+
|
|
21
|
+
- 933dae3: fix (ai): download deprecated `file-url` and `image-url` tool result content
|
|
22
|
+
|
|
23
|
+
Tool result content parts that use the deprecated `file-url` and `image-url`
|
|
24
|
+
types were converted to `file` parts with `{ type: 'url' }` data, but they were
|
|
25
|
+
never passed to the download function. When the model does not support the URL,
|
|
26
|
+
the provider received a bare URL instead of the file contents, even though the
|
|
27
|
+
replacement `file` part with `{ type: 'url' }` data was downloaded and inlined.
|
|
28
|
+
|
|
29
|
+
Downloaded legacy URL parts now use the same media type normalization as file
|
|
30
|
+
parts, resolving generic types from the response header or image bytes.
|
|
31
|
+
Legacy base64 data URLs also normalize to inline data with the media type from
|
|
32
|
+
their data URL, matching replacement file parts.
|
|
33
|
+
|
|
34
|
+
- e0143b0: feat(ai): support provider-owned realtime transports
|
|
35
|
+
|
|
36
|
+
Add an optional `createTransport` interface and `provider` connection capability.
|
|
37
|
+
|
|
38
|
+
- 934100c: Report the actual OpenAI Chat HTTP endpoint (also used by Azure Chat and Bedrock Mantle Chat) through optional request metadata and model-call end events. Record its host and port on OpenTelemetry chat spans without exposing URL credentials, paths, queries, or fragments. Expose only the sanitized HTTP origin in text and object generation results and step/finish callbacks. Providers that do not report an endpoint leave these attributes unset.
|
|
39
|
+
- c389374: fix(ai): infer union output types when passing a union of schemas to `Output.object` and `Output.array`
|
|
40
|
+
|
|
41
|
+
Previously, passing a schema whose type is a union of schemas (e.g. a schema selected from a map at runtime) failed to type-check because the output type was inferred from the first union member only. The output type is now inferred as the union of the schemas' output types.
|
|
42
|
+
|
|
43
|
+
- 892af4d: feat (ai): re-export realtime server-connection and usage types
|
|
44
|
+
|
|
45
|
+
Adds `Experimental_RealtimeServerConnection`, `Experimental_RealtimeSessionIntent`, and `Experimental_RealtimeUsage` aliases for the new experimental `RealtimeModelV4` server-side spec types.
|
|
46
|
+
|
|
47
|
+
- 1a1da8d: stream steering messages to the ui and keep them in converted messages
|
|
48
|
+
- 41465fd: Expose optional transcription word timings separately from segments and accept shared timestampGranularities. Explicit provider timing settings take precedence. OpenAI now sends timestamp_granularities only with verbose_json and warns when a requested timing is unavailable or excluded.
|
|
49
|
+
- 9754014: Add typed streaming heartbeat parts. Anthropic emits them only with `includePings: true` (disabled by default), without requiring raw chunks. Core forwards pings through stream retries without storing them as generated content or sending them to UI message streams. Consumers with exhaustive stream-part switches must handle the new `ping` union variant when upgrading, even when the opt-in is disabled. Typed pings do not flush partial words during stream smoothing.
|
|
50
|
+
- 2e44144: Represent videos delivered directly to caller-managed storage with an explicit uploaded outcome. Video generation reports `uploadedVideos` without downloading or synthesizing video bytes; access `video` only when `videos` is nonempty.
|
|
51
|
+
- Updated dependencies [722d4a9]
|
|
52
|
+
- Updated dependencies [acea2b5]
|
|
53
|
+
- Updated dependencies [89aff56]
|
|
54
|
+
- Updated dependencies [41465fd]
|
|
55
|
+
- Updated dependencies [2e44144]
|
|
56
|
+
- Updated dependencies [36802d4]
|
|
57
|
+
- Updated dependencies [ef2dfb5]
|
|
58
|
+
- Updated dependencies [e0143b0]
|
|
59
|
+
- Updated dependencies [934100c]
|
|
60
|
+
- Updated dependencies [892af4d]
|
|
61
|
+
- Updated dependencies [892af4d]
|
|
62
|
+
- Updated dependencies [89aff56]
|
|
63
|
+
- Updated dependencies [32acf43]
|
|
64
|
+
- Updated dependencies [41465fd]
|
|
65
|
+
- Updated dependencies [9754014]
|
|
66
|
+
- Updated dependencies [4bb73b0]
|
|
67
|
+
- Updated dependencies [2e44144]
|
|
68
|
+
- @ai-sdk/gateway@4.0.136
|
|
69
|
+
- @ai-sdk/provider@4.0.36
|
|
70
|
+
- @ai-sdk/provider-utils@5.0.75
|
|
71
|
+
|
|
72
|
+
## 7.0.162
|
|
73
|
+
|
|
74
|
+
### Patch Changes
|
|
75
|
+
|
|
76
|
+
- 857ca45: Restore server-defined tool metadata, dynamic status, and title when validating tool approval continuations so approval policies receive the same tool definition fields as new model calls.
|
|
77
|
+
- 4d6d830: Support a single telemetry operation for durable `WorkflowAgent` runs, including the prompt, final output, steps, and tools. Events recorded in the workflow are reported on completion or suspension with their original timestamps. For OpenTelemetry, pass the same `OpenTelemetryIdGenerator` instance as the tracer provider's `idGenerator` and `sampler` and as `new OpenTelemetry({ durable })`. This explicit bridge carries parent trace context and sampling across steps, reports model spans live with provider requests nested beneath them, and reconstructs the enclosing `invoke_agent` tree when the run completes. Without the bridge, existing live per-model tracing is preserved. Add typed experimental durable context hooks for telemetry integrations; remove reliance on process-global ID-generator detection.
|
|
78
|
+
- Updated dependencies [fa15312]
|
|
79
|
+
- @ai-sdk/provider-utils@5.0.74
|
|
80
|
+
- @ai-sdk/gateway@4.0.135
|
|
81
|
+
|
|
3
82
|
## 7.0.161
|
|
4
83
|
|
|
5
84
|
### Patch Changes
|
package/dist/index.d.ts
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
import { GatewayAsyncJobMetadata, GatewayModelId, GatewayModelId as GatewayModelId$1, GatewayProviderMetadata, createGateway, gateway } from "@ai-sdk/gateway";
|
|
2
2
|
import { Arrayable, AssistantContent, AssistantModelMessage, AssistantModelMessage as AssistantModelMessage$1, Context, DataContent, DataContent as DataContent$1, DownloadError, Experimental_SandboxDirectoryEntry, Experimental_SandboxFileStat, Experimental_SandboxProcess, Experimental_SandboxSession, Experimental_SandboxSession as Experimental_SandboxSession$1, Experimental_ToolCallerTool, Experimental_ToolCallerTool as Experimental_ToolCallerTool$1, FetchFunction, FilePart, FilePart as FilePart$1, FlexibleSchema, FlexibleSchema as FlexibleSchema$1, HasRequiredKey, IdGenerator, IdGenerator as IdGenerator$1, ImagePart, InferSchema, InferSchema as InferSchema$1, InferToolContext, InferToolInput, InferToolInput as InferToolInput$1, InferToolOutput, InferToolOutput as InferToolOutput$1, InferToolSetContext, MaybePromiseLike, ModelMessage, ModelMessage as ModelMessage$1, ProviderOptions, ReasoningFilePart, ReasoningPart, Resolvable, Schema, SystemModelMessage, SystemModelMessage as SystemModelMessage$1, TextPart, TextPart as TextPart$1, Tool, Tool as Tool$1, ToolApprovalRequest, ToolApprovalResponse, ToolCall, ToolCallPart, ToolContent, ToolExecuteFunction, ToolExecutionOptions, ToolExecutionOptions as ToolExecutionOptions$1, ToolModelMessage, ToolModelMessage as ToolModelMessage$1, ToolResultPart, ToolSet, ToolSet as ToolSet$1, UserContent, UserModelMessage, UserModelMessage as UserModelMessage$1, WebSocketConstructor, asSchema, createIdGenerator, dynamicTool, experimental_toolCaller, generateId as generateId$1, jsonSchema, parseJsonEventStream, tool as tool$1, zodSchema } from "@ai-sdk/provider-utils";
|
|
3
|
-
import { AISDKError, AISDKError as AISDKError$1, APICallError, EmbeddingModelV2, EmbeddingModelV3, EmbeddingModelV4, EmbeddingModelV4CallOptions, EmbeddingModelV4Embedding, EmbeddingModelV4Middleware, EmptyResponseBodyError, Experimental_BatchV4, Experimental_BatchV4Error, Experimental_BatchV4ModelIds, Experimental_BatchV4StartResult, Experimental_BatchV4Status, Experimental_DecisionModelV4, Experimental_DecisionModelV4CallOptions, Experimental_DecisionModelV4Question, Experimental_DecisionModelV4Question as Experimental_DecisionQuestion, Experimental_DecisionModelV4Result, Experimental_DecisionRefusalError, Experimental_DecisionUnsupportedQuestionTypeError, Experimental_DecisionUnsupportedQuestionTypeError as Experimental_DecisionUnsupportedQuestionTypeError$1, Experimental_EvaluationModelV4, Experimental_RealtimeFactoryV4, Experimental_RealtimeFactoryV4GetTokenOptions, Experimental_RealtimeFactoryV4GetTokenResult, Experimental_RealtimeModelV4, Experimental_RealtimeModelV4ClientEvent, Experimental_RealtimeModelV4ServerEvent, Experimental_RealtimeModelV4SessionConfig, Experimental_RealtimeModelV4ToolDefinition, Experimental_SpeechModelV4StreamUsage, Experimental_SpeechTranslationModelV4, Experimental_SpeechTranslationModelV4Usage, Experimental_VideoModelV3, Experimental_VideoModelV4, Experimental_VideoModelV4FrameType, Experimental_VideoModelV4OperationStatusResult, Experimental_VideoModelV4OperationWebhook, FilesV4, FilesV4UploadFileCallOptions, ImageModelV2, ImageModelV2ProviderMetadata, ImageModelV3, ImageModelV4, ImageModelV4Middleware, ImageModelV4ProviderMetadata, ImageModelV4Usage, InvalidPromptError, InvalidResponseDataError, JSONObject, JSONParseError, JSONParseError as JSONParseError$1, JSONSchema7, JSONSchema7 as JSONSchema7$1, JSONValue as JSONValue$1, LanguageModelV2, LanguageModelV3, LanguageModelV4, LanguageModelV4CallOptions, LanguageModelV4Citation, LanguageModelV4Content, LanguageModelV4Middleware, LanguageModelV4Prompt, LanguageModelV4Source, LanguageModelV4ToolCall, LanguageModelV4ToolChoice, LoadAPIKeyError, LoadSettingError, NoContentGeneratedError, NoSuchModelError, NoSuchModelError as NoSuchModelError$1, NoSuchProviderReferenceError, ProviderV2, ProviderV3, ProviderV4, RerankingModelV3, RerankingModelV4, SharedV4AudioFormat, SharedV4Headers, SharedV4ProviderMetadata, SharedV4ProviderReference, SharedV4Warning, SkillsV4, SkillsV4File, SkillsV4UploadSkillCallOptions, SkillsV4UploadSkillResult, SpeechModelV2, SpeechModelV3, SpeechModelV4, TooManyEmbeddingValuesForCallError, TranscriptionModelV2, TranscriptionModelV3, TranscriptionModelV4, TypeValidationError, TypeValidationError as TypeValidationError$1, UnsupportedFunctionalityError } from "@ai-sdk/provider";
|
|
3
|
+
import { AISDKError, AISDKError as AISDKError$1, APICallError, EmbeddingModelV2, EmbeddingModelV3, EmbeddingModelV4, EmbeddingModelV4CallOptions, EmbeddingModelV4Embedding, EmbeddingModelV4Middleware, EmptyResponseBodyError, Experimental_BatchV4, Experimental_BatchV4Error, Experimental_BatchV4ModelIds, Experimental_BatchV4StartResult, Experimental_BatchV4Status, Experimental_DecisionModelV4, Experimental_DecisionModelV4CallOptions, Experimental_DecisionModelV4Question, Experimental_DecisionModelV4Question as Experimental_DecisionQuestion, Experimental_DecisionModelV4Result, Experimental_DecisionRefusalError, Experimental_DecisionUnsupportedQuestionTypeError, Experimental_DecisionUnsupportedQuestionTypeError as Experimental_DecisionUnsupportedQuestionTypeError$1, Experimental_EvaluationModelV4, Experimental_RealtimeFactoryV4, Experimental_RealtimeFactoryV4GetTokenOptions, Experimental_RealtimeFactoryV4GetTokenResult, Experimental_RealtimeModelV4, Experimental_RealtimeModelV4ClientEvent, Experimental_RealtimeModelV4ServerConnection, Experimental_RealtimeModelV4ServerEvent, Experimental_RealtimeModelV4SessionConfig, Experimental_RealtimeModelV4SessionIntent, Experimental_RealtimeModelV4ToolDefinition, Experimental_RealtimeModelV4Usage, Experimental_SpeechModelV4StreamUsage, Experimental_SpeechTranslationModelV4, Experimental_SpeechTranslationModelV4Usage, Experimental_VideoModelV3, Experimental_VideoModelV4, Experimental_VideoModelV4FrameType, Experimental_VideoModelV4OperationStatusResult, Experimental_VideoModelV4OperationWebhook, FilesV4, FilesV4UploadFileCallOptions, ImageModelV2, ImageModelV2ProviderMetadata, ImageModelV3, ImageModelV4, ImageModelV4Middleware, ImageModelV4ProviderMetadata, ImageModelV4Usage, InvalidPromptError, InvalidResponseDataError, JSONObject, JSONParseError, JSONParseError as JSONParseError$1, JSONSchema7, JSONSchema7 as JSONSchema7$1, JSONValue as JSONValue$1, LanguageModelV2, LanguageModelV3, LanguageModelV4, LanguageModelV4CallOptions, LanguageModelV4Citation, LanguageModelV4Content, LanguageModelV4Middleware, LanguageModelV4Prompt, LanguageModelV4Source, LanguageModelV4ToolCall, LanguageModelV4ToolChoice, LoadAPIKeyError, LoadSettingError, NoContentGeneratedError, NoSuchModelError, NoSuchModelError as NoSuchModelError$1, NoSuchProviderReferenceError, ProviderV2, ProviderV3, ProviderV4, RerankingModelV3, RerankingModelV4, SharedV4AudioFormat, SharedV4Headers, SharedV4ProviderMetadata, SharedV4ProviderReference, SharedV4Warning, SkillsV4, SkillsV4File, SkillsV4UploadSkillCallOptions, SkillsV4UploadSkillResult, SpeechModelV2, SpeechModelV3, SpeechModelV4, TooManyEmbeddingValuesForCallError, TranscriptionModelV2, TranscriptionModelV3, TranscriptionModelV4, TranscriptionModelV4TimestampGranularity, TypeValidationError, TypeValidationError as TypeValidationError$1, UnsupportedFunctionalityError } from "@ai-sdk/provider";
|
|
4
4
|
import { ZodType, array, boolean, custom, discriminatedUnion, enum as enum$1, instanceof as instanceof$1, lazy, literal, looseObject, never, null as null$1, number, object, record, string, union, unknown } from "zod/v4";
|
|
5
5
|
import { ServerResponse } from "node:http";
|
|
6
6
|
import { ServerResponse as ServerResponse$1 } from "http";
|
|
@@ -172,6 +172,8 @@ type LanguageModelMiddleware = Omit<LanguageModelV4Middleware, 'specificationVer
|
|
|
172
172
|
* Metadata for a language model request.
|
|
173
173
|
*/
|
|
174
174
|
type LanguageModelRequestMetadata = {
|
|
175
|
+
/** HTTP origin used for this request, without URL credentials, paths, queries or fragments. */
|
|
176
|
+
readonly url?: string;
|
|
175
177
|
/**
|
|
176
178
|
* The input messages that were sent to the model for this step.
|
|
177
179
|
*/
|
|
@@ -1753,6 +1755,10 @@ type LanguageModelCallEndEvent<TOOLS extends ToolSet$1 = ToolSet$1> = ModelInfo
|
|
|
1753
1755
|
readonly responseId: string;
|
|
1754
1756
|
/** Optional provider-specific metadata for this model call. */
|
|
1755
1757
|
readonly providerMetadata?: ProviderMetadata;
|
|
1758
|
+
/** HTTP origin reported by the provider, excluding URL credentials and path. */
|
|
1759
|
+
readonly request?: {
|
|
1760
|
+
readonly url?: string;
|
|
1761
|
+
};
|
|
1756
1762
|
/** Performance metrics for the model call. */
|
|
1757
1763
|
readonly performance: {
|
|
1758
1764
|
/** Time spent waiting for the language model response in milliseconds. */
|
|
@@ -1864,7 +1870,7 @@ interface UIMessage<METADATA = unknown, DATA_PARTS extends UIDataTypes = UIDataT
|
|
|
1864
1870
|
*/
|
|
1865
1871
|
parts: Array<UIMessagePart<DATA_PARTS, TOOLS>>;
|
|
1866
1872
|
}
|
|
1867
|
-
type UIMessagePart<DATA_TYPES extends UIDataTypes, TOOLS extends UITools> = TextUIPart | CustomContentUIPart | ReasoningUIPart | ToolUIPart<TOOLS> | DynamicToolUIPart | SourceUrlUIPart | SourceDocumentUIPart | FileUIPart | ReasoningFileUIPart | DataUIPart<DATA_TYPES> | StepStartUIPart;
|
|
1873
|
+
type UIMessagePart<DATA_TYPES extends UIDataTypes, TOOLS extends UITools> = TextUIPart | CustomContentUIPart | ReasoningUIPart | ToolUIPart<TOOLS> | DynamicToolUIPart | SourceUrlUIPart | SourceDocumentUIPart | FileUIPart | ReasoningFileUIPart | DataUIPart<DATA_TYPES> | SteeringMessageUIPart | StepStartUIPart;
|
|
1868
1874
|
/**
|
|
1869
1875
|
* A text part of a message.
|
|
1870
1876
|
*/
|
|
@@ -2001,6 +2007,22 @@ type ReasoningFileUIPart = {
|
|
|
2001
2007
|
*/
|
|
2002
2008
|
providerMetadata?: ProviderMetadata;
|
|
2003
2009
|
};
|
|
2010
|
+
/**
|
|
2011
|
+
* Experimental. A user message that was added to the run with steering while
|
|
2012
|
+
* the assistant message was generated. It is placed before the output of the
|
|
2013
|
+
* step that received it.
|
|
2014
|
+
*/
|
|
2015
|
+
type SteeringMessageUIPart = {
|
|
2016
|
+
type: 'steering-message';
|
|
2017
|
+
/**
|
|
2018
|
+
* The id of the steering message.
|
|
2019
|
+
*/
|
|
2020
|
+
id: string;
|
|
2021
|
+
/**
|
|
2022
|
+
* The content of the user message.
|
|
2023
|
+
*/
|
|
2024
|
+
parts: Array<TextUIPart | FileUIPart>;
|
|
2025
|
+
};
|
|
2004
2026
|
/**
|
|
2005
2027
|
* A step boundary part of a message.
|
|
2006
2028
|
*/
|
|
@@ -2499,6 +2521,13 @@ type UIMessageChunk<METADATA = unknown, DATA_TYPES extends UIDataTypes = UIDataT
|
|
|
2499
2521
|
mediaType: string;
|
|
2500
2522
|
providerMetadata?: ProviderMetadata;
|
|
2501
2523
|
} | DataUIMessageChunk<DATA_TYPES> | {
|
|
2524
|
+
/**
|
|
2525
|
+
* Experimental. A user message that was added to the run with steering.
|
|
2526
|
+
*/
|
|
2527
|
+
type: 'steering-message';
|
|
2528
|
+
id: string;
|
|
2529
|
+
parts: Array<TextUIPart | FileUIPart>;
|
|
2530
|
+
} | {
|
|
2502
2531
|
type: 'start-step';
|
|
2503
2532
|
} | {
|
|
2504
2533
|
type: 'finish-step';
|
|
@@ -3101,6 +3130,19 @@ type TextStreamToolOutputDeniedPart<TOOLS extends ToolSet$1> = {
|
|
|
3101
3130
|
} & StaticToolOutputDenied<TOOLS>;
|
|
3102
3131
|
type TextStreamToolApprovalRequestPart<TOOLS extends ToolSet$1> = ToolApprovalRequestOutput<TOOLS>;
|
|
3103
3132
|
type TextStreamToolApprovalResponsePart<TOOLS extends ToolSet$1> = ToolApprovalResponseOutput<TOOLS>;
|
|
3133
|
+
/**
|
|
3134
|
+
* Experimental. A steering message that was added to the run before the step
|
|
3135
|
+
* with the given number. Streamed before the output of that step.
|
|
3136
|
+
*/
|
|
3137
|
+
type TextStreamSteeringMessagePart = {
|
|
3138
|
+
type: 'steering-message';
|
|
3139
|
+
/** The id of the steering message. */
|
|
3140
|
+
id: string;
|
|
3141
|
+
/** The user message that was added to the run. */
|
|
3142
|
+
message: UserModelMessage$1;
|
|
3143
|
+
/** The number of the step whose model call received the message. */
|
|
3144
|
+
stepNumber: number;
|
|
3145
|
+
};
|
|
3104
3146
|
type TextStreamStartStepPart = {
|
|
3105
3147
|
type: 'start-step';
|
|
3106
3148
|
request: LanguageModelRequestMetadata;
|
|
@@ -3136,7 +3178,10 @@ type TextStreamRawPart = {
|
|
|
3136
3178
|
type: 'raw';
|
|
3137
3179
|
rawValue: unknown;
|
|
3138
3180
|
};
|
|
3139
|
-
type
|
|
3181
|
+
type TextStreamPingPart = {
|
|
3182
|
+
type: 'ping';
|
|
3183
|
+
};
|
|
3184
|
+
type TextStreamPart<TOOLS extends ToolSet$1> = TextStreamTextStartPart | TextStreamTextEndPart | TextStreamTextDeltaPart | TextStreamReasoningStartPart | TextStreamReasoningEndPart | TextStreamReasoningDeltaPart | TextStreamCustomPart | TextStreamToolInputStartPart | TextStreamToolInputEndPart | TextStreamToolInputDeltaPart | TextStreamSourcePart | TextStreamFilePart | TextStreamReasoningFilePart | TextStreamToolCallPart<TOOLS> | TextStreamToolResultPart<TOOLS> | TextStreamToolErrorPart<TOOLS> | TextStreamToolOutputDeniedPart<TOOLS> | TextStreamToolApprovalRequestPart<TOOLS> | TextStreamToolApprovalResponsePart<TOOLS> | TextStreamSteeringMessagePart | TextStreamStartStepPart | TextStreamFinishStepPart | TextStreamStartPart | TextStreamFinishPart | TextStreamAbortPart | TextStreamErrorPart | TextStreamPingPart | TextStreamRawPart;
|
|
3140
3185
|
//#endregion
|
|
3141
3186
|
//#region src/generate-text/stream-text-single-consumer-result.d.ts
|
|
3142
3187
|
/** A single-consumer view of a text generation, without replay or final content getters. */
|
|
@@ -3391,12 +3436,16 @@ type SteeringRun = {
|
|
|
3391
3436
|
takeMessages(): Array<UserModelMessage$1>;
|
|
3392
3437
|
/**
|
|
3393
3438
|
* Resolves the taken messages as delivered when they are part of the
|
|
3394
|
-
* messages that are sent to the model, and returns the delivered messages
|
|
3439
|
+
* messages that are sent to the model, and returns the delivered messages
|
|
3440
|
+
* with their ids.
|
|
3395
3441
|
*/
|
|
3396
3442
|
resolveTakenMessages(options: {
|
|
3397
3443
|
stepNumber: number;
|
|
3398
3444
|
sentMessages: ReadonlyArray<ModelMessage$1>;
|
|
3399
|
-
}): Array<
|
|
3445
|
+
}): Array<{
|
|
3446
|
+
id: string;
|
|
3447
|
+
message: UserModelMessage$1;
|
|
3448
|
+
}>;
|
|
3400
3449
|
end(reason: SteeringNotDeliveredReason): void;
|
|
3401
3450
|
};
|
|
3402
3451
|
/**
|
|
@@ -4275,18 +4324,13 @@ interface Output<OUTPUT = any, PARTIAL = any, ELEMENT = any> {
|
|
|
4275
4324
|
* @returns An output specification for generating text.
|
|
4276
4325
|
*/
|
|
4277
4326
|
declare const text$1: () => Output<string, string, never>;
|
|
4278
|
-
|
|
4279
|
-
|
|
4280
|
-
|
|
4281
|
-
|
|
4282
|
-
|
|
4283
|
-
|
|
4284
|
-
|
|
4285
|
-
*
|
|
4286
|
-
* @returns An output specification for generating objects with the specified schema.
|
|
4287
|
-
*/
|
|
4288
|
-
declare const object$1: <OBJECT>({ schema: inputSchema, name, description }: {
|
|
4289
|
-
schema: FlexibleSchema$1<OBJECT>;
|
|
4327
|
+
type ValidatedSchema<SCHEMA> = 0 extends 1 & SCHEMA ? never : [SCHEMA] extends [FlexibleSchema$1] ? SCHEMA : never;
|
|
4328
|
+
type ResolveOutput<OUTPUT, SCHEMA> = [OUTPUT] extends [never] ? InferSchema$1<SCHEMA> : OUTPUT;
|
|
4329
|
+
type ObjectOptions<SCHEMA> = {
|
|
4330
|
+
/**
|
|
4331
|
+
* The schema of the object to generate.
|
|
4332
|
+
*/
|
|
4333
|
+
schema: SCHEMA;
|
|
4290
4334
|
/**
|
|
4291
4335
|
* Optional name of the output that should be generated.
|
|
4292
4336
|
* Used by some providers for additional LLM guidance, e.g. via tool or schema name.
|
|
@@ -4297,21 +4341,24 @@ declare const object$1: <OBJECT>({ schema: inputSchema, name, description }: {
|
|
|
4297
4341
|
* Used by some providers for additional LLM guidance, e.g. via tool or schema description.
|
|
4298
4342
|
*/
|
|
4299
4343
|
description?: string;
|
|
4300
|
-
}
|
|
4344
|
+
};
|
|
4301
4345
|
/**
|
|
4302
|
-
* Output specification for
|
|
4303
|
-
* When the model generates a text response, it will return an
|
|
4346
|
+
* Output specification for typed object generation using schemas.
|
|
4347
|
+
* When the model generates a text response, it will return an object that matches the schema.
|
|
4304
4348
|
*
|
|
4305
|
-
* @param
|
|
4306
|
-
* @param minItems - Optional minimum number of elements to generate.
|
|
4307
|
-
* @param maxItems - Optional maximum number of elements to generate.
|
|
4349
|
+
* @param schema - The schema of the object to generate.
|
|
4308
4350
|
* @param name - Optional name of the output that should be generated. Used by some providers for additional LLM guidance, e.g. via tool or schema name.
|
|
4309
4351
|
* @param description - Optional description of the output that should be generated. Used by some providers for additional LLM guidance, e.g. via tool or schema description.
|
|
4310
4352
|
*
|
|
4311
|
-
* @returns An output specification for generating
|
|
4353
|
+
* @returns An output specification for generating objects with the specified schema.
|
|
4312
4354
|
*/
|
|
4313
|
-
declare
|
|
4314
|
-
|
|
4355
|
+
declare function object$1<OBJECT>(options: ObjectOptions<FlexibleSchema$1<OBJECT>>): Output<OBJECT, DeepPartial<OBJECT>, never>;
|
|
4356
|
+
declare function object$1<OUTPUT = never, SCHEMA = FlexibleSchema$1<OUTPUT>>(options: ObjectOptions<ValidatedSchema<SCHEMA>>): Output<ResolveOutput<OUTPUT, SCHEMA>, DeepPartial<ResolveOutput<OUTPUT, SCHEMA>>, never>;
|
|
4357
|
+
type ArrayOptions<SCHEMA> = {
|
|
4358
|
+
/**
|
|
4359
|
+
* The schema of the array elements to generate.
|
|
4360
|
+
*/
|
|
4361
|
+
element: SCHEMA;
|
|
4315
4362
|
/**
|
|
4316
4363
|
* Optional minimum number of elements to generate.
|
|
4317
4364
|
*/
|
|
@@ -4330,7 +4377,21 @@ declare const array$1: <ELEMENT>({ element: inputElementSchema, minItems, maxIte
|
|
|
4330
4377
|
* Used by some providers for additional LLM guidance, e.g. via tool or schema description.
|
|
4331
4378
|
*/
|
|
4332
4379
|
description?: string;
|
|
4333
|
-
}
|
|
4380
|
+
};
|
|
4381
|
+
/**
|
|
4382
|
+
* Output specification for array generation.
|
|
4383
|
+
* When the model generates a text response, it will return an array of elements.
|
|
4384
|
+
*
|
|
4385
|
+
* @param element - The schema of the array elements to generate.
|
|
4386
|
+
* @param minItems - Optional minimum number of elements to generate.
|
|
4387
|
+
* @param maxItems - Optional maximum number of elements to generate.
|
|
4388
|
+
* @param name - Optional name of the output that should be generated. Used by some providers for additional LLM guidance, e.g. via tool or schema name.
|
|
4389
|
+
* @param description - Optional description of the output that should be generated. Used by some providers for additional LLM guidance, e.g. via tool or schema description.
|
|
4390
|
+
*
|
|
4391
|
+
* @returns An output specification for generating an array of elements.
|
|
4392
|
+
*/
|
|
4393
|
+
declare function array$1<ELEMENT>(options: ArrayOptions<FlexibleSchema$1<ELEMENT>>): Output<Array<ELEMENT>, Array<ELEMENT>, ELEMENT>;
|
|
4394
|
+
declare function array$1<OUTPUT = never, SCHEMA = FlexibleSchema$1<OUTPUT>>(options: ArrayOptions<ValidatedSchema<SCHEMA>>): Output<Array<ResolveOutput<OUTPUT, SCHEMA>>, Array<ResolveOutput<OUTPUT, SCHEMA>>, ResolveOutput<OUTPUT, SCHEMA>>;
|
|
4334
4395
|
/**
|
|
4335
4396
|
* Output specification for choice generation.
|
|
4336
4397
|
* When the model generates a text response, it will return one of the choice options.
|
|
@@ -4863,8 +4924,9 @@ type TranscriptionStartEventFor<OPERATION_ID extends string> = {
|
|
|
4863
4924
|
/** The specific model identifier. */
|
|
4864
4925
|
readonly modelId: string;
|
|
4865
4926
|
/**
|
|
4866
|
-
* Metadata about the input audio.
|
|
4867
|
-
*
|
|
4927
|
+
* Metadata about the input audio. Native URL transcription does not inspect
|
|
4928
|
+
* the audio, so its byte length and media type are unknown. Streaming byte
|
|
4929
|
+
* length is reported on the end event after consuming the stream.
|
|
4868
4930
|
*/
|
|
4869
4931
|
readonly audio: {
|
|
4870
4932
|
readonly byteLength: number | undefined;
|
|
@@ -4883,7 +4945,10 @@ type TranscriptionStartEventFor<OPERATION_ID extends string> = {
|
|
|
4883
4945
|
/** Additional provider-specific options. */
|
|
4884
4946
|
readonly providerOptions: ProviderOptions;
|
|
4885
4947
|
};
|
|
4886
|
-
type TranscriptionStartEvent = TranscriptionStartEventFor<'ai.transcribe'
|
|
4948
|
+
type TranscriptionStartEvent = TranscriptionStartEventFor<'ai.transcribe'> & {
|
|
4949
|
+
/** Requested shared timing granularities, when specified. */
|
|
4950
|
+
readonly timestampGranularities?: Array<TranscriptionModelV4TimestampGranularity>;
|
|
4951
|
+
};
|
|
4887
4952
|
type StreamTranscriptionStartEvent = TranscriptionStartEventFor<'ai.streamTranscribe'>;
|
|
4888
4953
|
/**
|
|
4889
4954
|
* Event passed to telemetry integrations when transcription completes.
|
|
@@ -4901,12 +4966,12 @@ type TranscriptionEndEventFor<OPERATION_ID extends string> = {
|
|
|
4901
4966
|
readonly modelId: string;
|
|
4902
4967
|
/** Metadata about the input audio. */
|
|
4903
4968
|
readonly audio: {
|
|
4904
|
-
readonly byteLength: number;
|
|
4905
|
-
readonly mediaType: string;
|
|
4969
|
+
readonly byteLength: OPERATION_ID extends 'ai.transcribe' ? number | undefined : number;
|
|
4970
|
+
readonly mediaType: OPERATION_ID extends 'ai.transcribe' ? string | undefined : string;
|
|
4906
4971
|
};
|
|
4907
4972
|
/** The complete transcript. */
|
|
4908
4973
|
readonly text: string;
|
|
4909
|
-
/** Transcript segments with timing information. */
|
|
4974
|
+
/** Transcript segments with timing information, retaining provider behavior. */
|
|
4910
4975
|
readonly segments: Array<{
|
|
4911
4976
|
readonly text: string;
|
|
4912
4977
|
readonly startSecond: number;
|
|
@@ -4925,7 +4990,14 @@ type TranscriptionEndEventFor<OPERATION_ID extends string> = {
|
|
|
4925
4990
|
/** Response metadata from the provider. */
|
|
4926
4991
|
readonly response: TranscriptionModelResponseMetadata;
|
|
4927
4992
|
};
|
|
4928
|
-
type TranscriptionEndEvent = TranscriptionEndEventFor<'ai.transcribe'
|
|
4993
|
+
type TranscriptionEndEvent = TranscriptionEndEventFor<'ai.transcribe'> & {
|
|
4994
|
+
/** Word timings returned by the provider, whether requested or returned by default. */
|
|
4995
|
+
readonly words?: Array<{
|
|
4996
|
+
readonly text: string;
|
|
4997
|
+
readonly startSecond: number;
|
|
4998
|
+
readonly endSecond: number;
|
|
4999
|
+
}>;
|
|
5000
|
+
};
|
|
4929
5001
|
type StreamTranscriptionEndEvent = TranscriptionEndEventFor<'ai.streamTranscribe'>;
|
|
4930
5002
|
//#endregion
|
|
4931
5003
|
//#region src/telemetry/tracing-channel.d.ts
|
|
@@ -4937,12 +5009,47 @@ type TelemetryTracingChannelMessage<EVENT = unknown> = {
|
|
|
4937
5009
|
};
|
|
4938
5010
|
//#endregion
|
|
4939
5011
|
//#region src/telemetry/telemetry.d.ts
|
|
5012
|
+
/** Serializable tracing identity shared by the processes of a durable run. */
|
|
5013
|
+
type DurableTelemetryContext = {
|
|
5014
|
+
traceId: string;
|
|
5015
|
+
rootSpanId: string;
|
|
5016
|
+
/** The integration's root-span data, reused when the run is reported. */
|
|
5017
|
+
rootSpanName?: string;
|
|
5018
|
+
rootAttributes?: Record<string, string | number | boolean | Array<string | null | undefined> | Array<number | null | undefined> | Array<boolean | null | undefined> | undefined>;
|
|
5019
|
+
traceFlags: number;
|
|
5020
|
+
traceState?: string;
|
|
5021
|
+
samplingDecision: 0 | 1 | 2;
|
|
5022
|
+
parentSpanContext?: {
|
|
5023
|
+
traceId: string;
|
|
5024
|
+
spanId: string;
|
|
5025
|
+
traceFlags: number;
|
|
5026
|
+
traceState?: string;
|
|
5027
|
+
};
|
|
5028
|
+
};
|
|
5029
|
+
/** Identifies live model events and the run events reported after completion. */
|
|
5030
|
+
type DurableTelemetryEventContext = {
|
|
5031
|
+
run: DurableTelemetryContext;
|
|
5032
|
+
stepNumber?: number;
|
|
5033
|
+
phase: 'live' | 'replay';
|
|
5034
|
+
/** Context has already been filtered before crossing the step boundary. */
|
|
5035
|
+
runtimeContext?: Record<string, unknown>;
|
|
5036
|
+
headers?: Record<string, string | undefined>;
|
|
5037
|
+
};
|
|
4940
5038
|
type InferTelemetryEvent<EVENT> = EVENT & Omit<TelemetryOptions, 'integrations' | 'isEnabled' | 'includeRuntimeContext'> & {
|
|
4941
5039
|
/**
|
|
4942
5040
|
* The version of the `ai` package that emitted this event.
|
|
4943
5041
|
* Absent in older releases.
|
|
4944
5042
|
*/
|
|
4945
5043
|
readonly aiVersion?: string;
|
|
5044
|
+
/**
|
|
5045
|
+
* Time at which the event occurred, in milliseconds since the Unix epoch.
|
|
5046
|
+
*
|
|
5047
|
+
* Set when events are reported after they happened, for example when a
|
|
5048
|
+
* durable workflow reports a run that spanned several processes.
|
|
5049
|
+
* Integrations should use it instead of the current time when present.
|
|
5050
|
+
*/
|
|
5051
|
+
readonly timestamp?: number;
|
|
5052
|
+
readonly durableContext?: DurableTelemetryEventContext;
|
|
4946
5053
|
};
|
|
4947
5054
|
type BivariantCallback<EVENT> = {
|
|
4948
5055
|
bivarianceHack(event: EVENT): PromiseLike<void> | void;
|
|
@@ -4954,6 +5061,15 @@ type OperationEndEvent = GenerateTextEndEvent<ToolSet$1> | GenerateObjectEndEven
|
|
|
4954
5061
|
* Methods can be sync or return a PromiseLike.
|
|
4955
5062
|
*/
|
|
4956
5063
|
interface Telemetry {
|
|
5064
|
+
/**
|
|
5065
|
+
* Capture a serializable tracing identity before a durable run's model calls.
|
|
5066
|
+
* Return undefined to preserve live per-model operations when the integration
|
|
5067
|
+
* cannot reconstruct a run span across processes. Integrations without this
|
|
5068
|
+
* hook receive the recorded lifecycle after completion.
|
|
5069
|
+
*/
|
|
5070
|
+
experimental_durable?: {
|
|
5071
|
+
captureContext: (event: InferTelemetryEvent<GenerateTextStartEvent>) => DurableTelemetryContext | undefined | PromiseLike<DurableTelemetryContext | undefined>;
|
|
5072
|
+
};
|
|
4957
5073
|
/**
|
|
4958
5074
|
* Called when an operation begins. Fired for text generation
|
|
4959
5075
|
* (generateText/streamText), object generation (generateObject/streamObject),
|
|
@@ -7327,7 +7443,7 @@ export declare function smoothStream<TOOLS extends ToolSet$1>({ delayInMs, chunk
|
|
|
7327
7443
|
//#endregion
|
|
7328
7444
|
//#region src/generate-text/stream-language-model-call.d.ts
|
|
7329
7445
|
type LanguageModelStreamPart<TOOLS extends ToolSet$1 = ToolSet$1> = Exclude<TextStreamPart<TOOLS>, {
|
|
7330
|
-
type: 'finish' | 'stream-start' | 'tool-output-denied' | 'start-step' | 'finish-step' | 'start' | 'abort';
|
|
7446
|
+
type: 'finish' | 'stream-start' | 'tool-output-denied' | 'start-step' | 'finish-step' | 'steering-message' | 'start' | 'abort';
|
|
7331
7447
|
}> | TextStreamTextDeltaPart | TextStreamReasoningDeltaPart | TextStreamFilePart | TextStreamReasoningFilePart | TextStreamToolApprovalRequestPart<TOOLS> | TextStreamToolApprovalResponsePart<TOOLS> | TextStreamToolCallPart<TOOLS> | TextStreamToolResultPart<TOOLS> | TextStreamToolErrorPart<TOOLS> | {
|
|
7332
7448
|
type: 'model-call-end';
|
|
7333
7449
|
finishReason: FinishReason;
|
|
@@ -7449,6 +7565,8 @@ declare function streamLanguageModelCall<TOOLS extends ToolSet$1, OUTPUT extends
|
|
|
7449
7565
|
} & Prompt & LanguageModelCallOptions): Promise<{
|
|
7450
7566
|
stream: AsyncIterableStream<LanguageModelStreamPart<TOOLS>>;
|
|
7451
7567
|
request?: {
|
|
7568
|
+
/** Sanitized HTTP origin, when the provider reports an endpoint. */
|
|
7569
|
+
url?: string;
|
|
7452
7570
|
/**
|
|
7453
7571
|
* Request HTTP body that was sent to the provider API.
|
|
7454
7572
|
*/
|
|
@@ -9702,13 +9820,21 @@ type VideoModelProviderMetadata = SharedV4ProviderMetadata;
|
|
|
9702
9820
|
*/
|
|
9703
9821
|
interface GenerateVideoResult {
|
|
9704
9822
|
/**
|
|
9705
|
-
* The first video
|
|
9823
|
+
* The first video available to the SDK.
|
|
9824
|
+
*
|
|
9825
|
+
* @throws {NoVideoGeneratedError} When all videos were delivered directly
|
|
9826
|
+
* to caller-managed storage. Use `uploadedVideos` to handle upload-only results.
|
|
9706
9827
|
*/
|
|
9707
9828
|
readonly video: GeneratedFile;
|
|
9708
9829
|
/**
|
|
9709
|
-
* All videos
|
|
9830
|
+
* All videos available to the SDK, excluding videos uploaded by the provider.
|
|
9710
9831
|
*/
|
|
9711
9832
|
readonly videos: Array<GeneratedFile>;
|
|
9833
|
+
/**
|
|
9834
|
+
* Number of videos delivered directly to caller-managed storage.
|
|
9835
|
+
* These videos are not downloaded and are not included in `videos`.
|
|
9836
|
+
*/
|
|
9837
|
+
readonly uploadedVideos: number;
|
|
9712
9838
|
/**
|
|
9713
9839
|
* Warnings for the call, e.g. unsupported settings.
|
|
9714
9840
|
*/
|
|
@@ -10261,9 +10387,12 @@ type RealtimeFactoryGetTokenOptions = Experimental_RealtimeFactoryV4GetTokenOpti
|
|
|
10261
10387
|
type RealtimeFactoryGetTokenResult = Experimental_RealtimeFactoryV4GetTokenResult;
|
|
10262
10388
|
type RealtimeModel = Experimental_RealtimeModelV4;
|
|
10263
10389
|
type RealtimeClientEvent = Experimental_RealtimeModelV4ClientEvent;
|
|
10390
|
+
type RealtimeServerConnection = Experimental_RealtimeModelV4ServerConnection;
|
|
10264
10391
|
type RealtimeServerEvent = Experimental_RealtimeModelV4ServerEvent;
|
|
10265
10392
|
type RealtimeSessionConfig = Experimental_RealtimeModelV4SessionConfig;
|
|
10393
|
+
type RealtimeSessionIntent = Experimental_RealtimeModelV4SessionIntent;
|
|
10266
10394
|
type RealtimeToolDefinition = Experimental_RealtimeModelV4ToolDefinition;
|
|
10395
|
+
type RealtimeUsage = Experimental_RealtimeModelV4Usage;
|
|
10267
10396
|
//#endregion
|
|
10268
10397
|
//#region src/realtime/get-realtime-tool-definitions.d.ts
|
|
10269
10398
|
declare function getRealtimeToolDefinitions<TOOLS extends ToolSet$1>({ tools, toolsContext }: {
|
|
@@ -10303,22 +10432,31 @@ interface RealtimeState {
|
|
|
10303
10432
|
//#region src/realtime/realtime-session.d.ts
|
|
10304
10433
|
type RealtimeSessionOptions = {
|
|
10305
10434
|
model: RealtimeModel;
|
|
10306
|
-
/**
|
|
10435
|
+
/** Application endpoints for token, SDP, provider-managed, or relay connections. */
|
|
10307
10436
|
api: {
|
|
10308
10437
|
token: string;
|
|
10309
10438
|
session?: never;
|
|
10310
10439
|
websocket?: never;
|
|
10311
10440
|
protocols?: never;
|
|
10441
|
+
provider?: never;
|
|
10312
10442
|
} | {
|
|
10313
10443
|
session: string;
|
|
10314
10444
|
token?: never;
|
|
10315
10445
|
websocket?: never;
|
|
10316
10446
|
protocols?: never;
|
|
10447
|
+
provider?: never;
|
|
10448
|
+
} | {
|
|
10449
|
+
provider: string;
|
|
10450
|
+
token?: never;
|
|
10451
|
+
session?: never;
|
|
10452
|
+
websocket?: never;
|
|
10453
|
+
protocols?: never;
|
|
10317
10454
|
} | {
|
|
10318
10455
|
websocket: string;
|
|
10319
10456
|
protocols?: string[];
|
|
10320
10457
|
token?: never;
|
|
10321
10458
|
session?: never;
|
|
10459
|
+
provider?: never;
|
|
10322
10460
|
};
|
|
10323
10461
|
sessionConfig?: Partial<RealtimeSessionConfig>;
|
|
10324
10462
|
sampleRate?: number;
|
|
@@ -10358,6 +10496,7 @@ declare abstract class AbstractRealtimeSession {
|
|
|
10358
10496
|
private audio?;
|
|
10359
10497
|
private pcm?;
|
|
10360
10498
|
private rtc?;
|
|
10499
|
+
private providerTransport?;
|
|
10361
10500
|
private suppliedStream?;
|
|
10362
10501
|
private captureGeneration;
|
|
10363
10502
|
private captureRequested;
|
|
@@ -10378,7 +10517,7 @@ declare abstract class AbstractRealtimeSession {
|
|
|
10378
10517
|
private finishAttempt;
|
|
10379
10518
|
private closeFailed;
|
|
10380
10519
|
disconnect(): void;
|
|
10381
|
-
/** Wait for
|
|
10520
|
+
/** Wait for provider cleanup or supported session-close finalization. */
|
|
10382
10521
|
close(options?: {
|
|
10383
10522
|
eventId?: string;
|
|
10384
10523
|
}): Promise<void>;
|
|
@@ -10856,6 +10995,7 @@ interface TranscriptionResult {
|
|
|
10856
10995
|
/**
|
|
10857
10996
|
* Array of transcript segments with timing information.
|
|
10858
10997
|
* Each segment represents a portion of the transcribed text with start and end times.
|
|
10998
|
+
* Segments retain the provider's behavior and may represent individual words.
|
|
10859
10999
|
*/
|
|
10860
11000
|
readonly segments: Array<{
|
|
10861
11001
|
/**
|
|
@@ -10871,6 +11011,24 @@ interface TranscriptionResult {
|
|
|
10871
11011
|
*/
|
|
10872
11012
|
readonly endSecond: number;
|
|
10873
11013
|
}>;
|
|
11014
|
+
/**
|
|
11015
|
+
* Word-level timings returned by the provider, whether explicitly requested
|
|
11016
|
+
* or returned by default. Undefined when the provider does not return them.
|
|
11017
|
+
*/
|
|
11018
|
+
readonly words?: Array<{
|
|
11019
|
+
/**
|
|
11020
|
+
* The text of this word.
|
|
11021
|
+
*/
|
|
11022
|
+
readonly text: string;
|
|
11023
|
+
/**
|
|
11024
|
+
* The start time of this word in seconds.
|
|
11025
|
+
*/
|
|
11026
|
+
readonly startSecond: number;
|
|
11027
|
+
/**
|
|
11028
|
+
* The end time of this word in seconds.
|
|
11029
|
+
*/
|
|
11030
|
+
readonly endSecond: number;
|
|
11031
|
+
}>;
|
|
10874
11032
|
/**
|
|
10875
11033
|
* The detected language of the audio content, as an ISO-639-1 code (e.g., 'en' for English).
|
|
10876
11034
|
* May be undefined if the language couldn't be detected.
|
|
@@ -10896,7 +11054,7 @@ interface TranscriptionResult {
|
|
|
10896
11054
|
}
|
|
10897
11055
|
//#endregion
|
|
10898
11056
|
//#region src/transcribe/transcribe.d.ts
|
|
10899
|
-
export declare function transcribe({ model, audio, providerOptions, maxRetries: maxRetriesArg, abortSignal, headers, telemetry, download: downloadFn, _internal: { generateCallId } }: {
|
|
11057
|
+
export declare function transcribe({ model, audio, providerOptions, timestampGranularities, maxRetries: maxRetriesArg, abortSignal, headers, telemetry, download: downloadFn, _internal: { generateCallId } }: {
|
|
10900
11058
|
/**
|
|
10901
11059
|
* The transcription model to use.
|
|
10902
11060
|
*/
|
|
@@ -10920,6 +11078,15 @@ export declare function transcribe({ model, audio, providerOptions, maxRetries:
|
|
|
10920
11078
|
* ```
|
|
10921
11079
|
*/
|
|
10922
11080
|
providerOptions?: ProviderOptions;
|
|
11081
|
+
/**
|
|
11082
|
+
* Word and segment timings to request.
|
|
11083
|
+
*
|
|
11084
|
+
* Supported adapters map this onto the provider's native control when the
|
|
11085
|
+
* matching provider option is omitted. An explicit provider option wins.
|
|
11086
|
+
* Supported adapters warn when they cannot return a requested granularity.
|
|
11087
|
+
* An empty array requests no shared timing granularity; provider defaults may vary.
|
|
11088
|
+
*/
|
|
11089
|
+
timestampGranularities?: Array<TranscriptionModelV4TimestampGranularity>;
|
|
10923
11090
|
/**
|
|
10924
11091
|
* Maximum number of retries per transcript model call. Set to 0 to disable retries.
|
|
10925
11092
|
*
|
|
@@ -10941,6 +11108,8 @@ export declare function transcribe({ model, audio, providerOptions, maxRetries:
|
|
|
10941
11108
|
telemetry?: TelemetryOptions;
|
|
10942
11109
|
/**
|
|
10943
11110
|
* Custom download function for fetching audio from URLs.
|
|
11111
|
+
* Providing this option forces local downloading even when the provider
|
|
11112
|
+
* supports native URL transcription.
|
|
10944
11113
|
* Use `createDownload()` from `ai` to create a download function with custom size limits.
|
|
10945
11114
|
*
|
|
10946
11115
|
* @default createDownload() (2 GiB limit)
|
|
@@ -11382,5 +11551,5 @@ export declare function uploadSkill({ api, files, displayTitle, providerOptions
|
|
|
11382
11551
|
files: UploadSkillFile[];
|
|
11383
11552
|
}): Promise<UploadSkillResult>;
|
|
11384
11553
|
//#endregion
|
|
11385
|
-
export { AISDKError, APICallError, type ActiveTools, type Agent, type AgentCallParameters, type AgentStreamParameters, type AssistantContent, type AssistantModelMessage, type AsyncIterableStream, type CallWarning, type CallWarningRegistry, type ChatAddToolApproveResponseFunction, type ChatAddToolOutputFunction, type ChatInit, type ChatOnDataCallback, type ChatOnErrorCallback, type ChatOnFinishCallback, type ChatOnToolCallCallback, type ChatRequestOptions, type ChatState, type ChatStatus, type ChatTransport, type ChunkDetector, type Citation, type CompletionRequestOptions, type ContentPart, type CreateUIMessage, type CustomContentUIPart, type DataContent, type DataUIPart, type DeepPartial, type DirectChatTransportOptions, DownloadError, type DynamicToolCall, type DynamicToolError, type DynamicToolResult, type DynamicToolUIPart, type Embedding, type EmbeddingModel, type EmbeddingModelMiddleware, type EmbeddingModelUsage, EmptyResponseBodyError, type ErrorHandler, AbstractRealtimeSession as Experimental_AbstractRealtimeSession, ToolLoopAgent as Experimental_Agent, type ToolLoopAgentSettings as Experimental_AgentSettings, type ToolLoopAgentSettings, type Batch as Experimental_Batch, type BatchError as Experimental_BatchError, type BatchItemResult as Experimental_BatchItemResult, type BatchProvider as Experimental_BatchProvider, type BatchReference as Experimental_BatchReference, type BatchRequest as Experimental_BatchRequest, type BatchStatus as Experimental_BatchStatus, type CancelBatchOptions as Experimental_CancelBatchOptions, type CancelBatchResult as Experimental_CancelBatchResult, type DecideEndEvent as Experimental_DecideEndEvent, type DecideStartEvent as Experimental_DecideStartEvent, type DecisionAnswer as Experimental_DecisionAnswer, type DecisionModel as Experimental_DecisionModel, type DecisionModelCallEndEvent as Experimental_DecisionModelCallEndEvent, type DecisionModelCallStartEvent as Experimental_DecisionModelCallStartEvent, type DecisionProviderRegistry as Experimental_DecisionProviderRegistry, type Experimental_DecisionQuestion, Experimental_DecisionRefusalError, type DecisionResult as Experimental_DecisionResult, type DecisionState as Experimental_DecisionState, type DecisionStatePart as Experimental_DecisionStatePart, Experimental_DecisionUnsupportedQuestionTypeError, type DownloadFunction as Experimental_DownloadFunction, type Experimental_GeneratedImage, type GetBatchResultsOptions as Experimental_GetBatchResultsOptions, type GetBatchStatusOptions as Experimental_GetBatchStatusOptions, type ImageBatchGenerationResult as Experimental_ImageBatchGenerationResult, type ImageBatchItemResult as Experimental_ImageBatchItemResult, type ImageBatchRequest as Experimental_ImageBatchRequest, type InferAgentUIMessage as Experimental_InferAgentUIMessage, type InferAgentUIMessage, type LanguageModelStreamPart as Experimental_LanguageModelStreamPart, type LanguageModelStreamPart, type ListBatchesOptions as Experimental_ListBatchesOptions, type ListBatchesResult as Experimental_ListBatchesResult, type LogWarningsFunction as Experimental_LogWarningsFunction, type LogWarningsFunction, type RealtimeClientEvent as Experimental_RealtimeClientEvent, type RealtimeFactory as Experimental_RealtimeFactory, type RealtimeFactoryGetTokenOptions as Experimental_RealtimeFactoryGetTokenOptions, type RealtimeFactoryGetTokenResult as Experimental_RealtimeFactoryGetTokenResult, type RealtimeModel as Experimental_RealtimeModel, type RealtimeServerEvent as Experimental_RealtimeServerEvent, type RealtimeSessionConfig as Experimental_RealtimeSessionConfig, type RealtimeSessionOptions as Experimental_RealtimeSessionOptions, type RealtimeSessionState as Experimental_RealtimeSessionState, type RealtimeSetupResponse as Experimental_RealtimeSetupResponse, type RealtimeState as Experimental_RealtimeState, type RealtimeStatus as Experimental_RealtimeStatus, type RealtimeToolDefinition as Experimental_RealtimeToolDefinition, type Experimental_SandboxDirectoryEntry, type Experimental_SandboxFileStat, type Experimental_SandboxProcess, type Experimental_SandboxSession, type Experimental_SpeechResult, type SpeechStreamPart as Experimental_SpeechStreamPart, type SpeechStreamUsage as Experimental_SpeechStreamUsage, type SpeechTextPart as Experimental_SpeechTextPart, type StartBatchOptions as Experimental_StartBatchOptions, type StartBatchResult as Experimental_StartBatchResult, type Steering as Experimental_Steering, type SteeringNotDeliveredReason as Experimental_SteeringNotDeliveredReason, type SteeringOutcome as Experimental_SteeringOutcome, type StreamSpeechResult as Experimental_StreamSpeechResult, type StreamTranscriptionEndEvent as Experimental_StreamTranscriptionEndEvent, type StreamTranscriptionStartEvent as Experimental_StreamTranscriptionStartEvent, type StreamTranslationResult as Experimental_StreamTranslationResult, type TextBatchGenerationResult as Experimental_TextBatchGenerationResult, type TextBatchItemResult as Experimental_TextBatchItemResult, type TextBatchRequest as Experimental_TextBatchRequest, type Experimental_ToolCallerTool, type Experimental_ToolCallers, type Experimental_TranscriptionResult, type TranslationStreamPart as Experimental_TranslationStreamPart, type FilePart, type FileUIPart, type FinishReason, type FlexibleSchema, type GatewayAsyncJobMetadata, type GatewayModelId, type GatewayProviderMetadata, type GenerateImageCall, type GenerateImageResult, type GenerateObjectEndEvent, type GenerateObjectResult, type GenerateObjectStartEvent, type GenerateObjectStepEndEvent, type GenerateObjectStepStartEvent, type GenerateSpeechEndEvent, type GenerateSpeechStartEvent, type GenerateTextAbortEvent, type GenerateTextEndEvent, type GenerateTextInclude, type GenerateTextOnAbortCallback, type GenerateTextOnEndCallback, type GenerateTextOnFinishCallback, type GenerateTextOnStartCallback, type GenerateTextOnStepEndCallback, type GenerateTextOnStepErrorCallback, type GenerateTextOnStepFinishCallback, type GenerateTextOnStepStartCallback, type GenerateTextResult, type GenerateTextStartEvent, type GenerateTextStepEndEvent, type GenerateTextStepErrorEvent, type GenerateTextStepStartEvent, type GenerateVideoPrompt, type GenerateVideoResult, type GeneratedAudioFile, type GeneratedFile, type GenericToolApprovalFunction, type GetVideoStatusResult, type HttpChatTransportInitOptions, type IdGenerator, type ImageModel, type ImageModelMiddleware, type ImageModelProviderMetadata, type ImageModelResponseMetadata, type ImageModelUsage, type ImagePart, type InferCompleteOutput as InferGenerateOutput, type InferSchema, type InferPartialOutput as InferStreamOutput, type InferTelemetryEvent, type InferToolInput, type InferToolOutput, type InferUIDataParts, type InferUIMessageChunk, type InferUITool, type InferUITools, type Instructions, InvalidPromptError, InvalidResponseDataError, JSONParseError, type JSONSchema7, type JSONValue, type LanguageModel, type LanguageModelCallEndEvent, type LanguageModelCallOptions, type LanguageModelCallStartEvent, type LanguageModelMiddleware, type LanguageModelRequestMetadata, type LanguageModelResponseMetadata, type LanguageModelUsage, LoadAPIKeyError, LoadSettingError, type ModelInfo, type ModelMessage, NoContentGeneratedError, NoSuchModelError, NoSuchProviderReferenceError, type ObjectStreamPart, type OnFinishEvent, type OnLanguageModelCallEndCallback, type OnLanguageModelCallStartCallback, type OnStartEvent, type OnStepFinishEvent, type OnStepStartEvent, type OnToolCallFinishEvent, type OnToolCallStartEvent, type OnToolExecutionEndCallback, type OnToolExecutionStartCallback, output_d_exports as Output, type OutputChunkTimingStats, type Output as OutputInterface, type PrepareReconnectToStreamRequest, type PrepareSendMessagesRequest, type PrepareStepFunction, type PrepareStepResult, type PrepareWebSocketChatTransportReconnectToStreamRequest, type PrepareWebSocketChatTransportSendMessagesRequest, type Prompt, type Provider, type ProviderMetadata, type ProviderReference, type ProviderRegistryProvider, type ReasoningFileOutput, type ReasoningFileUIPart, type ReasoningOutput, type ReasoningUIPart, type RepairTextFunction, type RequestOptions, type RerankEndEvent, type RerankResult, type RerankStartEvent, type RerankingModel, type RerankingModelCallEndEvent, type RerankingModelCallStartEvent, type SafeValidateUIMessagesResult, type SafeValidateWebSocketChatTransportRequestResult, type Schema, type SingleToolApprovalFunction, type SourceDocumentUIPart, type SourceUrlUIPart, type SpeechModel, type SpeechModelResponseMetadata, type SpeechResult, type StartVideoResult, type StaticToolCall, type StaticToolError, type StaticToolOutputDenied, type StaticToolResult, type StepResult, type StepResultPerformance, type StepStartUIPart, type StopCondition, type StreamObjectOnFinishCallback, type StreamObjectResult, type StreamTextEndEvent, type StreamTextInclude, type StreamTextOnChunkCallback, type StreamTextOnEndCallback, type StreamTextOnErrorCallback, type StreamTextOnErrorResult, type StreamTextOnErrorRetryCallback, type StreamTextResult, type StreamTextTransform, type StreamTranscriptionResult, type SystemModelMessage, type Telemetry, type TelemetryOptions, type TelemetryTracingChannelMessage, type TelemetryTracingEventType, type TextPart, type TextStreamPart, type TextUIPart, type TimeoutConfiguration, type ToUIMessageChunkOptions, TooManyEmbeddingValuesForCallError, type Tool, type ToolApprovalConfiguration, type ToolApprovalRequest, type ToolApprovalRequestOutput, type ToolApprovalResponse, type ToolApprovalResponseOutput, type ToolApprovalStatus, type ToolCallPart, type ToolCallRepairFunction, type ToolChoice, type ToolContent, type ToolExecuteFunction, type ToolExecutionEndEvent, type ToolExecutionOptions, type ToolExecutionStartEvent, type ToolInputRefinement, type ToolModelMessage, type ToolOrder, type ToolOutputErrorUIPart, type ToolResultPart, type ToolSet, type ToolUIPart, type TranscriptionEndEvent, type TranscriptionModel, type TranscriptionModelResponseMetadata, type TranscriptionResult, type TranscriptionStartEvent, type TranscriptionStreamPart, TypeValidationError, type TypedToolCall, type TypedToolError, type TypedToolOutputDenied, type TypedToolResult, type UIDataPartSchemas, type UIDataTypes, type UIMessage, type UIMessageChunk, type UIMessagePart, type UIMessageStreamOnEndCallback, type UIMessageStreamOnFinishCallback, type UIMessageStreamOnStepEndCallback, type UIMessageStreamOnStepFinishCallback, type UIMessageStreamOptions, type UIMessageStreamOutcome, type UIMessageStreamWriter, type UIMessageStreamWriterWithOutcome, type UITool, type UIToolInvocation, type UITools, UnsupportedFunctionalityError, type UploadFileResult, type UploadSkillResult, type UseCompletionOptions, type UserContent, type UserModelMessage, type Warning, type WebSocketChatTransportAbortRequest, type WebSocketChatTransportInitOptions, type WebSocketChatTransportRequest, type WebSocketChatTransportResponse, type WebSocketChatTransportResumeRequest, type WebSocketChatTransportSendRequest, asSchema, createGateway, createIdGenerator, dynamicTool, cancelBatch as experimental_cancelBatch, createSteering as experimental_createSteering, decide as experimental_decide, decodeRealtimeAudio as experimental_decodeRealtimeAudio, encodeRealtimeAudio as experimental_encodeRealtimeAudio, filterActiveTools as experimental_filterActiveTools, experimental_generateSpeech, getBatchResults as experimental_getBatchResults, getBatchStatus as experimental_getBatchStatus, getRealtimeToolDefinitions as experimental_getRealtimeToolDefinitions, listBatches as experimental_listBatches, resampleAudio as experimental_resampleAudio, startBatch as experimental_startBatch, streamLanguageModelCall as experimental_streamLanguageModelCall, streamSpeech as experimental_streamSpeech, streamTextLowMemory as experimental_streamTextLowMemory, streamTranscribe as experimental_streamTranscribe, streamTranslate as experimental_streamTranslate, experimental_toolCaller, experimental_transcribe, gateway, generateId$1 as generateId, isStepCount as stepCountIs, jsonSchema, parseJsonEventStream, tool$1 as tool, zodSchema };
|
|
11554
|
+
export { AISDKError, APICallError, type ActiveTools, type Agent, type AgentCallParameters, type AgentStreamParameters, type AssistantContent, type AssistantModelMessage, type AsyncIterableStream, type CallWarning, type CallWarningRegistry, type ChatAddToolApproveResponseFunction, type ChatAddToolOutputFunction, type ChatInit, type ChatOnDataCallback, type ChatOnErrorCallback, type ChatOnFinishCallback, type ChatOnToolCallCallback, type ChatRequestOptions, type ChatState, type ChatStatus, type ChatTransport, type ChunkDetector, type Citation, type CompletionRequestOptions, type ContentPart, type CreateUIMessage, type CustomContentUIPart, type DataContent, type DataUIPart, type DeepPartial, type DirectChatTransportOptions, DownloadError, type DurableTelemetryContext, type DurableTelemetryEventContext, type DynamicToolCall, type DynamicToolError, type DynamicToolResult, type DynamicToolUIPart, type Embedding, type EmbeddingModel, type EmbeddingModelMiddleware, type EmbeddingModelUsage, EmptyResponseBodyError, type ErrorHandler, AbstractRealtimeSession as Experimental_AbstractRealtimeSession, ToolLoopAgent as Experimental_Agent, type ToolLoopAgentSettings as Experimental_AgentSettings, type ToolLoopAgentSettings, type Batch as Experimental_Batch, type BatchError as Experimental_BatchError, type BatchItemResult as Experimental_BatchItemResult, type BatchProvider as Experimental_BatchProvider, type BatchReference as Experimental_BatchReference, type BatchRequest as Experimental_BatchRequest, type BatchStatus as Experimental_BatchStatus, type CancelBatchOptions as Experimental_CancelBatchOptions, type CancelBatchResult as Experimental_CancelBatchResult, type DecideEndEvent as Experimental_DecideEndEvent, type DecideStartEvent as Experimental_DecideStartEvent, type DecisionAnswer as Experimental_DecisionAnswer, type DecisionModel as Experimental_DecisionModel, type DecisionModelCallEndEvent as Experimental_DecisionModelCallEndEvent, type DecisionModelCallStartEvent as Experimental_DecisionModelCallStartEvent, type DecisionProviderRegistry as Experimental_DecisionProviderRegistry, type Experimental_DecisionQuestion, Experimental_DecisionRefusalError, type DecisionResult as Experimental_DecisionResult, type DecisionState as Experimental_DecisionState, type DecisionStatePart as Experimental_DecisionStatePart, Experimental_DecisionUnsupportedQuestionTypeError, type DownloadFunction as Experimental_DownloadFunction, type Experimental_GeneratedImage, type GetBatchResultsOptions as Experimental_GetBatchResultsOptions, type GetBatchStatusOptions as Experimental_GetBatchStatusOptions, type ImageBatchGenerationResult as Experimental_ImageBatchGenerationResult, type ImageBatchItemResult as Experimental_ImageBatchItemResult, type ImageBatchRequest as Experimental_ImageBatchRequest, type InferAgentUIMessage as Experimental_InferAgentUIMessage, type InferAgentUIMessage, type LanguageModelStreamPart as Experimental_LanguageModelStreamPart, type LanguageModelStreamPart, type ListBatchesOptions as Experimental_ListBatchesOptions, type ListBatchesResult as Experimental_ListBatchesResult, type LogWarningsFunction as Experimental_LogWarningsFunction, type LogWarningsFunction, type RealtimeClientEvent as Experimental_RealtimeClientEvent, type RealtimeFactory as Experimental_RealtimeFactory, type RealtimeFactoryGetTokenOptions as Experimental_RealtimeFactoryGetTokenOptions, type RealtimeFactoryGetTokenResult as Experimental_RealtimeFactoryGetTokenResult, type RealtimeModel as Experimental_RealtimeModel, type RealtimeServerConnection as Experimental_RealtimeServerConnection, type RealtimeServerEvent as Experimental_RealtimeServerEvent, type RealtimeSessionConfig as Experimental_RealtimeSessionConfig, type RealtimeSessionIntent as Experimental_RealtimeSessionIntent, type RealtimeSessionOptions as Experimental_RealtimeSessionOptions, type RealtimeSessionState as Experimental_RealtimeSessionState, type RealtimeSetupResponse as Experimental_RealtimeSetupResponse, type RealtimeState as Experimental_RealtimeState, type RealtimeStatus as Experimental_RealtimeStatus, type RealtimeToolDefinition as Experimental_RealtimeToolDefinition, type RealtimeUsage as Experimental_RealtimeUsage, type Experimental_SandboxDirectoryEntry, type Experimental_SandboxFileStat, type Experimental_SandboxProcess, type Experimental_SandboxSession, type Experimental_SpeechResult, type SpeechStreamPart as Experimental_SpeechStreamPart, type SpeechStreamUsage as Experimental_SpeechStreamUsage, type SpeechTextPart as Experimental_SpeechTextPart, type StartBatchOptions as Experimental_StartBatchOptions, type StartBatchResult as Experimental_StartBatchResult, type Steering as Experimental_Steering, type SteeringMessageUIPart as Experimental_SteeringMessageUIPart, type SteeringNotDeliveredReason as Experimental_SteeringNotDeliveredReason, type SteeringOutcome as Experimental_SteeringOutcome, type StreamSpeechResult as Experimental_StreamSpeechResult, type StreamTranscriptionEndEvent as Experimental_StreamTranscriptionEndEvent, type StreamTranscriptionStartEvent as Experimental_StreamTranscriptionStartEvent, type StreamTranslationResult as Experimental_StreamTranslationResult, type TextBatchGenerationResult as Experimental_TextBatchGenerationResult, type TextBatchItemResult as Experimental_TextBatchItemResult, type TextBatchRequest as Experimental_TextBatchRequest, type Experimental_ToolCallerTool, type Experimental_ToolCallers, type Experimental_TranscriptionResult, type TranslationStreamPart as Experimental_TranslationStreamPart, type FilePart, type FileUIPart, type FinishReason, type FlexibleSchema, type GatewayAsyncJobMetadata, type GatewayModelId, type GatewayProviderMetadata, type GenerateImageCall, type GenerateImageResult, type GenerateObjectEndEvent, type GenerateObjectResult, type GenerateObjectStartEvent, type GenerateObjectStepEndEvent, type GenerateObjectStepStartEvent, type GenerateSpeechEndEvent, type GenerateSpeechStartEvent, type GenerateTextAbortEvent, type GenerateTextEndEvent, type GenerateTextInclude, type GenerateTextOnAbortCallback, type GenerateTextOnEndCallback, type GenerateTextOnFinishCallback, type GenerateTextOnStartCallback, type GenerateTextOnStepEndCallback, type GenerateTextOnStepErrorCallback, type GenerateTextOnStepFinishCallback, type GenerateTextOnStepStartCallback, type GenerateTextResult, type GenerateTextStartEvent, type GenerateTextStepEndEvent, type GenerateTextStepErrorEvent, type GenerateTextStepStartEvent, type GenerateVideoPrompt, type GenerateVideoResult, type GeneratedAudioFile, type GeneratedFile, type GenericToolApprovalFunction, type GetVideoStatusResult, type HttpChatTransportInitOptions, type IdGenerator, type ImageModel, type ImageModelMiddleware, type ImageModelProviderMetadata, type ImageModelResponseMetadata, type ImageModelUsage, type ImagePart, type InferCompleteOutput as InferGenerateOutput, type InferSchema, type InferPartialOutput as InferStreamOutput, type InferTelemetryEvent, type InferToolInput, type InferToolOutput, type InferUIDataParts, type InferUIMessageChunk, type InferUITool, type InferUITools, type Instructions, InvalidPromptError, InvalidResponseDataError, JSONParseError, type JSONSchema7, type JSONValue, type LanguageModel, type LanguageModelCallEndEvent, type LanguageModelCallOptions, type LanguageModelCallStartEvent, type LanguageModelMiddleware, type LanguageModelRequestMetadata, type LanguageModelResponseMetadata, type LanguageModelUsage, LoadAPIKeyError, LoadSettingError, type ModelInfo, type ModelMessage, NoContentGeneratedError, NoSuchModelError, NoSuchProviderReferenceError, type ObjectStreamPart, type OnFinishEvent, type OnLanguageModelCallEndCallback, type OnLanguageModelCallStartCallback, type OnStartEvent, type OnStepFinishEvent, type OnStepStartEvent, type OnToolCallFinishEvent, type OnToolCallStartEvent, type OnToolExecutionEndCallback, type OnToolExecutionStartCallback, output_d_exports as Output, type OutputChunkTimingStats, type Output as OutputInterface, type PrepareReconnectToStreamRequest, type PrepareSendMessagesRequest, type PrepareStepFunction, type PrepareStepResult, type PrepareWebSocketChatTransportReconnectToStreamRequest, type PrepareWebSocketChatTransportSendMessagesRequest, type Prompt, type Provider, type ProviderMetadata, type ProviderReference, type ProviderRegistryProvider, type ReasoningFileOutput, type ReasoningFileUIPart, type ReasoningOutput, type ReasoningUIPart, type RepairTextFunction, type RequestOptions, type RerankEndEvent, type RerankResult, type RerankStartEvent, type RerankingModel, type RerankingModelCallEndEvent, type RerankingModelCallStartEvent, type SafeValidateUIMessagesResult, type SafeValidateWebSocketChatTransportRequestResult, type Schema, type SingleToolApprovalFunction, type SourceDocumentUIPart, type SourceUrlUIPart, type SpeechModel, type SpeechModelResponseMetadata, type SpeechResult, type StartVideoResult, type StaticToolCall, type StaticToolError, type StaticToolOutputDenied, type StaticToolResult, type StepResult, type StepResultPerformance, type StepStartUIPart, type StopCondition, type StreamObjectOnFinishCallback, type StreamObjectResult, type StreamTextEndEvent, type StreamTextInclude, type StreamTextOnChunkCallback, type StreamTextOnEndCallback, type StreamTextOnErrorCallback, type StreamTextOnErrorResult, type StreamTextOnErrorRetryCallback, type StreamTextResult, type StreamTextTransform, type StreamTranscriptionResult, type SystemModelMessage, type Telemetry, type TelemetryOptions, type TelemetryTracingChannelMessage, type TelemetryTracingEventType, type TextPart, type TextStreamPart, type TextUIPart, type TimeoutConfiguration, type ToUIMessageChunkOptions, TooManyEmbeddingValuesForCallError, type Tool, type ToolApprovalConfiguration, type ToolApprovalRequest, type ToolApprovalRequestOutput, type ToolApprovalResponse, type ToolApprovalResponseOutput, type ToolApprovalStatus, type ToolCallPart, type ToolCallRepairFunction, type ToolChoice, type ToolContent, type ToolExecuteFunction, type ToolExecutionEndEvent, type ToolExecutionOptions, type ToolExecutionStartEvent, type ToolInputRefinement, type ToolModelMessage, type ToolOrder, type ToolOutputErrorUIPart, type ToolResultPart, type ToolSet, type ToolUIPart, type TranscriptionEndEvent, type TranscriptionModel, type TranscriptionModelResponseMetadata, type TranscriptionResult, type TranscriptionStartEvent, type TranscriptionStreamPart, TypeValidationError, type TypedToolCall, type TypedToolError, type TypedToolOutputDenied, type TypedToolResult, type UIDataPartSchemas, type UIDataTypes, type UIMessage, type UIMessageChunk, type UIMessagePart, type UIMessageStreamOnEndCallback, type UIMessageStreamOnFinishCallback, type UIMessageStreamOnStepEndCallback, type UIMessageStreamOnStepFinishCallback, type UIMessageStreamOptions, type UIMessageStreamOutcome, type UIMessageStreamWriter, type UIMessageStreamWriterWithOutcome, type UITool, type UIToolInvocation, type UITools, UnsupportedFunctionalityError, type UploadFileResult, type UploadSkillResult, type UseCompletionOptions, type UserContent, type UserModelMessage, type Warning, type WebSocketChatTransportAbortRequest, type WebSocketChatTransportInitOptions, type WebSocketChatTransportRequest, type WebSocketChatTransportResponse, type WebSocketChatTransportResumeRequest, type WebSocketChatTransportSendRequest, asSchema, createGateway, createIdGenerator, dynamicTool, cancelBatch as experimental_cancelBatch, createSteering as experimental_createSteering, decide as experimental_decide, decodeRealtimeAudio as experimental_decodeRealtimeAudio, encodeRealtimeAudio as experimental_encodeRealtimeAudio, filterActiveTools as experimental_filterActiveTools, experimental_generateSpeech, getBatchResults as experimental_getBatchResults, getBatchStatus as experimental_getBatchStatus, getRealtimeToolDefinitions as experimental_getRealtimeToolDefinitions, listBatches as experimental_listBatches, resampleAudio as experimental_resampleAudio, startBatch as experimental_startBatch, streamLanguageModelCall as experimental_streamLanguageModelCall, streamSpeech as experimental_streamSpeech, streamTextLowMemory as experimental_streamTextLowMemory, streamTranscribe as experimental_streamTranscribe, streamTranslate as experimental_streamTranslate, experimental_toolCaller, experimental_transcribe, gateway, generateId$1 as generateId, isStepCount as stepCountIs, jsonSchema, parseJsonEventStream, tool$1 as tool, zodSchema };
|
|
11386
11555
|
//# sourceMappingURL=index.d.ts.map
|