@runpod/ai-sdk-provider 0.3.1 → 0.3.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +12 -0
- package/README.md +4 -13
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,17 @@
|
|
|
1
1
|
# @runpod/ai-sdk-provider
|
|
2
2
|
|
|
3
|
+
## 0.3.3
|
|
4
|
+
|
|
5
|
+
### Patch Changes
|
|
6
|
+
|
|
7
|
+
- 7adbc33: docs: moved everything into "about Runpod"
|
|
8
|
+
|
|
9
|
+
## 0.3.2
|
|
10
|
+
|
|
11
|
+
### Patch Changes
|
|
12
|
+
|
|
13
|
+
- 012cb6f: docs: moved "get api key on console" into "apiKey"
|
|
14
|
+
|
|
3
15
|
## 0.3.1
|
|
4
16
|
|
|
5
17
|
### Patch Changes
|
package/README.md
CHANGED
|
@@ -2,8 +2,6 @@
|
|
|
2
2
|
|
|
3
3
|
The **Runpod provider** for the [AI SDK](https://ai-sdk.dev/docs) contains language model and image generation support for [Runpod's](https://runpod.io) public endpoints.
|
|
4
4
|
|
|
5
|
-
Runpod is the foundation for developers to build, deploy, and scale custom AI systems.
|
|
6
|
-
|
|
7
5
|
## Setup
|
|
8
6
|
|
|
9
7
|
The Runpod provider is available in the `@runpod/ai-sdk-provider` module. You can install it with:
|
|
@@ -56,6 +54,7 @@ You can use the following optional settings to customize the Runpod provider ins
|
|
|
56
54
|
|
|
57
55
|
API key that is being sent using the `Authorization` header.
|
|
58
56
|
It defaults to the `RUNPOD_API_KEY` environment variable.
|
|
57
|
+
You can obtain your api key from the [Runpod Console](https://console.runpod.io/user/settings) under "API Keys".
|
|
59
58
|
|
|
60
59
|
- **headers** _Record<string,string>_
|
|
61
60
|
|
|
@@ -67,8 +66,6 @@ You can use the following optional settings to customize the Runpod provider ins
|
|
|
67
66
|
You can use it as a middleware to intercept requests,
|
|
68
67
|
or to provide a custom fetch implementation for e.g. testing.
|
|
69
68
|
|
|
70
|
-
You can obtain your Runpod API key from the [Runpod Console](https://console.runpod.io/user/settings) under "API Keys".
|
|
71
|
-
|
|
72
69
|
## Language Models
|
|
73
70
|
|
|
74
71
|
You can create language models using the provider instance. The first argument is the model ID:
|
|
@@ -167,7 +164,6 @@ const { object } = await generateObject({
|
|
|
167
164
|
## Image Models
|
|
168
165
|
|
|
169
166
|
You can create Runpod image models using the `.imageModel()` factory method.
|
|
170
|
-
For more on image generation with the AI SDK see [generateImage()](/docs/reference/ai-sdk-core/generate-image).
|
|
171
167
|
|
|
172
168
|
### Basic Usage
|
|
173
169
|
|
|
@@ -304,13 +300,8 @@ Runpod image models support flexible provider options through the `providerOptio
|
|
|
304
300
|
| `maxPollAttempts` | `number` | `60` | Maximum polling attempts for async generation |
|
|
305
301
|
| `pollIntervalMillis` | `number` | `5000` | Polling interval in milliseconds (5 seconds) |
|
|
306
302
|
|
|
307
|
-
##
|
|
308
|
-
|
|
309
|
-
Runpod offers public endpoints (everything above), custom serverless endpoints / pods / clusters and a hub of open-source AI repositories including ComfyUI, Axolotl, FLUX.1-dev-juiced, Chatterbox, vLLM, and SGLang.
|
|
303
|
+
## About Runpod
|
|
310
304
|
|
|
311
|
-
|
|
305
|
+
[Runpod](https://runpod.io) is the foundation for developers to build, deploy, and scale custom AI systems.
|
|
312
306
|
|
|
313
|
-
|
|
314
|
-
- [Runpod Public Endpoints Documentation](https://docs.runpod.io/hub/public-endpoints)
|
|
315
|
-
- [AI SDK Documentation](https://ai-sdk.dev/docs)
|
|
316
|
-
- [GitHub Repository](https://github.com/runpod/ai-sdk-provider)
|
|
307
|
+
Beyond some of the public endpoints you've seen above (+ more generative media apis), Runpod offers custom [serverless endpoints](https://docs.runpod.io/serverless/overview), dedicated [pods](https://docs.runpod.io/pods/overview) and [instant clusters](https://docs.runpod.io/instant-clusters), [fine-tuning](https://docs.runpod.io/fine-tune), and a comprehensive [hub of open-source AI repos](https://docs.runpod.io/hub/overview) (like ComfyUI, Axolotl, FLUX.1-dev-juiced, Chatterbox, vLLM or SGLang).
|