@ai-sdk/google-vertex 1.0.4 → 2.0.1

package/CHANGELOG.md

@@ -1,5 +1,27 @@
 # @ai-sdk/google-vertex
 
+## 2.0.1
+
+### Patch Changes
+
+- bcd892e: feat (provider/google-vertex): Add support for Anthropic models.
+- Updated dependencies [bcd892e]
+  - @ai-sdk/anthropic@1.0.4
+
+## 2.0.0
+
+### Major Changes
+
+- 0984f0b: feat (provider/google-vertex): Rewrite for Edge runtime support.
+
+### Patch Changes
+
+- 0984f0b: chore (providers/google-vertex): Remove unref'd base default provider.
+- Updated dependencies [0984f0b]
+- Updated dependencies [0984f0b]
+  - @ai-sdk/google@1.0.5
+  - @ai-sdk/provider-utils@2.0.3
+
 ## 1.0.4
 
 ### Patch Changes

package/README.md

@@ -2,32 +2,164 @@
 
 The **[Google Vertex provider](https://sdk.vercel.ai/providers/ai-sdk-providers/google-vertex)** for the [AI SDK](https://sdk.vercel.ai/docs) contains language model support for the [Google Vertex AI](https://cloud.google.com/vertex-ai) APIs.
 
+This library includes a Google Vertex Anthropic provider. This provider closely follows the core Google Vertex library's usage patterns. See more in the [Google Vertex Anthropic Provider](#google-vertex-anthropic-provider) section below.
+
 ## Setup
 
-The Google provider is available in the `@ai-sdk/google-vertex` module. You can install it with
+The Google Vertex provider is available in the `@ai-sdk/google-vertex` module. You can install it with
 
 ```bash
 npm i @ai-sdk/google-vertex
 ```
 
-## Provider Instance
+## Google Vertex Provider
+
+The Google Vertex provider has two different authentication implementations depending on your runtime environment:
 
-You can import the default provider instance `vertex` from `@ai-sdk/google-vertex`:
+### Node.js Runtime
+
+The Node.js runtime is the default runtime supported by the AI SDK. You can use the default provider instance to generate text with the `gemini-1.5-flash` model like this:
 
 ```ts
 import { vertex } from '@ai-sdk/google-vertex';
+import { generateText } from 'ai';
+
+const { text } = await generateText({
+  model: vertex('gemini-1.5-flash'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+This provider supports all standard Google Cloud authentication options through the [`google-auth-library`](https://github.com/googleapis/google-auth-library-nodejs?tab=readme-ov-file#ways-to-authenticate). The most common authentication method is to set the path to a json credentials file in the `GOOGLE_APPLICATION_CREDENTIALS` environment variable. Credentials can be obtained from the [Google Cloud Console](https://console.cloud.google.com/apis/credentials).
+
+### Edge Runtime
+
+The Edge runtime is supported through the `@ai-sdk/google-vertex/edge` module. Note the additional sub-module path `/edge` required to differentiate the Edge provider from the Node.js provider.
+
+You can use the default provider instance to generate text with the `gemini-1.5-flash` model like this:
+
+```ts
+import { vertex } from '@ai-sdk/google-vertex/edge';
+import { generateText } from 'ai';
+
+const { text } = await generateText({
+  model: vertex('gemini-1.5-flash'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+This method supports Google's [Application Default Credentials](https://github.com/googleapis/google-auth-library-nodejs?tab=readme-ov-file#application-default-credentials) through the environment variables `GOOGLE_CLIENT_EMAIL`, `GOOGLE_PRIVATE_KEY`, and (optionally) `GOOGLE_PRIVATE_KEY_ID`. The values can be obtained from a json credentials file obtained from the [Google Cloud Console](https://console.cloud.google.com/apis/credentials).
+
+## Google Vertex Anthropic Provider
+
+The Google Vertex Anthropic provider is available for both Node.js and Edge runtimes. It follows a similar usage pattern to the [core Google Vertex provider](#google-vertex-provider).
+
+### Node.js Runtime
+
+```ts
+import { vertexAnthropic } from '@ai-sdk/google-vertex/anthropic';
+import { generateText } from 'ai';
+
+const { text } = await generateText({
+  model: vertexAnthropic('claude-3-5-sonnet@20240620'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+### Edge Runtime
+
+```ts
+import { vertexAnthropic } from '@ai-sdk/google-vertex/anthropic/edge';
+import { generateText } from 'ai';
+
+const { text } = await generateText({
+  model: vertexAnthropic('claude-3-5-sonnet@20240620'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+## Custom Provider Configuration
+
+You can create a custom provider instance using the `createVertex` function. This allows you to specify additional configuration options. Below is an example with the default Node.js provider which includes a `googleAuthOptions` object.
+
+```ts
+import { createVertex } from '@ai-sdk/google-vertex';
+import { generateText } from 'ai';
+
+const customProvider = createVertex({
+  project: 'your-project-id',
+  location: 'us-central1',
+  googleAuthOptions: {
+    credentials: {
+      client_email: 'your-client-email',
+      private_key: 'your-private-key',
+    },
+  },
+});
+
+const { text } = await generateText({
+  model: customProvider('gemini-1.5-flash'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
 ```
 
-## Example
+The `googleAuthOptions` object is not present in the Edge provider options but custom provider creation is otherwise identical.
+
+The Edge provider supports a `googleCredentials` option rather than `googleAuthOptions`. This can be used to specify the Google Cloud service account credentials and will take precedence over the environment variables used otherwise.
 
 ```ts
-import { vertex } from '@ai-sdk/google-vertex'
-import { generateText } from 'ai'
+import { createVertex } from '@ai-sdk/google-vertex/edge';
+import { generateText } from 'ai';
+
+const customProvider = createVertex({
+  project: 'your-project-id',
+  location: 'us-central1',
+  googleCredentials: {
+    clientEmail: 'your-client-email',
+    privateKey: 'your-private-key',
+  },
+});
+
+const { text } = await generateText({
+  model: customProvider('gemini-1.5-flash'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+### Google Vertex Anthropic Provider Custom Configuration
+
+The Google Vertex Anthropic provider custom configuration is analogous to the above:
+
+```ts
+import { createVertexAnthropic } from '@ai-sdk/google-vertex/anthropic';
+import { generateText } from 'ai';
+
+const customProvider = createVertexAnthropic({
+  project: 'your-project-id',
+  location: 'us-east5',
+});
+
+const { text } = await generateText({
+  model: customProvider('claude-3-5-sonnet@20240620'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
+```
+
+And for the Edge runtime:
+
+```ts
+import { vertexAnthropic } from '@ai-sdk/google-vertex/anthropic/edge';
+import { generateText } from 'ai';
+
+const customProvider = createVertexAnthropic({
+  project: 'your-project-id',
+  location: 'us-east5',
+});
 
 const { text } = await generateText({
-  model: vertex('gemini-1.5-flash')
-  prompt: 'Write a vegetarian lasagna recipe for 4 people.'
-})
+  model: customProvider('claude-3-5-sonnet@20240620'),
+  prompt: 'Write a vegetarian lasagna recipe.',
+});
 ```
 
 ## Documentation

package/anthropic/dist/index.d.mts

@@ -0,0 +1,62 @@
+import { ProviderV1, LanguageModelV1 } from '@ai-sdk/provider';
+import { Resolvable, FetchFunction } from '@ai-sdk/provider-utils';
+import { AnthropicMessagesSettings, anthropicTools } from '@ai-sdk/anthropic/internal';
+import { GoogleAuthOptions } from 'google-auth-library';
+
+type GoogleVertexAnthropicMessagesModelId = 'claude-3-5-sonnet-v2@20241022' | 'claude-3-5-haiku@20241022' | 'claude-3-5-sonnet@20240620' | 'claude-3-haiku@20240307' | 'claude-3-sonnet@20240229' | 'claude-3-opus@20240229' | (string & {});
+
+interface GoogleVertexAnthropicProvider extends ProviderV1 {
+    /**
+  Creates a model for text generation.
+  */
+    (modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Creates a model for text generation.
+  */
+    languageModel(modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Anthropic-specific computer use tool.
+     */
+    tools: typeof anthropicTools;
+}
+interface GoogleVertexAnthropicProviderSettings$1 {
+    /**
+     * Google Cloud project ID. Defaults to the value of the `GOOGLE_VERTEX_PROJECT` environment variable.
+     */
+    project?: string;
+    /**
+     * Google Cloud region. Defaults to the value of the `GOOGLE_VERTEX_LOCATION` environment variable.
+     */
+    location?: string;
+    /**
+  Use a different URL prefix for API calls, e.g. to use proxy servers.
+  The default prefix is `https://api.anthropic.com/v1`.
+     */
+    baseURL?: string;
+    /**
+  Custom headers to include in the requests.
+       */
+    headers?: Resolvable<Record<string, string | undefined>>;
+    /**
+  Custom fetch implementation. You can use it as a middleware to intercept requests,
+  or to provide a custom fetch implementation for e.g. testing.
+      */
+    fetch?: FetchFunction;
+}
+
+interface GoogleVertexAnthropicProviderSettings extends GoogleVertexAnthropicProviderSettings$1 {
+    /**
+   Optional. The Authentication options provided by google-auth-library.
+  Complete list of authentication options is documented in the
+  GoogleAuthOptions interface:
+  https://github.com/googleapis/google-auth-library-nodejs/blob/main/src/auth/googleauth.ts.
+     */
+    googleAuthOptions?: GoogleAuthOptions;
+}
+declare function createVertexAnthropic(options?: GoogleVertexAnthropicProviderSettings): GoogleVertexAnthropicProvider;
+/**
+Default Google Vertex Anthropic provider instance.
+ */
+declare const vertexAnthropic: GoogleVertexAnthropicProvider;
+
+export { type GoogleVertexAnthropicProvider, type GoogleVertexAnthropicProviderSettings, createVertexAnthropic, vertexAnthropic };

package/anthropic/dist/index.d.ts

@@ -0,0 +1,62 @@
+import { ProviderV1, LanguageModelV1 } from '@ai-sdk/provider';
+import { Resolvable, FetchFunction } from '@ai-sdk/provider-utils';
+import { AnthropicMessagesSettings, anthropicTools } from '@ai-sdk/anthropic/internal';
+import { GoogleAuthOptions } from 'google-auth-library';
+
+type GoogleVertexAnthropicMessagesModelId = 'claude-3-5-sonnet-v2@20241022' | 'claude-3-5-haiku@20241022' | 'claude-3-5-sonnet@20240620' | 'claude-3-haiku@20240307' | 'claude-3-sonnet@20240229' | 'claude-3-opus@20240229' | (string & {});
+
+interface GoogleVertexAnthropicProvider extends ProviderV1 {
+    /**
+  Creates a model for text generation.
+  */
+    (modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Creates a model for text generation.
+  */
+    languageModel(modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Anthropic-specific computer use tool.
+     */
+    tools: typeof anthropicTools;
+}
+interface GoogleVertexAnthropicProviderSettings$1 {
+    /**
+     * Google Cloud project ID. Defaults to the value of the `GOOGLE_VERTEX_PROJECT` environment variable.
+     */
+    project?: string;
+    /**
+     * Google Cloud region. Defaults to the value of the `GOOGLE_VERTEX_LOCATION` environment variable.
+     */
+    location?: string;
+    /**
+  Use a different URL prefix for API calls, e.g. to use proxy servers.
+  The default prefix is `https://api.anthropic.com/v1`.
+     */
+    baseURL?: string;
+    /**
+  Custom headers to include in the requests.
+       */
+    headers?: Resolvable<Record<string, string | undefined>>;
+    /**
+  Custom fetch implementation. You can use it as a middleware to intercept requests,
+  or to provide a custom fetch implementation for e.g. testing.
+      */
+    fetch?: FetchFunction;
+}
+
+interface GoogleVertexAnthropicProviderSettings extends GoogleVertexAnthropicProviderSettings$1 {
+    /**
+   Optional. The Authentication options provided by google-auth-library.
+  Complete list of authentication options is documented in the
+  GoogleAuthOptions interface:
+  https://github.com/googleapis/google-auth-library-nodejs/blob/main/src/auth/googleauth.ts.
+     */
+    googleAuthOptions?: GoogleAuthOptions;
+}
+declare function createVertexAnthropic(options?: GoogleVertexAnthropicProviderSettings): GoogleVertexAnthropicProvider;
+/**
+Default Google Vertex Anthropic provider instance.
+ */
+declare const vertexAnthropic: GoogleVertexAnthropicProvider;
+
+export { type GoogleVertexAnthropicProvider, type GoogleVertexAnthropicProviderSettings, createVertexAnthropic, vertexAnthropic };

package/anthropic/dist/index.js

@@ -0,0 +1,121 @@
+"use strict";
+var __defProp = Object.defineProperty;
+var __getOwnPropDesc = Object.getOwnPropertyDescriptor;
+var __getOwnPropNames = Object.getOwnPropertyNames;
+var __hasOwnProp = Object.prototype.hasOwnProperty;
+var __export = (target, all) => {
+  for (var name in all)
+    __defProp(target, name, { get: all[name], enumerable: true });
+};
+var __copyProps = (to, from, except, desc) => {
+  if (from && typeof from === "object" || typeof from === "function") {
+    for (let key of __getOwnPropNames(from))
+      if (!__hasOwnProp.call(to, key) && key !== except)
+        __defProp(to, key, { get: () => from[key], enumerable: !(desc = __getOwnPropDesc(from, key)) || desc.enumerable });
+  }
+  return to;
+};
+var __toCommonJS = (mod) => __copyProps(__defProp({}, "__esModule", { value: true }), mod);
+
+// src/anthropic/index.ts
+var anthropic_exports = {};
+__export(anthropic_exports, {
+  createVertexAnthropic: () => createVertexAnthropic2,
+  vertexAnthropic: () => vertexAnthropic
+});
+module.exports = __toCommonJS(anthropic_exports);
+
+// src/google-vertex-auth-google-auth-library.ts
+var import_google_auth_library = require("google-auth-library");
+var authInstance = null;
+var authOptions = null;
+function getAuth(options) {
+  if (!authInstance || options !== authOptions) {
+    authInstance = new import_google_auth_library.GoogleAuth({
+      scopes: ["https://www.googleapis.com/auth/cloud-platform"],
+      ...options
+    });
+    authOptions = options;
+  }
+  return authInstance;
+}
+async function generateAuthToken(options) {
+  const auth = getAuth(options || {});
+  const client = await auth.getClient();
+  const token = await client.getAccessToken();
+  return (token == null ? void 0 : token.token) || null;
+}
+
+// src/anthropic/google-vertex-anthropic-provider.ts
+var import_provider = require("@ai-sdk/provider");
+var import_provider_utils = require("@ai-sdk/provider-utils");
+var import_internal = require("@ai-sdk/anthropic/internal");
+function createVertexAnthropic(options = {}) {
+  var _a;
+  const location = (0, import_provider_utils.loadOptionalSetting)({
+    settingValue: options.location,
+    environmentVariableName: "GOOGLE_VERTEX_LOCATION"
+  });
+  const project = (0, import_provider_utils.loadOptionalSetting)({
+    settingValue: options.project,
+    environmentVariableName: "GOOGLE_VERTEX_PROJECT"
+  });
+  const baseURL = (_a = (0, import_provider_utils.withoutTrailingSlash)(options.baseURL)) != null ? _a : `https://${location}-aiplatform.googleapis.com/v1/projects/${project}/locations/${location}/publishers/anthropic/models`;
+  const createChatModel = (modelId, settings = {}) => {
+    var _a2;
+    return new import_internal.AnthropicMessagesLanguageModel(
+      modelId,
+      settings,
+      {
+        provider: "vertex.anthropic.messages",
+        baseURL,
+        headers: (_a2 = options.headers) != null ? _a2 : {},
+        fetch: options.fetch,
+        buildRequestUrl: (baseURL2, isStreaming) => `${baseURL2}/${modelId}:${isStreaming ? "streamRawPredict" : "rawPredict"}`,
+        transformRequestBody: (args) => {
+          const { model, ...rest } = args;
+          return {
+            ...rest,
+            anthropic_version: "vertex-2023-10-16"
+          };
+        }
+      }
+    );
+  };
+  const provider = function(modelId, settings) {
+    if (new.target) {
+      throw new Error(
+        "The Anthropic model function cannot be called with the new keyword."
+      );
+    }
+    return createChatModel(modelId, settings);
+  };
+  provider.languageModel = createChatModel;
+  provider.chat = createChatModel;
+  provider.messages = createChatModel;
+  provider.textEmbeddingModel = (modelId) => {
+    throw new import_provider.NoSuchModelError({ modelId, modelType: "textEmbeddingModel" });
+  };
+  provider.tools = import_internal.anthropicTools;
+  return provider;
+}
+
+// src/anthropic/google-vertex-anthropic-provider-node.ts
+function createVertexAnthropic2(options = {}) {
+  var _a;
+  return createVertexAnthropic({
+    ...options,
+    headers: (_a = options.headers) != null ? _a : async () => ({
+      Authorization: `Bearer ${await generateAuthToken(
+        options.googleAuthOptions
+      )}`
+    })
+  });
+}
+var vertexAnthropic = createVertexAnthropic2();
+// Annotate the CommonJS export names for ESM import in node:
+0 && (module.exports = {
+  createVertexAnthropic,
+  vertexAnthropic
+});
+//# sourceMappingURL=index.js.map

package/anthropic/dist/index.js.map

@@ -0,0 +1 @@
+{"version":3,"sources":["../../src/anthropic/index.ts","../../src/google-vertex-auth-google-auth-library.ts","../../src/anthropic/google-vertex-anthropic-provider.ts","../../src/anthropic/google-vertex-anthropic-provider-node.ts"],"sourcesContent":["export {\n  vertexAnthropic,\n  createVertexAnthropic,\n} from './google-vertex-anthropic-provider-node';\nexport type {\n  GoogleVertexAnthropicProvider,\n  GoogleVertexAnthropicProviderSettings,\n} from './google-vertex-anthropic-provider-node';\n","import { GoogleAuth, GoogleAuthOptions } from 'google-auth-library';\n\nlet authInstance: GoogleAuth | null = null;\nlet authOptions: GoogleAuthOptions | null = null;\n\nfunction getAuth(options: GoogleAuthOptions) {\n  if (!authInstance || options !== authOptions) {\n    authInstance = new GoogleAuth({\n      scopes: ['https://www.googleapis.com/auth/cloud-platform'],\n      ...options,\n    });\n    authOptions = options;\n  }\n  return authInstance;\n}\n\nexport async function generateAuthToken(options?: GoogleAuthOptions) {\n  const auth = getAuth(options || {});\n  const client = await auth.getClient();\n  const token = await client.getAccessToken();\n  return token?.token || null;\n}\n\n// For testing purposes only\nexport function _resetAuthInstance() {\n  authInstance = null;\n}\n","import {\n  LanguageModelV1,\n  NoSuchModelError,\n  ProviderV1,\n} from '@ai-sdk/provider';\nimport {\n  FetchFunction,\n  Resolvable,\n  loadOptionalSetting,\n  withoutTrailingSlash,\n} from '@ai-sdk/provider-utils';\nimport {\n  anthropicTools,\n  AnthropicMessagesLanguageModel,\n  AnthropicMessagesModelId,\n  AnthropicMessagesSettings,\n} from '@ai-sdk/anthropic/internal';\nimport {\n  GoogleVertexAnthropicMessagesModelId,\n  GoogleVertexAnthropicMessagesSettings,\n} from './google-vertex-anthropic-messages-settings';\nexport interface GoogleVertexAnthropicProvider extends ProviderV1 {\n  /**\nCreates a model for text generation.\n*/\n  (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: AnthropicMessagesSettings,\n  ): LanguageModelV1;\n\n  /**\nCreates a model for text generation.\n*/\n  languageModel(\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: AnthropicMessagesSettings,\n  ): LanguageModelV1;\n\n  /**\nAnthropic-specific computer use tool.\n   */\n  tools: typeof anthropicTools;\n}\n\nexport interface GoogleVertexAnthropicProviderSettings {\n  /**\n   * Google Cloud project ID. Defaults to the value of the `GOOGLE_VERTEX_PROJECT` environment variable.\n   */\n  project?: string;\n\n  /**\n   * Google Cloud region. Defaults to the value of the `GOOGLE_VERTEX_LOCATION` environment variable.\n   */\n  location?: string;\n\n  /**\nUse a different URL prefix for API calls, e.g. to use proxy servers.\nThe default prefix is `https://api.anthropic.com/v1`.\n   */\n  baseURL?: string;\n\n  /**\nCustom headers to include in the requests.\n     */\n  headers?: Resolvable<Record<string, string | undefined>>;\n\n  /**\nCustom fetch implementation. You can use it as a middleware to intercept requests,\nor to provide a custom fetch implementation for e.g. testing.\n    */\n  fetch?: FetchFunction;\n}\n\n/**\nCreate a Google Vertex Anthropic provider instance.\n */\nexport function createVertexAnthropic(\n  options: GoogleVertexAnthropicProviderSettings = {},\n): GoogleVertexAnthropicProvider {\n  const location = loadOptionalSetting({\n    settingValue: options.location,\n    environmentVariableName: 'GOOGLE_VERTEX_LOCATION',\n  });\n  const project = loadOptionalSetting({\n    settingValue: options.project,\n    environmentVariableName: 'GOOGLE_VERTEX_PROJECT',\n  });\n  const baseURL =\n    withoutTrailingSlash(options.baseURL) ??\n    `https://${location}-aiplatform.googleapis.com/v1/projects/${project}/locations/${location}/publishers/anthropic/models`;\n\n  const createChatModel = (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings: GoogleVertexAnthropicMessagesSettings = {},\n  ) =>\n    new AnthropicMessagesLanguageModel(\n      modelId as AnthropicMessagesModelId,\n      settings,\n      {\n        provider: 'vertex.anthropic.messages',\n        baseURL,\n        headers: options.headers ?? {},\n        fetch: options.fetch,\n        buildRequestUrl: (baseURL, isStreaming) =>\n          `${baseURL}/${modelId}:${\n            isStreaming ? 'streamRawPredict' : 'rawPredict'\n          }`,\n        transformRequestBody: args => {\n          // Remove model from args and add anthropic version\n          const { model, ...rest } = args;\n          return {\n            ...rest,\n            anthropic_version: 'vertex-2023-10-16',\n          };\n        },\n      },\n    );\n\n  const provider = function (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: GoogleVertexAnthropicMessagesSettings,\n  ) {\n    if (new.target) {\n      throw new Error(\n        'The Anthropic model function cannot be called with the new keyword.',\n      );\n    }\n\n    return createChatModel(modelId, settings);\n  };\n\n  provider.languageModel = createChatModel;\n  provider.chat = createChatModel;\n  provider.messages = createChatModel;\n  provider.textEmbeddingModel = (modelId: string) => {\n    throw new NoSuchModelError({ modelId, modelType: 'textEmbeddingModel' });\n  };\n\n  provider.tools = anthropicTools;\n\n  return provider as GoogleVertexAnthropicProvider;\n}\n","import { generateAuthToken } from '../google-vertex-auth-google-auth-library';\nimport {\n  createVertexAnthropic as createVertexAnthropicOriginal,\n  GoogleVertexAnthropicProvider,\n  GoogleVertexAnthropicProviderSettings as GoogleVertexAnthropicProviderSettingsOriginal,\n} from './google-vertex-anthropic-provider';\nimport { GoogleAuthOptions } from 'google-auth-library';\n\nexport type { GoogleVertexAnthropicProvider };\n\nexport interface GoogleVertexAnthropicProviderSettings\n  extends GoogleVertexAnthropicProviderSettingsOriginal {\n  /**\n Optional. The Authentication options provided by google-auth-library.\nComplete list of authentication options is documented in the\nGoogleAuthOptions interface:\nhttps://github.com/googleapis/google-auth-library-nodejs/blob/main/src/auth/googleauth.ts.\n   */\n  googleAuthOptions?: GoogleAuthOptions;\n}\n\nexport function createVertexAnthropic(\n  options: GoogleVertexAnthropicProviderSettings = {},\n): GoogleVertexAnthropicProvider {\n  return createVertexAnthropicOriginal({\n    ...options,\n    headers:\n      options.headers ??\n      (async () => ({\n        Authorization: `Bearer ${await generateAuthToken(\n          options.googleAuthOptions,\n        )}`,\n      })),\n  });\n}\n\n/**\nDefault Google Vertex Anthropic provider instance.\n */\nexport const vertexAnthropic = createVertexAnthropic();\n"],"mappings":";;;;;;;;;;;;;;;;;;;;AAAA;AAAA;AAAA,+BAAAA;AAAA,EAAA;AAAA;AAAA;;;ACAA,iCAA8C;AAE9C,IAAI,eAAkC;AACtC,IAAI,cAAwC;AAE5C,SAAS,QAAQ,SAA4B;AAC3C,MAAI,CAAC,gBAAgB,YAAY,aAAa;AAC5C,mBAAe,IAAI,sCAAW;AAAA,MAC5B,QAAQ,CAAC,gDAAgD;AAAA,MACzD,GAAG;AAAA,IACL,CAAC;AACD,kBAAc;AAAA,EAChB;AACA,SAAO;AACT;AAEA,eAAsB,kBAAkB,SAA6B;AACnE,QAAM,OAAO,QAAQ,WAAW,CAAC,CAAC;AAClC,QAAM,SAAS,MAAM,KAAK,UAAU;AACpC,QAAM,QAAQ,MAAM,OAAO,eAAe;AAC1C,UAAO,+BAAO,UAAS;AACzB;;;ACrBA,sBAIO;AACP,4BAKO;AACP,sBAKO;AA4DA,SAAS,sBACd,UAAiD,CAAC,GACnB;AA9EjC;AA+EE,QAAM,eAAW,2CAAoB;AAAA,IACnC,cAAc,QAAQ;AAAA,IACtB,yBAAyB;AAAA,EAC3B,CAAC;AACD,QAAM,cAAU,2CAAoB;AAAA,IAClC,cAAc,QAAQ;AAAA,IACtB,yBAAyB;AAAA,EAC3B,CAAC;AACD,QAAM,WACJ,qDAAqB,QAAQ,OAAO,MAApC,YACA,WAAW,QAAQ,0CAA0C,OAAO,cAAc,QAAQ;AAE5F,QAAM,kBAAkB,CACtB,SACA,WAAkD,CAAC,MACnD;AA9FJ,QAAAC;AA+FI,eAAI;AAAA,MACF;AAAA,MACA;AAAA,MACA;AAAA,QACE,UAAU;AAAA,QACV;AAAA,QACA,UAASA,MAAA,QAAQ,YAAR,OAAAA,MAAmB,CAAC;AAAA,QAC7B,OAAO,QAAQ;AAAA,QACf,iBAAiB,CAACC,UAAS,gBACzB,GAAGA,QAAO,IAAI,OAAO,IACnB,cAAc,qBAAqB,YACrC;AAAA,QACF,sBAAsB,UAAQ;AAE5B,gBAAM,EAAE,OAAO,GAAG,KAAK,IAAI;AAC3B,iBAAO;AAAA,YACL,GAAG;AAAA,YACH,mBAAmB;AAAA,UACrB;AAAA,QACF;AAAA,MACF;AAAA,IACF;AAAA;AAEF,QAAM,WAAW,SACf,SACA,UACA;AACA,QAAI,YAAY;AACd,YAAM,IAAI;AAAA,QACR;AAAA,MACF;AAAA,IACF;AAEA,WAAO,gBAAgB,SAAS,QAAQ;AAAA,EAC1C;AAEA,WAAS,gBAAgB;AACzB,WAAS,OAAO;AAChB,WAAS,WAAW;AACpB,WAAS,qBAAqB,CAAC,YAAoB;AACjD,UAAM,IAAI,iCAAiB,EAAE,SAAS,WAAW,qBAAqB,CAAC;AAAA,EACzE;AAEA,WAAS,QAAQ;AAEjB,SAAO;AACT;;;ACxHO,SAASC,uBACd,UAAiD,CAAC,GACnB;AAvBjC;AAwBE,SAAO,sBAA8B;AAAA,IACnC,GAAG;AAAA,IACH,UACE,aAAQ,YAAR,YACC,aAAa;AAAA,MACZ,eAAe,UAAU,MAAM;AAAA,QAC7B,QAAQ;AAAA,MACV,CAAC;AAAA,IACH;AAAA,EACJ,CAAC;AACH;AAKO,IAAM,kBAAkBA,uBAAsB;","names":["createVertexAnthropic","_a","baseURL","createVertexAnthropic"]}

package/anthropic/dist/index.mjs

@@ -0,0 +1,101 @@
+// src/google-vertex-auth-google-auth-library.ts
+import { GoogleAuth } from "google-auth-library";
+var authInstance = null;
+var authOptions = null;
+function getAuth(options) {
+  if (!authInstance || options !== authOptions) {
+    authInstance = new GoogleAuth({
+      scopes: ["https://www.googleapis.com/auth/cloud-platform"],
+      ...options
+    });
+    authOptions = options;
+  }
+  return authInstance;
+}
+async function generateAuthToken(options) {
+  const auth = getAuth(options || {});
+  const client = await auth.getClient();
+  const token = await client.getAccessToken();
+  return (token == null ? void 0 : token.token) || null;
+}
+
+// src/anthropic/google-vertex-anthropic-provider.ts
+import {
+  NoSuchModelError
+} from "@ai-sdk/provider";
+import {
+  loadOptionalSetting,
+  withoutTrailingSlash
+} from "@ai-sdk/provider-utils";
+import {
+  anthropicTools,
+  AnthropicMessagesLanguageModel
+} from "@ai-sdk/anthropic/internal";
+function createVertexAnthropic(options = {}) {
+  var _a;
+  const location = loadOptionalSetting({
+    settingValue: options.location,
+    environmentVariableName: "GOOGLE_VERTEX_LOCATION"
+  });
+  const project = loadOptionalSetting({
+    settingValue: options.project,
+    environmentVariableName: "GOOGLE_VERTEX_PROJECT"
+  });
+  const baseURL = (_a = withoutTrailingSlash(options.baseURL)) != null ? _a : `https://${location}-aiplatform.googleapis.com/v1/projects/${project}/locations/${location}/publishers/anthropic/models`;
+  const createChatModel = (modelId, settings = {}) => {
+    var _a2;
+    return new AnthropicMessagesLanguageModel(
+      modelId,
+      settings,
+      {
+        provider: "vertex.anthropic.messages",
+        baseURL,
+        headers: (_a2 = options.headers) != null ? _a2 : {},
+        fetch: options.fetch,
+        buildRequestUrl: (baseURL2, isStreaming) => `${baseURL2}/${modelId}:${isStreaming ? "streamRawPredict" : "rawPredict"}`,
+        transformRequestBody: (args) => {
+          const { model, ...rest } = args;
+          return {
+            ...rest,
+            anthropic_version: "vertex-2023-10-16"
+          };
+        }
+      }
+    );
+  };
+  const provider = function(modelId, settings) {
+    if (new.target) {
+      throw new Error(
+        "The Anthropic model function cannot be called with the new keyword."
+      );
+    }
+    return createChatModel(modelId, settings);
+  };
+  provider.languageModel = createChatModel;
+  provider.chat = createChatModel;
+  provider.messages = createChatModel;
+  provider.textEmbeddingModel = (modelId) => {
+    throw new NoSuchModelError({ modelId, modelType: "textEmbeddingModel" });
+  };
+  provider.tools = anthropicTools;
+  return provider;
+}
+
+// src/anthropic/google-vertex-anthropic-provider-node.ts
+function createVertexAnthropic2(options = {}) {
+  var _a;
+  return createVertexAnthropic({
+    ...options,
+    headers: (_a = options.headers) != null ? _a : async () => ({
+      Authorization: `Bearer ${await generateAuthToken(
+        options.googleAuthOptions
+      )}`
+    })
+  });
+}
+var vertexAnthropic = createVertexAnthropic2();
+export {
+  createVertexAnthropic2 as createVertexAnthropic,
+  vertexAnthropic
+};
+//# sourceMappingURL=index.mjs.map

package/anthropic/dist/index.mjs.map

@@ -0,0 +1 @@
+{"version":3,"sources":["../../src/google-vertex-auth-google-auth-library.ts","../../src/anthropic/google-vertex-anthropic-provider.ts","../../src/anthropic/google-vertex-anthropic-provider-node.ts"],"sourcesContent":["import { GoogleAuth, GoogleAuthOptions } from 'google-auth-library';\n\nlet authInstance: GoogleAuth | null = null;\nlet authOptions: GoogleAuthOptions | null = null;\n\nfunction getAuth(options: GoogleAuthOptions) {\n  if (!authInstance || options !== authOptions) {\n    authInstance = new GoogleAuth({\n      scopes: ['https://www.googleapis.com/auth/cloud-platform'],\n      ...options,\n    });\n    authOptions = options;\n  }\n  return authInstance;\n}\n\nexport async function generateAuthToken(options?: GoogleAuthOptions) {\n  const auth = getAuth(options || {});\n  const client = await auth.getClient();\n  const token = await client.getAccessToken();\n  return token?.token || null;\n}\n\n// For testing purposes only\nexport function _resetAuthInstance() {\n  authInstance = null;\n}\n","import {\n  LanguageModelV1,\n  NoSuchModelError,\n  ProviderV1,\n} from '@ai-sdk/provider';\nimport {\n  FetchFunction,\n  Resolvable,\n  loadOptionalSetting,\n  withoutTrailingSlash,\n} from '@ai-sdk/provider-utils';\nimport {\n  anthropicTools,\n  AnthropicMessagesLanguageModel,\n  AnthropicMessagesModelId,\n  AnthropicMessagesSettings,\n} from '@ai-sdk/anthropic/internal';\nimport {\n  GoogleVertexAnthropicMessagesModelId,\n  GoogleVertexAnthropicMessagesSettings,\n} from './google-vertex-anthropic-messages-settings';\nexport interface GoogleVertexAnthropicProvider extends ProviderV1 {\n  /**\nCreates a model for text generation.\n*/\n  (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: AnthropicMessagesSettings,\n  ): LanguageModelV1;\n\n  /**\nCreates a model for text generation.\n*/\n  languageModel(\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: AnthropicMessagesSettings,\n  ): LanguageModelV1;\n\n  /**\nAnthropic-specific computer use tool.\n   */\n  tools: typeof anthropicTools;\n}\n\nexport interface GoogleVertexAnthropicProviderSettings {\n  /**\n   * Google Cloud project ID. Defaults to the value of the `GOOGLE_VERTEX_PROJECT` environment variable.\n   */\n  project?: string;\n\n  /**\n   * Google Cloud region. Defaults to the value of the `GOOGLE_VERTEX_LOCATION` environment variable.\n   */\n  location?: string;\n\n  /**\nUse a different URL prefix for API calls, e.g. to use proxy servers.\nThe default prefix is `https://api.anthropic.com/v1`.\n   */\n  baseURL?: string;\n\n  /**\nCustom headers to include in the requests.\n     */\n  headers?: Resolvable<Record<string, string | undefined>>;\n\n  /**\nCustom fetch implementation. You can use it as a middleware to intercept requests,\nor to provide a custom fetch implementation for e.g. testing.\n    */\n  fetch?: FetchFunction;\n}\n\n/**\nCreate a Google Vertex Anthropic provider instance.\n */\nexport function createVertexAnthropic(\n  options: GoogleVertexAnthropicProviderSettings = {},\n): GoogleVertexAnthropicProvider {\n  const location = loadOptionalSetting({\n    settingValue: options.location,\n    environmentVariableName: 'GOOGLE_VERTEX_LOCATION',\n  });\n  const project = loadOptionalSetting({\n    settingValue: options.project,\n    environmentVariableName: 'GOOGLE_VERTEX_PROJECT',\n  });\n  const baseURL =\n    withoutTrailingSlash(options.baseURL) ??\n    `https://${location}-aiplatform.googleapis.com/v1/projects/${project}/locations/${location}/publishers/anthropic/models`;\n\n  const createChatModel = (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings: GoogleVertexAnthropicMessagesSettings = {},\n  ) =>\n    new AnthropicMessagesLanguageModel(\n      modelId as AnthropicMessagesModelId,\n      settings,\n      {\n        provider: 'vertex.anthropic.messages',\n        baseURL,\n        headers: options.headers ?? {},\n        fetch: options.fetch,\n        buildRequestUrl: (baseURL, isStreaming) =>\n          `${baseURL}/${modelId}:${\n            isStreaming ? 'streamRawPredict' : 'rawPredict'\n          }`,\n        transformRequestBody: args => {\n          // Remove model from args and add anthropic version\n          const { model, ...rest } = args;\n          return {\n            ...rest,\n            anthropic_version: 'vertex-2023-10-16',\n          };\n        },\n      },\n    );\n\n  const provider = function (\n    modelId: GoogleVertexAnthropicMessagesModelId,\n    settings?: GoogleVertexAnthropicMessagesSettings,\n  ) {\n    if (new.target) {\n      throw new Error(\n        'The Anthropic model function cannot be called with the new keyword.',\n      );\n    }\n\n    return createChatModel(modelId, settings);\n  };\n\n  provider.languageModel = createChatModel;\n  provider.chat = createChatModel;\n  provider.messages = createChatModel;\n  provider.textEmbeddingModel = (modelId: string) => {\n    throw new NoSuchModelError({ modelId, modelType: 'textEmbeddingModel' });\n  };\n\n  provider.tools = anthropicTools;\n\n  return provider as GoogleVertexAnthropicProvider;\n}\n","import { generateAuthToken } from '../google-vertex-auth-google-auth-library';\nimport {\n  createVertexAnthropic as createVertexAnthropicOriginal,\n  GoogleVertexAnthropicProvider,\n  GoogleVertexAnthropicProviderSettings as GoogleVertexAnthropicProviderSettingsOriginal,\n} from './google-vertex-anthropic-provider';\nimport { GoogleAuthOptions } from 'google-auth-library';\n\nexport type { GoogleVertexAnthropicProvider };\n\nexport interface GoogleVertexAnthropicProviderSettings\n  extends GoogleVertexAnthropicProviderSettingsOriginal {\n  /**\n Optional. The Authentication options provided by google-auth-library.\nComplete list of authentication options is documented in the\nGoogleAuthOptions interface:\nhttps://github.com/googleapis/google-auth-library-nodejs/blob/main/src/auth/googleauth.ts.\n   */\n  googleAuthOptions?: GoogleAuthOptions;\n}\n\nexport function createVertexAnthropic(\n  options: GoogleVertexAnthropicProviderSettings = {},\n): GoogleVertexAnthropicProvider {\n  return createVertexAnthropicOriginal({\n    ...options,\n    headers:\n      options.headers ??\n      (async () => ({\n        Authorization: `Bearer ${await generateAuthToken(\n          options.googleAuthOptions,\n        )}`,\n      })),\n  });\n}\n\n/**\nDefault Google Vertex Anthropic provider instance.\n */\nexport const vertexAnthropic = createVertexAnthropic();\n"],"mappings":";AAAA,SAAS,kBAAqC;AAE9C,IAAI,eAAkC;AACtC,IAAI,cAAwC;AAE5C,SAAS,QAAQ,SAA4B;AAC3C,MAAI,CAAC,gBAAgB,YAAY,aAAa;AAC5C,mBAAe,IAAI,WAAW;AAAA,MAC5B,QAAQ,CAAC,gDAAgD;AAAA,MACzD,GAAG;AAAA,IACL,CAAC;AACD,kBAAc;AAAA,EAChB;AACA,SAAO;AACT;AAEA,eAAsB,kBAAkB,SAA6B;AACnE,QAAM,OAAO,QAAQ,WAAW,CAAC,CAAC;AAClC,QAAM,SAAS,MAAM,KAAK,UAAU;AACpC,QAAM,QAAQ,MAAM,OAAO,eAAe;AAC1C,UAAO,+BAAO,UAAS;AACzB;;;ACrBA;AAAA,EAEE;AAAA,OAEK;AACP;AAAA,EAGE;AAAA,EACA;AAAA,OACK;AACP;AAAA,EACE;AAAA,EACA;AAAA,OAGK;AA4DA,SAAS,sBACd,UAAiD,CAAC,GACnB;AA9EjC;AA+EE,QAAM,WAAW,oBAAoB;AAAA,IACnC,cAAc,QAAQ;AAAA,IACtB,yBAAyB;AAAA,EAC3B,CAAC;AACD,QAAM,UAAU,oBAAoB;AAAA,IAClC,cAAc,QAAQ;AAAA,IACtB,yBAAyB;AAAA,EAC3B,CAAC;AACD,QAAM,WACJ,0BAAqB,QAAQ,OAAO,MAApC,YACA,WAAW,QAAQ,0CAA0C,OAAO,cAAc,QAAQ;AAE5F,QAAM,kBAAkB,CACtB,SACA,WAAkD,CAAC,MACnD;AA9FJ,QAAAA;AA+FI,eAAI;AAAA,MACF;AAAA,MACA;AAAA,MACA;AAAA,QACE,UAAU;AAAA,QACV;AAAA,QACA,UAASA,MAAA,QAAQ,YAAR,OAAAA,MAAmB,CAAC;AAAA,QAC7B,OAAO,QAAQ;AAAA,QACf,iBAAiB,CAACC,UAAS,gBACzB,GAAGA,QAAO,IAAI,OAAO,IACnB,cAAc,qBAAqB,YACrC;AAAA,QACF,sBAAsB,UAAQ;AAE5B,gBAAM,EAAE,OAAO,GAAG,KAAK,IAAI;AAC3B,iBAAO;AAAA,YACL,GAAG;AAAA,YACH,mBAAmB;AAAA,UACrB;AAAA,QACF;AAAA,MACF;AAAA,IACF;AAAA;AAEF,QAAM,WAAW,SACf,SACA,UACA;AACA,QAAI,YAAY;AACd,YAAM,IAAI;AAAA,QACR;AAAA,MACF;AAAA,IACF;AAEA,WAAO,gBAAgB,SAAS,QAAQ;AAAA,EAC1C;AAEA,WAAS,gBAAgB;AACzB,WAAS,OAAO;AAChB,WAAS,WAAW;AACpB,WAAS,qBAAqB,CAAC,YAAoB;AACjD,UAAM,IAAI,iBAAiB,EAAE,SAAS,WAAW,qBAAqB,CAAC;AAAA,EACzE;AAEA,WAAS,QAAQ;AAEjB,SAAO;AACT;;;ACxHO,SAASC,uBACd,UAAiD,CAAC,GACnB;AAvBjC;AAwBE,SAAO,sBAA8B;AAAA,IACnC,GAAG;AAAA,IACH,UACE,aAAQ,YAAR,YACC,aAAa;AAAA,MACZ,eAAe,UAAU,MAAM;AAAA,QAC7B,QAAQ;AAAA,MACV,CAAC;AAAA,IACH;AAAA,EACJ,CAAC;AACH;AAKO,IAAM,kBAAkBA,uBAAsB;","names":["_a","baseURL","createVertexAnthropic"]}

package/anthropic/edge/dist/index.d.mts

@@ -0,0 +1,78 @@
+import { ProviderV1, LanguageModelV1 } from '@ai-sdk/provider';
+import { Resolvable, FetchFunction } from '@ai-sdk/provider-utils';
+import { AnthropicMessagesSettings, anthropicTools } from '@ai-sdk/anthropic/internal';
+
+interface GoogleCredentials {
+    /**
+     * The client email for the Google Cloud service account. Defaults to the
+     * value of the `GOOGLE_CLIENT_EMAIL` environment variable.
+     */
+    clientEmail: string;
+    /**
+     * The private key for the Google Cloud service account. Defaults to the
+     * value of the `GOOGLE_PRIVATE_KEY` environment variable.
+     */
+    privateKey: string;
+    /**
+     * Optional. The private key ID for the Google Cloud service account. Defaults
+     * to the value of the `GOOGLE_PRIVATE_KEY_ID` environment variable.
+     */
+    privateKeyId?: string;
+}
+
+type GoogleVertexAnthropicMessagesModelId = 'claude-3-5-sonnet-v2@20241022' | 'claude-3-5-haiku@20241022' | 'claude-3-5-sonnet@20240620' | 'claude-3-haiku@20240307' | 'claude-3-sonnet@20240229' | 'claude-3-opus@20240229' | (string & {});
+
+interface GoogleVertexAnthropicProvider extends ProviderV1 {
+    /**
+  Creates a model for text generation.
+  */
+    (modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Creates a model for text generation.
+  */
+    languageModel(modelId: GoogleVertexAnthropicMessagesModelId, settings?: AnthropicMessagesSettings): LanguageModelV1;
+    /**
+  Anthropic-specific computer use tool.
+     */
+    tools: typeof anthropicTools;
+}
+interface GoogleVertexAnthropicProviderSettings$1 {
+    /**
+     * Google Cloud project ID. Defaults to the value of the `GOOGLE_VERTEX_PROJECT` environment variable.
+     */
+    project?: string;
+    /**
+     * Google Cloud region. Defaults to the value of the `GOOGLE_VERTEX_LOCATION` environment variable.
+     */
+    location?: string;
+    /**
+  Use a different URL prefix for API calls, e.g. to use proxy servers.
+  The default prefix is `https://api.anthropic.com/v1`.
+     */
+    baseURL?: string;
+    /**
+  Custom headers to include in the requests.
+       */
+    headers?: Resolvable<Record<string, string | undefined>>;
+    /**
+  Custom fetch implementation. You can use it as a middleware to intercept requests,
+  or to provide a custom fetch implementation for e.g. testing.
+      */
+    fetch?: FetchFunction;
+}
+
+interface GoogleVertexAnthropicProviderSettings extends GoogleVertexAnthropicProviderSettings$1 {
+    /**
+     * Optional. The Google credentials for the Google Cloud service account. If
+     * not provided, the Google Vertex provider will use environment variables to
+     * load the credentials.
+     */
+    googleCredentials?: GoogleCredentials;
+}
+declare function createVertexAnthropic(options?: GoogleVertexAnthropicProviderSettings): GoogleVertexAnthropicProvider;
+/**
+ * Default Google Vertex AI Anthropic provider instance.
+ */
+declare const vertexAnthropic: GoogleVertexAnthropicProvider;
+
+export { type GoogleVertexAnthropicProvider, type GoogleVertexAnthropicProviderSettings, createVertexAnthropic, vertexAnthropic };