@mastra/fastembed 0.0.0-1.x-tester-20251106055847

package/CHANGELOG.md

@@ -0,0 +1,97 @@
+# @mastra/fastembed
+
+## 0.0.0-1.x-tester-20251106055847
+
+### Major Changes
+
+- Bump minimum required Node.js version to 22.13.0 ([#9706](https://github.com/mastra-ai/mastra/pull/9706))
+
+- Upgraded to AI SDK v5 (specification version v2) for compatibility with @mastra/core. Default exports now use v2 specification. Legacy v1 exports available for backwards compatibility via `fastembed.smallLegacy` and `fastembed.baseLegacy`. ([#9349](https://github.com/mastra-ai/mastra/pull/9349))
+
+- Mark as stable ([`83d5942`](https://github.com/mastra-ai/mastra/commit/83d5942669ce7bba4a6ca4fd4da697a10eb5ebdc))
+
+## 0.10.5
+
+### Patch Changes
+
+- de3cbc6: Update the `package.json` file to include additional fields like `repository`, `homepage` or `files`.
+
+## 0.10.5-alpha.0
+
+### Patch Changes
+
+- [#7343](https://github.com/mastra-ai/mastra/pull/7343) [`de3cbc6`](https://github.com/mastra-ai/mastra/commit/de3cbc61079211431bd30487982ea3653517278e) Thanks [@LekoArts](https://github.com/LekoArts)! - Update the `package.json` file to include additional fields like `repository`, `homepage` or `files`.
+
+## 0.10.4
+
+### Patch Changes
+
+- [`c6113ed`](https://github.com/mastra-ai/mastra/commit/c6113ed7f9df297e130d94436ceee310273d6430) Thanks [@wardpeet](https://github.com/wardpeet)! - Fix peerdpes for @mastra/core
+
+## 0.10.3
+
+### Patch Changes
+
+- [#6919](https://github.com/mastra-ai/mastra/pull/6919) [`6e7e120`](https://github.com/mastra-ai/mastra/commit/6e7e1207d6e8d8b838f9024f90bd10df1181ba27) Thanks [@dane-ai-mastra](https://github.com/apps/dane-ai-mastra)! - dependencies updates:
+  - Updated dependency [`ai@^4.3.19` ↗︎](https://www.npmjs.com/package/ai/v/4.3.19) (from `^4.3.16`, in `dependencies`)
+
+## 0.10.3-alpha.0
+
+### Patch Changes
+
+- [#6919](https://github.com/mastra-ai/mastra/pull/6919) [`6e7e120`](https://github.com/mastra-ai/mastra/commit/6e7e1207d6e8d8b838f9024f90bd10df1181ba27) Thanks [@dane-ai-mastra](https://github.com/apps/dane-ai-mastra)! - dependencies updates:
+  - Updated dependency [`ai@^4.3.19` ↗︎](https://www.npmjs.com/package/ai/v/4.3.19) (from `^4.3.16`, in `dependencies`)
+
+## 0.10.2
+
+### Patch Changes
+
+- 4a406ec: fixes TypeScript declaration file imports to ensure proper ESM compatibility
+
+## 0.10.2-alpha.0
+
+### Patch Changes
+
+- 4a406ec: fixes TypeScript declaration file imports to ensure proper ESM compatibility
+
+## 0.10.1
+
+### Patch Changes
+
+- f64b3f7: dependencies updates:
+  - Updated dependency [`ai@^4.3.16` ↗︎](https://www.npmjs.com/package/ai/v/4.3.16) (from `^3.4.33`, in `dependencies`)
+
+## 0.10.1-alpha.0
+
+### Patch Changes
+
+- f64b3f7: dependencies updates:
+  - Updated dependency [`ai@^4.3.16` ↗︎](https://www.npmjs.com/package/ai/v/4.3.16) (from `^3.4.33`, in `dependencies`)
+
+## 0.0.3
+
+### Patch Changes
+
+- 48b8c2c: dependencies updates:
+  - Updated dependency [`ai@^3.4.33` ↗︎](https://www.npmjs.com/package/ai/v/3.4.33) (from `^3.0.0`, in `dependencies`)
+
+## 0.0.3-alpha.0
+
+### Patch Changes
+
+- 48b8c2c: dependencies updates:
+  - Updated dependency [`ai@^3.4.33` ↗︎](https://www.npmjs.com/package/ai/v/3.4.33) (from `^3.0.0`, in `dependencies`)
+
+## 0.0.2
+
+### Patch Changes
+
+- 3a5f1e1: Created a new @mastra/fastembed package based on the default embedder in @mastra/core as the default embedder will be removed in a breaking change (May 20th)
+  Added a warning to use the new @mastra/fastembed package instead of the default embedder
+
+## 0.0.2-alpha.0
+
+### Patch Changes
+
+- 3a5f1e1: Created a new @mastra/fastembed package based on the default embedder in @mastra/core as the default embedder will be removed in a breaking change (May 20th)
+  Added a warning to use the new @mastra/fastembed package instead of the default embedder

package/LICENSE.md

@@ -0,0 +1,15 @@
+# Apache License 2.0
+
+Copyright (c) 2025 Kepler Software, Inc.
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.

package/README.md

@@ -0,0 +1,67 @@
+# @mastra/fastembed
+
+This package provides a FastEmbed embedding model integration for use with Mastra Memory.
+
+**Note:** This functionality was previously included directly within `@mastra/core`. It has been moved to this separate package because `fastembed-js` relies on large native dependencies (like `onnxruntime-node`). Separating it keeps `@mastra/core` lightweight for users who may not need FastEmbed.
+
+## Installation
+
+```bash
+pnpm add @mastra/fastembed
+```
+
+## AI SDK v2 Compatibility
+
+This package supports AI SDK v5 (specification version v2). The default exports use v2, which is compatible with `@mastra/core` and AI SDK v5.
+
+**Breaking Change:** Previous versions used AI SDK specification v1. If you need v1 compatibility for legacy code, use the `Legacy` exports.
+
+## Usage
+
+### Default (AI SDK v2)
+
+```typescript
+import { Memory } from '@mastra/memory';
+import { fastembed } from '@mastra/fastembed';
+
+const memory = new Memory({
+  // ... other memory options
+  embedder: fastembed, // Uses v2 specification
+});
+
+// Now you can use this memory instance with an Agent
+// const agent = new Agent({ memory, ... });
+```
+
+### Available Models
+
+```typescript
+import { fastembed } from '@mastra/fastembed';
+
+// Default export (bge-small-en-v1.5 with v2 spec)
+const embedder = fastembed;
+
+// Named exports for v2 models
+const small = fastembed.small; // bge-small-en-v1.5
+const base = fastembed.base; // bge-base-en-v1.5
+
+// Legacy v1 models (for backwards compatibility)
+const smallLegacy = fastembed.smallLegacy; // bge-small-en-v1.5 (v1 spec)
+const baseLegacy = fastembed.baseLegacy; // bge-base-en-v1.5 (v1 spec)
+```
+
+### Direct Usage with AI SDK v5
+
+```typescript
+import { embed } from 'ai';
+import { fastembed } from '@mastra/fastembed';
+
+const result = await embed({
+  model: fastembed,
+  value: 'Text to embed',
+});
+
+console.log(result.embedding); // number[]
+```
+
+This package wraps the `fastembed-js` library to provide an embedding model compatible with the AI SDK and Mastra.

package/dist/index.cjs

@@ -0,0 +1,94 @@
+'use strict';
+
+var fsp = require('fs/promises');
+var os = require('os');
+var path = require('path');
+var ai = require('ai');
+var aiV4 = require('ai-v4');
+var fastembed$1 = require('fastembed');
+
+function _interopDefault (e) { return e && e.__esModule ? e : { default: e }; }
+
+var fsp__default = /*#__PURE__*/_interopDefault(fsp);
+var os__default = /*#__PURE__*/_interopDefault(os);
+var path__default = /*#__PURE__*/_interopDefault(path);
+
+// src/index.ts
+async function getModelCachePath() {
+  const cachePath = path__default.default.join(os__default.default.homedir(), ".cache", "mastra", "fastembed-models");
+  await fsp__default.default.mkdir(cachePath, { recursive: true });
+  return cachePath;
+}
+async function generateEmbeddings(values, modelType) {
+  const model = await fastembed$1.FlagEmbedding.init({
+    model: fastembed$1.EmbeddingModel[modelType],
+    cacheDir: await getModelCachePath()
+  });
+  const embeddings = model.embed(values);
+  const allResults = [];
+  for await (const result of embeddings) {
+    allResults.push(...result.map((embedding) => Array.from(embedding)));
+  }
+  if (allResults.length === 0) throw new Error("No embeddings generated");
+  return {
+    embeddings: allResults
+  };
+}
+var fastEmbedLegacyProvider = aiV4.experimental_customProvider({
+  textEmbeddingModels: {
+    "bge-small-en-v1.5": {
+      specificationVersion: "v1",
+      provider: "fastembed",
+      modelId: "bge-small-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGESmallENV15");
+      }
+    },
+    "bge-base-en-v1.5": {
+      specificationVersion: "v1",
+      provider: "fastembed",
+      modelId: "bge-base-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGEBaseENV15");
+      }
+    }
+  }
+});
+var fastEmbedProvider = ai.customProvider({
+  textEmbeddingModels: {
+    "bge-small-en-v1.5": {
+      specificationVersion: "v2",
+      provider: "fastembed",
+      modelId: "bge-small-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGESmallENV15");
+      }
+    },
+    "bge-base-en-v1.5": {
+      specificationVersion: "v2",
+      provider: "fastembed",
+      modelId: "bge-base-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGEBaseENV15");
+      }
+    }
+  }
+});
+var fastembed = Object.assign(fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`), {
+  small: fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`),
+  base: fastEmbedProvider.textEmbeddingModel(`bge-base-en-v1.5`),
+  smallLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-small-en-v1.5`),
+  baseLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-base-en-v1.5`)
+});
+
+exports.fastembed = fastembed;
+//# sourceMappingURL=index.cjs.map
+//# sourceMappingURL=index.cjs.map

package/dist/index.cjs.map

@@ -0,0 +1 @@
+{"version":3,"sources":["../src/index.ts"],"names":["path","os","fsp","FlagEmbedding","EmbeddingModel","experimental_customProvider","customProvider"],"mappings":";;;;;;;;;;;;;;;;AAOA,eAAe,iBAAA,GAAoB;AACjC,EAAA,MAAM,SAAA,GAAYA,sBAAK,IAAA,CAAKC,mBAAA,CAAG,SAAQ,EAAG,QAAA,EAAU,UAAU,kBAAkB,CAAA;AAChF,EAAA,MAAMC,qBAAI,KAAA,CAAM,SAAA,EAAW,EAAE,SAAA,EAAW,MAAM,CAAA;AAC9C,EAAA,OAAO,SAAA;AACT;AAGA,eAAe,kBAAA,CAAmB,QAAkB,SAAA,EAA6C;AAC/F,EAAA,MAAM,KAAA,GAAQ,MAAMC,yBAAA,CAAc,IAAA,CAAK;AAAA,IACrC,KAAA,EAAOC,2BAAe,SAAS,CAAA;AAAA,IAC/B,QAAA,EAAU,MAAM,iBAAA;AAAkB,GACnC,CAAA;AAGD,EAAA,MAAM,UAAA,GAAa,KAAA,CAAM,KAAA,CAAM,MAAM,CAAA;AAErC,EAAA,MAAM,aAAa,EAAC;AACpB,EAAA,WAAA,MAAiB,UAAU,UAAA,EAAY;AAGrC,IAAA,UAAA,CAAW,IAAA,CAAK,GAAG,MAAA,CAAO,GAAA,CAAI,eAAa,KAAA,CAAM,IAAA,CAAK,SAAS,CAAC,CAAC,CAAA;AAAA,EACnE;AAEA,EAAA,IAAI,WAAW,MAAA,KAAW,CAAA,EAAG,MAAM,IAAI,MAAM,yBAAyB,CAAA;AAEtE,EAAA,OAAO;AAAA,IACL,UAAA,EAAY;AAAA,GACd;AACF;AAGA,IAAM,0BAA0BC,gCAAA,CAA4B;AAAA,EAC1D,mBAAA,EAAqB;AAAA,IACnB,mBAAA,EAAqB;AAAA,MACnB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,mBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,eAAe,CAAA;AAAA,MACnD;AAAA,KACF;AAAA,IACA,kBAAA,EAAoB;AAAA,MAClB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,kBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,cAAc,CAAA;AAAA,MAClD;AAAA;AACF;AAEJ,CAAC,CAAA;AAGD,IAAM,oBAAoBC,iBAAA,CAAe;AAAA,EACvC,mBAAA,EAAqB;AAAA,IACnB,mBAAA,EAAqB;AAAA,MACnB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,mBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,eAAe,CAAA;AAAA,MACnD;AAAA,KACF;AAAA,IACA,kBAAA,EAAoB;AAAA,MAClB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,kBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,cAAc,CAAA;AAAA,MAClD;AAAA;AACF;AAEJ,CAAC,CAAA;AAEM,IAAM,YAAY,MAAA,CAAO,MAAA,CAAO,iBAAA,CAAkB,kBAAA,CAAmB,mBAAmB,CAAA,EAAG;AAAA,EAChG,KAAA,EAAO,iBAAA,CAAkB,kBAAA,CAAmB,CAAA,iBAAA,CAAmB,CAAA;AAAA,EAC/D,IAAA,EAAM,iBAAA,CAAkB,kBAAA,CAAmB,CAAA,gBAAA,CAAkB,CAAA;AAAA,EAC7D,WAAA,EAAa,uBAAA,CAAwB,kBAAA,CAAmB,CAAA,iBAAA,CAAmB,CAAA;AAAA,EAC3E,UAAA,EAAY,uBAAA,CAAwB,kBAAA,CAAmB,CAAA,gBAAA,CAAkB;AAC3E,CAAC","file":"index.cjs","sourcesContent":["import fsp from 'node:fs/promises';\nimport os from 'node:os';\nimport path from 'node:path';\nimport { customProvider } from 'ai';\nimport { experimental_customProvider } from 'ai-v4';\nimport { FlagEmbedding, EmbeddingModel } from 'fastembed';\n\nasync function getModelCachePath() {\n  const cachePath = path.join(os.homedir(), '.cache', 'mastra', 'fastembed-models');\n  await fsp.mkdir(cachePath, { recursive: true });\n  return cachePath;\n}\n\n// Shared function to generate embeddings using fastembed\nasync function generateEmbeddings(values: string[], modelType: 'BGESmallENV15' | 'BGEBaseENV15') {\n  const model = await FlagEmbedding.init({\n    model: EmbeddingModel[modelType],\n    cacheDir: await getModelCachePath(),\n  });\n\n  // model.embed() returns an AsyncGenerator that processes texts in batches (default size 256)\n  const embeddings = model.embed(values);\n\n  const allResults = [];\n  for await (const result of embeddings) {\n    // result is an array of embeddings, one for each text in the batch\n    // We convert each Float32Array embedding to a regular number array\n    allResults.push(...result.map(embedding => Array.from(embedding)));\n  }\n\n  if (allResults.length === 0) throw new Error('No embeddings generated');\n\n  return {\n    embeddings: allResults,\n  };\n}\n\n// Legacy v1 provider for backwards compatibility\nconst fastEmbedLegacyProvider = experimental_customProvider({\n  textEmbeddingModels: {\n    'bge-small-en-v1.5': {\n      specificationVersion: 'v1',\n      provider: 'fastembed',\n      modelId: 'bge-small-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGESmallENV15');\n      },\n    },\n    'bge-base-en-v1.5': {\n      specificationVersion: 'v1',\n      provider: 'fastembed',\n      modelId: 'bge-base-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGEBaseENV15');\n      },\n    },\n  },\n});\n\n// V2 provider for AI SDK v5 compatibility\nconst fastEmbedProvider = customProvider({\n  textEmbeddingModels: {\n    'bge-small-en-v1.5': {\n      specificationVersion: 'v2',\n      provider: 'fastembed',\n      modelId: 'bge-small-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGESmallENV15');\n      },\n    },\n    'bge-base-en-v1.5': {\n      specificationVersion: 'v2',\n      provider: 'fastembed',\n      modelId: 'bge-base-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGEBaseENV15');\n      },\n    },\n  },\n});\n\nexport const fastembed = Object.assign(fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`), {\n  small: fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`),\n  base: fastEmbedProvider.textEmbeddingModel(`bge-base-en-v1.5`),\n  smallLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-small-en-v1.5`),\n  baseLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-base-en-v1.5`),\n});\n"]}

package/dist/index.d.ts

@@ -0,0 +1,7 @@
+export declare const fastembed: import("@ai-sdk/provider").EmbeddingModelV2<string> & {
+    small: import("@ai-sdk/provider").EmbeddingModelV2<string>;
+    base: import("@ai-sdk/provider").EmbeddingModelV2<string>;
+    smallLegacy: import("ai-v4").EmbeddingModel<string>;
+    baseLegacy: import("ai-v4").EmbeddingModel<string>;
+};
+//# sourceMappingURL=index.d.ts.map

package/dist/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAyFA,eAAO,MAAM,SAAS;;;;;CAKpB,CAAC"}

package/dist/index.js

@@ -0,0 +1,86 @@
+import fsp from 'fs/promises';
+import os from 'os';
+import path from 'path';
+import { customProvider } from 'ai';
+import { experimental_customProvider } from 'ai-v4';
+import { FlagEmbedding, EmbeddingModel } from 'fastembed';
+
+// src/index.ts
+async function getModelCachePath() {
+  const cachePath = path.join(os.homedir(), ".cache", "mastra", "fastembed-models");
+  await fsp.mkdir(cachePath, { recursive: true });
+  return cachePath;
+}
+async function generateEmbeddings(values, modelType) {
+  const model = await FlagEmbedding.init({
+    model: EmbeddingModel[modelType],
+    cacheDir: await getModelCachePath()
+  });
+  const embeddings = model.embed(values);
+  const allResults = [];
+  for await (const result of embeddings) {
+    allResults.push(...result.map((embedding) => Array.from(embedding)));
+  }
+  if (allResults.length === 0) throw new Error("No embeddings generated");
+  return {
+    embeddings: allResults
+  };
+}
+var fastEmbedLegacyProvider = experimental_customProvider({
+  textEmbeddingModels: {
+    "bge-small-en-v1.5": {
+      specificationVersion: "v1",
+      provider: "fastembed",
+      modelId: "bge-small-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGESmallENV15");
+      }
+    },
+    "bge-base-en-v1.5": {
+      specificationVersion: "v1",
+      provider: "fastembed",
+      modelId: "bge-base-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGEBaseENV15");
+      }
+    }
+  }
+});
+var fastEmbedProvider = customProvider({
+  textEmbeddingModels: {
+    "bge-small-en-v1.5": {
+      specificationVersion: "v2",
+      provider: "fastembed",
+      modelId: "bge-small-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGESmallENV15");
+      }
+    },
+    "bge-base-en-v1.5": {
+      specificationVersion: "v2",
+      provider: "fastembed",
+      modelId: "bge-base-en-v1.5",
+      maxEmbeddingsPerCall: 256,
+      supportsParallelCalls: true,
+      async doEmbed({ values }) {
+        return generateEmbeddings(values, "BGEBaseENV15");
+      }
+    }
+  }
+});
+var fastembed = Object.assign(fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`), {
+  small: fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`),
+  base: fastEmbedProvider.textEmbeddingModel(`bge-base-en-v1.5`),
+  smallLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-small-en-v1.5`),
+  baseLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-base-en-v1.5`)
+});
+
+export { fastembed };
+//# sourceMappingURL=index.js.map
+//# sourceMappingURL=index.js.map

package/dist/index.js.map

@@ -0,0 +1 @@
+{"version":3,"sources":["../src/index.ts"],"names":[],"mappings":";;;;;;;;AAOA,eAAe,iBAAA,GAAoB;AACjC,EAAA,MAAM,SAAA,GAAY,KAAK,IAAA,CAAK,EAAA,CAAG,SAAQ,EAAG,QAAA,EAAU,UAAU,kBAAkB,CAAA;AAChF,EAAA,MAAM,IAAI,KAAA,CAAM,SAAA,EAAW,EAAE,SAAA,EAAW,MAAM,CAAA;AAC9C,EAAA,OAAO,SAAA;AACT;AAGA,eAAe,kBAAA,CAAmB,QAAkB,SAAA,EAA6C;AAC/F,EAAA,MAAM,KAAA,GAAQ,MAAM,aAAA,CAAc,IAAA,CAAK;AAAA,IACrC,KAAA,EAAO,eAAe,SAAS,CAAA;AAAA,IAC/B,QAAA,EAAU,MAAM,iBAAA;AAAkB,GACnC,CAAA;AAGD,EAAA,MAAM,UAAA,GAAa,KAAA,CAAM,KAAA,CAAM,MAAM,CAAA;AAErC,EAAA,MAAM,aAAa,EAAC;AACpB,EAAA,WAAA,MAAiB,UAAU,UAAA,EAAY;AAGrC,IAAA,UAAA,CAAW,IAAA,CAAK,GAAG,MAAA,CAAO,GAAA,CAAI,eAAa,KAAA,CAAM,IAAA,CAAK,SAAS,CAAC,CAAC,CAAA;AAAA,EACnE;AAEA,EAAA,IAAI,WAAW,MAAA,KAAW,CAAA,EAAG,MAAM,IAAI,MAAM,yBAAyB,CAAA;AAEtE,EAAA,OAAO;AAAA,IACL,UAAA,EAAY;AAAA,GACd;AACF;AAGA,IAAM,0BAA0B,2BAAA,CAA4B;AAAA,EAC1D,mBAAA,EAAqB;AAAA,IACnB,mBAAA,EAAqB;AAAA,MACnB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,mBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,eAAe,CAAA;AAAA,MACnD;AAAA,KACF;AAAA,IACA,kBAAA,EAAoB;AAAA,MAClB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,kBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,cAAc,CAAA;AAAA,MAClD;AAAA;AACF;AAEJ,CAAC,CAAA;AAGD,IAAM,oBAAoB,cAAA,CAAe;AAAA,EACvC,mBAAA,EAAqB;AAAA,IACnB,mBAAA,EAAqB;AAAA,MACnB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,mBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,eAAe,CAAA;AAAA,MACnD;AAAA,KACF;AAAA,IACA,kBAAA,EAAoB;AAAA,MAClB,oBAAA,EAAsB,IAAA;AAAA,MACtB,QAAA,EAAU,WAAA;AAAA,MACV,OAAA,EAAS,kBAAA;AAAA,MACT,oBAAA,EAAsB,GAAA;AAAA,MACtB,qBAAA,EAAuB,IAAA;AAAA,MACvB,MAAM,OAAA,CAAQ,EAAE,MAAA,EAAO,EAAG;AACxB,QAAA,OAAO,kBAAA,CAAmB,QAAQ,cAAc,CAAA;AAAA,MAClD;AAAA;AACF;AAEJ,CAAC,CAAA;AAEM,IAAM,YAAY,MAAA,CAAO,MAAA,CAAO,iBAAA,CAAkB,kBAAA,CAAmB,mBAAmB,CAAA,EAAG;AAAA,EAChG,KAAA,EAAO,iBAAA,CAAkB,kBAAA,CAAmB,CAAA,iBAAA,CAAmB,CAAA;AAAA,EAC/D,IAAA,EAAM,iBAAA,CAAkB,kBAAA,CAAmB,CAAA,gBAAA,CAAkB,CAAA;AAAA,EAC7D,WAAA,EAAa,uBAAA,CAAwB,kBAAA,CAAmB,CAAA,iBAAA,CAAmB,CAAA;AAAA,EAC3E,UAAA,EAAY,uBAAA,CAAwB,kBAAA,CAAmB,CAAA,gBAAA,CAAkB;AAC3E,CAAC","file":"index.js","sourcesContent":["import fsp from 'node:fs/promises';\nimport os from 'node:os';\nimport path from 'node:path';\nimport { customProvider } from 'ai';\nimport { experimental_customProvider } from 'ai-v4';\nimport { FlagEmbedding, EmbeddingModel } from 'fastembed';\n\nasync function getModelCachePath() {\n  const cachePath = path.join(os.homedir(), '.cache', 'mastra', 'fastembed-models');\n  await fsp.mkdir(cachePath, { recursive: true });\n  return cachePath;\n}\n\n// Shared function to generate embeddings using fastembed\nasync function generateEmbeddings(values: string[], modelType: 'BGESmallENV15' | 'BGEBaseENV15') {\n  const model = await FlagEmbedding.init({\n    model: EmbeddingModel[modelType],\n    cacheDir: await getModelCachePath(),\n  });\n\n  // model.embed() returns an AsyncGenerator that processes texts in batches (default size 256)\n  const embeddings = model.embed(values);\n\n  const allResults = [];\n  for await (const result of embeddings) {\n    // result is an array of embeddings, one for each text in the batch\n    // We convert each Float32Array embedding to a regular number array\n    allResults.push(...result.map(embedding => Array.from(embedding)));\n  }\n\n  if (allResults.length === 0) throw new Error('No embeddings generated');\n\n  return {\n    embeddings: allResults,\n  };\n}\n\n// Legacy v1 provider for backwards compatibility\nconst fastEmbedLegacyProvider = experimental_customProvider({\n  textEmbeddingModels: {\n    'bge-small-en-v1.5': {\n      specificationVersion: 'v1',\n      provider: 'fastembed',\n      modelId: 'bge-small-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGESmallENV15');\n      },\n    },\n    'bge-base-en-v1.5': {\n      specificationVersion: 'v1',\n      provider: 'fastembed',\n      modelId: 'bge-base-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGEBaseENV15');\n      },\n    },\n  },\n});\n\n// V2 provider for AI SDK v5 compatibility\nconst fastEmbedProvider = customProvider({\n  textEmbeddingModels: {\n    'bge-small-en-v1.5': {\n      specificationVersion: 'v2',\n      provider: 'fastembed',\n      modelId: 'bge-small-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGESmallENV15');\n      },\n    },\n    'bge-base-en-v1.5': {\n      specificationVersion: 'v2',\n      provider: 'fastembed',\n      modelId: 'bge-base-en-v1.5',\n      maxEmbeddingsPerCall: 256,\n      supportsParallelCalls: true,\n      async doEmbed({ values }) {\n        return generateEmbeddings(values, 'BGEBaseENV15');\n      },\n    },\n  },\n});\n\nexport const fastembed = Object.assign(fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`), {\n  small: fastEmbedProvider.textEmbeddingModel(`bge-small-en-v1.5`),\n  base: fastEmbedProvider.textEmbeddingModel(`bge-base-en-v1.5`),\n  smallLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-small-en-v1.5`),\n  baseLegacy: fastEmbedLegacyProvider.textEmbeddingModel(`bge-base-en-v1.5`),\n});\n"]}

package/package.json

@@ -0,0 +1,56 @@
+{
+  "name": "@mastra/fastembed",
+  "version": "0.0.0-1.x-tester-20251106055847",
+  "license": "Apache-2.0",
+  "type": "module",
+  "main": "dist/index.js",
+  "types": "dist/index.d.ts",
+  "exports": {
+    ".": {
+      "import": {
+        "types": "./dist/index.d.ts",
+        "default": "./dist/index.js"
+      },
+      "require": {
+        "types": "./dist/index.d.ts",
+        "default": "./dist/index.cjs"
+      }
+    },
+    "./package.json": "./package.json"
+  },
+  "files": [
+    "dist",
+    "CHANGELOG.md"
+  ],
+  "homepage": "https://mastra.ai",
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/mastra-ai/mastra.git",
+    "directory": "packages/fastembed"
+  },
+  "bugs": {
+    "url": "https://github.com/mastra-ai/mastra/issues"
+  },
+  "dependencies": {
+    "ai": "^5.0.76",
+    "ai-v4": "npm:ai@4.3.19",
+    "@ai-sdk/provider": "^2.0.0",
+    "fastembed": "^1.14.4"
+  },
+  "devDependencies": {
+    "@types/node": "^20.19.0",
+    "tsup": "^8.5.0",
+    "typescript": "^5.8.3",
+    "vitest": "^3.2.4",
+    "@internal/types-builder": "0.0.0-1.x-tester-20251106055847",
+    "@internal/lint": "0.0.0-1.x-tester-20251106055847"
+  },
+  "engines": {
+    "node": ">=22.13.0"
+  },
+  "scripts": {
+    "build": "tsup --silent --config tsup.config.ts",
+    "build:watch": "tsup --watch --silent --config tsup.config.ts",
+    "test": "vitest run"
+  }
+}