@mastra/lance 1.0.0-beta.10 → 1.0.0-beta.11

package/CHANGELOG.md

@@ -1,5 +1,88 @@
 # @mastra/lance
 
+## 1.0.0-beta.11
+
+### Patch Changes
+
+- Aligned vector store configuration with underlying library APIs, giving you access to all library options directly. ([#11742](https://github.com/mastra-ai/mastra/pull/11742))
+
+  **Why this change?**
+
+  Previously, each vector store defined its own configuration types that only exposed a subset of the underlying library's options. This meant users couldn't access advanced features like authentication, SSL, compression, or custom headers without creating their own client instances. Now, the configuration types extend the library types directly, so all options are available.
+
+  **@mastra/libsql** (Breaking)
+
+  Renamed `connectionUrl` to `url` to match the `@libsql/client` API and align with LibSQLStorage.
+
+  ```typescript
+  // Before
+  new LibSQLVector({ id: 'my-vector', connectionUrl: 'file:./db.sqlite' });
+
+  // After
+  new LibSQLVector({ id: 'my-vector', url: 'file:./db.sqlite' });
+  ```
+
+  **@mastra/opensearch** (Breaking)
+
+  Renamed `url` to `node` and added support for all OpenSearch `ClientOptions` including authentication, SSL, and compression.
+
+  ```typescript
+  // Before
+  new OpenSearchVector({ id: 'my-vector', url: 'http://localhost:9200' });
+
+  // After
+  new OpenSearchVector({ id: 'my-vector', node: 'http://localhost:9200' });
+
+  // With authentication (now possible)
+  new OpenSearchVector({
+    id: 'my-vector',
+    node: 'https://localhost:9200',
+    auth: { username: 'admin', password: 'admin' },
+    ssl: { rejectUnauthorized: false },
+  });
+  ```
+
+  **@mastra/pinecone** (Breaking)
+
+  Removed `environment` parameter. Use `controllerHostUrl` instead (the actual Pinecone SDK field name). Added support for all `PineconeConfiguration` options.
+
+  ```typescript
+  // Before
+  new PineconeVector({ id: 'my-vector', apiKey: '...', environment: '...' });
+
+  // After
+  new PineconeVector({ id: 'my-vector', apiKey: '...' });
+
+  // With custom controller host (if needed)
+  new PineconeVector({ id: 'my-vector', apiKey: '...', controllerHostUrl: '...' });
+  ```
+
+  **@mastra/clickhouse**
+
+  Added support for all `ClickHouseClientConfigOptions` like `request_timeout`, `compression`, `keep_alive`, and `database`. Existing configurations continue to work unchanged.
+
+  **@mastra/cloudflare, @mastra/cloudflare-d1, @mastra/lance, @mastra/libsql, @mastra/mongodb, @mastra/pg, @mastra/upstash**
+
+  Improved logging by replacing `console.warn` with structured logger in workflow storage domains.
+
+  **@mastra/deployer-cloud**
+
+  Updated internal LibSQLVector configuration for compatibility with the new API.
+
+- Fixed `LanceVectorStore` failing when used with Memory. ([#11828](https://github.com/mastra-ai/mastra/pull/11828))
+
+  When using `LanceVectorStore` with `@mastra/memory`, operations would fail because Memory calls methods without a `tableName` parameter. The `tableName` parameter now defaults to `indexName` when not provided in `createIndex`, `query`, and `upsert` methods, matching the behavior of other vector stores like PgVector.
+
+  Additionally fixed three critical bugs:
+  1. **Upsert replacing entire table**: The `upsert` method was using `mode: 'overwrite'` which replaced all rows in the table instead of updating only the specified rows. Now uses LanceDB's `mergeInsert` for proper upsert semantics (update existing rows, insert new ones).
+  2. **UpdateVector replacing entire table**: The `updateVector` method had the same issue - using `mode: 'overwrite'` caused all other rows to be deleted. Now uses `mergeInsert` to only update the targeted rows.
+  3. **Query not returning metadata by default**: When querying without specifying `columns`, only the `id` field was returned, causing metadata to be empty even though filters worked on metadata fields. Now returns all columns by default.
+
+  Fixes #11716
+
+- Updated dependencies [[`ebae12a`](https://github.com/mastra-ai/mastra/commit/ebae12a2dd0212e75478981053b148a2c246962d), [`c61a0a5`](https://github.com/mastra-ai/mastra/commit/c61a0a5de4904c88fd8b3718bc26d1be1c2ec6e7), [`69136e7`](https://github.com/mastra-ai/mastra/commit/69136e748e32f57297728a4e0f9a75988462f1a7), [`449aed2`](https://github.com/mastra-ai/mastra/commit/449aed2ba9d507b75bf93d427646ea94f734dfd1), [`eb648a2`](https://github.com/mastra-ai/mastra/commit/eb648a2cc1728f7678768dd70cd77619b448dab9), [`0131105`](https://github.com/mastra-ai/mastra/commit/0131105532e83bdcbb73352fc7d0879eebf140dc), [`9d5059e`](https://github.com/mastra-ai/mastra/commit/9d5059eae810829935fb08e81a9bb7ecd5b144a7), [`ef756c6`](https://github.com/mastra-ai/mastra/commit/ef756c65f82d16531c43f49a27290a416611e526), [`b00ccd3`](https://github.com/mastra-ai/mastra/commit/b00ccd325ebd5d9e37e34dd0a105caae67eb568f), [`3bdfa75`](https://github.com/mastra-ai/mastra/commit/3bdfa7507a91db66f176ba8221aa28dd546e464a), [`e770de9`](https://github.com/mastra-ai/mastra/commit/e770de941a287a49b1964d44db5a5763d19890a6), [`52e2716`](https://github.com/mastra-ai/mastra/commit/52e2716b42df6eff443de72360ae83e86ec23993), [`27b4040`](https://github.com/mastra-ai/mastra/commit/27b4040bfa1a95d92546f420a02a626b1419a1d6), [`610a70b`](https://github.com/mastra-ai/mastra/commit/610a70bdad282079f0c630e0d7bb284578f20151), [`8dc7f55`](https://github.com/mastra-ai/mastra/commit/8dc7f55900395771da851dc7d78d53ae84fe34ec), [`8379099`](https://github.com/mastra-ai/mastra/commit/8379099fc467af6bef54dd7f80c9bd75bf8bbddf), [`8c0ec25`](https://github.com/mastra-ai/mastra/commit/8c0ec25646c8a7df253ed1e5ff4863a0d3f1316c), [`ff4d9a6`](https://github.com/mastra-ai/mastra/commit/ff4d9a6704fc87b31a380a76ed22736fdedbba5a), [`69821ef`](https://github.com/mastra-ai/mastra/commit/69821ef806482e2c44e2197ac0b050c3fe3a5285), [`1ed5716`](https://github.com/mastra-ai/mastra/commit/1ed5716830867b3774c4a1b43cc0d82935f32b96), [`4186bdd`](https://github.com/mastra-ai/mastra/commit/4186bdd00731305726fa06adba0b076a1d50b49f), [`7aaf973`](https://github.com/mastra-ai/mastra/commit/7aaf973f83fbbe9521f1f9e7a4fd99b8de464617)]:
+  - @mastra/core@1.0.0-beta.22
+
 ## 1.0.0-beta.10
 
 ### Patch Changes

package/dist/docs/README.md

@@ -30,4 +30,4 @@ docs/
 ## Version
 
 Package: @mastra/lance
-Version: 1.0.0-beta.10
+Version: 1.0.0-beta.11

package/dist/docs/SKILL.md

@@ -5,7 +5,7 @@ description: Documentation for @mastra/lance. Includes links to type definitions
 
 # @mastra/lance Documentation
 
-> **Version**: 1.0.0-beta.10
+> **Version**: 1.0.0-beta.11
 > **Package**: @mastra/lance
 
 ## Quick Navigation

package/dist/docs/SOURCE_MAP.json

@@ -1,5 +1,5 @@
 {
-  "version": "1.0.0-beta.10",
+  "version": "1.0.0-beta.11",
   "package": "@mastra/lance",
   "exports": {},
   "modules": {}

package/dist/docs/rag/01-vector-databases.md

@@ -12,6 +12,7 @@ After generating embeddings, you need to store them in a database that supports
 import { MongoDBVector } from "@mastra/mongodb";
 
 const store = new MongoDBVector({
+  id: 'mongodb-vector',
   uri: process.env.MONGODB_URI,
   dbName: process.env.MONGODB_DATABASE,
 });
@@ -144,6 +145,7 @@ await store.upsert({
 import { AstraVector } from "@mastra/astra";
 
 const store = new AstraVector({
+  id: 'astra-vector',
   token: process.env.ASTRA_DB_TOKEN,
   endpoint: process.env.ASTRA_DB_ENDPOINT,
   keyspace: process.env.ASTRA_DB_KEYSPACE,
@@ -170,7 +172,7 @@ import { LibSQLVector } from "@mastra/core/vector/libsql";
 
 const store = new LibSQLVector({
   id: 'libsql-vector',
-  connectionUrl: process.env.DATABASE_URL,
+  url: process.env.DATABASE_URL,
   authToken: process.env.DATABASE_AUTH_TOKEN, // Optional: for Turso cloud databases
 });
 
@@ -217,6 +219,7 @@ await store.upsert({
 import { CloudflareVector } from "@mastra/vectorize";
 
 const store = new CloudflareVector({
+  id: 'cloudflare-vector',
   accountId: process.env.CF_ACCOUNT_ID,
   apiToken: process.env.CF_API_TOKEN,
 });
@@ -238,7 +241,7 @@ await store.upsert({
 ```ts title="vector-store.ts"
 import { OpenSearchVector } from "@mastra/opensearch";
 
-const store = new OpenSearchVector({ url: process.env.OPENSEARCH_URL });
+const store = new OpenSearchVector({ id: "opensearch", node: process.env.OPENSEARCH_URL });
 
 await store.createIndex({
   indexName: "my-collection",
@@ -259,7 +262,7 @@ await store.upsert({
 ```ts title="vector-store.ts"
 import { ElasticSearchVector } from "@mastra/elasticsearch";
 
-const store = new ElasticSearchVector({ url: process.env.ELASTICSEARCH_URL });
+const store = new ElasticSearchVector({ id: 'elasticsearch-vector', url: process.env.ELASTICSEARCH_URL });
 
 await store.createIndex({
   indexName: "my-collection",
@@ -280,6 +283,7 @@ await store.upsert({
 import { CouchbaseVector } from "@mastra/couchbase";
 
 const store = new CouchbaseVector({
+  id: 'couchbase-vector',
   connectionString: process.env.COUCHBASE_CONNECTION_STRING,
   username: process.env.COUCHBASE_USERNAME,
   password: process.env.COUCHBASE_PASSWORD,
@@ -331,6 +335,7 @@ For detailed setup instructions and best practices, see the [official LanceDB do
 import { S3Vectors } from "@mastra/s3vectors";
 
 const store = new S3Vectors({
+  id: 's3-vectors',
   vectorBucketName: "my-vector-bucket",
   clientConfig: {
     region: "us-east-1",
@@ -373,7 +378,7 @@ The dimension size must match the output dimension of your chosen embedding mode
 - Cohere embed-multilingual-v3: 1024 dimensions
 - Google text-embedding-004: 768 dimensions (or custom)
 
-important
+> **Note:**
 Index dimensions cannot be changed after creation. To use a different model, delete and recreate the index with the new dimension size.
 
 ### Naming Rules for Databases
@@ -537,7 +542,7 @@ The upsert operation:
 
 Vector stores support rich metadata (any JSON-serializable fields) for filtering and organization. Since metadata is stored with no fixed schema, use consistent field naming to avoid unexpected query results.
 
-important
+> **Note:**
 Metadata is crucial for vector storage - without it, you'd only have numerical embeddings with no way to return the original text or filter results. Always store at least the source text as metadata.
 
 ```ts

package/dist/index.cjs

@@ -1605,24 +1605,6 @@ var StoreScoresLance = class extends storage.ScoresStorage {
 function escapeSql(str) {
   return str.replace(/'/g, "''");
 }
-function parseWorkflowRun(row) {
-  let parsedSnapshot = row.snapshot;
-  if (typeof parsedSnapshot === "string") {
-    try {
-      parsedSnapshot = JSON.parse(row.snapshot);
-    } catch (e) {
-      console.warn(`Failed to parse snapshot for workflow ${row.workflow_name}: ${e}`);
-    }
-  }
-  return {
-    workflowName: row.workflow_name,
-    runId: row.run_id,
-    snapshot: parsedSnapshot,
-    createdAt: storage.ensureDate(row.createdAt),
-    updatedAt: storage.ensureDate(row.updatedAt),
-    resourceId: row.resourceId
-  };
-}
 var StoreWorkflowsLance = class extends storage.WorkflowsStorage {
   client;
   #db;
@@ -1632,6 +1614,24 @@ var StoreWorkflowsLance = class extends storage.WorkflowsStorage {
     this.client = client;
     this.#db = new LanceDB({ client });
   }
+  parseWorkflowRun(row) {
+    let parsedSnapshot = row.snapshot;
+    if (typeof parsedSnapshot === "string") {
+      try {
+        parsedSnapshot = JSON.parse(row.snapshot);
+      } catch (e) {
+        this.logger.warn(`Failed to parse snapshot for workflow ${row.workflow_name}: ${e}`);
+      }
+    }
+    return {
+      workflowName: row.workflow_name,
+      runId: row.run_id,
+      snapshot: parsedSnapshot,
+      createdAt: storage.ensureDate(row.createdAt),
+      updatedAt: storage.ensureDate(row.updatedAt),
+      resourceId: row.resourceId
+    };
+  }
   async init() {
     const schema = storage.TABLE_SCHEMAS[storage.TABLE_WORKFLOW_SNAPSHOT];
     await this.#db.createTable({ tableName: storage.TABLE_WORKFLOW_SNAPSHOT, schema });
@@ -1763,7 +1763,7 @@ var StoreWorkflowsLance = class extends storage.WorkflowsStorage {
       const records = await query.toArray();
       if (records.length === 0) return null;
       const record = records[0];
-      return parseWorkflowRun(record);
+      return this.parseWorkflowRun(record);
     } catch (error$1) {
       throw new error.MastraError(
         {
@@ -1840,7 +1840,7 @@ var StoreWorkflowsLance = class extends storage.WorkflowsStorage {
       }
       const records = await query.toArray();
       return {
-        runs: records.map((record) => parseWorkflowRun(record)),
+        runs: records.map((record) => this.parseWorkflowRun(record)),
         total: total || records.length
       };
     } catch (error$1) {
@@ -2330,6 +2330,7 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
   }
   async query({
     tableName,
+    indexName,
     queryVector,
     filter,
     includeVector = false,
@@ -2337,12 +2338,13 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
     columns = [],
     includeAllColumns = false
   }) {
+    const resolvedTableName = tableName ?? indexName;
     try {
       if (!this.lanceClient) {
         throw new Error("LanceDB client not initialized. Use LanceVectorStore.create() to create an instance");
       }
-      if (!tableName) {
-        throw new Error("tableName is required");
+      if (!resolvedTableName) {
+        throw new Error("tableName or indexName is required");
       }
       if (!queryVector) {
         throw new Error("queryVector is required");
@@ -2353,25 +2355,30 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "QUERY", "INVALID_ARGS"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.USER,
-          text: "LanceDB client not initialized. Use LanceVectorStore.create() to create an instance",
-          details: { tableName }
+          text: error$1 instanceof Error ? error$1.message : "Invalid query arguments",
+          details: { tableName: resolvedTableName }
         },
         error$1
       );
     }
     try {
-      const table = await this.lanceClient.openTable(tableName);
-      const selectColumns = [...columns];
-      if (!selectColumns.includes("id")) {
-        selectColumns.push("id");
+      const tables = await this.lanceClient.tableNames();
+      if (!tables.includes(resolvedTableName)) {
+        this.logger.debug(`Table ${resolvedTableName} does not exist. Returning empty results.`);
+        return [];
       }
+      const table = await this.lanceClient.openTable(resolvedTableName);
       let query = table.search(queryVector);
       if (filter && Object.keys(filter).length > 0) {
         const whereClause = this.filterTranslator(filter);
         this.logger.debug(`Where clause generated: ${whereClause}`);
         query = query.where(whereClause);
       }
-      if (!includeAllColumns && selectColumns.length > 0) {
+      if (!includeAllColumns && columns.length > 0) {
+        const selectColumns = [...columns];
+        if (!selectColumns.includes("id")) {
+          selectColumns.push("id");
+        }
         query = query.select(selectColumns);
       }
       query = query.limit(topK);
@@ -2401,7 +2408,7 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "QUERY", "FAILED"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.THIRD_PARTY,
-          details: { tableName, includeVector, columnsCount: columns?.length, includeAllColumns }
+          details: { tableName: resolvedTableName, includeVector, columnsCount: columns?.length, includeAllColumns }
         },
         error$1
       );
@@ -2436,13 +2443,14 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
     const translator = new LanceFilterTranslator();
     return translator.translate(prefixedFilter);
   }
-  async upsert({ tableName, vectors, metadata = [], ids = [] }) {
+  async upsert({ tableName, indexName, vectors, metadata = [], ids = [] }) {
+    const resolvedTableName = tableName ?? indexName;
     try {
       if (!this.lanceClient) {
         throw new Error("LanceDB client not initialized. Use LanceVectorStore.create() to create an instance");
       }
-      if (!tableName) {
-        throw new Error("tableName is required");
+      if (!resolvedTableName) {
+        throw new Error("tableName or indexName is required");
       }
       if (!vectors || !Array.isArray(vectors) || vectors.length === 0) {
         throw new Error("vectors array is required and must not be empty");
@@ -2453,18 +2461,21 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "UPSERT", "INVALID_ARGS"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.USER,
-          text: "LanceDB client not initialized. Use LanceVectorStore.create() to create an instance",
-          details: { tableName }
+          text: error$1 instanceof Error ? error$1.message : "Invalid upsert arguments",
+          details: { tableName: resolvedTableName }
         },
         error$1
       );
     }
     try {
       const tables = await this.lanceClient.tableNames();
-      if (!tables.includes(tableName)) {
-        throw new Error(`Table ${tableName} does not exist`);
+      const tableExists = tables.includes(resolvedTableName);
+      let table = null;
+      if (!tableExists) {
+        this.logger.debug(`Table ${resolvedTableName} does not exist. Creating it with the first upsert data.`);
+      } else {
+        table = await this.lanceClient.openTable(resolvedTableName);
       }
-      const table = await this.lanceClient.openTable(tableName);
       const vectorIds = ids.length === vectors.length ? ids : vectors.map((_, i) => ids[i] || crypto.randomUUID());
       const data = vectors.map((vector, i) => {
         const id = String(vectorIds[i]);
@@ -2481,7 +2492,42 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
         }
         return rowData;
       });
-      await table.add(data, { mode: "overwrite" });
+      if (table !== null) {
+        const rowCount = await table.countRows();
+        const schema = await table.schema();
+        const existingColumns = new Set(schema.fields.map((f) => f.name));
+        const dataColumns = new Set(Object.keys(data[0] || {}));
+        const extraColumns = [...dataColumns].filter((col) => !existingColumns.has(col));
+        const missingSchemaColumns = [...existingColumns].filter((col) => !dataColumns.has(col));
+        const hasSchemaMismatch = extraColumns.length > 0 || missingSchemaColumns.length > 0;
+        if (rowCount === 0 && extraColumns.length > 0) {
+          this.logger.warn(
+            `Table ${resolvedTableName} is empty and data has extra columns ${extraColumns.join(", ")}. Recreating with new schema.`
+          );
+          await this.lanceClient.dropTable(resolvedTableName);
+          await this.lanceClient.createTable(resolvedTableName, data);
+        } else if (hasSchemaMismatch) {
+          if (extraColumns.length > 0) {
+            this.logger.warn(
+              `Table ${resolvedTableName} has ${rowCount} rows. Columns ${extraColumns.join(", ")} will be dropped from upsert.`
+            );
+          }
+          const schemaFieldNames = schema.fields.map((f) => f.name);
+          const normalizedData = data.map((row) => {
+            const normalized = {};
+            for (const col of schemaFieldNames) {
+              normalized[col] = col in row ? row[col] : null;
+            }
+            return normalized;
+          });
+          await table.mergeInsert("id").whenMatchedUpdateAll().whenNotMatchedInsertAll().execute(normalizedData);
+        } else {
+          await table.mergeInsert("id").whenMatchedUpdateAll().whenNotMatchedInsertAll().execute(data);
+        }
+      } else {
+        this.logger.debug(`Creating table ${resolvedTableName} with initial data`);
+        await this.lanceClient.createTable(resolvedTableName, data);
+      }
       return vectorIds;
     } catch (error$1) {
       throw new error.MastraError(
@@ -2489,7 +2535,12 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "UPSERT", "FAILED"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.THIRD_PARTY,
-          details: { tableName, vectorCount: vectors.length, metadataCount: metadata.length, idsCount: ids.length }
+          details: {
+            tableName: resolvedTableName,
+            vectorCount: vectors.length,
+            metadataCount: metadata.length,
+            idsCount: ids.length
+          }
         },
         error$1
       );
@@ -2586,7 +2637,17 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
     }
   }
   /**
-   * indexName is actually a column name in a table in lanceDB
+   * Creates a vector index on a table.
+   *
+   * The behavior of `indexName` depends on whether `tableName` is provided:
+   * - With `tableName`: `indexName` is the column to index (advanced use case)
+   * - Without `tableName`: `indexName` becomes the table name, and 'vector' is used as the column (Memory compatibility)
+   *
+   * @param tableName - Optional table name. If not provided, defaults to indexName.
+   * @param indexName - The index/column name, or table name if tableName is not provided.
+   * @param dimension - Vector dimension size.
+   * @param metric - Distance metric: 'cosine', 'euclidean', or 'dotproduct'.
+   * @param indexConfig - Optional index configuration.
    */
   async createIndex({
     tableName,
@@ -2595,13 +2656,12 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
     metric = "cosine",
     indexConfig = {}
   }) {
+    const resolvedTableName = tableName ?? indexName;
+    const columnToIndex = tableName ? indexName : "vector";
     try {
       if (!this.lanceClient) {
         throw new Error("LanceDB client not initialized. Use LanceVectorStore.create() to create an instance");
       }
-      if (!tableName) {
-        throw new Error("tableName is required");
-      }
       if (!indexName) {
         throw new Error("indexName is required");
       }
@@ -2614,19 +2674,33 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "CREATE_INDEX", "INVALID_ARGS"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.USER,
-          details: { tableName: tableName || "", indexName, dimension, metric }
+          details: { tableName: resolvedTableName, indexName, dimension, metric }
         },
         err
       );
     }
     try {
       const tables = await this.lanceClient.tableNames();
-      if (!tables.includes(tableName)) {
-        throw new Error(
-          `Table ${tableName} does not exist. Please create the table first by calling createTable() method.`
+      let table;
+      if (!tables.includes(resolvedTableName)) {
+        this.logger.debug(
+          `Table ${resolvedTableName} does not exist. Creating empty table with dimension ${dimension}.`
         );
+        const initVector = new Array(dimension).fill(0);
+        table = await this.lanceClient.createTable(resolvedTableName, [{ id: "__init__", vector: initVector }]);
+        try {
+          await table.delete("id = '__init__'");
+        } catch (deleteError) {
+          this.logger.warn(
+            `Failed to delete initialization row from ${resolvedTableName}. Subsequent queries may include '__init__' row.`,
+            deleteError
+          );
+        }
+        this.logger.debug(`Table ${resolvedTableName} created. Index creation deferred until data is available.`);
+        return;
+      } else {
+        table = await this.lanceClient.openTable(resolvedTableName);
       }
-      const table = await this.lanceClient.openTable(tableName);
       let metricType;
       if (metric === "euclidean") {
         metricType = "l2";
@@ -2635,8 +2709,15 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
       } else if (metric === "cosine") {
         metricType = "cosine";
       }
+      const rowCount = await table.countRows();
+      if (rowCount < 256) {
+        this.logger.warn(
+          `Table ${resolvedTableName} has ${rowCount} rows, which is below the 256 row minimum for index creation. Skipping index creation.`
+        );
+        return;
+      }
       if (indexConfig.type === "ivfflat") {
-        await table.createIndex(indexName, {
+        await table.createIndex(columnToIndex, {
           config: lancedb.Index.ivfPq({
             numPartitions: indexConfig.numPartitions || 128,
             numSubVectors: indexConfig.numSubVectors || 16,
@@ -2645,7 +2726,7 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
         });
       } else {
         this.logger.debug("Creating HNSW PQ index with config:", indexConfig);
-        await table.createIndex(indexName, {
+        await table.createIndex(columnToIndex, {
           config: lancedb.Index.hnswPq({
             m: indexConfig?.hnsw?.m || 16,
             efConstruction: indexConfig?.hnsw?.efConstruction || 100,
@@ -2659,7 +2740,7 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
           id: storage.createVectorErrorId("LANCE", "CREATE_INDEX", "FAILED"),
           domain: error.ErrorDomain.STORAGE,
           category: error.ErrorCategory.THIRD_PARTY,
-          details: { tableName: tableName || "", indexName, dimension }
+          details: { tableName: resolvedTableName, indexName, dimension }
         },
         error$1
       );
@@ -2957,7 +3038,7 @@ var LanceVectorStore = class _LanceVectorStore extends vector.MastraVector {
               }
               return rowData;
             });
-            await table.add(updatedRecords, { mode: "overwrite" });
+            await table.mergeInsert("id").whenMatchedUpdateAll().whenNotMatchedInsertAll().execute(updatedRecords);
             return;
           }
         } catch (err) {