@mastra/libsql 1.10.1-alpha.1 → 1.10.1-alpha.3

package/CHANGELOG.md

@@ -1,5 +1,37 @@
 # @mastra/libsql
 
+## 1.10.1-alpha.3
+
+### Patch Changes
+
+- Improved local LibSQL startup performance by applying conservative local SQLite performance settings before initialization, exposing local PRAGMA overrides, and reducing schema initialization contention. ([#16513](https://github.com/mastra-ai/mastra/pull/16513))
+
+- Added LibSQL indexes for thread message history queries to speed up recent-message and observational-memory loading. ([#16513](https://github.com/mastra-ai/mastra/pull/16513))
+
+- Updated dependencies [[`4999667`](https://github.com/mastra-ai/mastra/commit/49996678b68356cad7f088430009690406c50fbd)]:
+  - @mastra/core@1.33.0-alpha.17
+
+## 1.10.1-alpha.2
+
+### Patch Changes
+
+- **Fixed** Workflow run snapshots no longer lose fields when serialized for storage. The libsql `safeStringify` cycle-detection treated any object that appeared more than once in a snapshot as a circular reference and dropped it. Because `snapshot.result` and the final step's `context[step].output` share the same reference on success, `snapshot.result` was being silently stripped on every persist. This caused `listWorkflowRuns` to return runs with `snapshot.result === undefined` and broke workflow resume when suspended-state fields were shared elsewhere in the snapshot. ([#16368](https://github.com/mastra-ai/mastra/pull/16368))
+
+- Respect optional `resourceId` in `getThreadById` so scoped thread lookups return `null` when the thread belongs to a different resource. ([#14237](https://github.com/mastra-ai/mastra/pull/14237))
+
+  Example:
+
+  ```typescript
+  const thread = await memory.getThreadById({
+    threadId: 'my-thread-id',
+    resourceId: 'my-user-id',
+  });
+  // Returns null if the thread does not belong to 'my-user-id'.
+  ```
+
+- Updated dependencies [[`7c275a8`](https://github.com/mastra-ai/mastra/commit/7c275a810595e1a6c41ccc39720531ab65734700), [`890b24c`](https://github.com/mastra-ai/mastra/commit/890b24cc7d32ed6aa4dfe253e54dc6bf4099f690), [`0f48ebf`](https://github.com/mastra-ai/mastra/commit/0f48ebfc7ac7897b2092a189f45751924cf56d1c), [`f180e49`](https://github.com/mastra-ai/mastra/commit/f180e4990e71b04c9a475b523584071712f0048f), [`9260e01`](https://github.com/mastra-ai/mastra/commit/9260e015276fb1b500f7878ee452b47476bf1583), [`2f6c54e`](https://github.com/mastra-ai/mastra/commit/2f6c54e17c041cac1def54baaa6b771647836414), [`e06a159`](https://github.com/mastra-ai/mastra/commit/e06a1598ca07a6c3778aefc2a2d288363c6294ff), [`db34bc6`](https://github.com/mastra-ai/mastra/commit/db34bc6fb36cf125bda0c46be4d3fdc774b70cc4)]:
+  - @mastra/core@1.33.0-alpha.8
+
 ## 1.10.1-alpha.1
 
 ### Patch Changes

package/dist/docs/SKILL.md

@@ -3,7 +3,7 @@ name: mastra-libsql
 description: Documentation for @mastra/libsql. Use when working with @mastra/libsql APIs, configuration, or implementation.
 metadata:
   package: "@mastra/libsql"
-  version: "1.10.1-alpha.1"
+  version: "1.10.1-alpha.3"
 ---
 
 ## When to use

package/dist/docs/assets/SOURCE_MAP.json

@@ -1,5 +1,5 @@
 {
-  "version": "1.10.1-alpha.1",
+  "version": "1.10.1-alpha.3",
   "package": "@mastra/libsql",
   "exports": {},
   "modules": {}

package/dist/docs/references/reference-storage-composite.md

@@ -242,4 +242,4 @@ const storage = new MastraCompositeStore({
 
 > **Note:** `ObservabilityStorageClickhouseVNext` is the current observability domain implementation. The legacy `ObservabilityStorageClickhouse` class is also exported and remains supported for projects that have not migrated. See the [ClickHouse storage reference](https://mastra.ai/reference/storage/clickhouse) for details.
 
-> **Info:** This approach is also required when using storage providers that don't support observability (like Convex, DynamoDB, or Cloudflare). See the [DefaultExporter documentation](https://mastra.ai/docs/observability/tracing/exporters/default) for the full list of supported providers.
+> **Info:** This approach is also required when using storage providers that don't support observability (like Convex, DynamoDB, or Cloudflare). See the [MastraStorageExporter documentation](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) for the full list of supported providers.

package/dist/docs/references/reference-storage-dynamodb.md

@@ -2,7 +2,7 @@
 
 The DynamoDB storage implementation provides a scalable and performant NoSQL database solution for Mastra, leveraging a single-table design pattern with [ElectroDB](https://electrodb.dev/).
 
-> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `MastraStorageExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse.
 
 > **Item Size Limit:** DynamoDB enforces a **400 KB maximum item size**. This limit can be exceeded when storing messages with base64-encoded attachments such as images. See [Handling large attachments](https://mastra.ai/docs/memory/storage) for workarounds including uploading attachments to external storage.
 

package/dist/docs/references/reference-storage-libsql.md

@@ -130,6 +130,6 @@ const thread = await memoryStore?.getThreadById({ threadId: '...' })
 
 ## Observability
 
-libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/default) for immediate visibility while debugging.
+libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) for immediate visibility while debugging.
 
 For production environments with higher trace volumes, consider using [PostgreSQL](https://mastra.ai/reference/storage/postgresql) or [ClickHouse via composite storage](https://mastra.ai/reference/storage/composite).

package/dist/index.cjs

@@ -1173,29 +1173,33 @@ var LibSQLVector = class extends vector.MastraVector {
   }
 };
 var safeStringify = (value) => {
-  const seen = /* @__PURE__ */ new WeakSet();
+  const ancestors = /* @__PURE__ */ new Set();
   const sanitize = (val) => {
     if (val === null || val === void 0) return val;
     if (typeof val === "function") return void 0;
     if (typeof val === "symbol") return void 0;
     if (typeof val === "bigint") return val.toString();
     if (typeof val !== "object") return val;
-    if (seen.has(val)) return void 0;
-    seen.add(val);
+    if (ancestors.has(val)) return void 0;
     if (typeof val.toJSON === "function") {
       return sanitize(val.toJSON());
     }
-    if (Array.isArray(val)) {
-      return val.map((item) => sanitize(item));
-    }
-    const result = {};
-    for (const key of Object.keys(val)) {
-      const sanitized = sanitize(val[key]);
-      if (sanitized !== void 0) {
-        result[key] = sanitized;
+    ancestors.add(val);
+    try {
+      if (Array.isArray(val)) {
+        return val.map((item) => sanitize(item));
       }
+      const result = {};
+      for (const key of Object.keys(val)) {
+        const sanitized = sanitize(val[key]);
+        if (sanitized !== void 0) {
+          result[key] = sanitized;
+        }
+      }
+      return result;
+    } finally {
+      ancestors.delete(val);
     }
-    return result;
   };
   return JSON.stringify(sanitize(value)) ?? "null";
 };
@@ -1930,15 +1934,21 @@ var LibSQLDB = class extends base.MastraBase {
   async migrateSpansTable() {
     const schema = storage.TABLE_SCHEMAS[storage.TABLE_SPANS];
     try {
+      const existingColumnsRaw = await this.getTableColumns(storage.TABLE_SPANS);
+      const existingColumns = new Set([...existingColumnsRaw].map((column) => column.toLowerCase()));
+      let addedColumns = false;
       for (const [columnName, columnDef] of Object.entries(schema)) {
-        const columnExists = await this.hasColumn(storage.TABLE_SPANS, columnName);
-        if (!columnExists) {
+        if (!existingColumns.has(columnName.toLowerCase())) {
           const sqlType = this.getSqlType(columnDef.type);
           const alterSql = `ALTER TABLE "${storage.TABLE_SPANS}" ADD COLUMN "${columnName}" ${sqlType}`;
           await this.client.execute(alterSql);
+          addedColumns = true;
           this.logger.debug(`LibSQLDB: Added column '${columnName}' to ${storage.TABLE_SPANS}`);
         }
       }
+      if (addedColumns) {
+        this.tableColumnsCache.delete(storage.TABLE_SPANS);
+      }
       const indexExists = await this.spansUniqueIndexExists();
       if (!indexExists) {
         const duplicateInfo = await this.checkForDuplicateSpans();
@@ -3347,11 +3357,18 @@ var ChannelsLibSQL = class extends storage.ChannelsStorage {
       tableName: storage.TABLE_CHANNEL_CONFIG,
       schema: storage.TABLE_SCHEMAS[storage.TABLE_CHANNEL_CONFIG]
     });
-    await this.#client.execute(
-      `CREATE UNIQUE INDEX IF NOT EXISTS idx_channel_installations_webhook ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("webhookId")`
-    );
-    await this.#client.execute(
-      `CREATE INDEX IF NOT EXISTS idx_channel_installations_platform_agent ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("platform", "agentId")`
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_channel_installations_webhook ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("webhookId")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_channel_installations_platform_agent ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("platform", "agentId")`,
+          args: []
+        }
+      ],
+      "write"
     );
   }
   async dangerouslyClearAll() {
@@ -3495,26 +3512,31 @@ var DatasetsLibSQL = class extends storage.DatasetsStorage {
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "requestContext", "TEXT");
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "source", "TEXT");
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "expectedTrajectory", "TEXT");
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_version ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "datasetVersion")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto_deleted ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo", "isDeleted")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version_unique ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
-      args: []
-    });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_version ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "datasetVersion")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto_deleted ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo", "isDeleted")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
+          args: []
+        },
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version_unique ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
+          args: []
+        }
+      ],
+      "write"
+    );
   }
   async #addColumnIfNotExists(table, column, sqlType) {
     const exists = await this.#db.hasColumn(table, column);
@@ -4415,18 +4437,23 @@ var ExperimentsLibSQL = class extends storage.ExperimentsStorage {
       schema: storage.EXPERIMENT_RESULTS_SCHEMA,
       ifNotExists: ["status", "tags"]
     });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_experiments_datasetid ON "${storage.TABLE_EXPERIMENTS}" ("datasetId")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_experiment_results_experimentid ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_experiment_results_exp_item ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId", "itemId")`,
-      args: []
-    });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_experiments_datasetid ON "${storage.TABLE_EXPERIMENTS}" ("datasetId")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_experiment_results_experimentid ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId")`,
+          args: []
+        },
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_experiment_results_exp_item ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId", "itemId")`,
+          args: []
+        }
+      ],
+      "write"
+    );
   }
   async dangerouslyClearAll() {
     await this.#db.deleteData({ tableName: storage.TABLE_EXPERIMENT_RESULTS });
@@ -5966,6 +5993,19 @@ var MemoryLibSQL = class extends storage.MemoryStorage {
       schema: storage.TABLE_SCHEMAS[storage.TABLE_MESSAGES],
       ifNotExists: ["resourceId"]
     });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_messages_thread_created_at ON ${storage.TABLE_MESSAGES} (thread_id, "createdAt")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_messages_thread_resource_created_at ON ${storage.TABLE_MESSAGES} (thread_id, "resourceId", "createdAt")`,
+          args: []
+        }
+      ],
+      "write"
+    );
     if (omSchema) {
       await this.#client.execute({
         sql: `CREATE INDEX IF NOT EXISTS idx_om_lookup_key ON "${OM_TABLE}" ("lookupKey")`,
@@ -6636,11 +6676,18 @@ var MemoryLibSQL = class extends storage.MemoryStorage {
     });
     return updatedResource;
   }
-  async getThreadById({ threadId }) {
+  async getThreadById({
+    threadId,
+    resourceId
+  }) {
     try {
+      const keys = { id: threadId };
+      if (resourceId !== void 0) {
+        keys.resourceId = resourceId;
+      }
       const result = await this.#db.select({
         tableName: storage.TABLE_THREADS,
-        keys: { id: threadId }
+        keys
       });
       if (!result) {
         return null;
@@ -11392,10 +11439,15 @@ var WorkspacesLibSQL = class extends storage.WorkspacesStorage {
 };
 
 // src/storage/index.ts
+var DEFAULT_LOCAL_CACHE_SIZE = -16e3;
+var DEFAULT_LOCAL_MMAP_SIZE = 134217728;
 var LibSQLStore = class extends storage.MastraCompositeStore {
   client;
   maxRetries;
   initialBackoffMs;
+  pragmasReady;
+  isLocalDb;
+  localPragmas;
   stores;
   constructor(config) {
     if (!config.id || typeof config.id !== "string" || config.id.trim() === "") {
@@ -11404,20 +11456,24 @@ var LibSQLStore = class extends storage.MastraCompositeStore {
     super({ id: config.id, name: `LibSQLStore`, disableInit: config.disableInit });
     this.maxRetries = config.maxRetries ?? 5;
     this.initialBackoffMs = config.initialBackoffMs ?? 100;
+    this.localPragmas = {
+      cacheSize: config.localPragmas?.cacheSize ?? DEFAULT_LOCAL_CACHE_SIZE,
+      mmapSize: config.localPragmas?.mmapSize ?? DEFAULT_LOCAL_MMAP_SIZE
+    };
     if ("url" in config) {
-      if (config.url.endsWith(":memory:")) {
+      if (config.url.includes(":memory:")) {
         this.shouldCacheInit = false;
       }
       this.client = client.createClient({
         url: config.url,
         ...config.authToken ? { authToken: config.authToken } : {}
       });
-      if (config.url.startsWith("file:") || config.url.includes(":memory:")) {
-        this.client.execute("PRAGMA journal_mode=WAL;").then(() => this.logger.debug("LibSQLStore: PRAGMA journal_mode=WAL set.")).catch((err) => this.logger.warn("LibSQLStore: Failed to set PRAGMA journal_mode=WAL.", err));
-        this.client.execute("PRAGMA busy_timeout = 5000;").then(() => this.logger.debug("LibSQLStore: PRAGMA busy_timeout=5000 set.")).catch((err) => this.logger.warn("LibSQLStore: Failed to set PRAGMA busy_timeout.", err));
-      }
+      this.isLocalDb = config.url.startsWith("file:") || config.url.includes(":memory:");
+      this.pragmasReady = this.isLocalDb ? this.applyLocalPragmas() : Promise.resolve();
     } else {
       this.client = config.client;
+      this.isLocalDb = false;
+      this.pragmasReady = Promise.resolve();
     }
     const domainConfig = {
       client: this.client,
@@ -11461,6 +11517,63 @@ var LibSQLStore = class extends storage.MastraCompositeStore {
       schedules
     };
   }
+  async applyLocalPragmas() {
+    const pragmas = [
+      ["journal_mode=WAL", "PRAGMA journal_mode=WAL;"],
+      ["busy_timeout=5000", "PRAGMA busy_timeout=5000;"],
+      ["synchronous=NORMAL", "PRAGMA synchronous=NORMAL;"],
+      ["temp_store=MEMORY", "PRAGMA temp_store=MEMORY;"],
+      [`cache_size=${this.localPragmas.cacheSize}`, `PRAGMA cache_size=${this.localPragmas.cacheSize};`],
+      [`mmap_size=${this.localPragmas.mmapSize}`, `PRAGMA mmap_size=${this.localPragmas.mmapSize};`]
+    ];
+    for (const [label, sql] of pragmas) {
+      try {
+        await this.client.execute(sql);
+        this.logger.debug(`LibSQLStore: PRAGMA ${label} set.`);
+      } catch (err) {
+        this.logger.warn(`LibSQLStore: Failed to set PRAGMA ${label}.`, err);
+      }
+    }
+  }
+  getStoresToInit() {
+    return Object.values(this.stores).filter(Boolean);
+  }
+  async initDomainsSequentially() {
+    for (const store of this.getStoresToInit()) {
+      await store.init();
+    }
+    return true;
+  }
+  async initDomainsInParallel() {
+    await Promise.all(this.getStoresToInit().map((store) => store.init()));
+    return true;
+  }
+  async init() {
+    await this.pragmasReady;
+    if (!this.isLocalDb) {
+      if (this.shouldCacheInit) {
+        if (this.hasInitialized) {
+          await this.hasInitialized;
+          return;
+        }
+        this.hasInitialized = this.initDomainsInParallel();
+        await this.hasInitialized;
+        return;
+      }
+      await this.initDomainsInParallel();
+      return;
+    }
+    if (this.shouldCacheInit) {
+      if (this.hasInitialized) {
+        await this.hasInitialized;
+        return;
+      }
+      this.hasInitialized = this.initDomainsSequentially();
+      await this.hasInitialized;
+      return;
+    }
+    await this.initDomainsSequentially();
+  }
 };
 
 // src/vector/prompt.ts