@mastra/libsql 1.10.1-alpha.2 → 1.10.1-alpha.3

package/CHANGELOG.md

@@ -1,5 +1,16 @@
 # @mastra/libsql
 
+## 1.10.1-alpha.3
+
+### Patch Changes
+
+- Improved local LibSQL startup performance by applying conservative local SQLite performance settings before initialization, exposing local PRAGMA overrides, and reducing schema initialization contention. ([#16513](https://github.com/mastra-ai/mastra/pull/16513))
+
+- Added LibSQL indexes for thread message history queries to speed up recent-message and observational-memory loading. ([#16513](https://github.com/mastra-ai/mastra/pull/16513))
+
+- Updated dependencies [[`4999667`](https://github.com/mastra-ai/mastra/commit/49996678b68356cad7f088430009690406c50fbd)]:
+  - @mastra/core@1.33.0-alpha.17
+
 ## 1.10.1-alpha.2
 
 ### Patch Changes

package/dist/docs/SKILL.md

@@ -3,7 +3,7 @@ name: mastra-libsql
 description: Documentation for @mastra/libsql. Use when working with @mastra/libsql APIs, configuration, or implementation.
 metadata:
   package: "@mastra/libsql"
-  version: "1.10.1-alpha.2"
+  version: "1.10.1-alpha.3"
 ---
 
 ## When to use

package/dist/docs/assets/SOURCE_MAP.json

@@ -1,5 +1,5 @@
 {
-  "version": "1.10.1-alpha.2",
+  "version": "1.10.1-alpha.3",
   "package": "@mastra/libsql",
   "exports": {},
   "modules": {}

package/dist/docs/references/reference-storage-composite.md

@@ -242,4 +242,4 @@ const storage = new MastraCompositeStore({
 
 > **Note:** `ObservabilityStorageClickhouseVNext` is the current observability domain implementation. The legacy `ObservabilityStorageClickhouse` class is also exported and remains supported for projects that have not migrated. See the [ClickHouse storage reference](https://mastra.ai/reference/storage/clickhouse) for details.
 
-> **Info:** This approach is also required when using storage providers that don't support observability (like Convex, DynamoDB, or Cloudflare). See the [DefaultExporter documentation](https://mastra.ai/docs/observability/tracing/exporters/default) for the full list of supported providers.
+> **Info:** This approach is also required when using storage providers that don't support observability (like Convex, DynamoDB, or Cloudflare). See the [MastraStorageExporter documentation](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) for the full list of supported providers.

package/dist/docs/references/reference-storage-dynamodb.md

@@ -2,7 +2,7 @@
 
 The DynamoDB storage implementation provides a scalable and performant NoSQL database solution for Mastra, leveraging a single-table design pattern with [ElectroDB](https://electrodb.dev/).
 
-> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `DefaultExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse or PostgreSQL.
+> **Observability Not Supported:** DynamoDB storage **doesn't support the observability domain**. Traces from the `MastraStorageExporter` can't be persisted to DynamoDB, and [Studio's](https://mastra.ai/docs/studio/overview) observability features won't work with DynamoDB as your only storage provider. To enable observability, use [composite storage](https://mastra.ai/reference/storage/composite) to route observability data to a supported provider like ClickHouse.
 
 > **Item Size Limit:** DynamoDB enforces a **400 KB maximum item size**. This limit can be exceeded when storing messages with base64-encoded attachments such as images. See [Handling large attachments](https://mastra.ai/docs/memory/storage) for workarounds including uploading attachments to external storage.
 

package/dist/docs/references/reference-storage-libsql.md

@@ -130,6 +130,6 @@ const thread = await memoryStore?.getThreadById({ threadId: '...' })
 
 ## Observability
 
-libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/default) for immediate visibility while debugging.
+libSQL supports observability and is ideal for local development. Use the `realtime` [tracing strategy](https://mastra.ai/docs/observability/tracing/exporters/mastra-storage) for immediate visibility while debugging.
 
 For production environments with higher trace volumes, consider using [PostgreSQL](https://mastra.ai/reference/storage/postgresql) or [ClickHouse via composite storage](https://mastra.ai/reference/storage/composite).

package/dist/index.cjs

@@ -1934,15 +1934,21 @@ var LibSQLDB = class extends base.MastraBase {
   async migrateSpansTable() {
     const schema = storage.TABLE_SCHEMAS[storage.TABLE_SPANS];
     try {
+      const existingColumnsRaw = await this.getTableColumns(storage.TABLE_SPANS);
+      const existingColumns = new Set([...existingColumnsRaw].map((column) => column.toLowerCase()));
+      let addedColumns = false;
       for (const [columnName, columnDef] of Object.entries(schema)) {
-        const columnExists = await this.hasColumn(storage.TABLE_SPANS, columnName);
-        if (!columnExists) {
+        if (!existingColumns.has(columnName.toLowerCase())) {
           const sqlType = this.getSqlType(columnDef.type);
           const alterSql = `ALTER TABLE "${storage.TABLE_SPANS}" ADD COLUMN "${columnName}" ${sqlType}`;
           await this.client.execute(alterSql);
+          addedColumns = true;
           this.logger.debug(`LibSQLDB: Added column '${columnName}' to ${storage.TABLE_SPANS}`);
         }
       }
+      if (addedColumns) {
+        this.tableColumnsCache.delete(storage.TABLE_SPANS);
+      }
       const indexExists = await this.spansUniqueIndexExists();
       if (!indexExists) {
         const duplicateInfo = await this.checkForDuplicateSpans();
@@ -3351,11 +3357,18 @@ var ChannelsLibSQL = class extends storage.ChannelsStorage {
       tableName: storage.TABLE_CHANNEL_CONFIG,
       schema: storage.TABLE_SCHEMAS[storage.TABLE_CHANNEL_CONFIG]
     });
-    await this.#client.execute(
-      `CREATE UNIQUE INDEX IF NOT EXISTS idx_channel_installations_webhook ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("webhookId")`
-    );
-    await this.#client.execute(
-      `CREATE INDEX IF NOT EXISTS idx_channel_installations_platform_agent ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("platform", "agentId")`
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_channel_installations_webhook ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("webhookId")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_channel_installations_platform_agent ON "${storage.TABLE_CHANNEL_INSTALLATIONS}" ("platform", "agentId")`,
+          args: []
+        }
+      ],
+      "write"
     );
   }
   async dangerouslyClearAll() {
@@ -3499,26 +3512,31 @@ var DatasetsLibSQL = class extends storage.DatasetsStorage {
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "requestContext", "TEXT");
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "source", "TEXT");
     await this.#addColumnIfNotExists(storage.TABLE_DATASET_ITEMS, "expectedTrajectory", "TEXT");
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_version ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "datasetVersion")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto_deleted ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo", "isDeleted")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version_unique ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
-      args: []
-    });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_version ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "datasetVersion")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_items_dataset_validto_deleted ON "${storage.TABLE_DATASET_ITEMS}" ("datasetId", "validTo", "isDeleted")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
+          args: []
+        },
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_dataset_versions_dataset_version_unique ON "${storage.TABLE_DATASET_VERSIONS}" ("datasetId", "version")`,
+          args: []
+        }
+      ],
+      "write"
+    );
   }
   async #addColumnIfNotExists(table, column, sqlType) {
     const exists = await this.#db.hasColumn(table, column);
@@ -4419,18 +4437,23 @@ var ExperimentsLibSQL = class extends storage.ExperimentsStorage {
       schema: storage.EXPERIMENT_RESULTS_SCHEMA,
       ifNotExists: ["status", "tags"]
     });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_experiments_datasetid ON "${storage.TABLE_EXPERIMENTS}" ("datasetId")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE INDEX IF NOT EXISTS idx_experiment_results_experimentid ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId")`,
-      args: []
-    });
-    await this.#client.execute({
-      sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_experiment_results_exp_item ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId", "itemId")`,
-      args: []
-    });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_experiments_datasetid ON "${storage.TABLE_EXPERIMENTS}" ("datasetId")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_experiment_results_experimentid ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId")`,
+          args: []
+        },
+        {
+          sql: `CREATE UNIQUE INDEX IF NOT EXISTS idx_experiment_results_exp_item ON "${storage.TABLE_EXPERIMENT_RESULTS}" ("experimentId", "itemId")`,
+          args: []
+        }
+      ],
+      "write"
+    );
   }
   async dangerouslyClearAll() {
     await this.#db.deleteData({ tableName: storage.TABLE_EXPERIMENT_RESULTS });
@@ -5970,6 +5993,19 @@ var MemoryLibSQL = class extends storage.MemoryStorage {
       schema: storage.TABLE_SCHEMAS[storage.TABLE_MESSAGES],
       ifNotExists: ["resourceId"]
     });
+    await this.#client.batch(
+      [
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_messages_thread_created_at ON ${storage.TABLE_MESSAGES} (thread_id, "createdAt")`,
+          args: []
+        },
+        {
+          sql: `CREATE INDEX IF NOT EXISTS idx_messages_thread_resource_created_at ON ${storage.TABLE_MESSAGES} (thread_id, "resourceId", "createdAt")`,
+          args: []
+        }
+      ],
+      "write"
+    );
     if (omSchema) {
       await this.#client.execute({
         sql: `CREATE INDEX IF NOT EXISTS idx_om_lookup_key ON "${OM_TABLE}" ("lookupKey")`,
@@ -11403,10 +11439,15 @@ var WorkspacesLibSQL = class extends storage.WorkspacesStorage {
 };
 
 // src/storage/index.ts
+var DEFAULT_LOCAL_CACHE_SIZE = -16e3;
+var DEFAULT_LOCAL_MMAP_SIZE = 134217728;
 var LibSQLStore = class extends storage.MastraCompositeStore {
   client;
   maxRetries;
   initialBackoffMs;
+  pragmasReady;
+  isLocalDb;
+  localPragmas;
   stores;
   constructor(config) {
     if (!config.id || typeof config.id !== "string" || config.id.trim() === "") {
@@ -11415,20 +11456,24 @@ var LibSQLStore = class extends storage.MastraCompositeStore {
     super({ id: config.id, name: `LibSQLStore`, disableInit: config.disableInit });
     this.maxRetries = config.maxRetries ?? 5;
     this.initialBackoffMs = config.initialBackoffMs ?? 100;
+    this.localPragmas = {
+      cacheSize: config.localPragmas?.cacheSize ?? DEFAULT_LOCAL_CACHE_SIZE,
+      mmapSize: config.localPragmas?.mmapSize ?? DEFAULT_LOCAL_MMAP_SIZE
+    };
     if ("url" in config) {
-      if (config.url.endsWith(":memory:")) {
+      if (config.url.includes(":memory:")) {
         this.shouldCacheInit = false;
       }
       this.client = client.createClient({
         url: config.url,
         ...config.authToken ? { authToken: config.authToken } : {}
       });
-      if (config.url.startsWith("file:") || config.url.includes(":memory:")) {
-        this.client.execute("PRAGMA journal_mode=WAL;").then(() => this.logger.debug("LibSQLStore: PRAGMA journal_mode=WAL set.")).catch((err) => this.logger.warn("LibSQLStore: Failed to set PRAGMA journal_mode=WAL.", err));
-        this.client.execute("PRAGMA busy_timeout = 5000;").then(() => this.logger.debug("LibSQLStore: PRAGMA busy_timeout=5000 set.")).catch((err) => this.logger.warn("LibSQLStore: Failed to set PRAGMA busy_timeout.", err));
-      }
+      this.isLocalDb = config.url.startsWith("file:") || config.url.includes(":memory:");
+      this.pragmasReady = this.isLocalDb ? this.applyLocalPragmas() : Promise.resolve();
     } else {
       this.client = config.client;
+      this.isLocalDb = false;
+      this.pragmasReady = Promise.resolve();
     }
     const domainConfig = {
       client: this.client,
@@ -11472,6 +11517,63 @@ var LibSQLStore = class extends storage.MastraCompositeStore {
       schedules
     };
   }
+  async applyLocalPragmas() {
+    const pragmas = [
+      ["journal_mode=WAL", "PRAGMA journal_mode=WAL;"],
+      ["busy_timeout=5000", "PRAGMA busy_timeout=5000;"],
+      ["synchronous=NORMAL", "PRAGMA synchronous=NORMAL;"],
+      ["temp_store=MEMORY", "PRAGMA temp_store=MEMORY;"],
+      [`cache_size=${this.localPragmas.cacheSize}`, `PRAGMA cache_size=${this.localPragmas.cacheSize};`],
+      [`mmap_size=${this.localPragmas.mmapSize}`, `PRAGMA mmap_size=${this.localPragmas.mmapSize};`]
+    ];
+    for (const [label, sql] of pragmas) {
+      try {
+        await this.client.execute(sql);
+        this.logger.debug(`LibSQLStore: PRAGMA ${label} set.`);
+      } catch (err) {
+        this.logger.warn(`LibSQLStore: Failed to set PRAGMA ${label}.`, err);
+      }
+    }
+  }
+  getStoresToInit() {
+    return Object.values(this.stores).filter(Boolean);
+  }
+  async initDomainsSequentially() {
+    for (const store of this.getStoresToInit()) {
+      await store.init();
+    }
+    return true;
+  }
+  async initDomainsInParallel() {
+    await Promise.all(this.getStoresToInit().map((store) => store.init()));
+    return true;
+  }
+  async init() {
+    await this.pragmasReady;
+    if (!this.isLocalDb) {
+      if (this.shouldCacheInit) {
+        if (this.hasInitialized) {
+          await this.hasInitialized;
+          return;
+        }
+        this.hasInitialized = this.initDomainsInParallel();
+        await this.hasInitialized;
+        return;
+      }
+      await this.initDomainsInParallel();
+      return;
+    }
+    if (this.shouldCacheInit) {
+      if (this.hasInitialized) {
+        await this.hasInitialized;
+        return;
+      }
+      this.hasInitialized = this.initDomainsSequentially();
+      await this.hasInitialized;
+      return;
+    }
+    await this.initDomainsSequentially();
+  }
 };
 
 // src/vector/prompt.ts