@mastra/spanner 1.8.0 → 1.8.1

package/dist/docs/SKILL.md

@@ -3,7 +3,7 @@ name: mastra-spanner
 description: Documentation for @mastra/spanner. Use when working with @mastra/spanner APIs, configuration, or implementation.
 metadata:
   package: "@mastra/spanner"
-  version: "1.8.0"
+  version: "1.8.1"
 ---
 
 ## When to use

package/dist/docs/assets/SOURCE_MAP.json

@@ -1,5 +1,5 @@
 {
-  "version": "1.8.0",
+  "version": "1.8.1",
   "package": "@mastra/spanner",
   "exports": {},
   "modules": {}

package/dist/docs/references/reference-storage-retention.md

@@ -15,7 +15,7 @@ Storage adapters use the shared core retention contract for `prune()`, or a data
 | Adapter              | Mechanism               | Retention support                                                                                                                                                                      |
 | -------------------- | ----------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
 | libSQL               | `prune()`               | All supported growth domains                                                                                                                                                           |
-| PostgreSQL           | `prune()`               | All supported growth domains. V-next observability drops expired partitions or chunks                                                                                                  |
+| PostgreSQL           | `prune()`               | All supported growth domains. vNext observability drops expired partitions or chunks                                                                                                   |
 | MongoDB              | `prune()` or native TTL | All supported growth domains. Native TTL indexes are also available                                                                                                                    |
 | DuckDB               | `prune()`               | Observability spans, metrics, logs, scores, and feedback                                                                                                                               |
 | MySQL                | `prune()`               | Observability spans                                                                                                                                                                    |
@@ -102,10 +102,10 @@ Each domain specifies its age-prunable tables and the timestamp column that anch
 | `memory`          | `resources`        | `createdAt`      | Resource age                                                     |
 | `threadState`     | `threadState`      | `updatedAt`      | Inactivity: state for still-active threads survives              |
 | `observability`   | `spans`            | `startedAt`      | Span age                                                         |
-| `observability`   | `metrics`          | `timestamp`      | Metric event age (v-next only)                                   |
-| `observability`   | `logs`             | `timestamp`      | Log event age (v-next only)                                      |
-| `observability`   | `scores`           | `timestamp`      | Score event age (v-next only)                                    |
-| `observability`   | `feedback`         | `timestamp`      | Feedback event age (v-next only)                                 |
+| `observability`   | `metrics`          | `timestamp`      | Metric event age (vNext only)                                    |
+| `observability`   | `logs`             | `timestamp`      | Log event age (vNext only)                                       |
+| `observability`   | `scores`           | `timestamp`      | Score event age (vNext only)                                     |
+| `observability`   | `feedback`         | `timestamp`      | Feedback event age (vNext only)                                  |
 | `scores`          | `scorers`          | `createdAt`      | Score record age                                                 |
 | `workflows`       | `workflowSnapshot` | `updatedAt`      | Inactivity, suspended or long-running workflows survive          |
 | `backgroundTasks` | `backgroundTasks`  | `completedAt`    | Time since completion, in-flight tasks (`NULL`) are never pruned |
@@ -122,7 +122,7 @@ Each domain specifies its age-prunable tables and the timestamp column that anch
 > - On PostgreSQL, timestamp anchors use the timezone-aware mirror columns (for example `createdAtZ`, `completedAtZ`).
 > - DuckDB observability stores append-only events for all five signals. Its `spans` policy uses the event `timestamp` column rather than `startedAt`.
 > - LibSQL and PostgreSQL support all domains above except `harness`, which PostgreSQL doesn't implement. MongoDB supports all except `threadState` and `harness`. DuckDB, MySQL, Microsoft SQL Server, Oracle Database, Amazon Aurora DSQL, and Google Cloud Spanner currently support retention only in their `observability` domains, with the signal coverage shown in the support matrix.
-> - The v-next PostgreSQL observability domain stores signal events in day-partitioned tables (`spans`, `metrics`, `logs`, `scores`, `feedback`). For it, `prune()` drops whole day partitions (or TimescaleDB chunks) that are entirely older than the cutoff instead of deleting rows: effective level of detail is one day, and a partition is only dropped once its entire day is past `maxAge`. `PruneResult.deleted` reports the number of rows in the dropped partitions.
+> - The vNext PostgreSQL observability domain stores signal events in day-partitioned tables (`spans`, `metrics`, `logs`, `scores`, `feedback`). For it, `prune()` drops whole day partitions (or TimescaleDB chunks) that are entirely older than the cutoff instead of deleting rows: effective level of detail is one day, and a partition is only dropped once its entire day is past `maxAge`. `PruneResult.deleted` reports the number of rows in the dropped partitions.
 
 ## Methods
 
@@ -208,7 +208,9 @@ You can also cancel a long-running prune with an `AbortSignal`: the loop stops b
 
 ClickHouse observability storage uses native table TTLs instead of `prune()`. Configure retention as days per signal. `init()` applies the TTLs to new and existing tables and skips `ALTER TABLE` statements when the configured TTL is already present.
 
-For deployments that need to update TTL configuration without running the full initialization path, call `applyRetention()` on the v-next observability store:
+Omitted signals, and signals set to zero or less, get no TTL. When you remove a signal from `retention`, the next `init()` or `applyRetention()` removes that table's TTL. If Mastra can't read the current TTLs from `system.tables`, it applies the configured TTLs and leaves the others unchanged.
+
+For deployments that need to update TTL configuration without running the full initialization path, call `applyRetention()` on the vNext observability store:
 
 ```typescript
 import { ObservabilityStorageClickhouseVNext } from '@mastra/clickhouse'

package/dist/index.cjs

@@ -2755,6 +2755,17 @@ var ChannelsSpanner = class ChannelsSpanner extends _mastra_core_storage.Channel
 function toDate$1(value) {
 	return value instanceof Date ? value : new Date(value);
 }
+function jsonDataArg(value) {
+	return value === void 0 ? null : JSON.stringify(value);
+}
+const ITEM_SELECT_COLUMNS = Object.keys(_mastra_core_storage.TABLE_SCHEMAS[_mastra_core_storage.TABLE_DATASET_ITEMS]).map((column) => {
+	const name = quoteIdent(column, "column name");
+	return [
+		"input",
+		"groundTruth",
+		"expectedTrajectory"
+	].includes(column) ? `CASE WHEN ${name} IS NULL THEN NULL ELSE TO_JSON_STRING(${name}) END AS ${name}` : name;
+}).join(", ");
 function rowToDataset(row) {
 	const t = transformFromSpannerRow({
 		tableName: _mastra_core_storage.TABLE_DATASETS,
@@ -2768,10 +2779,10 @@ function rowToDataset(row) {
 		inputSchema: t.inputSchema ?? void 0,
 		groundTruthSchema: t.groundTruthSchema ?? void 0,
 		requestContextSchema: t.requestContextSchema ?? void 0,
-		tags: t.tags ?? null,
-		targetType: t.targetType ?? null,
-		targetIds: t.targetIds ?? null,
-		scorerIds: t.scorerIds ?? null,
+		tags: t.tags ?? void 0,
+		targetType: t.targetType ?? void 0,
+		targetIds: t.targetIds ?? void 0,
+		scorerIds: t.scorerIds ?? void 0,
 		version: Number(t.version ?? 0),
 		organizationId: t.organizationId ?? null,
 		projectId: t.projectId ?? null,
@@ -2795,8 +2806,8 @@ function rowToItem(row) {
 		organizationId: t.organizationId ?? null,
 		projectId: t.projectId ?? null,
 		input: t.input,
-		groundTruth: t.groundTruth ?? emptyValue,
-		expectedTrajectory: t.expectedTrajectory ?? emptyValue,
+		groundTruth: row.groundTruth == null ? emptyValue : t.groundTruth,
+		expectedTrajectory: row.expectedTrajectory == null ? emptyValue : t.expectedTrajectory,
 		toolMocks: t.toolMocks ?? emptyValue,
 		unmockedToolPolicy: t.unmockedToolPolicy ?? emptyValue,
 		scorerIds: t.scorerIds ?? emptyValue,
@@ -2973,10 +2984,10 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 				inputSchema: input.inputSchema ?? void 0,
 				groundTruthSchema: input.groundTruthSchema ?? void 0,
 				requestContextSchema: input.requestContextSchema ?? void 0,
-				tags: null,
-				targetType: input.targetType ?? null,
-				targetIds: input.targetIds ?? null,
-				scorerIds: input.scorerIds ?? null,
+				tags: void 0,
+				targetType: input.targetType ?? void 0,
+				targetIds: input.targetIds ?? void 0,
+				scorerIds: input.scorerIds ?? void 0,
 				version: 0,
 				organizationId: input.organizationId ?? null,
 				projectId: input.projectId ?? null,
@@ -3336,7 +3347,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 	/** Reads the current live row for an item (validTo IS NULL, not deleted). */
 	async loadCurrentItemRow(tx, itemId) {
 		const [rows] = await tx.run({
-			sql: `SELECT * FROM ${quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name")}
+			sql: `SELECT ${ITEM_SELECT_COLUMNS} FROM ${quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name")}
             WHERE ${quoteIdent("id", "column name")} = @id
               AND ${quoteIdent("validTo", "column name")} IS NULL
               AND ${quoteIdent("isDeleted", "column name")} = FALSE LIMIT 1`,
@@ -3364,9 +3375,9 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 							projectId,
 							validTo: null,
 							isDeleted: false,
-							input: args.input,
-							groundTruth: args.groundTruth ?? null,
-							expectedTrajectory: args.expectedTrajectory ?? null,
+							input: jsonDataArg(args.input),
+							groundTruth: jsonDataArg(args.groundTruth),
+							expectedTrajectory: jsonDataArg(args.expectedTrajectory),
 							toolMocks: args.toolMocks ?? null,
 							unmockedToolPolicy: args.unmockedToolPolicy ?? null,
 							scorerIds: args.scorerIds ?? null,
@@ -3474,9 +3485,9 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 							projectId,
 							validTo: null,
 							isDeleted: false,
-							input: merged.input,
-							groundTruth: merged.groundTruth ?? null,
-							expectedTrajectory: merged.expectedTrajectory ?? null,
+							input: jsonDataArg(merged.input),
+							groundTruth: jsonDataArg(merged.groundTruth),
+							expectedTrajectory: jsonDataArg(merged.expectedTrajectory),
 							toolMocks: merged.toolMocks ?? null,
 							unmockedToolPolicy: merged.unmockedToolPolicy ?? null,
 							scorerIds: merged.scorerIds ?? null,
@@ -3560,9 +3571,9 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 							projectId,
 							validTo: null,
 							isDeleted: true,
-							input: existing.input,
-							groundTruth: existing.groundTruth ?? null,
-							expectedTrajectory: existing.expectedTrajectory ?? null,
+							input: jsonDataArg(existing.input),
+							groundTruth: jsonDataArg(existing.groundTruth),
+							expectedTrajectory: jsonDataArg(existing.expectedTrajectory),
 							toolMocks: existing.toolMocks ?? null,
 							unmockedToolPolicy: existing.unmockedToolPolicy ?? null,
 							scorerIds: existing.scorerIds ?? null,
@@ -3729,7 +3740,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 			};
 			const limit = perPageInput === false ? total : perPage;
 			const [rows] = await this.database.run({
-				sql: `SELECT * FROM ${tableName} ${whereSql}
+				sql: `SELECT ${ITEM_SELECT_COLUMNS} FROM ${tableName} ${whereSql}
               ORDER BY ${quoteIdent(orderBy.field, "column name")} ${orderBy.direction}, ${quoteIdent("id", "column name")} ASC
               LIMIT @limit OFFSET @offset`,
 				params: {
@@ -3763,7 +3774,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 			let sql;
 			const params = { id: args.id };
 			if (args.datasetVersion !== void 0) {
-				sql = `SELECT * FROM ${tableName}
+				sql = `SELECT ${ITEM_SELECT_COLUMNS} FROM ${tableName}
                WHERE ${quoteIdent("id", "column name")} = @id
                  AND ${quoteIdent("datasetVersion", "column name")} <= @datasetVersion
                  AND (${quoteIdent("validTo", "column name")} IS NULL OR ${quoteIdent("validTo", "column name")} > @datasetVersion)
@@ -3771,7 +3782,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
                ORDER BY ${quoteIdent("datasetVersion", "column name")} DESC
                LIMIT 1`;
 				params.datasetVersion = args.datasetVersion;
-			} else sql = `SELECT * FROM ${tableName}
+			} else sql = `SELECT ${ITEM_SELECT_COLUMNS} FROM ${tableName}
                WHERE ${quoteIdent("id", "column name")} = @id
                  AND ${quoteIdent("validTo", "column name")} IS NULL
                  AND ${quoteIdent("isDeleted", "column name")} = FALSE LIMIT 1`;
@@ -3795,7 +3806,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 		try {
 			const tableName = quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name");
 			const [rows] = await this.database.run({
-				sql: `SELECT * FROM ${tableName}
+				sql: `SELECT ${ITEM_SELECT_COLUMNS} FROM ${tableName}
               WHERE ${quoteIdent("datasetId", "column name")} = @datasetId
                 AND ${quoteIdent("datasetVersion", "column name")} <= @version
                 AND (${quoteIdent("validTo", "column name")} IS NULL OR ${quoteIdent("validTo", "column name")} > @version)
@@ -3824,7 +3835,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 		try {
 			const tableName = quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name");
 			const [rows] = await this.database.run({
-				sql: `SELECT * FROM ${tableName}
+				sql: `SELECT ${ITEM_SELECT_COLUMNS} FROM ${tableName}
               WHERE ${quoteIdent("id", "column name")} = @id
               ORDER BY ${quoteIdent("datasetVersion", "column name")} DESC`,
 				params: { id: itemId },
@@ -3944,7 +3955,7 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 					let historyRows = [];
 					if (externalIds.length > 0) {
 						const [rows] = await tx.run({
-							sql: `SELECT * FROM ${quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name")} WHERE ${quoteIdent("datasetId", "column name")} = @datasetId AND ${quoteIdent("externalId", "column name")} IN UNNEST(@externalIds) ORDER BY ${quoteIdent("datasetVersion", "column name")}`,
+							sql: `SELECT ${ITEM_SELECT_COLUMNS} FROM ${quoteIdent(_mastra_core_storage.TABLE_DATASET_ITEMS, "table name")} WHERE ${quoteIdent("datasetId", "column name")} = @datasetId AND ${quoteIdent("externalId", "column name")} IN UNNEST(@externalIds) ORDER BY ${quoteIdent("datasetVersion", "column name")}`,
 							params: {
 								datasetId: input.datasetId,
 								externalIds
@@ -3986,6 +3997,9 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 								tableName: _mastra_core_storage.TABLE_DATASET_ITEMS,
 								record: {
 									...item,
+									input: jsonDataArg(item.input),
+									groundTruth: jsonDataArg(item.groundTruth),
+									expectedTrajectory: jsonDataArg(item.expectedTrajectory),
 									validTo: null,
 									isDeleted: false
 								},
@@ -4043,9 +4057,9 @@ var DatasetsSpanner = class DatasetsSpanner extends _mastra_core_storage.Dataset
 								projectId,
 								validTo: null,
 								isDeleted: true,
-								input: existing.input,
-								groundTruth: existing.groundTruth ?? null,
-								expectedTrajectory: existing.expectedTrajectory ?? null,
+								input: jsonDataArg(existing.input),
+								groundTruth: jsonDataArg(existing.groundTruth),
+								expectedTrajectory: jsonDataArg(existing.expectedTrajectory),
 								toolMocks: existing.toolMocks ?? null,
 								unmockedToolPolicy: existing.unmockedToolPolicy ?? null,
 								scorerIds: existing.scorerIds ?? null,