@mastra/turbopuffer 1.0.0-beta.0 → 1.0.0-beta.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +18 -0
- package/README.md +12 -0
- package/dist/index.cjs +196 -21
- package/dist/index.cjs.map +1 -1
- package/dist/index.js +196 -21
- package/dist/index.js.map +1 -1
- package/dist/vector/index.d.ts +5 -3
- package/dist/vector/index.d.ts.map +1 -1
- package/package.json +8 -5
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,23 @@
|
|
|
1
1
|
# @mastra/turbopuffer
|
|
2
2
|
|
|
3
|
+
## 1.0.0-beta.2
|
|
4
|
+
|
|
5
|
+
### Patch Changes
|
|
6
|
+
|
|
7
|
+
- Standardize error IDs across all storage and vector stores using centralized helper functions (`createStorageErrorId` and `createVectorErrorId`). This ensures consistent error ID patterns (`MASTRA_STORAGE_{STORE}_{OPERATION}_{STATUS}` and `MASTRA_VECTOR_{STORE}_{OPERATION}_{STATUS}`) across the codebase for better error tracking and debugging. ([#10913](https://github.com/mastra-ai/mastra/pull/10913))
|
|
8
|
+
|
|
9
|
+
- Updated dependencies [[`3076c67`](https://github.com/mastra-ai/mastra/commit/3076c6778b18988ae7d5c4c5c466366974b2d63f), [`85d7ee1`](https://github.com/mastra-ai/mastra/commit/85d7ee18ff4e14d625a8a30ec6656bb49804989b), [`c6c1092`](https://github.com/mastra-ai/mastra/commit/c6c1092f8fbf76109303f69e000e96fd1960c4ce), [`81dc110`](https://github.com/mastra-ai/mastra/commit/81dc11008d147cf5bdc8996ead1aa61dbdebb6fc), [`7aedb74`](https://github.com/mastra-ai/mastra/commit/7aedb74883adf66af38e270e4068fd42e7a37036), [`8f02d80`](https://github.com/mastra-ai/mastra/commit/8f02d800777397e4b45d7f1ad041988a8b0c6630), [`d7aad50`](https://github.com/mastra-ai/mastra/commit/d7aad501ce61646b76b4b511e558ac4eea9884d0), [`ce0a73a`](https://github.com/mastra-ai/mastra/commit/ce0a73abeaa75b10ca38f9e40a255a645d50ebfb), [`a02e542`](https://github.com/mastra-ai/mastra/commit/a02e542d23179bad250b044b17ff023caa61739f), [`a372c64`](https://github.com/mastra-ai/mastra/commit/a372c640ad1fd12e8f0613cebdc682fc156b4d95), [`8846867`](https://github.com/mastra-ai/mastra/commit/8846867ffa9a3746767618e314bebac08eb77d87), [`42a42cf`](https://github.com/mastra-ai/mastra/commit/42a42cf3132b9786feecbb8c13c583dce5b0e198), [`ae08bf0`](https://github.com/mastra-ai/mastra/commit/ae08bf0ebc6a4e4da992b711c4a389c32ba84cf4), [`21735a7`](https://github.com/mastra-ai/mastra/commit/21735a7ef306963554a69a89b44f06c3bcd85141), [`1d877b8`](https://github.com/mastra-ai/mastra/commit/1d877b8d7b536a251c1a7a18db7ddcf4f68d6f8b)]:
|
|
10
|
+
- @mastra/core@1.0.0-beta.7
|
|
11
|
+
|
|
12
|
+
## 1.0.0-beta.1
|
|
13
|
+
|
|
14
|
+
### Patch Changes
|
|
15
|
+
|
|
16
|
+
- Add new deleteVectors, updateVector by filter ([#10408](https://github.com/mastra-ai/mastra/pull/10408))
|
|
17
|
+
|
|
18
|
+
- Updated dependencies [[`21a15de`](https://github.com/mastra-ai/mastra/commit/21a15de369fe82aac26bb642ed7be73505475e8b), [`feb7ee4`](https://github.com/mastra-ai/mastra/commit/feb7ee4d09a75edb46c6669a3beaceec78811747), [`b0e2ea5`](https://github.com/mastra-ai/mastra/commit/b0e2ea5b52c40fae438b9e2f7baee6f0f89c5442), [`c456e01`](https://github.com/mastra-ai/mastra/commit/c456e0149e3c176afcefdbd9bb1d2c5917723725), [`ab035c2`](https://github.com/mastra-ai/mastra/commit/ab035c2ef6d8cc7bb25f06f1a38508bd9e6f126b), [`1a46a56`](https://github.com/mastra-ai/mastra/commit/1a46a566f45a3fcbadc1cf36bf86d351f264bfa3), [`3cf540b`](https://github.com/mastra-ai/mastra/commit/3cf540b9fbfea8f4fc8d3a2319a4e6c0b0cbfd52), [`1c6ce51`](https://github.com/mastra-ai/mastra/commit/1c6ce51f875915ab57fd36873623013699a2a65d), [`898a972`](https://github.com/mastra-ai/mastra/commit/898a9727d286c2510d6b702dfd367e6aaf5c6b0f), [`a97003a`](https://github.com/mastra-ai/mastra/commit/a97003aa1cf2f4022a41912324a1e77263b326b8), [`ccc141e`](https://github.com/mastra-ai/mastra/commit/ccc141ed27da0abc3a3fc28e9e5128152e8e37f4), [`fe3b897`](https://github.com/mastra-ai/mastra/commit/fe3b897c2ccbcd2b10e81b099438c7337feddf89), [`00123ba`](https://github.com/mastra-ai/mastra/commit/00123ba96dc9e5cd0b110420ebdba56d8f237b25), [`29c4309`](https://github.com/mastra-ai/mastra/commit/29c4309f818b24304c041bcb4a8f19b5f13f6b62), [`16785ce`](https://github.com/mastra-ai/mastra/commit/16785ced928f6f22638f4488cf8a125d99211799), [`de8239b`](https://github.com/mastra-ai/mastra/commit/de8239bdcb1d8c0cfa06da21f1569912a66bbc8a), [`b5e6cd7`](https://github.com/mastra-ai/mastra/commit/b5e6cd77fc8c8e64e0494c1d06cee3d84e795d1e), [`3759cb0`](https://github.com/mastra-ai/mastra/commit/3759cb064935b5f74c65ac2f52a1145f7352899d), [`651e772`](https://github.com/mastra-ai/mastra/commit/651e772eb1475fb13e126d3fcc01751297a88214), [`b61b93f`](https://github.com/mastra-ai/mastra/commit/b61b93f9e058b11dd2eec169853175d31dbdd567), [`bae33d9`](https://github.com/mastra-ai/mastra/commit/bae33d91a63fbb64d1e80519e1fc1acaed1e9013), [`c0b731f`](https://github.com/mastra-ai/mastra/commit/c0b731fb27d712dc8582e846df5c0332a6a0c5ba), [`43ca8f2`](https://github.com/mastra-ai/mastra/commit/43ca8f2c7334851cc7b4d3d2f037d8784bfbdd5f), [`2ca67cc`](https://github.com/mastra-ai/mastra/commit/2ca67cc3bb1f6a617353fdcab197d9efebe60d6f), [`9e67002`](https://github.com/mastra-ai/mastra/commit/9e67002b52c9be19936c420a489dbee9c5fd6a78), [`35edc49`](https://github.com/mastra-ai/mastra/commit/35edc49ac0556db609189641d6341e76771b81fc)]:
|
|
19
|
+
- @mastra/core@1.0.0-beta.5
|
|
20
|
+
|
|
3
21
|
## 1.0.0-beta.0
|
|
4
22
|
|
|
5
23
|
### Major Changes
|
package/README.md
CHANGED
|
@@ -52,6 +52,18 @@ Optional:
|
|
|
52
52
|
- `compression`: Whether to compress requests and accept compressed responses (default: true)
|
|
53
53
|
- `schemaConfigForIndex`: A function that returns a Turbopuffer schema config for an index (default: undefined).
|
|
54
54
|
|
|
55
|
+
## Methods
|
|
56
|
+
|
|
57
|
+
- `createIndex({ indexName, dimension, metric? })`: Create a new namespace
|
|
58
|
+
- `upsert({ indexName, vectors, metadata?, ids? })`: Add or update vectors
|
|
59
|
+
- `query({ indexName, queryVector, topK?, filter?, includeVector? })`: Search for similar vectors
|
|
60
|
+
- `updateVector({ indexName, id?, filter?, update })`: Update a single vector by ID or metadata filter
|
|
61
|
+
- `deleteVector({ indexName, id })`: Delete a single vector by ID
|
|
62
|
+
- `deleteVectors({ indexName, ids?, filter? })`: Delete multiple vectors by IDs or metadata filter
|
|
63
|
+
- `listIndexes()`: List all namespaces
|
|
64
|
+
- `describeIndex({ indexName })`: Get namespace statistics
|
|
65
|
+
- `deleteIndex({ indexName })`: Delete a namespace
|
|
66
|
+
|
|
55
67
|
## Related Links
|
|
56
68
|
|
|
57
69
|
- [Turbopuffer Documentation](https://turbopuffer.com/docs)
|
package/dist/index.cjs
CHANGED
|
@@ -1,6 +1,7 @@
|
|
|
1
1
|
'use strict';
|
|
2
2
|
|
|
3
3
|
var error = require('@mastra/core/error');
|
|
4
|
+
var storage = require('@mastra/core/storage');
|
|
4
5
|
var vector = require('@mastra/core/vector');
|
|
5
6
|
var turbopuffer = require('@turbopuffer/turbopuffer');
|
|
6
7
|
var filter = require('@mastra/core/vector/filter');
|
|
@@ -209,7 +210,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
209
210
|
} catch (error$1) {
|
|
210
211
|
throw new error.MastraError(
|
|
211
212
|
{
|
|
212
|
-
id: "
|
|
213
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "CREATE_INDEX", "INVALID_ARGS"),
|
|
213
214
|
domain: error.ErrorDomain.STORAGE,
|
|
214
215
|
category: error.ErrorCategory.USER,
|
|
215
216
|
details: { indexName, dimension, metric }
|
|
@@ -239,7 +240,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
239
240
|
} catch (error$1) {
|
|
240
241
|
throw new error.MastraError(
|
|
241
242
|
{
|
|
242
|
-
id: "
|
|
243
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPSERT", "INVALID_ARGS"),
|
|
243
244
|
domain: error.ErrorDomain.STORAGE,
|
|
244
245
|
category: error.ErrorCategory.USER,
|
|
245
246
|
details: { indexName }
|
|
@@ -277,7 +278,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
277
278
|
} catch (error$1) {
|
|
278
279
|
throw new error.MastraError(
|
|
279
280
|
{
|
|
280
|
-
id: "
|
|
281
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPSERT", "FAILED"),
|
|
281
282
|
domain: error.ErrorDomain.STORAGE,
|
|
282
283
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
283
284
|
details: { indexName }
|
|
@@ -310,7 +311,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
310
311
|
} catch (error$1) {
|
|
311
312
|
throw new error.MastraError(
|
|
312
313
|
{
|
|
313
|
-
id: "
|
|
314
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "QUERY", "INVALID_ARGS"),
|
|
314
315
|
domain: error.ErrorDomain.STORAGE,
|
|
315
316
|
category: error.ErrorCategory.USER,
|
|
316
317
|
details: { indexName }
|
|
@@ -341,7 +342,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
341
342
|
} catch (error$1) {
|
|
342
343
|
throw new error.MastraError(
|
|
343
344
|
{
|
|
344
|
-
id: "
|
|
345
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "QUERY", "FAILED"),
|
|
345
346
|
domain: error.ErrorDomain.STORAGE,
|
|
346
347
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
347
348
|
details: { indexName }
|
|
@@ -357,7 +358,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
357
358
|
} catch (error$1) {
|
|
358
359
|
throw new error.MastraError(
|
|
359
360
|
{
|
|
360
|
-
id: "
|
|
361
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "LIST_INDEXES", "FAILED"),
|
|
361
362
|
domain: error.ErrorDomain.STORAGE,
|
|
362
363
|
category: error.ErrorCategory.THIRD_PARTY
|
|
363
364
|
},
|
|
@@ -389,7 +390,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
389
390
|
} catch (error$1) {
|
|
390
391
|
throw new error.MastraError(
|
|
391
392
|
{
|
|
392
|
-
id: "
|
|
393
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DESCRIBE_INDEX", "FAILED"),
|
|
393
394
|
domain: error.ErrorDomain.STORAGE,
|
|
394
395
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
395
396
|
details: { indexName }
|
|
@@ -406,7 +407,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
406
407
|
} catch (error$1) {
|
|
407
408
|
throw new error.MastraError(
|
|
408
409
|
{
|
|
409
|
-
id: "
|
|
410
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_INDEX", "FAILED"),
|
|
410
411
|
domain: error.ErrorDomain.STORAGE,
|
|
411
412
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
412
413
|
details: { indexName }
|
|
@@ -416,20 +417,47 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
416
417
|
}
|
|
417
418
|
}
|
|
418
419
|
/**
|
|
419
|
-
* Updates a vector by its ID with the provided vector and/or metadata.
|
|
420
|
+
* Updates a vector by its ID or filter with the provided vector and/or metadata.
|
|
420
421
|
* @param indexName - The name of the index containing the vector.
|
|
421
422
|
* @param id - The ID of the vector to update.
|
|
423
|
+
* @param filter - The filter to match vectors to update.
|
|
422
424
|
* @param update - An object containing the vector and/or metadata to update.
|
|
423
425
|
* @param update.vector - An optional array of numbers representing the new vector.
|
|
424
426
|
* @param update.metadata - An optional record containing the new metadata.
|
|
425
427
|
* @returns A promise that resolves when the update is complete.
|
|
426
428
|
* @throws Will throw an error if no updates are provided or if the update operation fails.
|
|
427
429
|
*/
|
|
428
|
-
async updateVector({ indexName, id, update }) {
|
|
430
|
+
async updateVector({ indexName, id, filter, update }) {
|
|
431
|
+
if (id && filter) {
|
|
432
|
+
throw new error.MastraError({
|
|
433
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "MUTUALLY_EXCLUSIVE"),
|
|
434
|
+
domain: error.ErrorDomain.STORAGE,
|
|
435
|
+
category: error.ErrorCategory.USER,
|
|
436
|
+
text: "id and filter are mutually exclusive",
|
|
437
|
+
details: { indexName }
|
|
438
|
+
});
|
|
439
|
+
}
|
|
440
|
+
if (!id && !filter) {
|
|
441
|
+
throw new error.MastraError({
|
|
442
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "NO_TARGET"),
|
|
443
|
+
domain: error.ErrorDomain.STORAGE,
|
|
444
|
+
category: error.ErrorCategory.USER,
|
|
445
|
+
text: "Either id or filter must be provided",
|
|
446
|
+
details: { indexName }
|
|
447
|
+
});
|
|
448
|
+
}
|
|
449
|
+
if (!update.vector && !update.metadata) {
|
|
450
|
+
throw new error.MastraError({
|
|
451
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "NO_PAYLOAD"),
|
|
452
|
+
domain: error.ErrorDomain.STORAGE,
|
|
453
|
+
category: error.ErrorCategory.USER,
|
|
454
|
+
text: "No update data provided",
|
|
455
|
+
details: { indexName, ...id && { id } }
|
|
456
|
+
});
|
|
457
|
+
}
|
|
429
458
|
let namespace;
|
|
430
459
|
let createIndex;
|
|
431
460
|
let distanceMetric;
|
|
432
|
-
let record;
|
|
433
461
|
try {
|
|
434
462
|
namespace = this.client.namespace(indexName);
|
|
435
463
|
createIndex = this.createIndexCache.get(indexName);
|
|
@@ -437,13 +465,10 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
437
465
|
throw new Error(`createIndex() not called for this index`);
|
|
438
466
|
}
|
|
439
467
|
distanceMetric = createIndex.tpufDistanceMetric;
|
|
440
|
-
record = { id };
|
|
441
|
-
if (update.vector) record.vector = update.vector;
|
|
442
|
-
if (update.metadata) record.attributes = update.metadata;
|
|
443
468
|
} catch (error$1) {
|
|
444
469
|
throw new error.MastraError(
|
|
445
470
|
{
|
|
446
|
-
id: "
|
|
471
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "INVALID_ARGS"),
|
|
447
472
|
domain: error.ErrorDomain.STORAGE,
|
|
448
473
|
category: error.ErrorCategory.USER,
|
|
449
474
|
details: { indexName }
|
|
@@ -452,17 +477,82 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
452
477
|
);
|
|
453
478
|
}
|
|
454
479
|
try {
|
|
455
|
-
|
|
456
|
-
|
|
457
|
-
|
|
480
|
+
let idsToUpdate = [];
|
|
481
|
+
if (id) {
|
|
482
|
+
idsToUpdate = [id];
|
|
483
|
+
} else if (filter) {
|
|
484
|
+
if (Object.keys(filter).length === 0) {
|
|
485
|
+
throw new error.MastraError({
|
|
486
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "EMPTY_FILTER"),
|
|
487
|
+
domain: error.ErrorDomain.STORAGE,
|
|
488
|
+
category: error.ErrorCategory.USER,
|
|
489
|
+
text: "Filter cannot be an empty object",
|
|
490
|
+
details: { indexName }
|
|
491
|
+
});
|
|
492
|
+
}
|
|
493
|
+
const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));
|
|
494
|
+
const translatedFilter = this.filterTranslator.translate(filter);
|
|
495
|
+
const results = await namespace.query({
|
|
496
|
+
vector: dummyVector,
|
|
497
|
+
top_k: 1e4,
|
|
498
|
+
// Get all matching vectors
|
|
499
|
+
filters: translatedFilter,
|
|
500
|
+
include_vectors: update.vector ? true : false,
|
|
501
|
+
// Only fetch vectors if we're not replacing them
|
|
502
|
+
include_attributes: ["*"]
|
|
503
|
+
});
|
|
504
|
+
idsToUpdate = results.map((r) => String(r.id));
|
|
505
|
+
if (!update.vector || !update.metadata) {
|
|
506
|
+
for (const result of results) {
|
|
507
|
+
const record = { id: result.id };
|
|
508
|
+
if (update.vector) {
|
|
509
|
+
record.vector = update.vector;
|
|
510
|
+
} else if (result.vector) {
|
|
511
|
+
record.vector = result.vector;
|
|
512
|
+
}
|
|
513
|
+
if (update.metadata) {
|
|
514
|
+
record.attributes = update.metadata;
|
|
515
|
+
} else if (result.attributes) {
|
|
516
|
+
record.attributes = result.attributes;
|
|
517
|
+
}
|
|
518
|
+
await namespace.upsert({
|
|
519
|
+
vectors: [record],
|
|
520
|
+
distance_metric: distanceMetric
|
|
521
|
+
});
|
|
522
|
+
}
|
|
523
|
+
return;
|
|
524
|
+
}
|
|
525
|
+
}
|
|
526
|
+
if (idsToUpdate.length === 0) {
|
|
527
|
+
this.logger.info(`No vectors matched the criteria for update in ${indexName}`);
|
|
528
|
+
return;
|
|
529
|
+
}
|
|
530
|
+
const records = idsToUpdate.map((vecId) => {
|
|
531
|
+
const record = { id: vecId };
|
|
532
|
+
if (update.vector) record.vector = update.vector;
|
|
533
|
+
if (update.metadata) record.attributes = update.metadata;
|
|
534
|
+
return record;
|
|
458
535
|
});
|
|
536
|
+
const batchSize = 1e3;
|
|
537
|
+
for (let i = 0; i < records.length; i += batchSize) {
|
|
538
|
+
const batch = records.slice(i, i + batchSize);
|
|
539
|
+
await namespace.upsert({
|
|
540
|
+
vectors: batch,
|
|
541
|
+
distance_metric: distanceMetric
|
|
542
|
+
});
|
|
543
|
+
}
|
|
459
544
|
} catch (error$1) {
|
|
545
|
+
if (error$1 instanceof error.MastraError) throw error$1;
|
|
460
546
|
throw new error.MastraError(
|
|
461
547
|
{
|
|
462
|
-
id: "
|
|
548
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "FAILED"),
|
|
463
549
|
domain: error.ErrorDomain.STORAGE,
|
|
464
550
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
465
|
-
details: {
|
|
551
|
+
details: {
|
|
552
|
+
indexName,
|
|
553
|
+
...id && { id },
|
|
554
|
+
...filter && { filter: JSON.stringify(filter) }
|
|
555
|
+
}
|
|
466
556
|
},
|
|
467
557
|
error$1
|
|
468
558
|
);
|
|
@@ -482,7 +572,7 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
482
572
|
} catch (error$1) {
|
|
483
573
|
throw new error.MastraError(
|
|
484
574
|
{
|
|
485
|
-
id: "
|
|
575
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTOR", "FAILED"),
|
|
486
576
|
domain: error.ErrorDomain.STORAGE,
|
|
487
577
|
category: error.ErrorCategory.THIRD_PARTY,
|
|
488
578
|
details: { indexName }
|
|
@@ -491,6 +581,91 @@ var TurbopufferVector = class extends vector.MastraVector {
|
|
|
491
581
|
);
|
|
492
582
|
}
|
|
493
583
|
}
|
|
584
|
+
async deleteVectors({ indexName, filter, ids }) {
|
|
585
|
+
if (ids && filter) {
|
|
586
|
+
throw new error.MastraError({
|
|
587
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "MUTUALLY_EXCLUSIVE"),
|
|
588
|
+
domain: error.ErrorDomain.STORAGE,
|
|
589
|
+
category: error.ErrorCategory.USER,
|
|
590
|
+
text: "ids and filter are mutually exclusive",
|
|
591
|
+
details: { indexName }
|
|
592
|
+
});
|
|
593
|
+
}
|
|
594
|
+
if (!ids && !filter) {
|
|
595
|
+
throw new error.MastraError({
|
|
596
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "NO_TARGET"),
|
|
597
|
+
domain: error.ErrorDomain.STORAGE,
|
|
598
|
+
category: error.ErrorCategory.USER,
|
|
599
|
+
text: "Either filter or ids must be provided",
|
|
600
|
+
details: { indexName }
|
|
601
|
+
});
|
|
602
|
+
}
|
|
603
|
+
if (ids && ids.length === 0) {
|
|
604
|
+
throw new error.MastraError({
|
|
605
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "EMPTY_IDS"),
|
|
606
|
+
domain: error.ErrorDomain.STORAGE,
|
|
607
|
+
category: error.ErrorCategory.USER,
|
|
608
|
+
text: "ids array cannot be empty",
|
|
609
|
+
details: { indexName }
|
|
610
|
+
});
|
|
611
|
+
}
|
|
612
|
+
if (filter && Object.keys(filter).length === 0) {
|
|
613
|
+
throw new error.MastraError({
|
|
614
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "EMPTY_FILTER"),
|
|
615
|
+
domain: error.ErrorDomain.STORAGE,
|
|
616
|
+
category: error.ErrorCategory.USER,
|
|
617
|
+
text: "Filter cannot be an empty object",
|
|
618
|
+
details: { indexName }
|
|
619
|
+
});
|
|
620
|
+
}
|
|
621
|
+
try {
|
|
622
|
+
const namespace = this.client.namespace(indexName);
|
|
623
|
+
let idsToDelete = [];
|
|
624
|
+
if (ids) {
|
|
625
|
+
idsToDelete = ids;
|
|
626
|
+
} else if (filter) {
|
|
627
|
+
const createIndex = this.createIndexCache.get(indexName);
|
|
628
|
+
if (!createIndex) {
|
|
629
|
+
throw new Error(`createIndex() not called for this index`);
|
|
630
|
+
}
|
|
631
|
+
const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));
|
|
632
|
+
const translatedFilter = this.filterTranslator.translate(filter);
|
|
633
|
+
const results = await namespace.query({
|
|
634
|
+
vector: dummyVector,
|
|
635
|
+
top_k: 1e4,
|
|
636
|
+
// Get all matching vectors
|
|
637
|
+
filters: translatedFilter,
|
|
638
|
+
include_vectors: false,
|
|
639
|
+
include_attributes: []
|
|
640
|
+
});
|
|
641
|
+
idsToDelete = results.map((r) => String(r.id));
|
|
642
|
+
}
|
|
643
|
+
if (idsToDelete.length === 0) {
|
|
644
|
+
this.logger.info(`No vectors matched the criteria for deletion in ${indexName}`);
|
|
645
|
+
return;
|
|
646
|
+
}
|
|
647
|
+
const batchSize = 1e3;
|
|
648
|
+
for (let i = 0; i < idsToDelete.length; i += batchSize) {
|
|
649
|
+
const batch = idsToDelete.slice(i, i + batchSize);
|
|
650
|
+
await namespace.delete({ ids: batch });
|
|
651
|
+
}
|
|
652
|
+
} catch (error$1) {
|
|
653
|
+
if (error$1 instanceof error.MastraError) throw error$1;
|
|
654
|
+
throw new error.MastraError(
|
|
655
|
+
{
|
|
656
|
+
id: storage.createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "FAILED"),
|
|
657
|
+
domain: error.ErrorDomain.STORAGE,
|
|
658
|
+
category: error.ErrorCategory.THIRD_PARTY,
|
|
659
|
+
details: {
|
|
660
|
+
indexName,
|
|
661
|
+
...filter && { filter: JSON.stringify(filter) },
|
|
662
|
+
...ids && { idsCount: ids.length }
|
|
663
|
+
}
|
|
664
|
+
},
|
|
665
|
+
error$1
|
|
666
|
+
);
|
|
667
|
+
}
|
|
668
|
+
}
|
|
494
669
|
};
|
|
495
670
|
|
|
496
671
|
exports.TurbopufferVector = TurbopufferVector;
|
package/dist/index.cjs.map
CHANGED
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"sources":["../src/vector/filter.ts","../src/vector/index.ts"],"names":["BaseFilterTranslator","op","MastraVector","Turbopuffer","error","MastraError","ErrorDomain","ErrorCategory"],"mappings":";;;;;;;;AA6BO,IAAM,2BAAA,GAAN,cAA0CA,2BAAA,CAAmE;AAAA,EAC/F,qBAAA,GAAyC;AAC1D,IAAA,OAAO;AAAA,MACL,GAAGA,2BAAA,CAAqB,iBAAA;AAAA,MACxB,OAAA,EAAS,CAAC,MAAA,EAAQ,KAAK,CAAA;AAAA,MACvB,KAAA,EAAO,CAAC,KAAA,EAAO,MAAA,EAAQ,MAAM,CAAA;AAAA,MAC7B,OAAA,EAAS,CAAC,SAAS,CAAA;AAAA,MACnB,OAAO,EAAC;AAAA;AAAA,MACR,QAAQ;AAAC;AAAA,KACX;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKQ,WAAA,GAA8C;AAAA,IACpD,GAAA,EAAK,IAAA;AAAA,IACL,GAAA,EAAK,OAAA;AAAA,IACL,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM;AAAA,GACR;AAAA;AAAA;AAAA;AAAA,EAKA,UAAU,MAAA,EAAuD;AAC/D,IAAA,IAAI,IAAA,CAAK,OAAA,CAAQ,MAAM,CAAA,EAAG;AACxB,MAAA,OAAO,MAAA;AAAA,IACT;AAGA,IAAA,IAAA,CAAK,eAAe,MAAM,CAAA;AAG1B,IAAA,MAAM,MAAA,GAAS,IAAA,CAAK,aAAA,CAAc,MAAM,CAAA;AAIxC,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,MAAM,KAAK,MAAA,CAAO,MAAA,KAAW,CAAA,IAAM,MAAA,CAAO,CAAC,CAAA,KAAM,KAAA,IAAS,MAAA,CAAO,CAAC,MAAM,IAAA,EAAO;AAChG,MAAA,OAAO,CAAC,KAAA,EAAO,CAAC,MAAyB,CAAC,CAAA;AAAA,IAC5C;AAEA,IAAA,OAAO,MAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKQ,cAAc,IAAA,EAA0D;AAE9E,IAAA,IAAI,IAAA,KAAS,QAAQ,IAAA,KAAS,MAAA,IAAa,OAAO,IAAA,CAAK,IAAI,CAAA,CAAE,MAAA,KAAW,CAAA,EAAG;AACzE,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,IAAI,CAAA,EAAG;AAC1B,MAAA,MAAM,IAAI,MAAM,mEAAmE,CAAA;AAAA,IACrF;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,IAAI,CAAA,EAAG;AACvB,MAAA,MAAM,IAAI,MAAM,+DAA+D,CAAA;AAAA,IACjF;AAEA,IAAA,MAAM,OAAA,GAAU,MAAA,CAAO,OAAA,CAAQ,IAAI,CAAA;AAGnC,IAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAEA,IAAA,MAAM,CAAC,GAAA,EAAK,KAAK,CAAA,GAAI,QAAQ,CAAC,CAAA;AAG9B,IAAA,IAAI,GAAA,IAAO,IAAA,CAAK,iBAAA,CAAkB,GAAG,CAAA,EAAG;AACtC,MAAA,OAAO,IAAA,CAAK,gBAAA,CAAiB,GAAA,EAAK,KAAK,CAAA;AAAA,IACzC;AAGA,IAAA,IAAI,OAAA,CAAQ,SAAS,CAAA,EAAG;AACtB,MAAA,MAAM,UAAA,GAAa,OAAA,CAAQ,GAAA,CAAI,CAAC,CAAC,KAAA,EAAO,UAAU,CAAA,KAAM,IAAA,CAAK,uBAAA,CAAwB,KAAA,EAAO,UAAU,CAAC,CAAA;AACvG,MAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,IAC3B;AAGA,IAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,GAAA,EAAK,KAAK,CAAA;AAAA,EAChD;AAAA;AAAA;AAAA;AAAA,EAKQ,uBAAA,CAAwB,OAAe,KAAA,EAA6B;AAE1E,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,KAAK,CAAA,EAAG;AAC3B,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,oBAAA,CAAqB,KAAK,CAAC,CAAA;AAAA,IACvD;AAGA,IAAA,IAAI,OAAO,KAAA,KAAU,QAAA,IAAY,KAAA,KAAU,IAAA,EAAM;AAC/C,MAAA,MAAM,SAAA,GAAY,MAAA,CAAO,IAAA,CAAK,KAAK,CAAA;AAGnC,MAAA,IAAI,SAAA,CAAU,SAAS,CAAA,EAAG;AAExB,QAAA,MAAM,YAAA,GAAe,UAAU,KAAA,CAAM,CAAAC,QAAM,IAAA,CAAK,UAAA,CAAWA,GAAE,CAAC,CAAA;AAC9D,QAAA,IAAI,YAAA,EAAc;AAEhB,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM,IAAA,CAAK,iBAAA,CAAkB,KAAA,EAAOA,GAAAA,EAAI,KAAA,CAAMA,GAAE,CAAC,CAAC,CAAA;AACnF,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B,CAAA,MAAO;AAEL,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM;AACrC,YAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAIA,GAAE,CAAA,CAAA;AAClC,YAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAMA,GAAE,CAAC,CAAA;AAAA,UAC5D,CAAC,CAAA;AACD,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B;AAAA,MACF;AAGA,MAAA,MAAM,EAAA,GAAK,UAAU,CAAC,CAAA;AACtB,MAAA,IAAI,EAAA,IAAM,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC7B,QAAA,OAAO,KAAK,iBAAA,CAAkB,KAAA,EAAO,EAAA,EAAI,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MACpD;AAGA,MAAA,IAAI,EAAA,IAAM,CAAC,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC9B,QAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAI,EAAE,CAAA,CAAA;AAClC,QAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MAC5D;AAAA,IACF;AAEA,IAAA,MAAM,IAAI,KAAA,CAAM,CAAA,qCAAA,EAAwC,KAAK,CAAA,CAAE,CAAA;AAAA,EACjE;AAAA;AAAA;AAAA;AAAA,EAKQ,gBAAA,CAAiB,UAAkB,UAAA,EAA4B;AAErE,IAAA,MAAM,SAAA,GAA8B,QAAA,KAAa,MAAA,GAAS,KAAA,GAAQ,IAAA;AAGlE,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,UAAU,CAAA,EAAG;AAC9B,MAAA,MAAM,IAAI,KAAA,CAAM,CAAA,iBAAA,EAAoB,QAAQ,CAAA,gCAAA,CAAkC,CAAA;AAAA,IAChF;AAGA,IAAA,MAAM,oBAAA,GAAuB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa;AACvD,MAAA,IAAI,OAAO,SAAA,KAAc,QAAA,IAAY,SAAA,KAAc,IAAA,EAAM;AACvD,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,uCAAA,EAA0C,QAAQ,CAAA,CAAE,CAAA;AAAA,MACtE;AACA,MAAA,OAAO,IAAA,CAAK,cAAc,SAAS,CAAA;AAAA,IACrC,CAAC,CAAA;AAED,IAAA,OAAO,CAAC,WAAW,oBAAoB,CAAA;AAAA,EACzC;AAAA;AAAA;AAAA;AAAA,EAKQ,iBAAA,CAAkB,KAAA,EAAe,QAAA,EAAkB,KAAA,EAA6B;AAEtF,IAAA,IAAI,QAAA,IAAY,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG;AAC1C,MAAA,OAAO,CAAC,OAAO,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACvE;AAGA,IAAA,QAAQ,QAAA;AAAU,MAChB,KAAK,SAAA;AAGH,QAAA,OAAO,KAAA,GAAQ,CAAC,KAAA,EAAO,OAAA,EAAS,IAAI,CAAA,GAAI,CAAC,KAAA,EAAO,IAAA,EAAM,IAAI,CAAA;AAAA,MAE5D,KAAK,MAAA;AAEH,QAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,IAAK,KAAA,CAAM,WAAW,CAAA,EAAG;AAC/C,UAAA,MAAM,IAAI,MAAM,0CAA0C,CAAA;AAAA,QAC5D;AAEA,QAAA,MAAM,aAAA,GAAgB,KAAA,CAAM,GAAA,CAAI,CAAA,IAAA,KAAQ,CAAC,KAAA,EAAO,IAAA,EAAM,CAAC,IAAA,CAAK,cAAA,CAAe,IAAI,CAAC,CAAC,CAAoB,CAAA;AAGrG,QAAA,OAAO,CAAC,OAAO,aAAa,CAAA;AAAA,MAE9B;AACE,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,sBAAA,EAAyB,QAAA,IAAY,WAAW,CAAA,CAAE,CAAA;AAAA;AACtE,EACF;AAAA;AAAA;AAAA;AAAA,EAKU,eAAe,KAAA,EAAiB;AAExC,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,MAAM,WAAA,EAAY;AAAA,IAC3B;AACA,IAAA,OAAO,KAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKU,qBAAqB,MAAA,EAAsB;AACnD,IAAA,OAAO,OAAO,GAAA,CAAI,CAAA,KAAA,KAAS,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,EACvD;AACF,CAAA;;;AC3LO,IAAM,iBAAA,GAAN,cAAgCC,mBAAA,CAAsC;AAAA,EACnE,MAAA;AAAA,EACA,gBAAA;AAAA;AAAA;AAAA;AAAA,EAIA,gBAAA,uBAKA,GAAA,EAAI;AAAA,EACJ,IAAA;AAAA,EAER,YAAY,IAAA,EAAiD;AAC3D,IAAA,KAAA,CAAM,EAAE,EAAA,EAAI,IAAA,CAAK,EAAA,EAAI,CAAA;AACrB,IAAA,IAAA,CAAK,gBAAA,GAAmB,IAAI,2BAAA,EAA4B;AACxD,IAAA,IAAA,CAAK,IAAA,GAAO,IAAA;AACZ,IAAA,IAAA,CAAK,MAAA,GAAS,IAAIC,uBAAA,CAAY,IAAI,CAAA;AAAA,EACpC;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAW,SAAA,EAAW,QAAO,EAAqC;AACpF,IAAA,MAAA,GAAS,MAAA,IAAU,QAAA;AACnB,IAAA,IAAI,cAAA,GAAiC,iBAAA;AACrC,IAAA,IAAI;AACF,MAAA,IAAI,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA,EAAG;AAExC,QAAA,MAAM,QAAA,GAAW,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACpD,QAAA,IAAI,SAAA,KAAc,QAAA,CAAS,SAAA,IAAa,MAAA,KAAW,SAAS,MAAA,EAAQ;AAClE,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,CAAA,oEAAA,EAAuE,SAAS,CAAA,qBAAA,EAAwB,QAAA,CAAS,SAAS,CAAA,YAAA,EAAe,QAAA,CAAS,MAAM,CAAA,oBAAA,EAAuB,SAAS,CAAA,YAAA,EAAe,MAAM,CAAA;AAAA,WAC/M;AAAA,QACF;AACA,QAAA;AAAA,MACF;AACA,MAAA,IAAI,aAAa,CAAA,EAAG;AAClB,QAAA,MAAM,IAAI,MAAM,sCAAsC,CAAA;AAAA,MACxD;AACA,MAAA,QAAQ,MAAA;AAAQ,QACd,KAAK,QAAA;AACH,UAAA,cAAA,GAAiB,iBAAA;AACjB,UAAA;AAAA,QACF,KAAK,WAAA;AACH,UAAA,cAAA,GAAiB,mBAAA;AACjB,UAAA;AAAA,QACF,KAAK,YAAA;AACH,UAAA,MAAM,IAAI,MAAM,4CAA4C,CAAA;AAAA;AAChE,IACF,SAASC,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,sDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA,EAAW,SAAA,EAAW,MAAA;AAAO,SAC1C;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAA,CAAK,gBAAA,CAAiB,IAAI,SAAA,EAAW;AAAA,MACnC,SAAA;AAAA,MACA,SAAA;AAAA,MACA,MAAA;AAAA,MACA,kBAAA,EAAoB;AAAA,KACrB,CAAA;AAAA,EACH;AAAA,EAEA,MAAM,MAAA,CAAO,EAAE,WAAW,OAAA,EAAS,QAAA,EAAU,KAAI,EAA0C;AACzF,IAAA,IAAI,KAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,QAAA,MAAM,IAAI,MAAM,oCAAoC,CAAA;AAAA,MACtD;AAEA,MAAA,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACvC,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,MAAA,MAAM,YAAY,GAAA,IAAO,OAAA,CAAQ,IAAI,MAAM,MAAA,CAAO,YAAY,CAAA;AAC9D,MAAA,MAAM,OAAA,GAAoB,OAAA,CAAQ,GAAA,CAAI,CAAC,QAAQ,CAAA,MAAO;AAAA,QACpD,EAAA,EAAI,UAAU,CAAC,CAAA;AAAA,QACf,MAAA;AAAA,QACA,UAAA,EAAY,QAAA,GAAW,CAAC,CAAA,IAAK;AAAC,OAChC,CAAE,CAAA;AAIF,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,aAAA,GAKF;AAAA,UACF,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SACnB;AAGA,QAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,QAAA,IAAI,YAAA,EAAc;AAChB,UAAA,aAAA,CAAc,SAAS,YAAA,CAAa,MAAA;AACpC,UAAA,IAAI,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAA,KAAW,aAAa,UAAA,EAAY;AAClD,YAAA,MAAM,IAAI,KAAA;AAAA,cACR,CAAA,kBAAA,EAAqB,SAAS,CAAA,gCAAA,EAAmC,YAAA,CAAa,UAAU,CAAA,4CAAA,EAA+C,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAM,CAAA;AAAA,aAC3J;AAAA,UACF;AAAA,QACF;AAEA,QAAA,MAAM,KAAA,CAAM,OAAO,aAAa,CAAA;AAAA,MAClC;AAEA,MAAA,OAAO,SAAA;AAAA,IACT,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,0CAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,KAAA,CAAM;AAAA,IACV,SAAA;AAAA,IACA,WAAA;AAAA,IACA,IAAA;AAAA,IACA,MAAA;AAAA,IACA;AAAA,GACF,EAAyD;AACvD,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,MAAA,IAAI,YAAA,EAAc;AAChB,QAAA,IAAI,WAAA,CAAY,MAAA,KAAW,YAAA,CAAa,UAAA,EAAY;AAClD,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,qBAAqB,SAAS,CAAA,gCAAA,EAAmC,aAAa,UAAU,CAAA,iDAAA,EAAoD,YAAY,MAAM,CAAA;AAAA,WAChK;AAAA,QACF;AAAA,MACF;AACA,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,+CAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAEA,IAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,IAAA,IAAI;AACF,MAAA,MAAM,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC7C,MAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAC/D,MAAA,MAAM,OAAA,GAAwB,MAAM,KAAA,CAAM,KAAA,CAAM;AAAA,QAC9C,eAAA,EAAiB,cAAA;AAAA,QACjB,MAAA,EAAQ,WAAA;AAAA,QACR,KAAA,EAAO,IAAA;AAAA,QACP,OAAA,EAAS,gBAAA;AAAA,QACT,eAAA,EAAiB,aAAA;AAAA,QACjB,kBAAA,EAAoB,IAAA;AAAA,QACpB,WAAA,EAAa,EAAE,KAAA,EAAO,QAAA;AAAS;AAAA,OAChC,CAAA;AACD,MAAA,OAAO,OAAA,CAAQ,IAAI,CAAA,IAAA,MAAS;AAAA,QAC1B,EAAA,EAAI,MAAA,CAAO,IAAA,CAAK,EAAE,CAAA;AAAA,QAClB,OAAO,OAAO,IAAA,CAAK,IAAA,KAAS,QAAA,GAAW,KAAK,IAAA,GAAO,CAAA;AAAA,QACnD,QAAA,EAAU,IAAA,CAAK,UAAA,IAAc,EAAC;AAAA,QAC9B,GAAI,iBAAiB,IAAA,CAAK,MAAA,GAAS,EAAE,MAAA,EAAQ,IAAA,CAAK,MAAA,EAAO,GAAI;AAAC,OAChE,CAAE,CAAA;AAAA,IACJ,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,yCAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,GAAiC;AACrC,IAAA,IAAI;AACF,MAAA,MAAM,mBAAmB,MAAM,IAAA,CAAK,MAAA,CAAO,UAAA,CAAW,EAAE,CAAA;AACxD,MAAA,OAAO,gBAAA,CAAiB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa,UAAU,EAAE,CAAA;AAAA,IAClE,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc;AAAA,SAC1B;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAU,EAA6C;AAC3E,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,QAAA,GAAW,MAAM,SAAA,CAAU,QAAA,EAAS;AAC1C,MAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,MAAM,YAAY,QAAA,CAAS,UAAA;AAC3B,MAAA,MAAM,QAAQ,QAAA,CAAS,YAAA;AACvB,MAAA,OAAO;AAAA,QACL,SAAA;AAAA,QACA,KAAA;AAAA,QACA,QAAQ,WAAA,CAAY;AAAA,OACtB;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,kDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAU,EAAqC;AACjE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,SAAA,EAAU;AAC1B,MAAA,IAAA,CAAK,gBAAA,CAAiB,OAAO,SAAS,CAAA;AAAA,IACxC,SAASA,OAAA,EAAY;AACnB,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAYA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,EAAA,EAAI,QAAO,EAAsC;AAC/E,IAAA,IAAI,SAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI,cAAA;AACJ,IAAA,IAAI,MAAA;AACJ,IAAA,IAAI;AACF,MAAA,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC3C,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,cAAA,GAAiB,WAAA,CAAY,kBAAA;AAC7B,MAAA,MAAA,GAAS,EAAE,EAAA,EAAG;AACd,MAAA,IAAI,MAAA,CAAO,MAAA,EAAQ,MAAA,CAAO,MAAA,GAAS,MAAA,CAAO,MAAA;AAC1C,MAAA,IAAI,MAAA,CAAO,QAAA,EAAU,MAAA,CAAO,UAAA,GAAa,MAAA,CAAO,QAAA;AAAA,IAClD,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,uDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AACA,IAAA,IAAI;AACF,MAAA,MAAM,UAAU,MAAA,CAAO;AAAA,QACrB,OAAA,EAAS,CAAC,MAAM,CAAA;AAAA,QAChB,eAAA,EAAiB;AAAA,OAClB,CAAA;AAAA,IACH,SAASA,OAAA,EAAY;AACnB,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,iDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,IAAG,EAAsC;AACvE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,MAAA,CAAO,EAAE,KAAK,CAAC,EAAE,GAAG,CAAA;AAAA,IACtC,SAASA,OAAA,EAAY;AACnB,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,iDAAA;AAAA,UACJ,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAH;AAAA,OACF;AAAA,IACF;AAAA,EACF;AACF","file":"index.cjs","sourcesContent":["import type {\n OperatorSupport,\n VectorFilter,\n OperatorValueMap,\n LogicalOperatorValueMap,\n BlacklistedRootOperators,\n} from '@mastra/core/vector/filter';\nimport { BaseFilterTranslator } from '@mastra/core/vector/filter';\nimport type { FilterCondition, FilterConnective, FilterOperator, Filters } from '@turbopuffer/turbopuffer';\n\ntype TurbopufferOperatorValueMap = Omit<OperatorValueMap, '$regex' | '$options' | '$elemMatch'>;\n\ntype TurbopufferLogicalOperatorValueMap = Omit<LogicalOperatorValueMap, '$nor' | '$not'>;\n\ntype TurbopufferBlacklistedRootOperators = BlacklistedRootOperators | '$nor' | '$not';\n\nexport type TurbopufferVectorFilter = VectorFilter<\n keyof TurbopufferOperatorValueMap,\n TurbopufferOperatorValueMap,\n TurbopufferLogicalOperatorValueMap,\n TurbopufferBlacklistedRootOperators\n>;\n\n/**\n * Translator for converting Mastra filters to Turbopuffer format\n *\n * Mastra filters: { field: { $gt: 10 } }\n * Turbopuffer filters: [\"And\", [[\"field\", \"Gt\", 10]]]\n */\nexport class TurbopufferFilterTranslator extends BaseFilterTranslator<TurbopufferVectorFilter, Filters | undefined> {\n protected override getSupportedOperators(): OperatorSupport {\n return {\n ...BaseFilterTranslator.DEFAULT_OPERATORS,\n logical: ['$and', '$or'],\n array: ['$in', '$nin', '$all'],\n element: ['$exists'],\n regex: [], // No regex support in Turbopuffer\n custom: [], // No custom operators\n };\n }\n\n /**\n * Map Mastra operators to Turbopuffer operators\n */\n private operatorMap: Record<string, FilterOperator> = {\n $eq: 'Eq',\n $ne: 'NotEq',\n $gt: 'Gt',\n $gte: 'Gte',\n $lt: 'Lt',\n $lte: 'Lte',\n $in: 'In',\n $nin: 'NotIn',\n };\n\n /**\n * Convert the Mastra filter to Turbopuffer format\n */\n translate(filter?: TurbopufferVectorFilter): Filters | undefined {\n if (this.isEmpty(filter)) {\n return undefined;\n }\n\n // Validate the filter structure before translating\n this.validateFilter(filter);\n\n // Translate the filter\n const result = this.translateNode(filter);\n\n // If we have a single condition (not a logical operator at the top level),\n // wrap it in an implicit AND to match Turbopuffer's expected format\n if (!Array.isArray(result) || result.length !== 2 || (result[0] !== 'And' && result[0] !== 'Or')) {\n return ['And', [result as FilterCondition]];\n }\n\n return result as Filters;\n }\n\n /**\n * Recursively translate a filter node\n */\n private translateNode(node: TurbopufferVectorFilter): Filters | FilterCondition {\n // Handle empty or null nodes\n if (node === null || node === undefined || Object.keys(node).length === 0) {\n return ['And', []];\n }\n\n // Handle primitive values (direct equality comparison)\n if (this.isPrimitive(node)) {\n throw new Error('Direct primitive values not valid in this context for Turbopuffer');\n }\n\n // Handle direct array value (convert to $in)\n if (Array.isArray(node)) {\n throw new Error('Direct array values not valid in this context for Turbopuffer');\n }\n\n const entries = Object.entries(node);\n\n // Process the first operator or field\n if (entries.length === 0) {\n return ['And', []];\n }\n\n const [key, value] = entries[0] as [string, any];\n\n // Handle logical operators\n if (key && this.isLogicalOperator(key)) {\n return this.translateLogical(key, value);\n }\n\n // Multiple fields at top level - implicit AND\n if (entries.length > 1) {\n const conditions = entries.map(([field, fieldValue]) => this.translateFieldCondition(field, fieldValue));\n return ['And', conditions];\n }\n\n // Single field with condition(s)\n return this.translateFieldCondition(key, value);\n }\n\n /**\n * Translate a field condition\n */\n private translateFieldCondition(field: string, value: any): FilterCondition {\n // Handle Date object directly (convert to ISO string)\n if (value instanceof Date) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle primitive value (direct equality)\n if (this.isPrimitive(value)) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle array value (convert to $in)\n if (Array.isArray(value)) {\n return [field, 'In', this.normalizeArrayValues(value)];\n }\n\n // Handle object with operators\n if (typeof value === 'object' && value !== null) {\n const operators = Object.keys(value);\n\n // If multiple operators for the same field, create an AND condition\n if (operators.length > 1) {\n // Check if all keys are operators\n const allOperators = operators.every(op => this.isOperator(op));\n if (allOperators) {\n // For multiple comparison operators on one field\n const conditions = operators.map(op => this.translateOperator(field, op, value[op]));\n return ['And', conditions] as unknown as FilterCondition;\n } else {\n // For nested objects with multiple fields\n const conditions = operators.map(op => {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n });\n return ['And', conditions] as unknown as FilterCondition;\n }\n }\n\n // Single operator\n const op = operators[0];\n if (op && this.isOperator(op)) {\n return this.translateOperator(field, op, value[op]);\n }\n\n // Nested field path (use dot notation)\n if (op && !this.isOperator(op)) {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n }\n }\n\n throw new Error(`Unsupported filter format for field: ${field}`);\n }\n\n /**\n * Translate a logical operator\n */\n private translateLogical(operator: string, conditions: any[]): Filters {\n // Map Mastra logical operators to Turbopuffer\n const logicalOp: FilterConnective = operator === '$and' ? 'And' : 'Or';\n\n // Validate conditions\n if (!Array.isArray(conditions)) {\n throw new Error(`Logical operator ${operator} requires an array of conditions`);\n }\n\n // Translate each condition\n const translatedConditions = conditions.map(condition => {\n if (typeof condition !== 'object' || condition === null) {\n throw new Error(`Invalid condition for logical operator ${operator}`);\n }\n return this.translateNode(condition);\n });\n\n return [logicalOp, translatedConditions];\n }\n\n /**\n * Translate a specific operator\n */\n private translateOperator(field: string, operator: string, value: any): FilterCondition {\n // Handle comparison operators\n if (operator && this.operatorMap[operator]) {\n return [field, this.operatorMap[operator], this.normalizeValue(value)];\n }\n\n // Handle special cases\n switch (operator) {\n case '$exists':\n // $exists: true -> use NotEq with null (field exists if it's not null)\n // $exists: false -> use Eq with null (field doesn't exist if it is null)\n return value ? [field, 'NotEq', null] : [field, 'Eq', null];\n\n case '$all':\n // $all is not directly supported, simulate with AND + IN conditions\n if (!Array.isArray(value) || value.length === 0) {\n throw new Error('$all operator requires a non-empty array');\n }\n\n const allConditions = value.map(item => [field, 'In', [this.normalizeValue(item)]] as FilterCondition);\n\n // Return the array of conditions directly without nesting\n return ['And', allConditions] as unknown as FilterCondition;\n\n default:\n throw new Error(`Unsupported operator: ${operator || 'undefined'}`);\n }\n }\n\n /**\n * Normalize a value for comparison operations\n */\n protected normalizeValue(value: any): any {\n // Handle special value types\n if (value instanceof Date) {\n return value.toISOString();\n }\n return value;\n }\n\n /**\n * Normalize array values\n */\n protected normalizeArrayValues(values: any[]): any[] {\n return values.map(value => this.normalizeValue(value));\n }\n}\n","import { ErrorCategory, ErrorDomain, MastraError } from '@mastra/core/error';\nimport type {\n CreateIndexParams,\n DeleteIndexParams,\n DeleteVectorParams,\n DescribeIndexParams,\n IndexStats,\n QueryResult,\n QueryVectorParams,\n UpdateVectorParams,\n UpsertVectorParams,\n} from '@mastra/core/vector';\nimport { MastraVector } from '@mastra/core/vector';\nimport { Turbopuffer } from '@turbopuffer/turbopuffer';\nimport type { DistanceMetric, QueryResults, Schema, Vector } from '@turbopuffer/turbopuffer';\nimport { TurbopufferFilterTranslator } from './filter';\nimport type { TurbopufferVectorFilter } from './filter';\n\ntype TurbopufferQueryVectorParams = QueryVectorParams<TurbopufferVectorFilter>;\n\nexport interface TurbopufferVectorOptions {\n /** The API key to authenticate with. */\n apiKey: string;\n /** The base URL. Default is https://api.turbopuffer.com. */\n baseUrl?: string;\n /** The timeout to establish a connection, in ms. Default is 10_000. Only applicable in Node and Deno.*/\n connectTimeout?: number;\n /** The socket idle timeout, in ms. Default is 60_000. Only applicable in Node and Deno.*/\n connectionIdleTimeout?: number;\n /** The number of connections to open initially when creating a new client. Default is 0. */\n warmConnections?: number;\n /** Whether to compress requests and accept compressed responses. Default is true. */\n compression?: boolean;\n /**\n * A callback function that takes an index name and returns a config object for that index.\n * This allows you to define explicit schemas per index.\n *\n * Example:\n * ```typescript\n * schemaConfigForIndex: (indexName: string) => {\n * // Mastra's default embedding model and index for memory messages:\n * if (indexName === \"memory_messages_384\") {\n * return {\n * dimensions: 384,\n * schema: {\n * thread_id: {\n * type: \"string\",\n * filterable: true,\n * },\n * },\n * };\n * } else {\n * throw new Error(`TODO: add schema for index: ${indexName}`);\n * }\n * },\n * ```\n */\n schemaConfigForIndex?: (indexName: string) => {\n dimensions: number;\n schema: Schema;\n };\n}\n\nexport class TurbopufferVector extends MastraVector<TurbopufferVectorFilter> {\n private client: Turbopuffer;\n private filterTranslator: TurbopufferFilterTranslator;\n // There is no explicit create index operation in Turbopuffer, so just register that\n // someone has called createIndex() and verify that subsequent upsert calls are consistent\n // with how the index was \"created\"\n private createIndexCache: Map<\n string,\n CreateIndexParams & {\n tpufDistanceMetric: DistanceMetric;\n }\n > = new Map();\n private opts: TurbopufferVectorOptions;\n\n constructor(opts: TurbopufferVectorOptions & { id: string }) {\n super({ id: opts.id });\n this.filterTranslator = new TurbopufferFilterTranslator();\n this.opts = opts;\n this.client = new Turbopuffer(opts);\n }\n\n async createIndex({ indexName, dimension, metric }: CreateIndexParams): Promise<void> {\n metric = metric ?? 'cosine'; // default to cosine distance\n let distanceMetric: DistanceMetric = 'cosine_distance';\n try {\n if (this.createIndexCache.has(indexName)) {\n // verify that the dimensions and distance metric match what we expect\n const expected = this.createIndexCache.get(indexName)!;\n if (dimension !== expected.dimension || metric !== expected.metric) {\n throw new Error(\n `createIndex() called more than once with inconsistent inputs. Index ${indexName} expected dimensions=${expected.dimension} and metric=${expected.metric} but got dimensions=${dimension} and metric=${metric}`,\n );\n }\n return;\n }\n if (dimension <= 0) {\n throw new Error('Dimension must be a positive integer');\n }\n switch (metric) {\n case 'cosine':\n distanceMetric = 'cosine_distance';\n break;\n case 'euclidean':\n distanceMetric = 'euclidean_squared';\n break;\n case 'dotproduct':\n throw new Error('dotproduct is not supported in Turbopuffer');\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_CREATE_INDEX_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName, dimension, metric },\n },\n error,\n );\n }\n\n this.createIndexCache.set(indexName, {\n indexName,\n dimension,\n metric,\n tpufDistanceMetric: distanceMetric,\n });\n }\n\n async upsert({ indexName, vectors, metadata, ids }: UpsertVectorParams): Promise<string[]> {\n let index;\n let createIndex;\n try {\n if (vectors.length === 0) {\n throw new Error('upsert() called with empty vectors');\n }\n\n index = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPSERT_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n const distanceMetric = createIndex.tpufDistanceMetric;\n const vectorIds = ids || vectors.map(() => crypto.randomUUID());\n const records: Vector[] = vectors.map((vector, i) => ({\n id: vectorIds[i]!,\n vector: vector,\n attributes: metadata?.[i] || {},\n }));\n\n // limit is 256 MB per upsert request, so set a reasonable batch size here that will stay under that for most cases\n // https://turbopuffer.com/docs/limits\n const batchSize = 100;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n const upsertOptions: {\n vectors: Vector[];\n distance_metric: DistanceMetric;\n schema?: Schema;\n batchSize?: number;\n } = {\n vectors: batch,\n distance_metric: distanceMetric,\n };\n\n // Use the schemaForIndex callback if provided\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n upsertOptions.schema = schemaConfig.schema;\n if (vectors[0]?.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to upsert vectors[0].length=${vectors[0]?.length}`,\n );\n }\n }\n\n await index.upsert(upsertOptions);\n }\n\n return vectorIds;\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPSERT_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async query({\n indexName,\n queryVector,\n topK,\n filter,\n includeVector,\n }: TurbopufferQueryVectorParams): Promise<QueryResult[]> {\n let createIndex;\n try {\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n if (queryVector.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to query with queryVector.length=${queryVector.length}`,\n );\n }\n }\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_QUERY_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n const distanceMetric = createIndex.tpufDistanceMetric;\n try {\n const index = this.client.namespace(indexName);\n const translatedFilter = this.filterTranslator.translate(filter);\n const results: QueryResults = await index.query({\n distance_metric: distanceMetric,\n vector: queryVector,\n top_k: topK,\n filters: translatedFilter,\n include_vectors: includeVector,\n include_attributes: true,\n consistency: { level: 'strong' }, // todo: make this configurable somehow?\n });\n return results.map(item => ({\n id: String(item.id),\n score: typeof item.dist === 'number' ? item.dist : 0,\n metadata: item.attributes || {},\n ...(includeVector && item.vector ? { vector: item.vector } : {}),\n }));\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_QUERY_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async listIndexes(): Promise<string[]> {\n try {\n const namespacesResult = await this.client.namespaces({});\n return namespacesResult.namespaces.map(namespace => namespace.id);\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_LIST_INDEXES_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n },\n error,\n );\n }\n }\n\n /**\n * Retrieves statistics about a vector index.\n *\n * @param {string} indexName - The name of the index to describe\n * @returns A promise that resolves to the index statistics including dimension, count and metric\n */\n async describeIndex({ indexName }: DescribeIndexParams): Promise<IndexStats> {\n try {\n const namespace = this.client.namespace(indexName);\n const metadata = await namespace.metadata();\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n const dimension = metadata.dimensions;\n const count = metadata.approx_count;\n return {\n dimension,\n count,\n metric: createIndex.metric,\n };\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DESCRIBE_INDEX_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteIndex({ indexName }: DeleteIndexParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.deleteAll();\n this.createIndexCache.delete(indexName);\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DELETE_INDEX_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Updates a vector by its ID with the provided vector and/or metadata.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to update.\n * @param update - An object containing the vector and/or metadata to update.\n * @param update.vector - An optional array of numbers representing the new vector.\n * @param update.metadata - An optional record containing the new metadata.\n * @returns A promise that resolves when the update is complete.\n * @throws Will throw an error if no updates are provided or if the update operation fails.\n */\n async updateVector({ indexName, id, update }: UpdateVectorParams): Promise<void> {\n let namespace;\n let createIndex;\n let distanceMetric;\n let record;\n try {\n namespace = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n distanceMetric = createIndex.tpufDistanceMetric;\n record = { id } as Vector;\n if (update.vector) record.vector = update.vector;\n if (update.metadata) record.attributes = update.metadata;\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPDATE_VECTOR_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n try {\n await namespace.upsert({\n vectors: [record],\n distance_metric: distanceMetric,\n });\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPDATE_VECTOR_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Deletes a vector by its ID.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to delete.\n * @returns A promise that resolves when the deletion is complete.\n * @throws Will throw an error if the deletion operation fails.\n */\n async deleteVector({ indexName, id }: DeleteVectorParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.delete({ ids: [id] });\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DELETE_VECTOR_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n}\n"]}
|
|
1
|
+
{"version":3,"sources":["../src/vector/filter.ts","../src/vector/index.ts"],"names":["BaseFilterTranslator","op","MastraVector","Turbopuffer","error","MastraError","createVectorErrorId","ErrorDomain","ErrorCategory"],"mappings":";;;;;;;;;AA6BO,IAAM,2BAAA,GAAN,cAA0CA,2BAAA,CAAmE;AAAA,EAC/F,qBAAA,GAAyC;AAC1D,IAAA,OAAO;AAAA,MACL,GAAGA,2BAAA,CAAqB,iBAAA;AAAA,MACxB,OAAA,EAAS,CAAC,MAAA,EAAQ,KAAK,CAAA;AAAA,MACvB,KAAA,EAAO,CAAC,KAAA,EAAO,MAAA,EAAQ,MAAM,CAAA;AAAA,MAC7B,OAAA,EAAS,CAAC,SAAS,CAAA;AAAA,MACnB,OAAO,EAAC;AAAA;AAAA,MACR,QAAQ;AAAC;AAAA,KACX;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKQ,WAAA,GAA8C;AAAA,IACpD,GAAA,EAAK,IAAA;AAAA,IACL,GAAA,EAAK,OAAA;AAAA,IACL,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM;AAAA,GACR;AAAA;AAAA;AAAA;AAAA,EAKA,UAAU,MAAA,EAAuD;AAC/D,IAAA,IAAI,IAAA,CAAK,OAAA,CAAQ,MAAM,CAAA,EAAG;AACxB,MAAA,OAAO,MAAA;AAAA,IACT;AAGA,IAAA,IAAA,CAAK,eAAe,MAAM,CAAA;AAG1B,IAAA,MAAM,MAAA,GAAS,IAAA,CAAK,aAAA,CAAc,MAAM,CAAA;AAIxC,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,MAAM,KAAK,MAAA,CAAO,MAAA,KAAW,CAAA,IAAM,MAAA,CAAO,CAAC,CAAA,KAAM,KAAA,IAAS,MAAA,CAAO,CAAC,MAAM,IAAA,EAAO;AAChG,MAAA,OAAO,CAAC,KAAA,EAAO,CAAC,MAAyB,CAAC,CAAA;AAAA,IAC5C;AAEA,IAAA,OAAO,MAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKQ,cAAc,IAAA,EAA0D;AAE9E,IAAA,IAAI,IAAA,KAAS,QAAQ,IAAA,KAAS,MAAA,IAAa,OAAO,IAAA,CAAK,IAAI,CAAA,CAAE,MAAA,KAAW,CAAA,EAAG;AACzE,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,IAAI,CAAA,EAAG;AAC1B,MAAA,MAAM,IAAI,MAAM,mEAAmE,CAAA;AAAA,IACrF;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,IAAI,CAAA,EAAG;AACvB,MAAA,MAAM,IAAI,MAAM,+DAA+D,CAAA;AAAA,IACjF;AAEA,IAAA,MAAM,OAAA,GAAU,MAAA,CAAO,OAAA,CAAQ,IAAI,CAAA;AAGnC,IAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAEA,IAAA,MAAM,CAAC,GAAA,EAAK,KAAK,CAAA,GAAI,QAAQ,CAAC,CAAA;AAG9B,IAAA,IAAI,GAAA,IAAO,IAAA,CAAK,iBAAA,CAAkB,GAAG,CAAA,EAAG;AACtC,MAAA,OAAO,IAAA,CAAK,gBAAA,CAAiB,GAAA,EAAK,KAAK,CAAA;AAAA,IACzC;AAGA,IAAA,IAAI,OAAA,CAAQ,SAAS,CAAA,EAAG;AACtB,MAAA,MAAM,UAAA,GAAa,OAAA,CAAQ,GAAA,CAAI,CAAC,CAAC,KAAA,EAAO,UAAU,CAAA,KAAM,IAAA,CAAK,uBAAA,CAAwB,KAAA,EAAO,UAAU,CAAC,CAAA;AACvG,MAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,IAC3B;AAGA,IAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,GAAA,EAAK,KAAK,CAAA;AAAA,EAChD;AAAA;AAAA;AAAA;AAAA,EAKQ,uBAAA,CAAwB,OAAe,KAAA,EAA6B;AAE1E,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,KAAK,CAAA,EAAG;AAC3B,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,oBAAA,CAAqB,KAAK,CAAC,CAAA;AAAA,IACvD;AAGA,IAAA,IAAI,OAAO,KAAA,KAAU,QAAA,IAAY,KAAA,KAAU,IAAA,EAAM;AAC/C,MAAA,MAAM,SAAA,GAAY,MAAA,CAAO,IAAA,CAAK,KAAK,CAAA;AAGnC,MAAA,IAAI,SAAA,CAAU,SAAS,CAAA,EAAG;AAExB,QAAA,MAAM,YAAA,GAAe,UAAU,KAAA,CAAM,CAAAC,QAAM,IAAA,CAAK,UAAA,CAAWA,GAAE,CAAC,CAAA;AAC9D,QAAA,IAAI,YAAA,EAAc;AAEhB,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM,IAAA,CAAK,iBAAA,CAAkB,KAAA,EAAOA,GAAAA,EAAI,KAAA,CAAMA,GAAE,CAAC,CAAC,CAAA;AACnF,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B,CAAA,MAAO;AAEL,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM;AACrC,YAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAIA,GAAE,CAAA,CAAA;AAClC,YAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAMA,GAAE,CAAC,CAAA;AAAA,UAC5D,CAAC,CAAA;AACD,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B;AAAA,MACF;AAGA,MAAA,MAAM,EAAA,GAAK,UAAU,CAAC,CAAA;AACtB,MAAA,IAAI,EAAA,IAAM,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC7B,QAAA,OAAO,KAAK,iBAAA,CAAkB,KAAA,EAAO,EAAA,EAAI,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MACpD;AAGA,MAAA,IAAI,EAAA,IAAM,CAAC,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC9B,QAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAI,EAAE,CAAA,CAAA;AAClC,QAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MAC5D;AAAA,IACF;AAEA,IAAA,MAAM,IAAI,KAAA,CAAM,CAAA,qCAAA,EAAwC,KAAK,CAAA,CAAE,CAAA;AAAA,EACjE;AAAA;AAAA;AAAA;AAAA,EAKQ,gBAAA,CAAiB,UAAkB,UAAA,EAA4B;AAErE,IAAA,MAAM,SAAA,GAA8B,QAAA,KAAa,MAAA,GAAS,KAAA,GAAQ,IAAA;AAGlE,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,UAAU,CAAA,EAAG;AAC9B,MAAA,MAAM,IAAI,KAAA,CAAM,CAAA,iBAAA,EAAoB,QAAQ,CAAA,gCAAA,CAAkC,CAAA;AAAA,IAChF;AAGA,IAAA,MAAM,oBAAA,GAAuB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa;AACvD,MAAA,IAAI,OAAO,SAAA,KAAc,QAAA,IAAY,SAAA,KAAc,IAAA,EAAM;AACvD,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,uCAAA,EAA0C,QAAQ,CAAA,CAAE,CAAA;AAAA,MACtE;AACA,MAAA,OAAO,IAAA,CAAK,cAAc,SAAS,CAAA;AAAA,IACrC,CAAC,CAAA;AAED,IAAA,OAAO,CAAC,WAAW,oBAAoB,CAAA;AAAA,EACzC;AAAA;AAAA;AAAA;AAAA,EAKQ,iBAAA,CAAkB,KAAA,EAAe,QAAA,EAAkB,KAAA,EAA6B;AAEtF,IAAA,IAAI,QAAA,IAAY,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG;AAC1C,MAAA,OAAO,CAAC,OAAO,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACvE;AAGA,IAAA,QAAQ,QAAA;AAAU,MAChB,KAAK,SAAA;AAGH,QAAA,OAAO,KAAA,GAAQ,CAAC,KAAA,EAAO,OAAA,EAAS,IAAI,CAAA,GAAI,CAAC,KAAA,EAAO,IAAA,EAAM,IAAI,CAAA;AAAA,MAE5D,KAAK,MAAA;AAEH,QAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,IAAK,KAAA,CAAM,WAAW,CAAA,EAAG;AAC/C,UAAA,MAAM,IAAI,MAAM,0CAA0C,CAAA;AAAA,QAC5D;AAEA,QAAA,MAAM,aAAA,GAAgB,KAAA,CAAM,GAAA,CAAI,CAAA,IAAA,KAAQ,CAAC,KAAA,EAAO,IAAA,EAAM,CAAC,IAAA,CAAK,cAAA,CAAe,IAAI,CAAC,CAAC,CAAoB,CAAA;AAGrG,QAAA,OAAO,CAAC,OAAO,aAAa,CAAA;AAAA,MAE9B;AACE,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,sBAAA,EAAyB,QAAA,IAAY,WAAW,CAAA,CAAE,CAAA;AAAA;AACtE,EACF;AAAA;AAAA;AAAA;AAAA,EAKU,eAAe,KAAA,EAAiB;AAExC,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,MAAM,WAAA,EAAY;AAAA,IAC3B;AACA,IAAA,OAAO,KAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKU,qBAAqB,MAAA,EAAsB;AACnD,IAAA,OAAO,OAAO,GAAA,CAAI,CAAA,KAAA,KAAS,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,EACvD;AACF,CAAA;;;ACzLO,IAAM,iBAAA,GAAN,cAAgCC,mBAAA,CAAsC;AAAA,EACnE,MAAA;AAAA,EACA,gBAAA;AAAA;AAAA;AAAA;AAAA,EAIA,gBAAA,uBAKA,GAAA,EAAI;AAAA,EACJ,IAAA;AAAA,EAER,YAAY,IAAA,EAAiD;AAC3D,IAAA,KAAA,CAAM,EAAE,EAAA,EAAI,IAAA,CAAK,EAAA,EAAI,CAAA;AACrB,IAAA,IAAA,CAAK,gBAAA,GAAmB,IAAI,2BAAA,EAA4B;AACxD,IAAA,IAAA,CAAK,IAAA,GAAO,IAAA;AACZ,IAAA,IAAA,CAAK,MAAA,GAAS,IAAIC,uBAAA,CAAY,IAAI,CAAA;AAAA,EACpC;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAW,SAAA,EAAW,QAAO,EAAqC;AACpF,IAAA,MAAA,GAAS,MAAA,IAAU,QAAA;AACnB,IAAA,IAAI,cAAA,GAAiC,iBAAA;AACrC,IAAA,IAAI;AACF,MAAA,IAAI,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA,EAAG;AAExC,QAAA,MAAM,QAAA,GAAW,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACpD,QAAA,IAAI,SAAA,KAAc,QAAA,CAAS,SAAA,IAAa,MAAA,KAAW,SAAS,MAAA,EAAQ;AAClE,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,CAAA,oEAAA,EAAuE,SAAS,CAAA,qBAAA,EAAwB,QAAA,CAAS,SAAS,CAAA,YAAA,EAAe,QAAA,CAAS,MAAM,CAAA,oBAAA,EAAuB,SAAS,CAAA,YAAA,EAAe,MAAM,CAAA;AAAA,WAC/M;AAAA,QACF;AACA,QAAA;AAAA,MACF;AACA,MAAA,IAAI,aAAa,CAAA,EAAG;AAClB,QAAA,MAAM,IAAI,MAAM,sCAAsC,CAAA;AAAA,MACxD;AACA,MAAA,QAAQ,MAAA;AAAQ,QACd,KAAK,QAAA;AACH,UAAA,cAAA,GAAiB,iBAAA;AACjB,UAAA;AAAA,QACF,KAAK,WAAA;AACH,UAAA,cAAA,GAAiB,mBAAA;AACjB,UAAA;AAAA,QACF,KAAK,YAAA;AACH,UAAA,MAAM,IAAI,MAAM,4CAA4C,CAAA;AAAA;AAChE,IACF,SAASC,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,cAAc,CAAA;AAAA,UACrE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA,EAAW,SAAA,EAAW,MAAA;AAAO,SAC1C;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAA,CAAK,gBAAA,CAAiB,IAAI,SAAA,EAAW;AAAA,MACnC,SAAA;AAAA,MACA,SAAA;AAAA,MACA,MAAA;AAAA,MACA,kBAAA,EAAoB;AAAA,KACrB,CAAA;AAAA,EACH;AAAA,EAEA,MAAM,MAAA,CAAO,EAAE,WAAW,OAAA,EAAS,QAAA,EAAU,KAAI,EAA0C;AACzF,IAAA,IAAI,KAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,QAAA,MAAM,IAAI,MAAM,oCAAoC,CAAA;AAAA,MACtD;AAEA,MAAA,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACvC,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,QAAA,EAAU,cAAc,CAAA;AAAA,UAC/D,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,MAAA,MAAM,YAAY,GAAA,IAAO,OAAA,CAAQ,IAAI,MAAM,MAAA,CAAO,YAAY,CAAA;AAC9D,MAAA,MAAM,OAAA,GAAoB,OAAA,CAAQ,GAAA,CAAI,CAAC,QAAQ,CAAA,MAAO;AAAA,QACpD,EAAA,EAAI,UAAU,CAAC,CAAA;AAAA,QACf,MAAA;AAAA,QACA,UAAA,EAAY,QAAA,GAAW,CAAC,CAAA,IAAK;AAAC,OAChC,CAAE,CAAA;AAIF,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,aAAA,GAKF;AAAA,UACF,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SACnB;AAGA,QAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,QAAA,IAAI,YAAA,EAAc;AAChB,UAAA,aAAA,CAAc,SAAS,YAAA,CAAa,MAAA;AACpC,UAAA,IAAI,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAA,KAAW,aAAa,UAAA,EAAY;AAClD,YAAA,MAAM,IAAI,KAAA;AAAA,cACR,CAAA,kBAAA,EAAqB,SAAS,CAAA,gCAAA,EAAmC,YAAA,CAAa,UAAU,CAAA,4CAAA,EAA+C,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAM,CAAA;AAAA,aAC3J;AAAA,UACF;AAAA,QACF;AAEA,QAAA,MAAM,KAAA,CAAM,OAAO,aAAa,CAAA;AAAA,MAClC;AAEA,MAAA,OAAO,SAAA;AAAA,IACT,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,QAAA,EAAU,QAAQ,CAAA;AAAA,UACzD,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,KAAA,CAAM;AAAA,IACV,SAAA;AAAA,IACA,WAAA;AAAA,IACA,IAAA;AAAA,IACA,MAAA;AAAA,IACA;AAAA,GACF,EAAyD;AACvD,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,MAAA,IAAI,YAAA,EAAc;AAChB,QAAA,IAAI,WAAA,CAAY,MAAA,KAAW,YAAA,CAAa,UAAA,EAAY;AAClD,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,qBAAqB,SAAS,CAAA,gCAAA,EAAmC,aAAa,UAAU,CAAA,iDAAA,EAAoD,YAAY,MAAM,CAAA;AAAA,WAChK;AAAA,QACF;AAAA,MACF;AACA,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,OAAA,EAAS,cAAc,CAAA;AAAA,UAC9D,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAEA,IAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,IAAA,IAAI;AACF,MAAA,MAAM,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC7C,MAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAC/D,MAAA,MAAM,OAAA,GAAwB,MAAM,KAAA,CAAM,KAAA,CAAM;AAAA,QAC9C,eAAA,EAAiB,cAAA;AAAA,QACjB,MAAA,EAAQ,WAAA;AAAA,QACR,KAAA,EAAO,IAAA;AAAA,QACP,OAAA,EAAS,gBAAA;AAAA,QACT,eAAA,EAAiB,aAAA;AAAA,QACjB,kBAAA,EAAoB,IAAA;AAAA,QACpB,WAAA,EAAa,EAAE,KAAA,EAAO,QAAA;AAAS;AAAA,OAChC,CAAA;AACD,MAAA,OAAO,OAAA,CAAQ,IAAI,CAAA,IAAA,MAAS;AAAA,QAC1B,EAAA,EAAI,MAAA,CAAO,IAAA,CAAK,EAAE,CAAA;AAAA,QAClB,OAAO,OAAO,IAAA,CAAK,IAAA,KAAS,QAAA,GAAW,KAAK,IAAA,GAAO,CAAA;AAAA,QACnD,QAAA,EAAU,IAAA,CAAK,UAAA,IAAc,EAAC;AAAA,QAC9B,GAAI,iBAAiB,IAAA,CAAK,MAAA,GAAS,EAAE,MAAA,EAAQ,IAAA,CAAK,MAAA,EAAO,GAAI;AAAC,OAChE,CAAE,CAAA;AAAA,IACJ,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,OAAA,EAAS,QAAQ,CAAA;AAAA,UACxD,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,GAAiC;AACrC,IAAA,IAAI;AACF,MAAA,MAAM,mBAAmB,MAAM,IAAA,CAAK,MAAA,CAAO,UAAA,CAAW,EAAE,CAAA;AACxD,MAAA,OAAO,gBAAA,CAAiB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa,UAAU,EAAE,CAAA;AAAA,IAClE,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,QAAQ,CAAA;AAAA,UAC/D,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc;AAAA,SAC1B;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAU,EAA6C;AAC3E,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,QAAA,GAAW,MAAM,SAAA,CAAU,QAAA,EAAS;AAC1C,MAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,MAAM,YAAY,QAAA,CAAS,UAAA;AAC3B,MAAA,MAAM,QAAQ,QAAA,CAAS,YAAA;AACvB,MAAA,OAAO;AAAA,QACL,SAAA;AAAA,QACA,KAAA;AAAA,QACA,QAAQ,WAAA,CAAY;AAAA,OACtB;AAAA,IACF,SAASA,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,QAAQ,CAAA;AAAA,UACjE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAU,EAAqC;AACjE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,SAAA,EAAU;AAC1B,MAAA,IAAA,CAAK,gBAAA,CAAiB,OAAO,SAAS,CAAA;AAAA,IACxC,SAASA,OAAA,EAAY;AACnB,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,QAAQ,CAAA;AAAA,UAC/D,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAaA,MAAM,YAAA,CAAa,EAAE,WAAW,EAAA,EAAI,MAAA,EAAQ,QAAO,EAA+D;AAEhH,IAAA,IAAI,MAAM,MAAA,EAAQ;AAChB,MAAA,MAAM,IAAIC,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,oBAAoB,CAAA;AAAA,QAC5E,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,sCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,EAAA,IAAM,CAAC,MAAA,EAAQ;AAClB,MAAA,MAAM,IAAIH,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,WAAW,CAAA;AAAA,QACnE,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,sCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,MAAA,CAAO,MAAA,IAAU,CAAC,OAAO,QAAA,EAAU;AACtC,MAAA,MAAM,IAAIH,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,YAAY,CAAA;AAAA,QACpE,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,yBAAA;AAAA,QACN,SAAS,EAAE,SAAA,EAAW,GAAI,EAAA,IAAM,EAAE,IAAG;AAAG,OACzC,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,SAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI,cAAA;AACJ,IAAA,IAAI;AACF,MAAA,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC3C,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,cAAA,GAAiB,WAAA,CAAY,kBAAA;AAAA,IAC/B,SAASJ,OAAA,EAAO;AACd,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,cAAc,CAAA;AAAA,UACtE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,IAAI,cAAwB,EAAC;AAE7B,MAAA,IAAI,EAAA,EAAI;AACN,QAAA,WAAA,GAAc,CAAC,EAAE,CAAA;AAAA,MACnB,WAAW,MAAA,EAAQ;AAEjB,QAAA,IAAI,MAAA,CAAO,IAAA,CAAK,MAAM,CAAA,CAAE,WAAW,CAAA,EAAG;AACpC,UAAA,MAAM,IAAIC,iBAAA,CAAY;AAAA,YACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,cAAc,CAAA;AAAA,YACtE,QAAQC,iBAAA,CAAY,OAAA;AAAA,YACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,YACxB,IAAA,EAAM,kCAAA;AAAA,YACN,OAAA,EAAS,EAAE,SAAA;AAAU,WACtB,CAAA;AAAA,QACH;AAGA,QAAA,MAAM,WAAA,GAAc,IAAI,KAAA,CAAM,WAAA,CAAY,SAAS,CAAA,CAAE,IAAA,CAAK,CAAA,GAAI,IAAA,CAAK,IAAA,CAAK,WAAA,CAAY,SAAS,CAAC,CAAA;AAC9F,QAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAE/D,QAAA,MAAM,OAAA,GAAU,MAAM,SAAA,CAAU,KAAA,CAAM;AAAA,UACpC,MAAA,EAAQ,WAAA;AAAA,UACR,KAAA,EAAO,GAAA;AAAA;AAAA,UACP,OAAA,EAAS,gBAAA;AAAA,UACT,eAAA,EAAiB,MAAA,CAAO,MAAA,GAAS,IAAA,GAAO,KAAA;AAAA;AAAA,UACxC,kBAAA,EAAoB,CAAC,GAAG;AAAA,SACzB,CAAA;AAED,QAAA,WAAA,GAAc,QAAQ,GAAA,CAAI,CAAA,CAAA,KAAK,MAAA,CAAO,CAAA,CAAE,EAAE,CAAC,CAAA;AAG3C,QAAA,IAAI,CAAC,MAAA,CAAO,MAAA,IAAU,CAAC,OAAO,QAAA,EAAU;AACtC,UAAA,KAAA,MAAW,UAAU,OAAA,EAAS;AAC5B,YAAA,MAAM,MAAA,GAAiB,EAAE,EAAA,EAAI,MAAA,CAAO,EAAA,EAAG;AACvC,YAAA,IAAI,OAAO,MAAA,EAAQ;AACjB,cAAA,MAAA,CAAO,SAAS,MAAA,CAAO,MAAA;AAAA,YACzB,CAAA,MAAA,IAAW,OAAO,MAAA,EAAQ;AACxB,cAAA,MAAA,CAAO,SAAS,MAAA,CAAO,MAAA;AAAA,YACzB;AACA,YAAA,IAAI,OAAO,QAAA,EAAU;AACnB,cAAA,MAAA,CAAO,aAAa,MAAA,CAAO,QAAA;AAAA,YAC7B,CAAA,MAAA,IAAW,OAAO,UAAA,EAAY;AAC5B,cAAA,MAAA,CAAO,aAAa,MAAA,CAAO,UAAA;AAAA,YAC7B;AACA,YAAA,MAAM,UAAU,MAAA,CAAO;AAAA,cACrB,OAAA,EAAS,CAAC,MAAM,CAAA;AAAA,cAChB,eAAA,EAAiB;AAAA,aAClB,CAAA;AAAA,UACH;AACA,UAAA;AAAA,QACF;AAAA,MACF;AAGA,MAAA,IAAI,WAAA,CAAY,WAAW,CAAA,EAAG;AAC5B,QAAA,IAAA,CAAK,MAAA,CAAO,IAAA,CAAK,CAAA,8CAAA,EAAiD,SAAS,CAAA,CAAE,CAAA;AAC7E,QAAA;AAAA,MACF;AAGA,MAAA,MAAM,OAAA,GAAoB,WAAA,CAAY,GAAA,CAAI,CAAA,KAAA,KAAS;AACjD,QAAA,MAAM,MAAA,GAAiB,EAAE,EAAA,EAAI,KAAA,EAAM;AACnC,QAAA,IAAI,MAAA,CAAO,MAAA,EAAQ,MAAA,CAAO,MAAA,GAAS,MAAA,CAAO,MAAA;AAC1C,QAAA,IAAI,MAAA,CAAO,QAAA,EAAU,MAAA,CAAO,UAAA,GAAa,MAAA,CAAO,QAAA;AAChD,QAAA,OAAO,MAAA;AAAA,MACT,CAAC,CAAA;AAGD,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,UAAU,MAAA,CAAO;AAAA,UACrB,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SAClB,CAAA;AAAA,MACH;AAAA,IACF,SAASJ,OAAA,EAAY;AACnB,MAAA,IAAIA,OAAA,YAAiBC,mBAAa,MAAMD,OAAA;AACxC,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,QAAQ,CAAA;AAAA,UAChE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS;AAAA,YACP,SAAA;AAAA,YACA,GAAI,EAAA,IAAM,EAAE,EAAA,EAAG;AAAA,YACf,GAAI,MAAA,IAAU,EAAE,QAAQ,IAAA,CAAK,SAAA,CAAU,MAAM,CAAA;AAAE;AACjD,SACF;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,IAAG,EAAsC;AACvE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,MAAA,CAAO,EAAE,KAAK,CAAC,EAAE,GAAG,CAAA;AAAA,IACtC,SAASA,OAAA,EAAY;AACnB,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,QAAQ,CAAA;AAAA,UAChE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAW,MAAA,EAAQ,KAAI,EAAgE;AAE3G,IAAA,IAAI,OAAO,MAAA,EAAQ;AACjB,MAAA,MAAM,IAAIC,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,oBAAoB,CAAA;AAAA,QAC7E,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,uCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,GAAA,IAAO,CAAC,MAAA,EAAQ;AACnB,MAAA,MAAM,IAAIH,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,WAAW,CAAA;AAAA,QACpE,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,uCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAGA,IAAA,IAAI,GAAA,IAAO,GAAA,CAAI,MAAA,KAAW,CAAA,EAAG;AAC3B,MAAA,MAAM,IAAIH,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,WAAW,CAAA;AAAA,QACpE,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,2BAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,UAAU,MAAA,CAAO,IAAA,CAAK,MAAM,CAAA,CAAE,WAAW,CAAA,EAAG;AAC9C,MAAA,MAAM,IAAIH,iBAAA,CAAY;AAAA,QACpB,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,cAAc,CAAA;AAAA,QACvE,QAAQC,iBAAA,CAAY,OAAA;AAAA,QACpB,UAAUC,mBAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,kCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,IAAI,cAAwB,EAAC;AAE7B,MAAA,IAAI,GAAA,EAAK;AACP,QAAA,WAAA,GAAc,GAAA;AAAA,MAChB,WAAW,MAAA,EAAQ;AAEjB,QAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,QAAA,IAAI,CAAC,WAAA,EAAa;AAChB,UAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,QAC3D;AAEA,QAAA,MAAM,WAAA,GAAc,IAAI,KAAA,CAAM,WAAA,CAAY,SAAS,CAAA,CAAE,IAAA,CAAK,CAAA,GAAI,IAAA,CAAK,IAAA,CAAK,WAAA,CAAY,SAAS,CAAC,CAAA;AAC9F,QAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAE/D,QAAA,MAAM,OAAA,GAAU,MAAM,SAAA,CAAU,KAAA,CAAM;AAAA,UACpC,MAAA,EAAQ,WAAA;AAAA,UACR,KAAA,EAAO,GAAA;AAAA;AAAA,UACP,OAAA,EAAS,gBAAA;AAAA,UACT,eAAA,EAAiB,KAAA;AAAA,UACjB,oBAAoB;AAAC,SACtB,CAAA;AAED,QAAA,WAAA,GAAc,QAAQ,GAAA,CAAI,CAAA,CAAA,KAAK,MAAA,CAAO,CAAA,CAAE,EAAE,CAAC,CAAA;AAAA,MAC7C;AAGA,MAAA,IAAI,WAAA,CAAY,WAAW,CAAA,EAAG;AAC5B,QAAA,IAAA,CAAK,MAAA,CAAO,IAAA,CAAK,CAAA,gDAAA,EAAmD,SAAS,CAAA,CAAE,CAAA;AAC/E,QAAA;AAAA,MACF;AAGA,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,WAAA,CAAY,MAAA,EAAQ,KAAK,SAAA,EAAW;AACtD,QAAA,MAAM,KAAA,GAAQ,WAAA,CAAY,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAChD,QAAA,MAAM,SAAA,CAAU,MAAA,CAAO,EAAE,GAAA,EAAK,OAAO,CAAA;AAAA,MACvC;AAAA,IACF,SAASJ,OAAA,EAAY;AACnB,MAAA,IAAIA,OAAA,YAAiBC,mBAAa,MAAMD,OAAA;AACxC,MAAA,MAAM,IAAIC,iBAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAIC,2BAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,QAAQ,CAAA;AAAA,UACjE,QAAQC,iBAAA,CAAY,OAAA;AAAA,UACpB,UAAUC,mBAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS;AAAA,YACP,SAAA;AAAA,YACA,GAAI,MAAA,IAAU,EAAE,QAAQ,IAAA,CAAK,SAAA,CAAU,MAAM,CAAA,EAAE;AAAA,YAC/C,GAAI,GAAA,IAAO,EAAE,QAAA,EAAU,IAAI,MAAA;AAAO;AACpC,SACF;AAAA,QACAJ;AAAA,OACF;AAAA,IACF;AAAA,EACF;AACF","file":"index.cjs","sourcesContent":["import type {\n OperatorSupport,\n VectorFilter,\n OperatorValueMap,\n LogicalOperatorValueMap,\n BlacklistedRootOperators,\n} from '@mastra/core/vector/filter';\nimport { BaseFilterTranslator } from '@mastra/core/vector/filter';\nimport type { FilterCondition, FilterConnective, FilterOperator, Filters } from '@turbopuffer/turbopuffer';\n\ntype TurbopufferOperatorValueMap = Omit<OperatorValueMap, '$regex' | '$options' | '$elemMatch'>;\n\ntype TurbopufferLogicalOperatorValueMap = Omit<LogicalOperatorValueMap, '$nor' | '$not'>;\n\ntype TurbopufferBlacklistedRootOperators = BlacklistedRootOperators | '$nor' | '$not';\n\nexport type TurbopufferVectorFilter = VectorFilter<\n keyof TurbopufferOperatorValueMap,\n TurbopufferOperatorValueMap,\n TurbopufferLogicalOperatorValueMap,\n TurbopufferBlacklistedRootOperators\n>;\n\n/**\n * Translator for converting Mastra filters to Turbopuffer format\n *\n * Mastra filters: { field: { $gt: 10 } }\n * Turbopuffer filters: [\"And\", [[\"field\", \"Gt\", 10]]]\n */\nexport class TurbopufferFilterTranslator extends BaseFilterTranslator<TurbopufferVectorFilter, Filters | undefined> {\n protected override getSupportedOperators(): OperatorSupport {\n return {\n ...BaseFilterTranslator.DEFAULT_OPERATORS,\n logical: ['$and', '$or'],\n array: ['$in', '$nin', '$all'],\n element: ['$exists'],\n regex: [], // No regex support in Turbopuffer\n custom: [], // No custom operators\n };\n }\n\n /**\n * Map Mastra operators to Turbopuffer operators\n */\n private operatorMap: Record<string, FilterOperator> = {\n $eq: 'Eq',\n $ne: 'NotEq',\n $gt: 'Gt',\n $gte: 'Gte',\n $lt: 'Lt',\n $lte: 'Lte',\n $in: 'In',\n $nin: 'NotIn',\n };\n\n /**\n * Convert the Mastra filter to Turbopuffer format\n */\n translate(filter?: TurbopufferVectorFilter): Filters | undefined {\n if (this.isEmpty(filter)) {\n return undefined;\n }\n\n // Validate the filter structure before translating\n this.validateFilter(filter);\n\n // Translate the filter\n const result = this.translateNode(filter);\n\n // If we have a single condition (not a logical operator at the top level),\n // wrap it in an implicit AND to match Turbopuffer's expected format\n if (!Array.isArray(result) || result.length !== 2 || (result[0] !== 'And' && result[0] !== 'Or')) {\n return ['And', [result as FilterCondition]];\n }\n\n return result as Filters;\n }\n\n /**\n * Recursively translate a filter node\n */\n private translateNode(node: TurbopufferVectorFilter): Filters | FilterCondition {\n // Handle empty or null nodes\n if (node === null || node === undefined || Object.keys(node).length === 0) {\n return ['And', []];\n }\n\n // Handle primitive values (direct equality comparison)\n if (this.isPrimitive(node)) {\n throw new Error('Direct primitive values not valid in this context for Turbopuffer');\n }\n\n // Handle direct array value (convert to $in)\n if (Array.isArray(node)) {\n throw new Error('Direct array values not valid in this context for Turbopuffer');\n }\n\n const entries = Object.entries(node);\n\n // Process the first operator or field\n if (entries.length === 0) {\n return ['And', []];\n }\n\n const [key, value] = entries[0] as [string, any];\n\n // Handle logical operators\n if (key && this.isLogicalOperator(key)) {\n return this.translateLogical(key, value);\n }\n\n // Multiple fields at top level - implicit AND\n if (entries.length > 1) {\n const conditions = entries.map(([field, fieldValue]) => this.translateFieldCondition(field, fieldValue));\n return ['And', conditions];\n }\n\n // Single field with condition(s)\n return this.translateFieldCondition(key, value);\n }\n\n /**\n * Translate a field condition\n */\n private translateFieldCondition(field: string, value: any): FilterCondition {\n // Handle Date object directly (convert to ISO string)\n if (value instanceof Date) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle primitive value (direct equality)\n if (this.isPrimitive(value)) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle array value (convert to $in)\n if (Array.isArray(value)) {\n return [field, 'In', this.normalizeArrayValues(value)];\n }\n\n // Handle object with operators\n if (typeof value === 'object' && value !== null) {\n const operators = Object.keys(value);\n\n // If multiple operators for the same field, create an AND condition\n if (operators.length > 1) {\n // Check if all keys are operators\n const allOperators = operators.every(op => this.isOperator(op));\n if (allOperators) {\n // For multiple comparison operators on one field\n const conditions = operators.map(op => this.translateOperator(field, op, value[op]));\n return ['And', conditions] as unknown as FilterCondition;\n } else {\n // For nested objects with multiple fields\n const conditions = operators.map(op => {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n });\n return ['And', conditions] as unknown as FilterCondition;\n }\n }\n\n // Single operator\n const op = operators[0];\n if (op && this.isOperator(op)) {\n return this.translateOperator(field, op, value[op]);\n }\n\n // Nested field path (use dot notation)\n if (op && !this.isOperator(op)) {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n }\n }\n\n throw new Error(`Unsupported filter format for field: ${field}`);\n }\n\n /**\n * Translate a logical operator\n */\n private translateLogical(operator: string, conditions: any[]): Filters {\n // Map Mastra logical operators to Turbopuffer\n const logicalOp: FilterConnective = operator === '$and' ? 'And' : 'Or';\n\n // Validate conditions\n if (!Array.isArray(conditions)) {\n throw new Error(`Logical operator ${operator} requires an array of conditions`);\n }\n\n // Translate each condition\n const translatedConditions = conditions.map(condition => {\n if (typeof condition !== 'object' || condition === null) {\n throw new Error(`Invalid condition for logical operator ${operator}`);\n }\n return this.translateNode(condition);\n });\n\n return [logicalOp, translatedConditions];\n }\n\n /**\n * Translate a specific operator\n */\n private translateOperator(field: string, operator: string, value: any): FilterCondition {\n // Handle comparison operators\n if (operator && this.operatorMap[operator]) {\n return [field, this.operatorMap[operator], this.normalizeValue(value)];\n }\n\n // Handle special cases\n switch (operator) {\n case '$exists':\n // $exists: true -> use NotEq with null (field exists if it's not null)\n // $exists: false -> use Eq with null (field doesn't exist if it is null)\n return value ? [field, 'NotEq', null] : [field, 'Eq', null];\n\n case '$all':\n // $all is not directly supported, simulate with AND + IN conditions\n if (!Array.isArray(value) || value.length === 0) {\n throw new Error('$all operator requires a non-empty array');\n }\n\n const allConditions = value.map(item => [field, 'In', [this.normalizeValue(item)]] as FilterCondition);\n\n // Return the array of conditions directly without nesting\n return ['And', allConditions] as unknown as FilterCondition;\n\n default:\n throw new Error(`Unsupported operator: ${operator || 'undefined'}`);\n }\n }\n\n /**\n * Normalize a value for comparison operations\n */\n protected normalizeValue(value: any): any {\n // Handle special value types\n if (value instanceof Date) {\n return value.toISOString();\n }\n return value;\n }\n\n /**\n * Normalize array values\n */\n protected normalizeArrayValues(values: any[]): any[] {\n return values.map(value => this.normalizeValue(value));\n }\n}\n","import { ErrorCategory, ErrorDomain, MastraError } from '@mastra/core/error';\nimport { createVectorErrorId } from '@mastra/core/storage';\nimport type {\n CreateIndexParams,\n DeleteIndexParams,\n DeleteVectorParams,\n DescribeIndexParams,\n IndexStats,\n QueryResult,\n QueryVectorParams,\n UpdateVectorParams,\n UpsertVectorParams,\n DeleteVectorsParams,\n} from '@mastra/core/vector';\nimport { MastraVector } from '@mastra/core/vector';\nimport { Turbopuffer } from '@turbopuffer/turbopuffer';\nimport type { DistanceMetric, QueryResults, Schema, Vector } from '@turbopuffer/turbopuffer';\nimport { TurbopufferFilterTranslator } from './filter';\nimport type { TurbopufferVectorFilter } from './filter';\n\ntype TurbopufferQueryVectorParams = QueryVectorParams<TurbopufferVectorFilter>;\n\nexport interface TurbopufferVectorOptions {\n /** The API key to authenticate with. */\n apiKey: string;\n /** The base URL. Default is https://api.turbopuffer.com. */\n baseUrl?: string;\n /** The timeout to establish a connection, in ms. Default is 10_000. Only applicable in Node and Deno.*/\n connectTimeout?: number;\n /** The socket idle timeout, in ms. Default is 60_000. Only applicable in Node and Deno.*/\n connectionIdleTimeout?: number;\n /** The number of connections to open initially when creating a new client. Default is 0. */\n warmConnections?: number;\n /** Whether to compress requests and accept compressed responses. Default is true. */\n compression?: boolean;\n /**\n * A callback function that takes an index name and returns a config object for that index.\n * This allows you to define explicit schemas per index.\n *\n * Example:\n * ```typescript\n * schemaConfigForIndex: (indexName: string) => {\n * // Mastra's default embedding model and index for memory messages:\n * if (indexName === \"memory_messages_384\") {\n * return {\n * dimensions: 384,\n * schema: {\n * thread_id: {\n * type: \"string\",\n * filterable: true,\n * },\n * },\n * };\n * } else {\n * throw new Error(`TODO: add schema for index: ${indexName}`);\n * }\n * },\n * ```\n */\n schemaConfigForIndex?: (indexName: string) => {\n dimensions: number;\n schema: Schema;\n };\n}\n\nexport class TurbopufferVector extends MastraVector<TurbopufferVectorFilter> {\n private client: Turbopuffer;\n private filterTranslator: TurbopufferFilterTranslator;\n // There is no explicit create index operation in Turbopuffer, so just register that\n // someone has called createIndex() and verify that subsequent upsert calls are consistent\n // with how the index was \"created\"\n private createIndexCache: Map<\n string,\n CreateIndexParams & {\n tpufDistanceMetric: DistanceMetric;\n }\n > = new Map();\n private opts: TurbopufferVectorOptions;\n\n constructor(opts: TurbopufferVectorOptions & { id: string }) {\n super({ id: opts.id });\n this.filterTranslator = new TurbopufferFilterTranslator();\n this.opts = opts;\n this.client = new Turbopuffer(opts);\n }\n\n async createIndex({ indexName, dimension, metric }: CreateIndexParams): Promise<void> {\n metric = metric ?? 'cosine'; // default to cosine distance\n let distanceMetric: DistanceMetric = 'cosine_distance';\n try {\n if (this.createIndexCache.has(indexName)) {\n // verify that the dimensions and distance metric match what we expect\n const expected = this.createIndexCache.get(indexName)!;\n if (dimension !== expected.dimension || metric !== expected.metric) {\n throw new Error(\n `createIndex() called more than once with inconsistent inputs. Index ${indexName} expected dimensions=${expected.dimension} and metric=${expected.metric} but got dimensions=${dimension} and metric=${metric}`,\n );\n }\n return;\n }\n if (dimension <= 0) {\n throw new Error('Dimension must be a positive integer');\n }\n switch (metric) {\n case 'cosine':\n distanceMetric = 'cosine_distance';\n break;\n case 'euclidean':\n distanceMetric = 'euclidean_squared';\n break;\n case 'dotproduct':\n throw new Error('dotproduct is not supported in Turbopuffer');\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'CREATE_INDEX', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName, dimension, metric },\n },\n error,\n );\n }\n\n this.createIndexCache.set(indexName, {\n indexName,\n dimension,\n metric,\n tpufDistanceMetric: distanceMetric,\n });\n }\n\n async upsert({ indexName, vectors, metadata, ids }: UpsertVectorParams): Promise<string[]> {\n let index;\n let createIndex;\n try {\n if (vectors.length === 0) {\n throw new Error('upsert() called with empty vectors');\n }\n\n index = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPSERT', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n const distanceMetric = createIndex.tpufDistanceMetric;\n const vectorIds = ids || vectors.map(() => crypto.randomUUID());\n const records: Vector[] = vectors.map((vector, i) => ({\n id: vectorIds[i]!,\n vector: vector,\n attributes: metadata?.[i] || {},\n }));\n\n // limit is 256 MB per upsert request, so set a reasonable batch size here that will stay under that for most cases\n // https://turbopuffer.com/docs/limits\n const batchSize = 100;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n const upsertOptions: {\n vectors: Vector[];\n distance_metric: DistanceMetric;\n schema?: Schema;\n batchSize?: number;\n } = {\n vectors: batch,\n distance_metric: distanceMetric,\n };\n\n // Use the schemaForIndex callback if provided\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n upsertOptions.schema = schemaConfig.schema;\n if (vectors[0]?.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to upsert vectors[0].length=${vectors[0]?.length}`,\n );\n }\n }\n\n await index.upsert(upsertOptions);\n }\n\n return vectorIds;\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPSERT', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async query({\n indexName,\n queryVector,\n topK,\n filter,\n includeVector,\n }: TurbopufferQueryVectorParams): Promise<QueryResult[]> {\n let createIndex;\n try {\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n if (queryVector.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to query with queryVector.length=${queryVector.length}`,\n );\n }\n }\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'QUERY', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n const distanceMetric = createIndex.tpufDistanceMetric;\n try {\n const index = this.client.namespace(indexName);\n const translatedFilter = this.filterTranslator.translate(filter);\n const results: QueryResults = await index.query({\n distance_metric: distanceMetric,\n vector: queryVector,\n top_k: topK,\n filters: translatedFilter,\n include_vectors: includeVector,\n include_attributes: true,\n consistency: { level: 'strong' }, // todo: make this configurable somehow?\n });\n return results.map(item => ({\n id: String(item.id),\n score: typeof item.dist === 'number' ? item.dist : 0,\n metadata: item.attributes || {},\n ...(includeVector && item.vector ? { vector: item.vector } : {}),\n }));\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'QUERY', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async listIndexes(): Promise<string[]> {\n try {\n const namespacesResult = await this.client.namespaces({});\n return namespacesResult.namespaces.map(namespace => namespace.id);\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'LIST_INDEXES', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n },\n error,\n );\n }\n }\n\n /**\n * Retrieves statistics about a vector index.\n *\n * @param {string} indexName - The name of the index to describe\n * @returns A promise that resolves to the index statistics including dimension, count and metric\n */\n async describeIndex({ indexName }: DescribeIndexParams): Promise<IndexStats> {\n try {\n const namespace = this.client.namespace(indexName);\n const metadata = await namespace.metadata();\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n const dimension = metadata.dimensions;\n const count = metadata.approx_count;\n return {\n dimension,\n count,\n metric: createIndex.metric,\n };\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DESCRIBE_INDEX', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteIndex({ indexName }: DeleteIndexParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.deleteAll();\n this.createIndexCache.delete(indexName);\n } catch (error: any) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_INDEX', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Updates a vector by its ID or filter with the provided vector and/or metadata.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to update.\n * @param filter - The filter to match vectors to update.\n * @param update - An object containing the vector and/or metadata to update.\n * @param update.vector - An optional array of numbers representing the new vector.\n * @param update.metadata - An optional record containing the new metadata.\n * @returns A promise that resolves when the update is complete.\n * @throws Will throw an error if no updates are provided or if the update operation fails.\n */\n async updateVector({ indexName, id, filter, update }: UpdateVectorParams<TurbopufferVectorFilter>): Promise<void> {\n // Validate mutually exclusive parameters\n if (id && filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'MUTUALLY_EXCLUSIVE'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'id and filter are mutually exclusive',\n details: { indexName },\n });\n }\n\n if (!id && !filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'NO_TARGET'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Either id or filter must be provided',\n details: { indexName },\n });\n }\n\n if (!update.vector && !update.metadata) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'NO_PAYLOAD'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'No update data provided',\n details: { indexName, ...(id && { id }) },\n });\n }\n\n let namespace;\n let createIndex;\n let distanceMetric;\n try {\n namespace = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n distanceMetric = createIndex.tpufDistanceMetric;\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n let idsToUpdate: string[] = [];\n\n if (id) {\n idsToUpdate = [id];\n } else if (filter) {\n // Validate filter is not empty\n if (Object.keys(filter).length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'EMPTY_FILTER'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Filter cannot be an empty object',\n details: { indexName },\n });\n }\n\n // Query for matching vectors to get their IDs\n const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));\n const translatedFilter = this.filterTranslator.translate(filter);\n\n const results = await namespace.query({\n vector: dummyVector,\n top_k: 10000, // Get all matching vectors\n filters: translatedFilter,\n include_vectors: update.vector ? true : false, // Only fetch vectors if we're not replacing them\n include_attributes: ['*'],\n });\n\n idsToUpdate = results.map(r => String(r.id));\n\n // If we're doing a partial update (only metadata or only vector), we need existing data\n if (!update.vector || !update.metadata) {\n for (const result of results) {\n const record: Vector = { id: result.id };\n if (update.vector) {\n record.vector = update.vector;\n } else if (result.vector) {\n record.vector = result.vector;\n }\n if (update.metadata) {\n record.attributes = update.metadata;\n } else if (result.attributes) {\n record.attributes = result.attributes;\n }\n await namespace.upsert({\n vectors: [record],\n distance_metric: distanceMetric,\n });\n }\n return;\n }\n }\n\n // If no vectors to update, return early\n if (idsToUpdate.length === 0) {\n this.logger.info(`No vectors matched the criteria for update in ${indexName}`);\n return;\n }\n\n // Full update - we have both vector and metadata (or just one without needing existing data)\n const records: Vector[] = idsToUpdate.map(vecId => {\n const record: Vector = { id: vecId };\n if (update.vector) record.vector = update.vector;\n if (update.metadata) record.attributes = update.metadata;\n return record;\n });\n\n // Batch updates in chunks of 1000\n const batchSize = 1000;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n await namespace.upsert({\n vectors: batch,\n distance_metric: distanceMetric,\n });\n }\n } catch (error: any) {\n if (error instanceof MastraError) throw error;\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: {\n indexName,\n ...(id && { id }),\n ...(filter && { filter: JSON.stringify(filter) }),\n },\n },\n error,\n );\n }\n }\n\n /**\n * Deletes a vector by its ID.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to delete.\n * @returns A promise that resolves when the deletion is complete.\n * @throws Will throw an error if the deletion operation fails.\n */\n async deleteVector({ indexName, id }: DeleteVectorParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.delete({ ids: [id] });\n } catch (error: any) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTOR', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteVectors({ indexName, filter, ids }: DeleteVectorsParams<TurbopufferVectorFilter>): Promise<void> {\n // Validate mutually exclusive parameters\n if (ids && filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'MUTUALLY_EXCLUSIVE'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'ids and filter are mutually exclusive',\n details: { indexName },\n });\n }\n\n if (!ids && !filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'NO_TARGET'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Either filter or ids must be provided',\n details: { indexName },\n });\n }\n\n // Validate non-empty arrays and objects\n if (ids && ids.length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'EMPTY_IDS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'ids array cannot be empty',\n details: { indexName },\n });\n }\n\n if (filter && Object.keys(filter).length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'EMPTY_FILTER'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Filter cannot be an empty object',\n details: { indexName },\n });\n }\n\n try {\n const namespace = this.client.namespace(indexName);\n let idsToDelete: string[] = [];\n\n if (ids) {\n idsToDelete = ids;\n } else if (filter) {\n // Query for matching vectors to get their IDs\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n\n const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));\n const translatedFilter = this.filterTranslator.translate(filter);\n\n const results = await namespace.query({\n vector: dummyVector,\n top_k: 10000, // Get all matching vectors\n filters: translatedFilter,\n include_vectors: false,\n include_attributes: [],\n });\n\n idsToDelete = results.map(r => String(r.id));\n }\n\n // If no IDs to delete, return early\n if (idsToDelete.length === 0) {\n this.logger.info(`No vectors matched the criteria for deletion in ${indexName}`);\n return;\n }\n\n // The turbopuffer SDK has a limit of 1000 IDs per delete request.\n const batchSize = 1000;\n for (let i = 0; i < idsToDelete.length; i += batchSize) {\n const batch = idsToDelete.slice(i, i + batchSize);\n await namespace.delete({ ids: batch });\n }\n } catch (error: any) {\n if (error instanceof MastraError) throw error;\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: {\n indexName,\n ...(filter && { filter: JSON.stringify(filter) }),\n ...(ids && { idsCount: ids.length }),\n },\n },\n error,\n );\n }\n }\n}\n"]}
|
package/dist/index.js
CHANGED
|
@@ -1,4 +1,5 @@
|
|
|
1
1
|
import { MastraError, ErrorCategory, ErrorDomain } from '@mastra/core/error';
|
|
2
|
+
import { createVectorErrorId } from '@mastra/core/storage';
|
|
2
3
|
import { MastraVector } from '@mastra/core/vector';
|
|
3
4
|
import { Turbopuffer } from '@turbopuffer/turbopuffer';
|
|
4
5
|
import { BaseFilterTranslator } from '@mastra/core/vector/filter';
|
|
@@ -207,7 +208,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
207
208
|
} catch (error) {
|
|
208
209
|
throw new MastraError(
|
|
209
210
|
{
|
|
210
|
-
id: "
|
|
211
|
+
id: createVectorErrorId("TURBOPUFFER", "CREATE_INDEX", "INVALID_ARGS"),
|
|
211
212
|
domain: ErrorDomain.STORAGE,
|
|
212
213
|
category: ErrorCategory.USER,
|
|
213
214
|
details: { indexName, dimension, metric }
|
|
@@ -237,7 +238,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
237
238
|
} catch (error) {
|
|
238
239
|
throw new MastraError(
|
|
239
240
|
{
|
|
240
|
-
id: "
|
|
241
|
+
id: createVectorErrorId("TURBOPUFFER", "UPSERT", "INVALID_ARGS"),
|
|
241
242
|
domain: ErrorDomain.STORAGE,
|
|
242
243
|
category: ErrorCategory.USER,
|
|
243
244
|
details: { indexName }
|
|
@@ -275,7 +276,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
275
276
|
} catch (error) {
|
|
276
277
|
throw new MastraError(
|
|
277
278
|
{
|
|
278
|
-
id: "
|
|
279
|
+
id: createVectorErrorId("TURBOPUFFER", "UPSERT", "FAILED"),
|
|
279
280
|
domain: ErrorDomain.STORAGE,
|
|
280
281
|
category: ErrorCategory.THIRD_PARTY,
|
|
281
282
|
details: { indexName }
|
|
@@ -308,7 +309,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
308
309
|
} catch (error) {
|
|
309
310
|
throw new MastraError(
|
|
310
311
|
{
|
|
311
|
-
id: "
|
|
312
|
+
id: createVectorErrorId("TURBOPUFFER", "QUERY", "INVALID_ARGS"),
|
|
312
313
|
domain: ErrorDomain.STORAGE,
|
|
313
314
|
category: ErrorCategory.USER,
|
|
314
315
|
details: { indexName }
|
|
@@ -339,7 +340,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
339
340
|
} catch (error) {
|
|
340
341
|
throw new MastraError(
|
|
341
342
|
{
|
|
342
|
-
id: "
|
|
343
|
+
id: createVectorErrorId("TURBOPUFFER", "QUERY", "FAILED"),
|
|
343
344
|
domain: ErrorDomain.STORAGE,
|
|
344
345
|
category: ErrorCategory.THIRD_PARTY,
|
|
345
346
|
details: { indexName }
|
|
@@ -355,7 +356,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
355
356
|
} catch (error) {
|
|
356
357
|
throw new MastraError(
|
|
357
358
|
{
|
|
358
|
-
id: "
|
|
359
|
+
id: createVectorErrorId("TURBOPUFFER", "LIST_INDEXES", "FAILED"),
|
|
359
360
|
domain: ErrorDomain.STORAGE,
|
|
360
361
|
category: ErrorCategory.THIRD_PARTY
|
|
361
362
|
},
|
|
@@ -387,7 +388,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
387
388
|
} catch (error) {
|
|
388
389
|
throw new MastraError(
|
|
389
390
|
{
|
|
390
|
-
id: "
|
|
391
|
+
id: createVectorErrorId("TURBOPUFFER", "DESCRIBE_INDEX", "FAILED"),
|
|
391
392
|
domain: ErrorDomain.STORAGE,
|
|
392
393
|
category: ErrorCategory.THIRD_PARTY,
|
|
393
394
|
details: { indexName }
|
|
@@ -404,7 +405,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
404
405
|
} catch (error) {
|
|
405
406
|
throw new MastraError(
|
|
406
407
|
{
|
|
407
|
-
id: "
|
|
408
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_INDEX", "FAILED"),
|
|
408
409
|
domain: ErrorDomain.STORAGE,
|
|
409
410
|
category: ErrorCategory.THIRD_PARTY,
|
|
410
411
|
details: { indexName }
|
|
@@ -414,20 +415,47 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
414
415
|
}
|
|
415
416
|
}
|
|
416
417
|
/**
|
|
417
|
-
* Updates a vector by its ID with the provided vector and/or metadata.
|
|
418
|
+
* Updates a vector by its ID or filter with the provided vector and/or metadata.
|
|
418
419
|
* @param indexName - The name of the index containing the vector.
|
|
419
420
|
* @param id - The ID of the vector to update.
|
|
421
|
+
* @param filter - The filter to match vectors to update.
|
|
420
422
|
* @param update - An object containing the vector and/or metadata to update.
|
|
421
423
|
* @param update.vector - An optional array of numbers representing the new vector.
|
|
422
424
|
* @param update.metadata - An optional record containing the new metadata.
|
|
423
425
|
* @returns A promise that resolves when the update is complete.
|
|
424
426
|
* @throws Will throw an error if no updates are provided or if the update operation fails.
|
|
425
427
|
*/
|
|
426
|
-
async updateVector({ indexName, id, update }) {
|
|
428
|
+
async updateVector({ indexName, id, filter, update }) {
|
|
429
|
+
if (id && filter) {
|
|
430
|
+
throw new MastraError({
|
|
431
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "MUTUALLY_EXCLUSIVE"),
|
|
432
|
+
domain: ErrorDomain.STORAGE,
|
|
433
|
+
category: ErrorCategory.USER,
|
|
434
|
+
text: "id and filter are mutually exclusive",
|
|
435
|
+
details: { indexName }
|
|
436
|
+
});
|
|
437
|
+
}
|
|
438
|
+
if (!id && !filter) {
|
|
439
|
+
throw new MastraError({
|
|
440
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "NO_TARGET"),
|
|
441
|
+
domain: ErrorDomain.STORAGE,
|
|
442
|
+
category: ErrorCategory.USER,
|
|
443
|
+
text: "Either id or filter must be provided",
|
|
444
|
+
details: { indexName }
|
|
445
|
+
});
|
|
446
|
+
}
|
|
447
|
+
if (!update.vector && !update.metadata) {
|
|
448
|
+
throw new MastraError({
|
|
449
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "NO_PAYLOAD"),
|
|
450
|
+
domain: ErrorDomain.STORAGE,
|
|
451
|
+
category: ErrorCategory.USER,
|
|
452
|
+
text: "No update data provided",
|
|
453
|
+
details: { indexName, ...id && { id } }
|
|
454
|
+
});
|
|
455
|
+
}
|
|
427
456
|
let namespace;
|
|
428
457
|
let createIndex;
|
|
429
458
|
let distanceMetric;
|
|
430
|
-
let record;
|
|
431
459
|
try {
|
|
432
460
|
namespace = this.client.namespace(indexName);
|
|
433
461
|
createIndex = this.createIndexCache.get(indexName);
|
|
@@ -435,13 +463,10 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
435
463
|
throw new Error(`createIndex() not called for this index`);
|
|
436
464
|
}
|
|
437
465
|
distanceMetric = createIndex.tpufDistanceMetric;
|
|
438
|
-
record = { id };
|
|
439
|
-
if (update.vector) record.vector = update.vector;
|
|
440
|
-
if (update.metadata) record.attributes = update.metadata;
|
|
441
466
|
} catch (error) {
|
|
442
467
|
throw new MastraError(
|
|
443
468
|
{
|
|
444
|
-
id: "
|
|
469
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "INVALID_ARGS"),
|
|
445
470
|
domain: ErrorDomain.STORAGE,
|
|
446
471
|
category: ErrorCategory.USER,
|
|
447
472
|
details: { indexName }
|
|
@@ -450,17 +475,82 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
450
475
|
);
|
|
451
476
|
}
|
|
452
477
|
try {
|
|
453
|
-
|
|
454
|
-
|
|
455
|
-
|
|
478
|
+
let idsToUpdate = [];
|
|
479
|
+
if (id) {
|
|
480
|
+
idsToUpdate = [id];
|
|
481
|
+
} else if (filter) {
|
|
482
|
+
if (Object.keys(filter).length === 0) {
|
|
483
|
+
throw new MastraError({
|
|
484
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "EMPTY_FILTER"),
|
|
485
|
+
domain: ErrorDomain.STORAGE,
|
|
486
|
+
category: ErrorCategory.USER,
|
|
487
|
+
text: "Filter cannot be an empty object",
|
|
488
|
+
details: { indexName }
|
|
489
|
+
});
|
|
490
|
+
}
|
|
491
|
+
const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));
|
|
492
|
+
const translatedFilter = this.filterTranslator.translate(filter);
|
|
493
|
+
const results = await namespace.query({
|
|
494
|
+
vector: dummyVector,
|
|
495
|
+
top_k: 1e4,
|
|
496
|
+
// Get all matching vectors
|
|
497
|
+
filters: translatedFilter,
|
|
498
|
+
include_vectors: update.vector ? true : false,
|
|
499
|
+
// Only fetch vectors if we're not replacing them
|
|
500
|
+
include_attributes: ["*"]
|
|
501
|
+
});
|
|
502
|
+
idsToUpdate = results.map((r) => String(r.id));
|
|
503
|
+
if (!update.vector || !update.metadata) {
|
|
504
|
+
for (const result of results) {
|
|
505
|
+
const record = { id: result.id };
|
|
506
|
+
if (update.vector) {
|
|
507
|
+
record.vector = update.vector;
|
|
508
|
+
} else if (result.vector) {
|
|
509
|
+
record.vector = result.vector;
|
|
510
|
+
}
|
|
511
|
+
if (update.metadata) {
|
|
512
|
+
record.attributes = update.metadata;
|
|
513
|
+
} else if (result.attributes) {
|
|
514
|
+
record.attributes = result.attributes;
|
|
515
|
+
}
|
|
516
|
+
await namespace.upsert({
|
|
517
|
+
vectors: [record],
|
|
518
|
+
distance_metric: distanceMetric
|
|
519
|
+
});
|
|
520
|
+
}
|
|
521
|
+
return;
|
|
522
|
+
}
|
|
523
|
+
}
|
|
524
|
+
if (idsToUpdate.length === 0) {
|
|
525
|
+
this.logger.info(`No vectors matched the criteria for update in ${indexName}`);
|
|
526
|
+
return;
|
|
527
|
+
}
|
|
528
|
+
const records = idsToUpdate.map((vecId) => {
|
|
529
|
+
const record = { id: vecId };
|
|
530
|
+
if (update.vector) record.vector = update.vector;
|
|
531
|
+
if (update.metadata) record.attributes = update.metadata;
|
|
532
|
+
return record;
|
|
456
533
|
});
|
|
534
|
+
const batchSize = 1e3;
|
|
535
|
+
for (let i = 0; i < records.length; i += batchSize) {
|
|
536
|
+
const batch = records.slice(i, i + batchSize);
|
|
537
|
+
await namespace.upsert({
|
|
538
|
+
vectors: batch,
|
|
539
|
+
distance_metric: distanceMetric
|
|
540
|
+
});
|
|
541
|
+
}
|
|
457
542
|
} catch (error) {
|
|
543
|
+
if (error instanceof MastraError) throw error;
|
|
458
544
|
throw new MastraError(
|
|
459
545
|
{
|
|
460
|
-
id: "
|
|
546
|
+
id: createVectorErrorId("TURBOPUFFER", "UPDATE_VECTOR", "FAILED"),
|
|
461
547
|
domain: ErrorDomain.STORAGE,
|
|
462
548
|
category: ErrorCategory.THIRD_PARTY,
|
|
463
|
-
details: {
|
|
549
|
+
details: {
|
|
550
|
+
indexName,
|
|
551
|
+
...id && { id },
|
|
552
|
+
...filter && { filter: JSON.stringify(filter) }
|
|
553
|
+
}
|
|
464
554
|
},
|
|
465
555
|
error
|
|
466
556
|
);
|
|
@@ -480,7 +570,7 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
480
570
|
} catch (error) {
|
|
481
571
|
throw new MastraError(
|
|
482
572
|
{
|
|
483
|
-
id: "
|
|
573
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTOR", "FAILED"),
|
|
484
574
|
domain: ErrorDomain.STORAGE,
|
|
485
575
|
category: ErrorCategory.THIRD_PARTY,
|
|
486
576
|
details: { indexName }
|
|
@@ -489,6 +579,91 @@ var TurbopufferVector = class extends MastraVector {
|
|
|
489
579
|
);
|
|
490
580
|
}
|
|
491
581
|
}
|
|
582
|
+
async deleteVectors({ indexName, filter, ids }) {
|
|
583
|
+
if (ids && filter) {
|
|
584
|
+
throw new MastraError({
|
|
585
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "MUTUALLY_EXCLUSIVE"),
|
|
586
|
+
domain: ErrorDomain.STORAGE,
|
|
587
|
+
category: ErrorCategory.USER,
|
|
588
|
+
text: "ids and filter are mutually exclusive",
|
|
589
|
+
details: { indexName }
|
|
590
|
+
});
|
|
591
|
+
}
|
|
592
|
+
if (!ids && !filter) {
|
|
593
|
+
throw new MastraError({
|
|
594
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "NO_TARGET"),
|
|
595
|
+
domain: ErrorDomain.STORAGE,
|
|
596
|
+
category: ErrorCategory.USER,
|
|
597
|
+
text: "Either filter or ids must be provided",
|
|
598
|
+
details: { indexName }
|
|
599
|
+
});
|
|
600
|
+
}
|
|
601
|
+
if (ids && ids.length === 0) {
|
|
602
|
+
throw new MastraError({
|
|
603
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "EMPTY_IDS"),
|
|
604
|
+
domain: ErrorDomain.STORAGE,
|
|
605
|
+
category: ErrorCategory.USER,
|
|
606
|
+
text: "ids array cannot be empty",
|
|
607
|
+
details: { indexName }
|
|
608
|
+
});
|
|
609
|
+
}
|
|
610
|
+
if (filter && Object.keys(filter).length === 0) {
|
|
611
|
+
throw new MastraError({
|
|
612
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "EMPTY_FILTER"),
|
|
613
|
+
domain: ErrorDomain.STORAGE,
|
|
614
|
+
category: ErrorCategory.USER,
|
|
615
|
+
text: "Filter cannot be an empty object",
|
|
616
|
+
details: { indexName }
|
|
617
|
+
});
|
|
618
|
+
}
|
|
619
|
+
try {
|
|
620
|
+
const namespace = this.client.namespace(indexName);
|
|
621
|
+
let idsToDelete = [];
|
|
622
|
+
if (ids) {
|
|
623
|
+
idsToDelete = ids;
|
|
624
|
+
} else if (filter) {
|
|
625
|
+
const createIndex = this.createIndexCache.get(indexName);
|
|
626
|
+
if (!createIndex) {
|
|
627
|
+
throw new Error(`createIndex() not called for this index`);
|
|
628
|
+
}
|
|
629
|
+
const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));
|
|
630
|
+
const translatedFilter = this.filterTranslator.translate(filter);
|
|
631
|
+
const results = await namespace.query({
|
|
632
|
+
vector: dummyVector,
|
|
633
|
+
top_k: 1e4,
|
|
634
|
+
// Get all matching vectors
|
|
635
|
+
filters: translatedFilter,
|
|
636
|
+
include_vectors: false,
|
|
637
|
+
include_attributes: []
|
|
638
|
+
});
|
|
639
|
+
idsToDelete = results.map((r) => String(r.id));
|
|
640
|
+
}
|
|
641
|
+
if (idsToDelete.length === 0) {
|
|
642
|
+
this.logger.info(`No vectors matched the criteria for deletion in ${indexName}`);
|
|
643
|
+
return;
|
|
644
|
+
}
|
|
645
|
+
const batchSize = 1e3;
|
|
646
|
+
for (let i = 0; i < idsToDelete.length; i += batchSize) {
|
|
647
|
+
const batch = idsToDelete.slice(i, i + batchSize);
|
|
648
|
+
await namespace.delete({ ids: batch });
|
|
649
|
+
}
|
|
650
|
+
} catch (error) {
|
|
651
|
+
if (error instanceof MastraError) throw error;
|
|
652
|
+
throw new MastraError(
|
|
653
|
+
{
|
|
654
|
+
id: createVectorErrorId("TURBOPUFFER", "DELETE_VECTORS", "FAILED"),
|
|
655
|
+
domain: ErrorDomain.STORAGE,
|
|
656
|
+
category: ErrorCategory.THIRD_PARTY,
|
|
657
|
+
details: {
|
|
658
|
+
indexName,
|
|
659
|
+
...filter && { filter: JSON.stringify(filter) },
|
|
660
|
+
...ids && { idsCount: ids.length }
|
|
661
|
+
}
|
|
662
|
+
},
|
|
663
|
+
error
|
|
664
|
+
);
|
|
665
|
+
}
|
|
666
|
+
}
|
|
492
667
|
};
|
|
493
668
|
|
|
494
669
|
export { TurbopufferVector };
|
package/dist/index.js.map
CHANGED
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"sources":["../src/vector/filter.ts","../src/vector/index.ts"],"names":["op"],"mappings":";;;;;;AA6BO,IAAM,2BAAA,GAAN,cAA0C,oBAAA,CAAmE;AAAA,EAC/F,qBAAA,GAAyC;AAC1D,IAAA,OAAO;AAAA,MACL,GAAG,oBAAA,CAAqB,iBAAA;AAAA,MACxB,OAAA,EAAS,CAAC,MAAA,EAAQ,KAAK,CAAA;AAAA,MACvB,KAAA,EAAO,CAAC,KAAA,EAAO,MAAA,EAAQ,MAAM,CAAA;AAAA,MAC7B,OAAA,EAAS,CAAC,SAAS,CAAA;AAAA,MACnB,OAAO,EAAC;AAAA;AAAA,MACR,QAAQ;AAAC;AAAA,KACX;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKQ,WAAA,GAA8C;AAAA,IACpD,GAAA,EAAK,IAAA;AAAA,IACL,GAAA,EAAK,OAAA;AAAA,IACL,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM;AAAA,GACR;AAAA;AAAA;AAAA;AAAA,EAKA,UAAU,MAAA,EAAuD;AAC/D,IAAA,IAAI,IAAA,CAAK,OAAA,CAAQ,MAAM,CAAA,EAAG;AACxB,MAAA,OAAO,MAAA;AAAA,IACT;AAGA,IAAA,IAAA,CAAK,eAAe,MAAM,CAAA;AAG1B,IAAA,MAAM,MAAA,GAAS,IAAA,CAAK,aAAA,CAAc,MAAM,CAAA;AAIxC,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,MAAM,KAAK,MAAA,CAAO,MAAA,KAAW,CAAA,IAAM,MAAA,CAAO,CAAC,CAAA,KAAM,KAAA,IAAS,MAAA,CAAO,CAAC,MAAM,IAAA,EAAO;AAChG,MAAA,OAAO,CAAC,KAAA,EAAO,CAAC,MAAyB,CAAC,CAAA;AAAA,IAC5C;AAEA,IAAA,OAAO,MAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKQ,cAAc,IAAA,EAA0D;AAE9E,IAAA,IAAI,IAAA,KAAS,QAAQ,IAAA,KAAS,MAAA,IAAa,OAAO,IAAA,CAAK,IAAI,CAAA,CAAE,MAAA,KAAW,CAAA,EAAG;AACzE,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,IAAI,CAAA,EAAG;AAC1B,MAAA,MAAM,IAAI,MAAM,mEAAmE,CAAA;AAAA,IACrF;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,IAAI,CAAA,EAAG;AACvB,MAAA,MAAM,IAAI,MAAM,+DAA+D,CAAA;AAAA,IACjF;AAEA,IAAA,MAAM,OAAA,GAAU,MAAA,CAAO,OAAA,CAAQ,IAAI,CAAA;AAGnC,IAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAEA,IAAA,MAAM,CAAC,GAAA,EAAK,KAAK,CAAA,GAAI,QAAQ,CAAC,CAAA;AAG9B,IAAA,IAAI,GAAA,IAAO,IAAA,CAAK,iBAAA,CAAkB,GAAG,CAAA,EAAG;AACtC,MAAA,OAAO,IAAA,CAAK,gBAAA,CAAiB,GAAA,EAAK,KAAK,CAAA;AAAA,IACzC;AAGA,IAAA,IAAI,OAAA,CAAQ,SAAS,CAAA,EAAG;AACtB,MAAA,MAAM,UAAA,GAAa,OAAA,CAAQ,GAAA,CAAI,CAAC,CAAC,KAAA,EAAO,UAAU,CAAA,KAAM,IAAA,CAAK,uBAAA,CAAwB,KAAA,EAAO,UAAU,CAAC,CAAA;AACvG,MAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,IAC3B;AAGA,IAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,GAAA,EAAK,KAAK,CAAA;AAAA,EAChD;AAAA;AAAA;AAAA;AAAA,EAKQ,uBAAA,CAAwB,OAAe,KAAA,EAA6B;AAE1E,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,KAAK,CAAA,EAAG;AAC3B,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,oBAAA,CAAqB,KAAK,CAAC,CAAA;AAAA,IACvD;AAGA,IAAA,IAAI,OAAO,KAAA,KAAU,QAAA,IAAY,KAAA,KAAU,IAAA,EAAM;AAC/C,MAAA,MAAM,SAAA,GAAY,MAAA,CAAO,IAAA,CAAK,KAAK,CAAA;AAGnC,MAAA,IAAI,SAAA,CAAU,SAAS,CAAA,EAAG;AAExB,QAAA,MAAM,YAAA,GAAe,UAAU,KAAA,CAAM,CAAAA,QAAM,IAAA,CAAK,UAAA,CAAWA,GAAE,CAAC,CAAA;AAC9D,QAAA,IAAI,YAAA,EAAc;AAEhB,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM,IAAA,CAAK,iBAAA,CAAkB,KAAA,EAAOA,GAAAA,EAAI,KAAA,CAAMA,GAAE,CAAC,CAAC,CAAA;AACnF,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B,CAAA,MAAO;AAEL,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM;AACrC,YAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAIA,GAAE,CAAA,CAAA;AAClC,YAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAMA,GAAE,CAAC,CAAA;AAAA,UAC5D,CAAC,CAAA;AACD,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B;AAAA,MACF;AAGA,MAAA,MAAM,EAAA,GAAK,UAAU,CAAC,CAAA;AACtB,MAAA,IAAI,EAAA,IAAM,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC7B,QAAA,OAAO,KAAK,iBAAA,CAAkB,KAAA,EAAO,EAAA,EAAI,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MACpD;AAGA,MAAA,IAAI,EAAA,IAAM,CAAC,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC9B,QAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAI,EAAE,CAAA,CAAA;AAClC,QAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MAC5D;AAAA,IACF;AAEA,IAAA,MAAM,IAAI,KAAA,CAAM,CAAA,qCAAA,EAAwC,KAAK,CAAA,CAAE,CAAA;AAAA,EACjE;AAAA;AAAA;AAAA;AAAA,EAKQ,gBAAA,CAAiB,UAAkB,UAAA,EAA4B;AAErE,IAAA,MAAM,SAAA,GAA8B,QAAA,KAAa,MAAA,GAAS,KAAA,GAAQ,IAAA;AAGlE,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,UAAU,CAAA,EAAG;AAC9B,MAAA,MAAM,IAAI,KAAA,CAAM,CAAA,iBAAA,EAAoB,QAAQ,CAAA,gCAAA,CAAkC,CAAA;AAAA,IAChF;AAGA,IAAA,MAAM,oBAAA,GAAuB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa;AACvD,MAAA,IAAI,OAAO,SAAA,KAAc,QAAA,IAAY,SAAA,KAAc,IAAA,EAAM;AACvD,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,uCAAA,EAA0C,QAAQ,CAAA,CAAE,CAAA;AAAA,MACtE;AACA,MAAA,OAAO,IAAA,CAAK,cAAc,SAAS,CAAA;AAAA,IACrC,CAAC,CAAA;AAED,IAAA,OAAO,CAAC,WAAW,oBAAoB,CAAA;AAAA,EACzC;AAAA;AAAA;AAAA;AAAA,EAKQ,iBAAA,CAAkB,KAAA,EAAe,QAAA,EAAkB,KAAA,EAA6B;AAEtF,IAAA,IAAI,QAAA,IAAY,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG;AAC1C,MAAA,OAAO,CAAC,OAAO,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACvE;AAGA,IAAA,QAAQ,QAAA;AAAU,MAChB,KAAK,SAAA;AAGH,QAAA,OAAO,KAAA,GAAQ,CAAC,KAAA,EAAO,OAAA,EAAS,IAAI,CAAA,GAAI,CAAC,KAAA,EAAO,IAAA,EAAM,IAAI,CAAA;AAAA,MAE5D,KAAK,MAAA;AAEH,QAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,IAAK,KAAA,CAAM,WAAW,CAAA,EAAG;AAC/C,UAAA,MAAM,IAAI,MAAM,0CAA0C,CAAA;AAAA,QAC5D;AAEA,QAAA,MAAM,aAAA,GAAgB,KAAA,CAAM,GAAA,CAAI,CAAA,IAAA,KAAQ,CAAC,KAAA,EAAO,IAAA,EAAM,CAAC,IAAA,CAAK,cAAA,CAAe,IAAI,CAAC,CAAC,CAAoB,CAAA;AAGrG,QAAA,OAAO,CAAC,OAAO,aAAa,CAAA;AAAA,MAE9B;AACE,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,sBAAA,EAAyB,QAAA,IAAY,WAAW,CAAA,CAAE,CAAA;AAAA;AACtE,EACF;AAAA;AAAA;AAAA;AAAA,EAKU,eAAe,KAAA,EAAiB;AAExC,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,MAAM,WAAA,EAAY;AAAA,IAC3B;AACA,IAAA,OAAO,KAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKU,qBAAqB,MAAA,EAAsB;AACnD,IAAA,OAAO,OAAO,GAAA,CAAI,CAAA,KAAA,KAAS,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,EACvD;AACF,CAAA;;;AC3LO,IAAM,iBAAA,GAAN,cAAgC,YAAA,CAAsC;AAAA,EACnE,MAAA;AAAA,EACA,gBAAA;AAAA;AAAA;AAAA;AAAA,EAIA,gBAAA,uBAKA,GAAA,EAAI;AAAA,EACJ,IAAA;AAAA,EAER,YAAY,IAAA,EAAiD;AAC3D,IAAA,KAAA,CAAM,EAAE,EAAA,EAAI,IAAA,CAAK,EAAA,EAAI,CAAA;AACrB,IAAA,IAAA,CAAK,gBAAA,GAAmB,IAAI,2BAAA,EAA4B;AACxD,IAAA,IAAA,CAAK,IAAA,GAAO,IAAA;AACZ,IAAA,IAAA,CAAK,MAAA,GAAS,IAAI,WAAA,CAAY,IAAI,CAAA;AAAA,EACpC;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAW,SAAA,EAAW,QAAO,EAAqC;AACpF,IAAA,MAAA,GAAS,MAAA,IAAU,QAAA;AACnB,IAAA,IAAI,cAAA,GAAiC,iBAAA;AACrC,IAAA,IAAI;AACF,MAAA,IAAI,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA,EAAG;AAExC,QAAA,MAAM,QAAA,GAAW,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACpD,QAAA,IAAI,SAAA,KAAc,QAAA,CAAS,SAAA,IAAa,MAAA,KAAW,SAAS,MAAA,EAAQ;AAClE,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,CAAA,oEAAA,EAAuE,SAAS,CAAA,qBAAA,EAAwB,QAAA,CAAS,SAAS,CAAA,YAAA,EAAe,QAAA,CAAS,MAAM,CAAA,oBAAA,EAAuB,SAAS,CAAA,YAAA,EAAe,MAAM,CAAA;AAAA,WAC/M;AAAA,QACF;AACA,QAAA;AAAA,MACF;AACA,MAAA,IAAI,aAAa,CAAA,EAAG;AAClB,QAAA,MAAM,IAAI,MAAM,sCAAsC,CAAA;AAAA,MACxD;AACA,MAAA,QAAQ,MAAA;AAAQ,QACd,KAAK,QAAA;AACH,UAAA,cAAA,GAAiB,iBAAA;AACjB,UAAA;AAAA,QACF,KAAK,WAAA;AACH,UAAA,cAAA,GAAiB,mBAAA;AACjB,UAAA;AAAA,QACF,KAAK,YAAA;AACH,UAAA,MAAM,IAAI,MAAM,4CAA4C,CAAA;AAAA;AAChE,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,sDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA,EAAW,SAAA,EAAW,MAAA;AAAO,SAC1C;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAA,CAAK,gBAAA,CAAiB,IAAI,SAAA,EAAW;AAAA,MACnC,SAAA;AAAA,MACA,SAAA;AAAA,MACA,MAAA;AAAA,MACA,kBAAA,EAAoB;AAAA,KACrB,CAAA;AAAA,EACH;AAAA,EAEA,MAAM,MAAA,CAAO,EAAE,WAAW,OAAA,EAAS,QAAA,EAAU,KAAI,EAA0C;AACzF,IAAA,IAAI,KAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,QAAA,MAAM,IAAI,MAAM,oCAAoC,CAAA;AAAA,MACtD;AAEA,MAAA,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACvC,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,MAAA,MAAM,YAAY,GAAA,IAAO,OAAA,CAAQ,IAAI,MAAM,MAAA,CAAO,YAAY,CAAA;AAC9D,MAAA,MAAM,OAAA,GAAoB,OAAA,CAAQ,GAAA,CAAI,CAAC,QAAQ,CAAA,MAAO;AAAA,QACpD,EAAA,EAAI,UAAU,CAAC,CAAA;AAAA,QACf,MAAA;AAAA,QACA,UAAA,EAAY,QAAA,GAAW,CAAC,CAAA,IAAK;AAAC,OAChC,CAAE,CAAA;AAIF,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,aAAA,GAKF;AAAA,UACF,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SACnB;AAGA,QAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,QAAA,IAAI,YAAA,EAAc;AAChB,UAAA,aAAA,CAAc,SAAS,YAAA,CAAa,MAAA;AACpC,UAAA,IAAI,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAA,KAAW,aAAa,UAAA,EAAY;AAClD,YAAA,MAAM,IAAI,KAAA;AAAA,cACR,CAAA,kBAAA,EAAqB,SAAS,CAAA,gCAAA,EAAmC,YAAA,CAAa,UAAU,CAAA,4CAAA,EAA+C,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAM,CAAA;AAAA,aAC3J;AAAA,UACF;AAAA,QACF;AAEA,QAAA,MAAM,KAAA,CAAM,OAAO,aAAa,CAAA;AAAA,MAClC;AAEA,MAAA,OAAO,SAAA;AAAA,IACT,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,0CAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,KAAA,CAAM;AAAA,IACV,SAAA;AAAA,IACA,WAAA;AAAA,IACA,IAAA;AAAA,IACA,MAAA;AAAA,IACA;AAAA,GACF,EAAyD;AACvD,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,MAAA,IAAI,YAAA,EAAc;AAChB,QAAA,IAAI,WAAA,CAAY,MAAA,KAAW,YAAA,CAAa,UAAA,EAAY;AAClD,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,qBAAqB,SAAS,CAAA,gCAAA,EAAmC,aAAa,UAAU,CAAA,iDAAA,EAAoD,YAAY,MAAM,CAAA;AAAA,WAChK;AAAA,QACF;AAAA,MACF;AACA,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,+CAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,IAAA,IAAI;AACF,MAAA,MAAM,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC7C,MAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAC/D,MAAA,MAAM,OAAA,GAAwB,MAAM,KAAA,CAAM,KAAA,CAAM;AAAA,QAC9C,eAAA,EAAiB,cAAA;AAAA,QACjB,MAAA,EAAQ,WAAA;AAAA,QACR,KAAA,EAAO,IAAA;AAAA,QACP,OAAA,EAAS,gBAAA;AAAA,QACT,eAAA,EAAiB,aAAA;AAAA,QACjB,kBAAA,EAAoB,IAAA;AAAA,QACpB,WAAA,EAAa,EAAE,KAAA,EAAO,QAAA;AAAS;AAAA,OAChC,CAAA;AACD,MAAA,OAAO,OAAA,CAAQ,IAAI,CAAA,IAAA,MAAS;AAAA,QAC1B,EAAA,EAAI,MAAA,CAAO,IAAA,CAAK,EAAE,CAAA;AAAA,QAClB,OAAO,OAAO,IAAA,CAAK,IAAA,KAAS,QAAA,GAAW,KAAK,IAAA,GAAO,CAAA;AAAA,QACnD,QAAA,EAAU,IAAA,CAAK,UAAA,IAAc,EAAC;AAAA,QAC9B,GAAI,iBAAiB,IAAA,CAAK,MAAA,GAAS,EAAE,MAAA,EAAQ,IAAA,CAAK,MAAA,EAAO,GAAI;AAAC,OAChE,CAAE,CAAA;AAAA,IACJ,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,yCAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,GAAiC;AACrC,IAAA,IAAI;AACF,MAAA,MAAM,mBAAmB,MAAM,IAAA,CAAK,MAAA,CAAO,UAAA,CAAW,EAAE,CAAA;AACxD,MAAA,OAAO,gBAAA,CAAiB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa,UAAU,EAAE,CAAA;AAAA,IAClE,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc;AAAA,SAC1B;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAU,EAA6C;AAC3E,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,QAAA,GAAW,MAAM,SAAA,CAAU,QAAA,EAAS;AAC1C,MAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,MAAM,YAAY,QAAA,CAAS,UAAA;AAC3B,MAAA,MAAM,QAAQ,QAAA,CAAS,YAAA;AACvB,MAAA,OAAO;AAAA,QACL,SAAA;AAAA,QACA,KAAA;AAAA,QACA,QAAQ,WAAA,CAAY;AAAA,OACtB;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,kDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAU,EAAqC;AACjE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,SAAA,EAAU;AAC1B,MAAA,IAAA,CAAK,gBAAA,CAAiB,OAAO,SAAS,CAAA;AAAA,IACxC,SAAS,KAAA,EAAY;AACnB,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,gDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAYA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,EAAA,EAAI,QAAO,EAAsC;AAC/E,IAAA,IAAI,SAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI,cAAA;AACJ,IAAA,IAAI,MAAA;AACJ,IAAA,IAAI;AACF,MAAA,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC3C,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,cAAA,GAAiB,WAAA,CAAY,kBAAA;AAC7B,MAAA,MAAA,GAAS,EAAE,EAAA,EAAG;AACd,MAAA,IAAI,MAAA,CAAO,MAAA,EAAQ,MAAA,CAAO,MAAA,GAAS,MAAA,CAAO,MAAA;AAC1C,MAAA,IAAI,MAAA,CAAO,QAAA,EAAU,MAAA,CAAO,UAAA,GAAa,MAAA,CAAO,QAAA;AAAA,IAClD,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,uDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AACA,IAAA,IAAI;AACF,MAAA,MAAM,UAAU,MAAA,CAAO;AAAA,QACrB,OAAA,EAAS,CAAC,MAAM,CAAA;AAAA,QAChB,eAAA,EAAiB;AAAA,OAClB,CAAA;AAAA,IACH,SAAS,KAAA,EAAY;AACnB,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,iDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,IAAG,EAAsC;AACvE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,MAAA,CAAO,EAAE,KAAK,CAAC,EAAE,GAAG,CAAA;AAAA,IACtC,SAAS,KAAA,EAAY;AACnB,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,iDAAA;AAAA,UACJ,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AACF","file":"index.js","sourcesContent":["import type {\n OperatorSupport,\n VectorFilter,\n OperatorValueMap,\n LogicalOperatorValueMap,\n BlacklistedRootOperators,\n} from '@mastra/core/vector/filter';\nimport { BaseFilterTranslator } from '@mastra/core/vector/filter';\nimport type { FilterCondition, FilterConnective, FilterOperator, Filters } from '@turbopuffer/turbopuffer';\n\ntype TurbopufferOperatorValueMap = Omit<OperatorValueMap, '$regex' | '$options' | '$elemMatch'>;\n\ntype TurbopufferLogicalOperatorValueMap = Omit<LogicalOperatorValueMap, '$nor' | '$not'>;\n\ntype TurbopufferBlacklistedRootOperators = BlacklistedRootOperators | '$nor' | '$not';\n\nexport type TurbopufferVectorFilter = VectorFilter<\n keyof TurbopufferOperatorValueMap,\n TurbopufferOperatorValueMap,\n TurbopufferLogicalOperatorValueMap,\n TurbopufferBlacklistedRootOperators\n>;\n\n/**\n * Translator for converting Mastra filters to Turbopuffer format\n *\n * Mastra filters: { field: { $gt: 10 } }\n * Turbopuffer filters: [\"And\", [[\"field\", \"Gt\", 10]]]\n */\nexport class TurbopufferFilterTranslator extends BaseFilterTranslator<TurbopufferVectorFilter, Filters | undefined> {\n protected override getSupportedOperators(): OperatorSupport {\n return {\n ...BaseFilterTranslator.DEFAULT_OPERATORS,\n logical: ['$and', '$or'],\n array: ['$in', '$nin', '$all'],\n element: ['$exists'],\n regex: [], // No regex support in Turbopuffer\n custom: [], // No custom operators\n };\n }\n\n /**\n * Map Mastra operators to Turbopuffer operators\n */\n private operatorMap: Record<string, FilterOperator> = {\n $eq: 'Eq',\n $ne: 'NotEq',\n $gt: 'Gt',\n $gte: 'Gte',\n $lt: 'Lt',\n $lte: 'Lte',\n $in: 'In',\n $nin: 'NotIn',\n };\n\n /**\n * Convert the Mastra filter to Turbopuffer format\n */\n translate(filter?: TurbopufferVectorFilter): Filters | undefined {\n if (this.isEmpty(filter)) {\n return undefined;\n }\n\n // Validate the filter structure before translating\n this.validateFilter(filter);\n\n // Translate the filter\n const result = this.translateNode(filter);\n\n // If we have a single condition (not a logical operator at the top level),\n // wrap it in an implicit AND to match Turbopuffer's expected format\n if (!Array.isArray(result) || result.length !== 2 || (result[0] !== 'And' && result[0] !== 'Or')) {\n return ['And', [result as FilterCondition]];\n }\n\n return result as Filters;\n }\n\n /**\n * Recursively translate a filter node\n */\n private translateNode(node: TurbopufferVectorFilter): Filters | FilterCondition {\n // Handle empty or null nodes\n if (node === null || node === undefined || Object.keys(node).length === 0) {\n return ['And', []];\n }\n\n // Handle primitive values (direct equality comparison)\n if (this.isPrimitive(node)) {\n throw new Error('Direct primitive values not valid in this context for Turbopuffer');\n }\n\n // Handle direct array value (convert to $in)\n if (Array.isArray(node)) {\n throw new Error('Direct array values not valid in this context for Turbopuffer');\n }\n\n const entries = Object.entries(node);\n\n // Process the first operator or field\n if (entries.length === 0) {\n return ['And', []];\n }\n\n const [key, value] = entries[0] as [string, any];\n\n // Handle logical operators\n if (key && this.isLogicalOperator(key)) {\n return this.translateLogical(key, value);\n }\n\n // Multiple fields at top level - implicit AND\n if (entries.length > 1) {\n const conditions = entries.map(([field, fieldValue]) => this.translateFieldCondition(field, fieldValue));\n return ['And', conditions];\n }\n\n // Single field with condition(s)\n return this.translateFieldCondition(key, value);\n }\n\n /**\n * Translate a field condition\n */\n private translateFieldCondition(field: string, value: any): FilterCondition {\n // Handle Date object directly (convert to ISO string)\n if (value instanceof Date) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle primitive value (direct equality)\n if (this.isPrimitive(value)) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle array value (convert to $in)\n if (Array.isArray(value)) {\n return [field, 'In', this.normalizeArrayValues(value)];\n }\n\n // Handle object with operators\n if (typeof value === 'object' && value !== null) {\n const operators = Object.keys(value);\n\n // If multiple operators for the same field, create an AND condition\n if (operators.length > 1) {\n // Check if all keys are operators\n const allOperators = operators.every(op => this.isOperator(op));\n if (allOperators) {\n // For multiple comparison operators on one field\n const conditions = operators.map(op => this.translateOperator(field, op, value[op]));\n return ['And', conditions] as unknown as FilterCondition;\n } else {\n // For nested objects with multiple fields\n const conditions = operators.map(op => {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n });\n return ['And', conditions] as unknown as FilterCondition;\n }\n }\n\n // Single operator\n const op = operators[0];\n if (op && this.isOperator(op)) {\n return this.translateOperator(field, op, value[op]);\n }\n\n // Nested field path (use dot notation)\n if (op && !this.isOperator(op)) {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n }\n }\n\n throw new Error(`Unsupported filter format for field: ${field}`);\n }\n\n /**\n * Translate a logical operator\n */\n private translateLogical(operator: string, conditions: any[]): Filters {\n // Map Mastra logical operators to Turbopuffer\n const logicalOp: FilterConnective = operator === '$and' ? 'And' : 'Or';\n\n // Validate conditions\n if (!Array.isArray(conditions)) {\n throw new Error(`Logical operator ${operator} requires an array of conditions`);\n }\n\n // Translate each condition\n const translatedConditions = conditions.map(condition => {\n if (typeof condition !== 'object' || condition === null) {\n throw new Error(`Invalid condition for logical operator ${operator}`);\n }\n return this.translateNode(condition);\n });\n\n return [logicalOp, translatedConditions];\n }\n\n /**\n * Translate a specific operator\n */\n private translateOperator(field: string, operator: string, value: any): FilterCondition {\n // Handle comparison operators\n if (operator && this.operatorMap[operator]) {\n return [field, this.operatorMap[operator], this.normalizeValue(value)];\n }\n\n // Handle special cases\n switch (operator) {\n case '$exists':\n // $exists: true -> use NotEq with null (field exists if it's not null)\n // $exists: false -> use Eq with null (field doesn't exist if it is null)\n return value ? [field, 'NotEq', null] : [field, 'Eq', null];\n\n case '$all':\n // $all is not directly supported, simulate with AND + IN conditions\n if (!Array.isArray(value) || value.length === 0) {\n throw new Error('$all operator requires a non-empty array');\n }\n\n const allConditions = value.map(item => [field, 'In', [this.normalizeValue(item)]] as FilterCondition);\n\n // Return the array of conditions directly without nesting\n return ['And', allConditions] as unknown as FilterCondition;\n\n default:\n throw new Error(`Unsupported operator: ${operator || 'undefined'}`);\n }\n }\n\n /**\n * Normalize a value for comparison operations\n */\n protected normalizeValue(value: any): any {\n // Handle special value types\n if (value instanceof Date) {\n return value.toISOString();\n }\n return value;\n }\n\n /**\n * Normalize array values\n */\n protected normalizeArrayValues(values: any[]): any[] {\n return values.map(value => this.normalizeValue(value));\n }\n}\n","import { ErrorCategory, ErrorDomain, MastraError } from '@mastra/core/error';\nimport type {\n CreateIndexParams,\n DeleteIndexParams,\n DeleteVectorParams,\n DescribeIndexParams,\n IndexStats,\n QueryResult,\n QueryVectorParams,\n UpdateVectorParams,\n UpsertVectorParams,\n} from '@mastra/core/vector';\nimport { MastraVector } from '@mastra/core/vector';\nimport { Turbopuffer } from '@turbopuffer/turbopuffer';\nimport type { DistanceMetric, QueryResults, Schema, Vector } from '@turbopuffer/turbopuffer';\nimport { TurbopufferFilterTranslator } from './filter';\nimport type { TurbopufferVectorFilter } from './filter';\n\ntype TurbopufferQueryVectorParams = QueryVectorParams<TurbopufferVectorFilter>;\n\nexport interface TurbopufferVectorOptions {\n /** The API key to authenticate with. */\n apiKey: string;\n /** The base URL. Default is https://api.turbopuffer.com. */\n baseUrl?: string;\n /** The timeout to establish a connection, in ms. Default is 10_000. Only applicable in Node and Deno.*/\n connectTimeout?: number;\n /** The socket idle timeout, in ms. Default is 60_000. Only applicable in Node and Deno.*/\n connectionIdleTimeout?: number;\n /** The number of connections to open initially when creating a new client. Default is 0. */\n warmConnections?: number;\n /** Whether to compress requests and accept compressed responses. Default is true. */\n compression?: boolean;\n /**\n * A callback function that takes an index name and returns a config object for that index.\n * This allows you to define explicit schemas per index.\n *\n * Example:\n * ```typescript\n * schemaConfigForIndex: (indexName: string) => {\n * // Mastra's default embedding model and index for memory messages:\n * if (indexName === \"memory_messages_384\") {\n * return {\n * dimensions: 384,\n * schema: {\n * thread_id: {\n * type: \"string\",\n * filterable: true,\n * },\n * },\n * };\n * } else {\n * throw new Error(`TODO: add schema for index: ${indexName}`);\n * }\n * },\n * ```\n */\n schemaConfigForIndex?: (indexName: string) => {\n dimensions: number;\n schema: Schema;\n };\n}\n\nexport class TurbopufferVector extends MastraVector<TurbopufferVectorFilter> {\n private client: Turbopuffer;\n private filterTranslator: TurbopufferFilterTranslator;\n // There is no explicit create index operation in Turbopuffer, so just register that\n // someone has called createIndex() and verify that subsequent upsert calls are consistent\n // with how the index was \"created\"\n private createIndexCache: Map<\n string,\n CreateIndexParams & {\n tpufDistanceMetric: DistanceMetric;\n }\n > = new Map();\n private opts: TurbopufferVectorOptions;\n\n constructor(opts: TurbopufferVectorOptions & { id: string }) {\n super({ id: opts.id });\n this.filterTranslator = new TurbopufferFilterTranslator();\n this.opts = opts;\n this.client = new Turbopuffer(opts);\n }\n\n async createIndex({ indexName, dimension, metric }: CreateIndexParams): Promise<void> {\n metric = metric ?? 'cosine'; // default to cosine distance\n let distanceMetric: DistanceMetric = 'cosine_distance';\n try {\n if (this.createIndexCache.has(indexName)) {\n // verify that the dimensions and distance metric match what we expect\n const expected = this.createIndexCache.get(indexName)!;\n if (dimension !== expected.dimension || metric !== expected.metric) {\n throw new Error(\n `createIndex() called more than once with inconsistent inputs. Index ${indexName} expected dimensions=${expected.dimension} and metric=${expected.metric} but got dimensions=${dimension} and metric=${metric}`,\n );\n }\n return;\n }\n if (dimension <= 0) {\n throw new Error('Dimension must be a positive integer');\n }\n switch (metric) {\n case 'cosine':\n distanceMetric = 'cosine_distance';\n break;\n case 'euclidean':\n distanceMetric = 'euclidean_squared';\n break;\n case 'dotproduct':\n throw new Error('dotproduct is not supported in Turbopuffer');\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_CREATE_INDEX_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName, dimension, metric },\n },\n error,\n );\n }\n\n this.createIndexCache.set(indexName, {\n indexName,\n dimension,\n metric,\n tpufDistanceMetric: distanceMetric,\n });\n }\n\n async upsert({ indexName, vectors, metadata, ids }: UpsertVectorParams): Promise<string[]> {\n let index;\n let createIndex;\n try {\n if (vectors.length === 0) {\n throw new Error('upsert() called with empty vectors');\n }\n\n index = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPSERT_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n const distanceMetric = createIndex.tpufDistanceMetric;\n const vectorIds = ids || vectors.map(() => crypto.randomUUID());\n const records: Vector[] = vectors.map((vector, i) => ({\n id: vectorIds[i]!,\n vector: vector,\n attributes: metadata?.[i] || {},\n }));\n\n // limit is 256 MB per upsert request, so set a reasonable batch size here that will stay under that for most cases\n // https://turbopuffer.com/docs/limits\n const batchSize = 100;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n const upsertOptions: {\n vectors: Vector[];\n distance_metric: DistanceMetric;\n schema?: Schema;\n batchSize?: number;\n } = {\n vectors: batch,\n distance_metric: distanceMetric,\n };\n\n // Use the schemaForIndex callback if provided\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n upsertOptions.schema = schemaConfig.schema;\n if (vectors[0]?.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to upsert vectors[0].length=${vectors[0]?.length}`,\n );\n }\n }\n\n await index.upsert(upsertOptions);\n }\n\n return vectorIds;\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPSERT_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async query({\n indexName,\n queryVector,\n topK,\n filter,\n includeVector,\n }: TurbopufferQueryVectorParams): Promise<QueryResult[]> {\n let createIndex;\n try {\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n if (queryVector.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to query with queryVector.length=${queryVector.length}`,\n );\n }\n }\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_QUERY_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n const distanceMetric = createIndex.tpufDistanceMetric;\n try {\n const index = this.client.namespace(indexName);\n const translatedFilter = this.filterTranslator.translate(filter);\n const results: QueryResults = await index.query({\n distance_metric: distanceMetric,\n vector: queryVector,\n top_k: topK,\n filters: translatedFilter,\n include_vectors: includeVector,\n include_attributes: true,\n consistency: { level: 'strong' }, // todo: make this configurable somehow?\n });\n return results.map(item => ({\n id: String(item.id),\n score: typeof item.dist === 'number' ? item.dist : 0,\n metadata: item.attributes || {},\n ...(includeVector && item.vector ? { vector: item.vector } : {}),\n }));\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_QUERY_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async listIndexes(): Promise<string[]> {\n try {\n const namespacesResult = await this.client.namespaces({});\n return namespacesResult.namespaces.map(namespace => namespace.id);\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_LIST_INDEXES_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n },\n error,\n );\n }\n }\n\n /**\n * Retrieves statistics about a vector index.\n *\n * @param {string} indexName - The name of the index to describe\n * @returns A promise that resolves to the index statistics including dimension, count and metric\n */\n async describeIndex({ indexName }: DescribeIndexParams): Promise<IndexStats> {\n try {\n const namespace = this.client.namespace(indexName);\n const metadata = await namespace.metadata();\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n const dimension = metadata.dimensions;\n const count = metadata.approx_count;\n return {\n dimension,\n count,\n metric: createIndex.metric,\n };\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DESCRIBE_INDEX_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteIndex({ indexName }: DeleteIndexParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.deleteAll();\n this.createIndexCache.delete(indexName);\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DELETE_INDEX_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Updates a vector by its ID with the provided vector and/or metadata.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to update.\n * @param update - An object containing the vector and/or metadata to update.\n * @param update.vector - An optional array of numbers representing the new vector.\n * @param update.metadata - An optional record containing the new metadata.\n * @returns A promise that resolves when the update is complete.\n * @throws Will throw an error if no updates are provided or if the update operation fails.\n */\n async updateVector({ indexName, id, update }: UpdateVectorParams): Promise<void> {\n let namespace;\n let createIndex;\n let distanceMetric;\n let record;\n try {\n namespace = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n distanceMetric = createIndex.tpufDistanceMetric;\n record = { id } as Vector;\n if (update.vector) record.vector = update.vector;\n if (update.metadata) record.attributes = update.metadata;\n } catch (error) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPDATE_VECTOR_INVALID_ARGS',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n try {\n await namespace.upsert({\n vectors: [record],\n distance_metric: distanceMetric,\n });\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_UPDATE_VECTOR_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Deletes a vector by its ID.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to delete.\n * @returns A promise that resolves when the deletion is complete.\n * @throws Will throw an error if the deletion operation fails.\n */\n async deleteVector({ indexName, id }: DeleteVectorParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.delete({ ids: [id] });\n } catch (error: any) {\n throw new MastraError(\n {\n id: 'STORAGE_TURBOBUFFER_VECTOR_DELETE_VECTOR_FAILED',\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n}\n"]}
|
|
1
|
+
{"version":3,"sources":["../src/vector/filter.ts","../src/vector/index.ts"],"names":["op"],"mappings":";;;;;;;AA6BO,IAAM,2BAAA,GAAN,cAA0C,oBAAA,CAAmE;AAAA,EAC/F,qBAAA,GAAyC;AAC1D,IAAA,OAAO;AAAA,MACL,GAAG,oBAAA,CAAqB,iBAAA;AAAA,MACxB,OAAA,EAAS,CAAC,MAAA,EAAQ,KAAK,CAAA;AAAA,MACvB,KAAA,EAAO,CAAC,KAAA,EAAO,MAAA,EAAQ,MAAM,CAAA;AAAA,MAC7B,OAAA,EAAS,CAAC,SAAS,CAAA;AAAA,MACnB,OAAO,EAAC;AAAA;AAAA,MACR,QAAQ;AAAC;AAAA,KACX;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKQ,WAAA,GAA8C;AAAA,IACpD,GAAA,EAAK,IAAA;AAAA,IACL,GAAA,EAAK,OAAA;AAAA,IACL,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM,KAAA;AAAA,IACN,GAAA,EAAK,IAAA;AAAA,IACL,IAAA,EAAM;AAAA,GACR;AAAA;AAAA;AAAA;AAAA,EAKA,UAAU,MAAA,EAAuD;AAC/D,IAAA,IAAI,IAAA,CAAK,OAAA,CAAQ,MAAM,CAAA,EAAG;AACxB,MAAA,OAAO,MAAA;AAAA,IACT;AAGA,IAAA,IAAA,CAAK,eAAe,MAAM,CAAA;AAG1B,IAAA,MAAM,MAAA,GAAS,IAAA,CAAK,aAAA,CAAc,MAAM,CAAA;AAIxC,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,MAAM,KAAK,MAAA,CAAO,MAAA,KAAW,CAAA,IAAM,MAAA,CAAO,CAAC,CAAA,KAAM,KAAA,IAAS,MAAA,CAAO,CAAC,MAAM,IAAA,EAAO;AAChG,MAAA,OAAO,CAAC,KAAA,EAAO,CAAC,MAAyB,CAAC,CAAA;AAAA,IAC5C;AAEA,IAAA,OAAO,MAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKQ,cAAc,IAAA,EAA0D;AAE9E,IAAA,IAAI,IAAA,KAAS,QAAQ,IAAA,KAAS,MAAA,IAAa,OAAO,IAAA,CAAK,IAAI,CAAA,CAAE,MAAA,KAAW,CAAA,EAAG;AACzE,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,IAAI,CAAA,EAAG;AAC1B,MAAA,MAAM,IAAI,MAAM,mEAAmE,CAAA;AAAA,IACrF;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,IAAI,CAAA,EAAG;AACvB,MAAA,MAAM,IAAI,MAAM,+DAA+D,CAAA;AAAA,IACjF;AAEA,IAAA,MAAM,OAAA,GAAU,MAAA,CAAO,OAAA,CAAQ,IAAI,CAAA;AAGnC,IAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,EAAE,CAAA;AAAA,IACnB;AAEA,IAAA,MAAM,CAAC,GAAA,EAAK,KAAK,CAAA,GAAI,QAAQ,CAAC,CAAA;AAG9B,IAAA,IAAI,GAAA,IAAO,IAAA,CAAK,iBAAA,CAAkB,GAAG,CAAA,EAAG;AACtC,MAAA,OAAO,IAAA,CAAK,gBAAA,CAAiB,GAAA,EAAK,KAAK,CAAA;AAAA,IACzC;AAGA,IAAA,IAAI,OAAA,CAAQ,SAAS,CAAA,EAAG;AACtB,MAAA,MAAM,UAAA,GAAa,OAAA,CAAQ,GAAA,CAAI,CAAC,CAAC,KAAA,EAAO,UAAU,CAAA,KAAM,IAAA,CAAK,uBAAA,CAAwB,KAAA,EAAO,UAAU,CAAC,CAAA;AACvG,MAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,IAC3B;AAGA,IAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,GAAA,EAAK,KAAK,CAAA;AAAA,EAChD;AAAA;AAAA;AAAA;AAAA,EAKQ,uBAAA,CAAwB,OAAe,KAAA,EAA6B;AAE1E,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,IAAA,CAAK,WAAA,CAAY,KAAK,CAAA,EAAG;AAC3B,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACjD;AAGA,IAAA,IAAI,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,EAAG;AACxB,MAAA,OAAO,CAAC,KAAA,EAAO,IAAA,EAAM,IAAA,CAAK,oBAAA,CAAqB,KAAK,CAAC,CAAA;AAAA,IACvD;AAGA,IAAA,IAAI,OAAO,KAAA,KAAU,QAAA,IAAY,KAAA,KAAU,IAAA,EAAM;AAC/C,MAAA,MAAM,SAAA,GAAY,MAAA,CAAO,IAAA,CAAK,KAAK,CAAA;AAGnC,MAAA,IAAI,SAAA,CAAU,SAAS,CAAA,EAAG;AAExB,QAAA,MAAM,YAAA,GAAe,UAAU,KAAA,CAAM,CAAAA,QAAM,IAAA,CAAK,UAAA,CAAWA,GAAE,CAAC,CAAA;AAC9D,QAAA,IAAI,YAAA,EAAc;AAEhB,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM,IAAA,CAAK,iBAAA,CAAkB,KAAA,EAAOA,GAAAA,EAAI,KAAA,CAAMA,GAAE,CAAC,CAAC,CAAA;AACnF,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B,CAAA,MAAO;AAEL,UAAA,MAAM,UAAA,GAAa,SAAA,CAAU,GAAA,CAAI,CAAAA,GAAAA,KAAM;AACrC,YAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAIA,GAAE,CAAA,CAAA;AAClC,YAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAMA,GAAE,CAAC,CAAA;AAAA,UAC5D,CAAC,CAAA;AACD,UAAA,OAAO,CAAC,OAAO,UAAU,CAAA;AAAA,QAC3B;AAAA,MACF;AAGA,MAAA,MAAM,EAAA,GAAK,UAAU,CAAC,CAAA;AACtB,MAAA,IAAI,EAAA,IAAM,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC7B,QAAA,OAAO,KAAK,iBAAA,CAAkB,KAAA,EAAO,EAAA,EAAI,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MACpD;AAGA,MAAA,IAAI,EAAA,IAAM,CAAC,IAAA,CAAK,UAAA,CAAW,EAAE,CAAA,EAAG;AAC9B,QAAA,MAAM,WAAA,GAAc,CAAA,EAAG,KAAK,CAAA,CAAA,EAAI,EAAE,CAAA,CAAA;AAClC,QAAA,OAAO,IAAA,CAAK,uBAAA,CAAwB,WAAA,EAAa,KAAA,CAAM,EAAE,CAAC,CAAA;AAAA,MAC5D;AAAA,IACF;AAEA,IAAA,MAAM,IAAI,KAAA,CAAM,CAAA,qCAAA,EAAwC,KAAK,CAAA,CAAE,CAAA;AAAA,EACjE;AAAA;AAAA;AAAA;AAAA,EAKQ,gBAAA,CAAiB,UAAkB,UAAA,EAA4B;AAErE,IAAA,MAAM,SAAA,GAA8B,QAAA,KAAa,MAAA,GAAS,KAAA,GAAQ,IAAA;AAGlE,IAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,UAAU,CAAA,EAAG;AAC9B,MAAA,MAAM,IAAI,KAAA,CAAM,CAAA,iBAAA,EAAoB,QAAQ,CAAA,gCAAA,CAAkC,CAAA;AAAA,IAChF;AAGA,IAAA,MAAM,oBAAA,GAAuB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa;AACvD,MAAA,IAAI,OAAO,SAAA,KAAc,QAAA,IAAY,SAAA,KAAc,IAAA,EAAM;AACvD,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,uCAAA,EAA0C,QAAQ,CAAA,CAAE,CAAA;AAAA,MACtE;AACA,MAAA,OAAO,IAAA,CAAK,cAAc,SAAS,CAAA;AAAA,IACrC,CAAC,CAAA;AAED,IAAA,OAAO,CAAC,WAAW,oBAAoB,CAAA;AAAA,EACzC;AAAA;AAAA;AAAA;AAAA,EAKQ,iBAAA,CAAkB,KAAA,EAAe,QAAA,EAAkB,KAAA,EAA6B;AAEtF,IAAA,IAAI,QAAA,IAAY,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG;AAC1C,MAAA,OAAO,CAAC,OAAO,IAAA,CAAK,WAAA,CAAY,QAAQ,CAAA,EAAG,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,IACvE;AAGA,IAAA,QAAQ,QAAA;AAAU,MAChB,KAAK,SAAA;AAGH,QAAA,OAAO,KAAA,GAAQ,CAAC,KAAA,EAAO,OAAA,EAAS,IAAI,CAAA,GAAI,CAAC,KAAA,EAAO,IAAA,EAAM,IAAI,CAAA;AAAA,MAE5D,KAAK,MAAA;AAEH,QAAA,IAAI,CAAC,KAAA,CAAM,OAAA,CAAQ,KAAK,CAAA,IAAK,KAAA,CAAM,WAAW,CAAA,EAAG;AAC/C,UAAA,MAAM,IAAI,MAAM,0CAA0C,CAAA;AAAA,QAC5D;AAEA,QAAA,MAAM,aAAA,GAAgB,KAAA,CAAM,GAAA,CAAI,CAAA,IAAA,KAAQ,CAAC,KAAA,EAAO,IAAA,EAAM,CAAC,IAAA,CAAK,cAAA,CAAe,IAAI,CAAC,CAAC,CAAoB,CAAA;AAGrG,QAAA,OAAO,CAAC,OAAO,aAAa,CAAA;AAAA,MAE9B;AACE,QAAA,MAAM,IAAI,KAAA,CAAM,CAAA,sBAAA,EAAyB,QAAA,IAAY,WAAW,CAAA,CAAE,CAAA;AAAA;AACtE,EACF;AAAA;AAAA;AAAA;AAAA,EAKU,eAAe,KAAA,EAAiB;AAExC,IAAA,IAAI,iBAAiB,IAAA,EAAM;AACzB,MAAA,OAAO,MAAM,WAAA,EAAY;AAAA,IAC3B;AACA,IAAA,OAAO,KAAA;AAAA,EACT;AAAA;AAAA;AAAA;AAAA,EAKU,qBAAqB,MAAA,EAAsB;AACnD,IAAA,OAAO,OAAO,GAAA,CAAI,CAAA,KAAA,KAAS,IAAA,CAAK,cAAA,CAAe,KAAK,CAAC,CAAA;AAAA,EACvD;AACF,CAAA;;;ACzLO,IAAM,iBAAA,GAAN,cAAgC,YAAA,CAAsC;AAAA,EACnE,MAAA;AAAA,EACA,gBAAA;AAAA;AAAA;AAAA;AAAA,EAIA,gBAAA,uBAKA,GAAA,EAAI;AAAA,EACJ,IAAA;AAAA,EAER,YAAY,IAAA,EAAiD;AAC3D,IAAA,KAAA,CAAM,EAAE,EAAA,EAAI,IAAA,CAAK,EAAA,EAAI,CAAA;AACrB,IAAA,IAAA,CAAK,gBAAA,GAAmB,IAAI,2BAAA,EAA4B;AACxD,IAAA,IAAA,CAAK,IAAA,GAAO,IAAA;AACZ,IAAA,IAAA,CAAK,MAAA,GAAS,IAAI,WAAA,CAAY,IAAI,CAAA;AAAA,EACpC;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAW,SAAA,EAAW,QAAO,EAAqC;AACpF,IAAA,MAAA,GAAS,MAAA,IAAU,QAAA;AACnB,IAAA,IAAI,cAAA,GAAiC,iBAAA;AACrC,IAAA,IAAI;AACF,MAAA,IAAI,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA,EAAG;AAExC,QAAA,MAAM,QAAA,GAAW,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACpD,QAAA,IAAI,SAAA,KAAc,QAAA,CAAS,SAAA,IAAa,MAAA,KAAW,SAAS,MAAA,EAAQ;AAClE,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,CAAA,oEAAA,EAAuE,SAAS,CAAA,qBAAA,EAAwB,QAAA,CAAS,SAAS,CAAA,YAAA,EAAe,QAAA,CAAS,MAAM,CAAA,oBAAA,EAAuB,SAAS,CAAA,YAAA,EAAe,MAAM,CAAA;AAAA,WAC/M;AAAA,QACF;AACA,QAAA;AAAA,MACF;AACA,MAAA,IAAI,aAAa,CAAA,EAAG;AAClB,QAAA,MAAM,IAAI,MAAM,sCAAsC,CAAA;AAAA,MACxD;AACA,MAAA,QAAQ,MAAA;AAAQ,QACd,KAAK,QAAA;AACH,UAAA,cAAA,GAAiB,iBAAA;AACjB,UAAA;AAAA,QACF,KAAK,WAAA;AACH,UAAA,cAAA,GAAiB,mBAAA;AACjB,UAAA;AAAA,QACF,KAAK,YAAA;AACH,UAAA,MAAM,IAAI,MAAM,4CAA4C,CAAA;AAAA;AAChE,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,cAAc,CAAA;AAAA,UACrE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA,EAAW,SAAA,EAAW,MAAA;AAAO,SAC1C;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAA,CAAK,gBAAA,CAAiB,IAAI,SAAA,EAAW;AAAA,MACnC,SAAA;AAAA,MACA,SAAA;AAAA,MACA,MAAA;AAAA,MACA,kBAAA,EAAoB;AAAA,KACrB,CAAA;AAAA,EACH;AAAA,EAEA,MAAM,MAAA,CAAO,EAAE,WAAW,OAAA,EAAS,QAAA,EAAU,KAAI,EAA0C;AACzF,IAAA,IAAI,KAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,IAAI,OAAA,CAAQ,WAAW,CAAA,EAAG;AACxB,QAAA,MAAM,IAAI,MAAM,oCAAoC,CAAA;AAAA,MACtD;AAEA,MAAA,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACvC,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,QAAA,EAAU,cAAc,CAAA;AAAA,UAC/D,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,MAAA,MAAM,YAAY,GAAA,IAAO,OAAA,CAAQ,IAAI,MAAM,MAAA,CAAO,YAAY,CAAA;AAC9D,MAAA,MAAM,OAAA,GAAoB,OAAA,CAAQ,GAAA,CAAI,CAAC,QAAQ,CAAA,MAAO;AAAA,QACpD,EAAA,EAAI,UAAU,CAAC,CAAA;AAAA,QACf,MAAA;AAAA,QACA,UAAA,EAAY,QAAA,GAAW,CAAC,CAAA,IAAK;AAAC,OAChC,CAAE,CAAA;AAIF,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,aAAA,GAKF;AAAA,UACF,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SACnB;AAGA,QAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,QAAA,IAAI,YAAA,EAAc;AAChB,UAAA,aAAA,CAAc,SAAS,YAAA,CAAa,MAAA;AACpC,UAAA,IAAI,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAA,KAAW,aAAa,UAAA,EAAY;AAClD,YAAA,MAAM,IAAI,KAAA;AAAA,cACR,CAAA,kBAAA,EAAqB,SAAS,CAAA,gCAAA,EAAmC,YAAA,CAAa,UAAU,CAAA,4CAAA,EAA+C,OAAA,CAAQ,CAAC,CAAA,EAAG,MAAM,CAAA;AAAA,aAC3J;AAAA,UACF;AAAA,QACF;AAEA,QAAA,MAAM,KAAA,CAAM,OAAO,aAAa,CAAA;AAAA,MAClC;AAEA,MAAA,OAAO,SAAA;AAAA,IACT,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,QAAA,EAAU,QAAQ,CAAA;AAAA,UACzD,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,KAAA,CAAM;AAAA,IACV,SAAA;AAAA,IACA,WAAA;AAAA,IACA,IAAA;AAAA,IACA,MAAA;AAAA,IACA;AAAA,GACF,EAAyD;AACvD,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI;AACF,MAAA,MAAM,YAAA,GAAe,IAAA,CAAK,IAAA,CAAK,oBAAA,GAAuB,SAAS,CAAA;AAC/D,MAAA,IAAI,YAAA,EAAc;AAChB,QAAA,IAAI,WAAA,CAAY,MAAA,KAAW,YAAA,CAAa,UAAA,EAAY;AAClD,UAAA,MAAM,IAAI,KAAA;AAAA,YACR,qBAAqB,SAAS,CAAA,gCAAA,EAAmC,aAAa,UAAU,CAAA,iDAAA,EAAoD,YAAY,MAAM,CAAA;AAAA,WAChK;AAAA,QACF;AAAA,MACF;AACA,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,OAAA,EAAS,cAAc,CAAA;AAAA,UAC9D,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,MAAM,iBAAiB,WAAA,CAAY,kBAAA;AACnC,IAAA,IAAI;AACF,MAAA,MAAM,KAAA,GAAQ,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC7C,MAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAC/D,MAAA,MAAM,OAAA,GAAwB,MAAM,KAAA,CAAM,KAAA,CAAM;AAAA,QAC9C,eAAA,EAAiB,cAAA;AAAA,QACjB,MAAA,EAAQ,WAAA;AAAA,QACR,KAAA,EAAO,IAAA;AAAA,QACP,OAAA,EAAS,gBAAA;AAAA,QACT,eAAA,EAAiB,aAAA;AAAA,QACjB,kBAAA,EAAoB,IAAA;AAAA,QACpB,WAAA,EAAa,EAAE,KAAA,EAAO,QAAA;AAAS;AAAA,OAChC,CAAA;AACD,MAAA,OAAO,OAAA,CAAQ,IAAI,CAAA,IAAA,MAAS;AAAA,QAC1B,EAAA,EAAI,MAAA,CAAO,IAAA,CAAK,EAAE,CAAA;AAAA,QAClB,OAAO,OAAO,IAAA,CAAK,IAAA,KAAS,QAAA,GAAW,KAAK,IAAA,GAAO,CAAA;AAAA,QACnD,QAAA,EAAU,IAAA,CAAK,UAAA,IAAc,EAAC;AAAA,QAC9B,GAAI,iBAAiB,IAAA,CAAK,MAAA,GAAS,EAAE,MAAA,EAAQ,IAAA,CAAK,MAAA,EAAO,GAAI;AAAC,OAChE,CAAE,CAAA;AAAA,IACJ,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,OAAA,EAAS,QAAQ,CAAA;AAAA,UACxD,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,GAAiC;AACrC,IAAA,IAAI;AACF,MAAA,MAAM,mBAAmB,MAAM,IAAA,CAAK,MAAA,CAAO,UAAA,CAAW,EAAE,CAAA;AACxD,MAAA,OAAO,gBAAA,CAAiB,UAAA,CAAW,GAAA,CAAI,CAAA,SAAA,KAAa,UAAU,EAAE,CAAA;AAAA,IAClE,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,QAAQ,CAAA;AAAA,UAC/D,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc;AAAA,SAC1B;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAU,EAA6C;AAC3E,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,QAAA,GAAW,MAAM,SAAA,CAAU,QAAA,EAAS;AAC1C,MAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,MAAM,YAAY,QAAA,CAAS,UAAA;AAC3B,MAAA,MAAM,QAAQ,QAAA,CAAS,YAAA;AACvB,MAAA,OAAO;AAAA,QACL,SAAA;AAAA,QACA,KAAA;AAAA,QACA,QAAQ,WAAA,CAAY;AAAA,OACtB;AAAA,IACF,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,QAAQ,CAAA;AAAA,UACjE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,WAAA,CAAY,EAAE,SAAA,EAAU,EAAqC;AACjE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,SAAA,EAAU;AAC1B,MAAA,IAAA,CAAK,gBAAA,CAAiB,OAAO,SAAS,CAAA;AAAA,IACxC,SAAS,KAAA,EAAY;AACnB,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,cAAA,EAAgB,QAAQ,CAAA;AAAA,UAC/D,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAaA,MAAM,YAAA,CAAa,EAAE,WAAW,EAAA,EAAI,MAAA,EAAQ,QAAO,EAA+D;AAEhH,IAAA,IAAI,MAAM,MAAA,EAAQ;AAChB,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,oBAAoB,CAAA;AAAA,QAC5E,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,sCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,EAAA,IAAM,CAAC,MAAA,EAAQ;AAClB,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,WAAW,CAAA;AAAA,QACnE,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,sCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,MAAA,CAAO,MAAA,IAAU,CAAC,OAAO,QAAA,EAAU;AACtC,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,YAAY,CAAA;AAAA,QACpE,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,yBAAA;AAAA,QACN,SAAS,EAAE,SAAA,EAAW,GAAI,EAAA,IAAM,EAAE,IAAG;AAAG,OACzC,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,SAAA;AACJ,IAAA,IAAI,WAAA;AACJ,IAAA,IAAI,cAAA;AACJ,IAAA,IAAI;AACF,MAAA,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AAC3C,MAAA,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACjD,MAAA,IAAI,CAAC,WAAA,EAAa;AAChB,QAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,MAC3D;AACA,MAAA,cAAA,GAAiB,WAAA,CAAY,kBAAA;AAAA,IAC/B,SAAS,KAAA,EAAO;AACd,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,cAAc,CAAA;AAAA,UACtE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,IAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAEA,IAAA,IAAI;AACF,MAAA,IAAI,cAAwB,EAAC;AAE7B,MAAA,IAAI,EAAA,EAAI;AACN,QAAA,WAAA,GAAc,CAAC,EAAE,CAAA;AAAA,MACnB,WAAW,MAAA,EAAQ;AAEjB,QAAA,IAAI,MAAA,CAAO,IAAA,CAAK,MAAM,CAAA,CAAE,WAAW,CAAA,EAAG;AACpC,UAAA,MAAM,IAAI,WAAA,CAAY;AAAA,YACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,cAAc,CAAA;AAAA,YACtE,QAAQ,WAAA,CAAY,OAAA;AAAA,YACpB,UAAU,aAAA,CAAc,IAAA;AAAA,YACxB,IAAA,EAAM,kCAAA;AAAA,YACN,OAAA,EAAS,EAAE,SAAA;AAAU,WACtB,CAAA;AAAA,QACH;AAGA,QAAA,MAAM,WAAA,GAAc,IAAI,KAAA,CAAM,WAAA,CAAY,SAAS,CAAA,CAAE,IAAA,CAAK,CAAA,GAAI,IAAA,CAAK,IAAA,CAAK,WAAA,CAAY,SAAS,CAAC,CAAA;AAC9F,QAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAE/D,QAAA,MAAM,OAAA,GAAU,MAAM,SAAA,CAAU,KAAA,CAAM;AAAA,UACpC,MAAA,EAAQ,WAAA;AAAA,UACR,KAAA,EAAO,GAAA;AAAA;AAAA,UACP,OAAA,EAAS,gBAAA;AAAA,UACT,eAAA,EAAiB,MAAA,CAAO,MAAA,GAAS,IAAA,GAAO,KAAA;AAAA;AAAA,UACxC,kBAAA,EAAoB,CAAC,GAAG;AAAA,SACzB,CAAA;AAED,QAAA,WAAA,GAAc,QAAQ,GAAA,CAAI,CAAA,CAAA,KAAK,MAAA,CAAO,CAAA,CAAE,EAAE,CAAC,CAAA;AAG3C,QAAA,IAAI,CAAC,MAAA,CAAO,MAAA,IAAU,CAAC,OAAO,QAAA,EAAU;AACtC,UAAA,KAAA,MAAW,UAAU,OAAA,EAAS;AAC5B,YAAA,MAAM,MAAA,GAAiB,EAAE,EAAA,EAAI,MAAA,CAAO,EAAA,EAAG;AACvC,YAAA,IAAI,OAAO,MAAA,EAAQ;AACjB,cAAA,MAAA,CAAO,SAAS,MAAA,CAAO,MAAA;AAAA,YACzB,CAAA,MAAA,IAAW,OAAO,MAAA,EAAQ;AACxB,cAAA,MAAA,CAAO,SAAS,MAAA,CAAO,MAAA;AAAA,YACzB;AACA,YAAA,IAAI,OAAO,QAAA,EAAU;AACnB,cAAA,MAAA,CAAO,aAAa,MAAA,CAAO,QAAA;AAAA,YAC7B,CAAA,MAAA,IAAW,OAAO,UAAA,EAAY;AAC5B,cAAA,MAAA,CAAO,aAAa,MAAA,CAAO,UAAA;AAAA,YAC7B;AACA,YAAA,MAAM,UAAU,MAAA,CAAO;AAAA,cACrB,OAAA,EAAS,CAAC,MAAM,CAAA;AAAA,cAChB,eAAA,EAAiB;AAAA,aAClB,CAAA;AAAA,UACH;AACA,UAAA;AAAA,QACF;AAAA,MACF;AAGA,MAAA,IAAI,WAAA,CAAY,WAAW,CAAA,EAAG;AAC5B,QAAA,IAAA,CAAK,MAAA,CAAO,IAAA,CAAK,CAAA,8CAAA,EAAiD,SAAS,CAAA,CAAE,CAAA;AAC7E,QAAA;AAAA,MACF;AAGA,MAAA,MAAM,OAAA,GAAoB,WAAA,CAAY,GAAA,CAAI,CAAA,KAAA,KAAS;AACjD,QAAA,MAAM,MAAA,GAAiB,EAAE,EAAA,EAAI,KAAA,EAAM;AACnC,QAAA,IAAI,MAAA,CAAO,MAAA,EAAQ,MAAA,CAAO,MAAA,GAAS,MAAA,CAAO,MAAA;AAC1C,QAAA,IAAI,MAAA,CAAO,QAAA,EAAU,MAAA,CAAO,UAAA,GAAa,MAAA,CAAO,QAAA;AAChD,QAAA,OAAO,MAAA;AAAA,MACT,CAAC,CAAA;AAGD,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,OAAA,CAAQ,MAAA,EAAQ,KAAK,SAAA,EAAW;AAClD,QAAA,MAAM,KAAA,GAAQ,OAAA,CAAQ,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAC5C,QAAA,MAAM,UAAU,MAAA,CAAO;AAAA,UACrB,OAAA,EAAS,KAAA;AAAA,UACT,eAAA,EAAiB;AAAA,SAClB,CAAA;AAAA,MACH;AAAA,IACF,SAAS,KAAA,EAAY;AACnB,MAAA,IAAI,KAAA,YAAiB,aAAa,MAAM,KAAA;AACxC,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,QAAQ,CAAA;AAAA,UAChE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS;AAAA,YACP,SAAA;AAAA,YACA,GAAI,EAAA,IAAM,EAAE,EAAA,EAAG;AAAA,YACf,GAAI,MAAA,IAAU,EAAE,QAAQ,IAAA,CAAK,SAAA,CAAU,MAAM,CAAA;AAAE;AACjD,SACF;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,YAAA,CAAa,EAAE,SAAA,EAAW,IAAG,EAAsC;AACvE,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,MAAM,UAAU,MAAA,CAAO,EAAE,KAAK,CAAC,EAAE,GAAG,CAAA;AAAA,IACtC,SAAS,KAAA,EAAY;AACnB,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,eAAA,EAAiB,QAAQ,CAAA;AAAA,UAChE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS,EAAE,SAAA;AAAU,SACvB;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AAAA,EAEA,MAAM,aAAA,CAAc,EAAE,SAAA,EAAW,MAAA,EAAQ,KAAI,EAAgE;AAE3G,IAAA,IAAI,OAAO,MAAA,EAAQ;AACjB,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,oBAAoB,CAAA;AAAA,QAC7E,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,uCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,CAAC,GAAA,IAAO,CAAC,MAAA,EAAQ;AACnB,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,WAAW,CAAA;AAAA,QACpE,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,uCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAGA,IAAA,IAAI,GAAA,IAAO,GAAA,CAAI,MAAA,KAAW,CAAA,EAAG;AAC3B,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,WAAW,CAAA;AAAA,QACpE,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,2BAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI,UAAU,MAAA,CAAO,IAAA,CAAK,MAAM,CAAA,CAAE,WAAW,CAAA,EAAG;AAC9C,MAAA,MAAM,IAAI,WAAA,CAAY;AAAA,QACpB,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,cAAc,CAAA;AAAA,QACvE,QAAQ,WAAA,CAAY,OAAA;AAAA,QACpB,UAAU,aAAA,CAAc,IAAA;AAAA,QACxB,IAAA,EAAM,kCAAA;AAAA,QACN,OAAA,EAAS,EAAE,SAAA;AAAU,OACtB,CAAA;AAAA,IACH;AAEA,IAAA,IAAI;AACF,MAAA,MAAM,SAAA,GAAY,IAAA,CAAK,MAAA,CAAO,SAAA,CAAU,SAAS,CAAA;AACjD,MAAA,IAAI,cAAwB,EAAC;AAE7B,MAAA,IAAI,GAAA,EAAK;AACP,QAAA,WAAA,GAAc,GAAA;AAAA,MAChB,WAAW,MAAA,EAAQ;AAEjB,QAAA,MAAM,WAAA,GAAc,IAAA,CAAK,gBAAA,CAAiB,GAAA,CAAI,SAAS,CAAA;AACvD,QAAA,IAAI,CAAC,WAAA,EAAa;AAChB,UAAA,MAAM,IAAI,MAAM,CAAA,uCAAA,CAAyC,CAAA;AAAA,QAC3D;AAEA,QAAA,MAAM,WAAA,GAAc,IAAI,KAAA,CAAM,WAAA,CAAY,SAAS,CAAA,CAAE,IAAA,CAAK,CAAA,GAAI,IAAA,CAAK,IAAA,CAAK,WAAA,CAAY,SAAS,CAAC,CAAA;AAC9F,QAAA,MAAM,gBAAA,GAAmB,IAAA,CAAK,gBAAA,CAAiB,SAAA,CAAU,MAAM,CAAA;AAE/D,QAAA,MAAM,OAAA,GAAU,MAAM,SAAA,CAAU,KAAA,CAAM;AAAA,UACpC,MAAA,EAAQ,WAAA;AAAA,UACR,KAAA,EAAO,GAAA;AAAA;AAAA,UACP,OAAA,EAAS,gBAAA;AAAA,UACT,eAAA,EAAiB,KAAA;AAAA,UACjB,oBAAoB;AAAC,SACtB,CAAA;AAED,QAAA,WAAA,GAAc,QAAQ,GAAA,CAAI,CAAA,CAAA,KAAK,MAAA,CAAO,CAAA,CAAE,EAAE,CAAC,CAAA;AAAA,MAC7C;AAGA,MAAA,IAAI,WAAA,CAAY,WAAW,CAAA,EAAG;AAC5B,QAAA,IAAA,CAAK,MAAA,CAAO,IAAA,CAAK,CAAA,gDAAA,EAAmD,SAAS,CAAA,CAAE,CAAA;AAC/E,QAAA;AAAA,MACF;AAGA,MAAA,MAAM,SAAA,GAAY,GAAA;AAClB,MAAA,KAAA,IAAS,IAAI,CAAA,EAAG,CAAA,GAAI,WAAA,CAAY,MAAA,EAAQ,KAAK,SAAA,EAAW;AACtD,QAAA,MAAM,KAAA,GAAQ,WAAA,CAAY,KAAA,CAAM,CAAA,EAAG,IAAI,SAAS,CAAA;AAChD,QAAA,MAAM,SAAA,CAAU,MAAA,CAAO,EAAE,GAAA,EAAK,OAAO,CAAA;AAAA,MACvC;AAAA,IACF,SAAS,KAAA,EAAY;AACnB,MAAA,IAAI,KAAA,YAAiB,aAAa,MAAM,KAAA;AACxC,MAAA,MAAM,IAAI,WAAA;AAAA,QACR;AAAA,UACE,EAAA,EAAI,mBAAA,CAAoB,aAAA,EAAe,gBAAA,EAAkB,QAAQ,CAAA;AAAA,UACjE,QAAQ,WAAA,CAAY,OAAA;AAAA,UACpB,UAAU,aAAA,CAAc,WAAA;AAAA,UACxB,OAAA,EAAS;AAAA,YACP,SAAA;AAAA,YACA,GAAI,MAAA,IAAU,EAAE,QAAQ,IAAA,CAAK,SAAA,CAAU,MAAM,CAAA,EAAE;AAAA,YAC/C,GAAI,GAAA,IAAO,EAAE,QAAA,EAAU,IAAI,MAAA;AAAO;AACpC,SACF;AAAA,QACA;AAAA,OACF;AAAA,IACF;AAAA,EACF;AACF","file":"index.js","sourcesContent":["import type {\n OperatorSupport,\n VectorFilter,\n OperatorValueMap,\n LogicalOperatorValueMap,\n BlacklistedRootOperators,\n} from '@mastra/core/vector/filter';\nimport { BaseFilterTranslator } from '@mastra/core/vector/filter';\nimport type { FilterCondition, FilterConnective, FilterOperator, Filters } from '@turbopuffer/turbopuffer';\n\ntype TurbopufferOperatorValueMap = Omit<OperatorValueMap, '$regex' | '$options' | '$elemMatch'>;\n\ntype TurbopufferLogicalOperatorValueMap = Omit<LogicalOperatorValueMap, '$nor' | '$not'>;\n\ntype TurbopufferBlacklistedRootOperators = BlacklistedRootOperators | '$nor' | '$not';\n\nexport type TurbopufferVectorFilter = VectorFilter<\n keyof TurbopufferOperatorValueMap,\n TurbopufferOperatorValueMap,\n TurbopufferLogicalOperatorValueMap,\n TurbopufferBlacklistedRootOperators\n>;\n\n/**\n * Translator for converting Mastra filters to Turbopuffer format\n *\n * Mastra filters: { field: { $gt: 10 } }\n * Turbopuffer filters: [\"And\", [[\"field\", \"Gt\", 10]]]\n */\nexport class TurbopufferFilterTranslator extends BaseFilterTranslator<TurbopufferVectorFilter, Filters | undefined> {\n protected override getSupportedOperators(): OperatorSupport {\n return {\n ...BaseFilterTranslator.DEFAULT_OPERATORS,\n logical: ['$and', '$or'],\n array: ['$in', '$nin', '$all'],\n element: ['$exists'],\n regex: [], // No regex support in Turbopuffer\n custom: [], // No custom operators\n };\n }\n\n /**\n * Map Mastra operators to Turbopuffer operators\n */\n private operatorMap: Record<string, FilterOperator> = {\n $eq: 'Eq',\n $ne: 'NotEq',\n $gt: 'Gt',\n $gte: 'Gte',\n $lt: 'Lt',\n $lte: 'Lte',\n $in: 'In',\n $nin: 'NotIn',\n };\n\n /**\n * Convert the Mastra filter to Turbopuffer format\n */\n translate(filter?: TurbopufferVectorFilter): Filters | undefined {\n if (this.isEmpty(filter)) {\n return undefined;\n }\n\n // Validate the filter structure before translating\n this.validateFilter(filter);\n\n // Translate the filter\n const result = this.translateNode(filter);\n\n // If we have a single condition (not a logical operator at the top level),\n // wrap it in an implicit AND to match Turbopuffer's expected format\n if (!Array.isArray(result) || result.length !== 2 || (result[0] !== 'And' && result[0] !== 'Or')) {\n return ['And', [result as FilterCondition]];\n }\n\n return result as Filters;\n }\n\n /**\n * Recursively translate a filter node\n */\n private translateNode(node: TurbopufferVectorFilter): Filters | FilterCondition {\n // Handle empty or null nodes\n if (node === null || node === undefined || Object.keys(node).length === 0) {\n return ['And', []];\n }\n\n // Handle primitive values (direct equality comparison)\n if (this.isPrimitive(node)) {\n throw new Error('Direct primitive values not valid in this context for Turbopuffer');\n }\n\n // Handle direct array value (convert to $in)\n if (Array.isArray(node)) {\n throw new Error('Direct array values not valid in this context for Turbopuffer');\n }\n\n const entries = Object.entries(node);\n\n // Process the first operator or field\n if (entries.length === 0) {\n return ['And', []];\n }\n\n const [key, value] = entries[0] as [string, any];\n\n // Handle logical operators\n if (key && this.isLogicalOperator(key)) {\n return this.translateLogical(key, value);\n }\n\n // Multiple fields at top level - implicit AND\n if (entries.length > 1) {\n const conditions = entries.map(([field, fieldValue]) => this.translateFieldCondition(field, fieldValue));\n return ['And', conditions];\n }\n\n // Single field with condition(s)\n return this.translateFieldCondition(key, value);\n }\n\n /**\n * Translate a field condition\n */\n private translateFieldCondition(field: string, value: any): FilterCondition {\n // Handle Date object directly (convert to ISO string)\n if (value instanceof Date) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle primitive value (direct equality)\n if (this.isPrimitive(value)) {\n return [field, 'Eq', this.normalizeValue(value)];\n }\n\n // Handle array value (convert to $in)\n if (Array.isArray(value)) {\n return [field, 'In', this.normalizeArrayValues(value)];\n }\n\n // Handle object with operators\n if (typeof value === 'object' && value !== null) {\n const operators = Object.keys(value);\n\n // If multiple operators for the same field, create an AND condition\n if (operators.length > 1) {\n // Check if all keys are operators\n const allOperators = operators.every(op => this.isOperator(op));\n if (allOperators) {\n // For multiple comparison operators on one field\n const conditions = operators.map(op => this.translateOperator(field, op, value[op]));\n return ['And', conditions] as unknown as FilterCondition;\n } else {\n // For nested objects with multiple fields\n const conditions = operators.map(op => {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n });\n return ['And', conditions] as unknown as FilterCondition;\n }\n }\n\n // Single operator\n const op = operators[0];\n if (op && this.isOperator(op)) {\n return this.translateOperator(field, op, value[op]);\n }\n\n // Nested field path (use dot notation)\n if (op && !this.isOperator(op)) {\n const nestedField = `${field}.${op}`;\n return this.translateFieldCondition(nestedField, value[op]);\n }\n }\n\n throw new Error(`Unsupported filter format for field: ${field}`);\n }\n\n /**\n * Translate a logical operator\n */\n private translateLogical(operator: string, conditions: any[]): Filters {\n // Map Mastra logical operators to Turbopuffer\n const logicalOp: FilterConnective = operator === '$and' ? 'And' : 'Or';\n\n // Validate conditions\n if (!Array.isArray(conditions)) {\n throw new Error(`Logical operator ${operator} requires an array of conditions`);\n }\n\n // Translate each condition\n const translatedConditions = conditions.map(condition => {\n if (typeof condition !== 'object' || condition === null) {\n throw new Error(`Invalid condition for logical operator ${operator}`);\n }\n return this.translateNode(condition);\n });\n\n return [logicalOp, translatedConditions];\n }\n\n /**\n * Translate a specific operator\n */\n private translateOperator(field: string, operator: string, value: any): FilterCondition {\n // Handle comparison operators\n if (operator && this.operatorMap[operator]) {\n return [field, this.operatorMap[operator], this.normalizeValue(value)];\n }\n\n // Handle special cases\n switch (operator) {\n case '$exists':\n // $exists: true -> use NotEq with null (field exists if it's not null)\n // $exists: false -> use Eq with null (field doesn't exist if it is null)\n return value ? [field, 'NotEq', null] : [field, 'Eq', null];\n\n case '$all':\n // $all is not directly supported, simulate with AND + IN conditions\n if (!Array.isArray(value) || value.length === 0) {\n throw new Error('$all operator requires a non-empty array');\n }\n\n const allConditions = value.map(item => [field, 'In', [this.normalizeValue(item)]] as FilterCondition);\n\n // Return the array of conditions directly without nesting\n return ['And', allConditions] as unknown as FilterCondition;\n\n default:\n throw new Error(`Unsupported operator: ${operator || 'undefined'}`);\n }\n }\n\n /**\n * Normalize a value for comparison operations\n */\n protected normalizeValue(value: any): any {\n // Handle special value types\n if (value instanceof Date) {\n return value.toISOString();\n }\n return value;\n }\n\n /**\n * Normalize array values\n */\n protected normalizeArrayValues(values: any[]): any[] {\n return values.map(value => this.normalizeValue(value));\n }\n}\n","import { ErrorCategory, ErrorDomain, MastraError } from '@mastra/core/error';\nimport { createVectorErrorId } from '@mastra/core/storage';\nimport type {\n CreateIndexParams,\n DeleteIndexParams,\n DeleteVectorParams,\n DescribeIndexParams,\n IndexStats,\n QueryResult,\n QueryVectorParams,\n UpdateVectorParams,\n UpsertVectorParams,\n DeleteVectorsParams,\n} from '@mastra/core/vector';\nimport { MastraVector } from '@mastra/core/vector';\nimport { Turbopuffer } from '@turbopuffer/turbopuffer';\nimport type { DistanceMetric, QueryResults, Schema, Vector } from '@turbopuffer/turbopuffer';\nimport { TurbopufferFilterTranslator } from './filter';\nimport type { TurbopufferVectorFilter } from './filter';\n\ntype TurbopufferQueryVectorParams = QueryVectorParams<TurbopufferVectorFilter>;\n\nexport interface TurbopufferVectorOptions {\n /** The API key to authenticate with. */\n apiKey: string;\n /** The base URL. Default is https://api.turbopuffer.com. */\n baseUrl?: string;\n /** The timeout to establish a connection, in ms. Default is 10_000. Only applicable in Node and Deno.*/\n connectTimeout?: number;\n /** The socket idle timeout, in ms. Default is 60_000. Only applicable in Node and Deno.*/\n connectionIdleTimeout?: number;\n /** The number of connections to open initially when creating a new client. Default is 0. */\n warmConnections?: number;\n /** Whether to compress requests and accept compressed responses. Default is true. */\n compression?: boolean;\n /**\n * A callback function that takes an index name and returns a config object for that index.\n * This allows you to define explicit schemas per index.\n *\n * Example:\n * ```typescript\n * schemaConfigForIndex: (indexName: string) => {\n * // Mastra's default embedding model and index for memory messages:\n * if (indexName === \"memory_messages_384\") {\n * return {\n * dimensions: 384,\n * schema: {\n * thread_id: {\n * type: \"string\",\n * filterable: true,\n * },\n * },\n * };\n * } else {\n * throw new Error(`TODO: add schema for index: ${indexName}`);\n * }\n * },\n * ```\n */\n schemaConfigForIndex?: (indexName: string) => {\n dimensions: number;\n schema: Schema;\n };\n}\n\nexport class TurbopufferVector extends MastraVector<TurbopufferVectorFilter> {\n private client: Turbopuffer;\n private filterTranslator: TurbopufferFilterTranslator;\n // There is no explicit create index operation in Turbopuffer, so just register that\n // someone has called createIndex() and verify that subsequent upsert calls are consistent\n // with how the index was \"created\"\n private createIndexCache: Map<\n string,\n CreateIndexParams & {\n tpufDistanceMetric: DistanceMetric;\n }\n > = new Map();\n private opts: TurbopufferVectorOptions;\n\n constructor(opts: TurbopufferVectorOptions & { id: string }) {\n super({ id: opts.id });\n this.filterTranslator = new TurbopufferFilterTranslator();\n this.opts = opts;\n this.client = new Turbopuffer(opts);\n }\n\n async createIndex({ indexName, dimension, metric }: CreateIndexParams): Promise<void> {\n metric = metric ?? 'cosine'; // default to cosine distance\n let distanceMetric: DistanceMetric = 'cosine_distance';\n try {\n if (this.createIndexCache.has(indexName)) {\n // verify that the dimensions and distance metric match what we expect\n const expected = this.createIndexCache.get(indexName)!;\n if (dimension !== expected.dimension || metric !== expected.metric) {\n throw new Error(\n `createIndex() called more than once with inconsistent inputs. Index ${indexName} expected dimensions=${expected.dimension} and metric=${expected.metric} but got dimensions=${dimension} and metric=${metric}`,\n );\n }\n return;\n }\n if (dimension <= 0) {\n throw new Error('Dimension must be a positive integer');\n }\n switch (metric) {\n case 'cosine':\n distanceMetric = 'cosine_distance';\n break;\n case 'euclidean':\n distanceMetric = 'euclidean_squared';\n break;\n case 'dotproduct':\n throw new Error('dotproduct is not supported in Turbopuffer');\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'CREATE_INDEX', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName, dimension, metric },\n },\n error,\n );\n }\n\n this.createIndexCache.set(indexName, {\n indexName,\n dimension,\n metric,\n tpufDistanceMetric: distanceMetric,\n });\n }\n\n async upsert({ indexName, vectors, metadata, ids }: UpsertVectorParams): Promise<string[]> {\n let index;\n let createIndex;\n try {\n if (vectors.length === 0) {\n throw new Error('upsert() called with empty vectors');\n }\n\n index = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPSERT', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n const distanceMetric = createIndex.tpufDistanceMetric;\n const vectorIds = ids || vectors.map(() => crypto.randomUUID());\n const records: Vector[] = vectors.map((vector, i) => ({\n id: vectorIds[i]!,\n vector: vector,\n attributes: metadata?.[i] || {},\n }));\n\n // limit is 256 MB per upsert request, so set a reasonable batch size here that will stay under that for most cases\n // https://turbopuffer.com/docs/limits\n const batchSize = 100;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n const upsertOptions: {\n vectors: Vector[];\n distance_metric: DistanceMetric;\n schema?: Schema;\n batchSize?: number;\n } = {\n vectors: batch,\n distance_metric: distanceMetric,\n };\n\n // Use the schemaForIndex callback if provided\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n upsertOptions.schema = schemaConfig.schema;\n if (vectors[0]?.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to upsert vectors[0].length=${vectors[0]?.length}`,\n );\n }\n }\n\n await index.upsert(upsertOptions);\n }\n\n return vectorIds;\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPSERT', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async query({\n indexName,\n queryVector,\n topK,\n filter,\n includeVector,\n }: TurbopufferQueryVectorParams): Promise<QueryResult[]> {\n let createIndex;\n try {\n const schemaConfig = this.opts.schemaConfigForIndex?.(indexName);\n if (schemaConfig) {\n if (queryVector.length !== schemaConfig.dimensions) {\n throw new Error(\n `Turbopuffer index ${indexName} was configured with dimensions=${schemaConfig.dimensions} but attempting to query with queryVector.length=${queryVector.length}`,\n );\n }\n }\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'QUERY', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n const distanceMetric = createIndex.tpufDistanceMetric;\n try {\n const index = this.client.namespace(indexName);\n const translatedFilter = this.filterTranslator.translate(filter);\n const results: QueryResults = await index.query({\n distance_metric: distanceMetric,\n vector: queryVector,\n top_k: topK,\n filters: translatedFilter,\n include_vectors: includeVector,\n include_attributes: true,\n consistency: { level: 'strong' }, // todo: make this configurable somehow?\n });\n return results.map(item => ({\n id: String(item.id),\n score: typeof item.dist === 'number' ? item.dist : 0,\n metadata: item.attributes || {},\n ...(includeVector && item.vector ? { vector: item.vector } : {}),\n }));\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'QUERY', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async listIndexes(): Promise<string[]> {\n try {\n const namespacesResult = await this.client.namespaces({});\n return namespacesResult.namespaces.map(namespace => namespace.id);\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'LIST_INDEXES', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n },\n error,\n );\n }\n }\n\n /**\n * Retrieves statistics about a vector index.\n *\n * @param {string} indexName - The name of the index to describe\n * @returns A promise that resolves to the index statistics including dimension, count and metric\n */\n async describeIndex({ indexName }: DescribeIndexParams): Promise<IndexStats> {\n try {\n const namespace = this.client.namespace(indexName);\n const metadata = await namespace.metadata();\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n const dimension = metadata.dimensions;\n const count = metadata.approx_count;\n return {\n dimension,\n count,\n metric: createIndex.metric,\n };\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DESCRIBE_INDEX', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteIndex({ indexName }: DeleteIndexParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.deleteAll();\n this.createIndexCache.delete(indexName);\n } catch (error: any) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_INDEX', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n /**\n * Updates a vector by its ID or filter with the provided vector and/or metadata.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to update.\n * @param filter - The filter to match vectors to update.\n * @param update - An object containing the vector and/or metadata to update.\n * @param update.vector - An optional array of numbers representing the new vector.\n * @param update.metadata - An optional record containing the new metadata.\n * @returns A promise that resolves when the update is complete.\n * @throws Will throw an error if no updates are provided or if the update operation fails.\n */\n async updateVector({ indexName, id, filter, update }: UpdateVectorParams<TurbopufferVectorFilter>): Promise<void> {\n // Validate mutually exclusive parameters\n if (id && filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'MUTUALLY_EXCLUSIVE'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'id and filter are mutually exclusive',\n details: { indexName },\n });\n }\n\n if (!id && !filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'NO_TARGET'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Either id or filter must be provided',\n details: { indexName },\n });\n }\n\n if (!update.vector && !update.metadata) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'NO_PAYLOAD'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'No update data provided',\n details: { indexName, ...(id && { id }) },\n });\n }\n\n let namespace;\n let createIndex;\n let distanceMetric;\n try {\n namespace = this.client.namespace(indexName);\n createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n distanceMetric = createIndex.tpufDistanceMetric;\n } catch (error) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'INVALID_ARGS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n details: { indexName },\n },\n error,\n );\n }\n\n try {\n let idsToUpdate: string[] = [];\n\n if (id) {\n idsToUpdate = [id];\n } else if (filter) {\n // Validate filter is not empty\n if (Object.keys(filter).length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'EMPTY_FILTER'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Filter cannot be an empty object',\n details: { indexName },\n });\n }\n\n // Query for matching vectors to get their IDs\n const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));\n const translatedFilter = this.filterTranslator.translate(filter);\n\n const results = await namespace.query({\n vector: dummyVector,\n top_k: 10000, // Get all matching vectors\n filters: translatedFilter,\n include_vectors: update.vector ? true : false, // Only fetch vectors if we're not replacing them\n include_attributes: ['*'],\n });\n\n idsToUpdate = results.map(r => String(r.id));\n\n // If we're doing a partial update (only metadata or only vector), we need existing data\n if (!update.vector || !update.metadata) {\n for (const result of results) {\n const record: Vector = { id: result.id };\n if (update.vector) {\n record.vector = update.vector;\n } else if (result.vector) {\n record.vector = result.vector;\n }\n if (update.metadata) {\n record.attributes = update.metadata;\n } else if (result.attributes) {\n record.attributes = result.attributes;\n }\n await namespace.upsert({\n vectors: [record],\n distance_metric: distanceMetric,\n });\n }\n return;\n }\n }\n\n // If no vectors to update, return early\n if (idsToUpdate.length === 0) {\n this.logger.info(`No vectors matched the criteria for update in ${indexName}`);\n return;\n }\n\n // Full update - we have both vector and metadata (or just one without needing existing data)\n const records: Vector[] = idsToUpdate.map(vecId => {\n const record: Vector = { id: vecId };\n if (update.vector) record.vector = update.vector;\n if (update.metadata) record.attributes = update.metadata;\n return record;\n });\n\n // Batch updates in chunks of 1000\n const batchSize = 1000;\n for (let i = 0; i < records.length; i += batchSize) {\n const batch = records.slice(i, i + batchSize);\n await namespace.upsert({\n vectors: batch,\n distance_metric: distanceMetric,\n });\n }\n } catch (error: any) {\n if (error instanceof MastraError) throw error;\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'UPDATE_VECTOR', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: {\n indexName,\n ...(id && { id }),\n ...(filter && { filter: JSON.stringify(filter) }),\n },\n },\n error,\n );\n }\n }\n\n /**\n * Deletes a vector by its ID.\n * @param indexName - The name of the index containing the vector.\n * @param id - The ID of the vector to delete.\n * @returns A promise that resolves when the deletion is complete.\n * @throws Will throw an error if the deletion operation fails.\n */\n async deleteVector({ indexName, id }: DeleteVectorParams): Promise<void> {\n try {\n const namespace = this.client.namespace(indexName);\n await namespace.delete({ ids: [id] });\n } catch (error: any) {\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTOR', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: { indexName },\n },\n error,\n );\n }\n }\n\n async deleteVectors({ indexName, filter, ids }: DeleteVectorsParams<TurbopufferVectorFilter>): Promise<void> {\n // Validate mutually exclusive parameters\n if (ids && filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'MUTUALLY_EXCLUSIVE'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'ids and filter are mutually exclusive',\n details: { indexName },\n });\n }\n\n if (!ids && !filter) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'NO_TARGET'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Either filter or ids must be provided',\n details: { indexName },\n });\n }\n\n // Validate non-empty arrays and objects\n if (ids && ids.length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'EMPTY_IDS'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'ids array cannot be empty',\n details: { indexName },\n });\n }\n\n if (filter && Object.keys(filter).length === 0) {\n throw new MastraError({\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'EMPTY_FILTER'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.USER,\n text: 'Filter cannot be an empty object',\n details: { indexName },\n });\n }\n\n try {\n const namespace = this.client.namespace(indexName);\n let idsToDelete: string[] = [];\n\n if (ids) {\n idsToDelete = ids;\n } else if (filter) {\n // Query for matching vectors to get their IDs\n const createIndex = this.createIndexCache.get(indexName);\n if (!createIndex) {\n throw new Error(`createIndex() not called for this index`);\n }\n\n const dummyVector = new Array(createIndex.dimension).fill(1 / Math.sqrt(createIndex.dimension));\n const translatedFilter = this.filterTranslator.translate(filter);\n\n const results = await namespace.query({\n vector: dummyVector,\n top_k: 10000, // Get all matching vectors\n filters: translatedFilter,\n include_vectors: false,\n include_attributes: [],\n });\n\n idsToDelete = results.map(r => String(r.id));\n }\n\n // If no IDs to delete, return early\n if (idsToDelete.length === 0) {\n this.logger.info(`No vectors matched the criteria for deletion in ${indexName}`);\n return;\n }\n\n // The turbopuffer SDK has a limit of 1000 IDs per delete request.\n const batchSize = 1000;\n for (let i = 0; i < idsToDelete.length; i += batchSize) {\n const batch = idsToDelete.slice(i, i + batchSize);\n await namespace.delete({ ids: batch });\n }\n } catch (error: any) {\n if (error instanceof MastraError) throw error;\n throw new MastraError(\n {\n id: createVectorErrorId('TURBOPUFFER', 'DELETE_VECTORS', 'FAILED'),\n domain: ErrorDomain.STORAGE,\n category: ErrorCategory.THIRD_PARTY,\n details: {\n indexName,\n ...(filter && { filter: JSON.stringify(filter) }),\n ...(ids && { idsCount: ids.length }),\n },\n },\n error,\n );\n }\n }\n}\n"]}
|
package/dist/vector/index.d.ts
CHANGED
|
@@ -1,4 +1,4 @@
|
|
|
1
|
-
import type { CreateIndexParams, DeleteIndexParams, DeleteVectorParams, DescribeIndexParams, IndexStats, QueryResult, QueryVectorParams, UpdateVectorParams, UpsertVectorParams } from '@mastra/core/vector';
|
|
1
|
+
import type { CreateIndexParams, DeleteIndexParams, DeleteVectorParams, DescribeIndexParams, IndexStats, QueryResult, QueryVectorParams, UpdateVectorParams, UpsertVectorParams, DeleteVectorsParams } from '@mastra/core/vector';
|
|
2
2
|
import { MastraVector } from '@mastra/core/vector';
|
|
3
3
|
import type { Schema } from '@turbopuffer/turbopuffer';
|
|
4
4
|
import type { TurbopufferVectorFilter } from './filter.js';
|
|
@@ -66,16 +66,17 @@ export declare class TurbopufferVector extends MastraVector<TurbopufferVectorFil
|
|
|
66
66
|
describeIndex({ indexName }: DescribeIndexParams): Promise<IndexStats>;
|
|
67
67
|
deleteIndex({ indexName }: DeleteIndexParams): Promise<void>;
|
|
68
68
|
/**
|
|
69
|
-
* Updates a vector by its ID with the provided vector and/or metadata.
|
|
69
|
+
* Updates a vector by its ID or filter with the provided vector and/or metadata.
|
|
70
70
|
* @param indexName - The name of the index containing the vector.
|
|
71
71
|
* @param id - The ID of the vector to update.
|
|
72
|
+
* @param filter - The filter to match vectors to update.
|
|
72
73
|
* @param update - An object containing the vector and/or metadata to update.
|
|
73
74
|
* @param update.vector - An optional array of numbers representing the new vector.
|
|
74
75
|
* @param update.metadata - An optional record containing the new metadata.
|
|
75
76
|
* @returns A promise that resolves when the update is complete.
|
|
76
77
|
* @throws Will throw an error if no updates are provided or if the update operation fails.
|
|
77
78
|
*/
|
|
78
|
-
updateVector({ indexName, id, update }: UpdateVectorParams): Promise<void>;
|
|
79
|
+
updateVector({ indexName, id, filter, update }: UpdateVectorParams<TurbopufferVectorFilter>): Promise<void>;
|
|
79
80
|
/**
|
|
80
81
|
* Deletes a vector by its ID.
|
|
81
82
|
* @param indexName - The name of the index containing the vector.
|
|
@@ -84,6 +85,7 @@ export declare class TurbopufferVector extends MastraVector<TurbopufferVectorFil
|
|
|
84
85
|
* @throws Will throw an error if the deletion operation fails.
|
|
85
86
|
*/
|
|
86
87
|
deleteVector({ indexName, id }: DeleteVectorParams): Promise<void>;
|
|
88
|
+
deleteVectors({ indexName, filter, ids }: DeleteVectorsParams<TurbopufferVectorFilter>): Promise<void>;
|
|
87
89
|
}
|
|
88
90
|
export {};
|
|
89
91
|
//# sourceMappingURL=index.d.ts.map
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/vector/index.ts"],"names":[],"mappings":"
|
|
1
|
+
{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/vector/index.ts"],"names":[],"mappings":"AAEA,OAAO,KAAK,EACV,iBAAiB,EACjB,iBAAiB,EACjB,kBAAkB,EAClB,mBAAmB,EACnB,UAAU,EACV,WAAW,EACX,iBAAiB,EACjB,kBAAkB,EAClB,kBAAkB,EAClB,mBAAmB,EACpB,MAAM,qBAAqB,CAAC;AAC7B,OAAO,EAAE,YAAY,EAAE,MAAM,qBAAqB,CAAC;AAEnD,OAAO,KAAK,EAAgC,MAAM,EAAU,MAAM,0BAA0B,CAAC;AAE7F,OAAO,KAAK,EAAE,uBAAuB,EAAE,MAAM,UAAU,CAAC;AAExD,KAAK,4BAA4B,GAAG,iBAAiB,CAAC,uBAAuB,CAAC,CAAC;AAE/E,MAAM,WAAW,wBAAwB;IACvC,wCAAwC;IACxC,MAAM,EAAE,MAAM,CAAC;IACf,4DAA4D;IAC5D,OAAO,CAAC,EAAE,MAAM,CAAC;IACjB,wGAAwG;IACxG,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,0FAA0F;IAC1F,qBAAqB,CAAC,EAAE,MAAM,CAAC;IAC/B,4FAA4F;IAC5F,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB,qFAAqF;IACrF,WAAW,CAAC,EAAE,OAAO,CAAC;IACtB;;;;;;;;;;;;;;;;;;;;;;;OAuBG;IACH,oBAAoB,CAAC,EAAE,CAAC,SAAS,EAAE,MAAM,KAAK;QAC5C,UAAU,EAAE,MAAM,CAAC;QACnB,MAAM,EAAE,MAAM,CAAC;KAChB,CAAC;CACH;AAED,qBAAa,iBAAkB,SAAQ,YAAY,CAAC,uBAAuB,CAAC;IAC1E,OAAO,CAAC,MAAM,CAAc;IAC5B,OAAO,CAAC,gBAAgB,CAA8B;IAItD,OAAO,CAAC,gBAAgB,CAKV;IACd,OAAO,CAAC,IAAI,CAA2B;gBAE3B,IAAI,EAAE,wBAAwB,GAAG;QAAE,EAAE,EAAE,MAAM,CAAA;KAAE;IAOrD,WAAW,CAAC,EAAE,SAAS,EAAE,SAAS,EAAE,MAAM,EAAE,EAAE,iBAAiB,GAAG,OAAO,CAAC,IAAI,CAAC;IA+C/E,MAAM,CAAC,EAAE,SAAS,EAAE,OAAO,EAAE,QAAQ,EAAE,GAAG,EAAE,EAAE,kBAAkB,GAAG,OAAO,CAAC,MAAM,EAAE,CAAC;IA6EpF,KAAK,CAAC,EACV,SAAS,EACT,WAAW,EACX,IAAI,EACJ,MAAM,EACN,aAAa,GACd,EAAE,4BAA4B,GAAG,OAAO,CAAC,WAAW,EAAE,CAAC;IA2DlD,WAAW,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;IAgBtC;;;;;OAKG;IACG,aAAa,CAAC,EAAE,SAAS,EAAE,EAAE,mBAAmB,GAAG,OAAO,CAAC,UAAU,CAAC;IA4BtE,WAAW,CAAC,EAAE,SAAS,EAAE,EAAE,iBAAiB,GAAG,OAAO,CAAC,IAAI,CAAC;IAkBlE;;;;;;;;;;OAUG;IACG,YAAY,CAAC,EAAE,SAAS,EAAE,EAAE,EAAE,MAAM,EAAE,MAAM,EAAE,EAAE,kBAAkB,CAAC,uBAAuB,CAAC,GAAG,OAAO,CAAC,IAAI,CAAC;IAqJjH;;;;;;OAMG;IACG,YAAY,CAAC,EAAE,SAAS,EAAE,EAAE,EAAE,EAAE,kBAAkB,GAAG,OAAO,CAAC,IAAI,CAAC;IAiBlE,aAAa,CAAC,EAAE,SAAS,EAAE,MAAM,EAAE,GAAG,EAAE,EAAE,mBAAmB,CAAC,uBAAuB,CAAC,GAAG,OAAO,CAAC,IAAI,CAAC;CAmG7G"}
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@mastra/turbopuffer",
|
|
3
|
-
"version": "1.0.0-beta.
|
|
3
|
+
"version": "1.0.0-beta.2",
|
|
4
4
|
"description": "Turbopuffer vector store provider for Mastra",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"files": [
|
|
@@ -28,15 +28,18 @@
|
|
|
28
28
|
},
|
|
29
29
|
"devDependencies": {
|
|
30
30
|
"@microsoft/api-extractor": "^7.52.8",
|
|
31
|
-
"@types/node": "
|
|
31
|
+
"@types/node": "22.13.17",
|
|
32
|
+
"@vitest/coverage-v8": "4.0.12",
|
|
33
|
+
"@vitest/ui": "4.0.12",
|
|
32
34
|
"dotenv": "^17.0.0",
|
|
33
35
|
"eslint": "^9.37.0",
|
|
34
36
|
"tsup": "^8.5.0",
|
|
35
37
|
"typescript": "^5.8.3",
|
|
36
|
-
"vitest": "
|
|
38
|
+
"vitest": "4.0.12",
|
|
37
39
|
"@internal/lint": "0.0.53",
|
|
38
|
-
"@
|
|
39
|
-
"@internal/
|
|
40
|
+
"@internal/types-builder": "0.0.28",
|
|
41
|
+
"@internal/storage-test-utils": "0.0.49",
|
|
42
|
+
"@mastra/core": "1.0.0-beta.7"
|
|
40
43
|
},
|
|
41
44
|
"peerDependencies": {
|
|
42
45
|
"@mastra/core": ">=1.0.0-0 <2.0.0-0"
|