@memberjunction/content-autotagging 5.21.0 → 5.23.0

package/README.md

@@ -1,10 +1,10 @@
 # @memberjunction/content-autotagging
 
-AI-powered content ingestion and autotagging engine for MemberJunction. Scans content from multiple sources (local files, websites, RSS feeds, cloud storage), extracts text from documents, and uses LLMs to generate tags, summaries, and metadata attributes.
+AI-powered content ingestion, autotagging, and vectorization engine for MemberJunction. Scans content from multiple sources (local files, websites, RSS feeds, cloud storage), extracts text from documents, uses LLMs to generate weighted tags and metadata attributes, and vectorizes content for semantic search.
 
 ## Overview
 
-The `@memberjunction/content-autotagging` package provides an extensible framework for ingesting content from diverse sources and leveraging AI models to extract meaningful tags, summaries, and metadata. Built on the MemberJunction platform, it helps organizations automatically organize and categorize their content.
+The `@memberjunction/content-autotagging` package provides an extensible framework for ingesting content from diverse sources and leveraging AI models to extract meaningful tags, summaries, and metadata. Built on the MemberJunction platform, it helps organizations automatically organize and categorize their content. The engine uses the managed **"Content Autotagging"** AI prompt via `AIPromptRunner` (rather than direct `BaseLLM` calls), enabling prompt versioning, model routing, and centralized prompt management.
 
 ```mermaid
 graph TD
@@ -19,10 +19,14 @@ graph TD
     G --> I["Office Parser"]
     G --> J["HTML Parser<br/>(Cheerio)"]
 
-    A --> K["LLM Processing"]
-    K --> L["Tag Generation"]
+    A --> K["AIPromptRunner<br/>(Content Autotagging prompt)"]
+    K --> L["Tag Generation<br/>(with weights)"]
     K --> M["Attribute Extraction"]
 
+    A --> V["Vectorization"]
+    V --> W["Embedding Model"]
+    V --> X["Vector DB Upsert"]
+
     A --> N["Content Items<br/>(Database)"]
     A --> O["Content Item Attributes<br/>(Database)"]
 
@@ -34,10 +38,21 @@ graph TD
     style F fill:#2d8659,stroke:#1a5c3a,color:#fff
     style G fill:#b8762f,stroke:#8a5722,color:#fff
     style K fill:#7c5295,stroke:#563a6b,color:#fff
+    style V fill:#2d6a9f,stroke:#1a4971,color:#fff
     style N fill:#2d6a9f,stroke:#1a4971,color:#fff
     style O fill:#2d6a9f,stroke:#1a4971,color:#fff
 ```
 
+## Key Features
+
+- **AIPromptRunner integration**: Uses the managed "Content Autotagging" prompt, enabling prompt versioning and model routing through MJ's prompt management system (no direct `BaseLLM` calls)
+- **Tag weights**: Each generated tag includes a relevance weight (0.0--1.0) indicating how strongly the tag relates to the content
+- **Batch processing**: Configurable batch size (default: 20) with concurrent processing within each batch
+- **Parallel tagging + vectorization**: Tagging and vectorization run in parallel for maximum throughput
+- **Per-source/type embedding model selection**: Cascade resolution for embedding model and vector index -- source override, then content type default, then global fallback (first active vector index)
+- **Real-time progress reporting**: `AutotagProgressCallback` provides per-item progress updates during processing
+- **Graceful provider skip**: Providers skip gracefully when no content sources are configured for their type
+
 ## Installation
 
 ```bash
@@ -51,7 +66,8 @@ sequenceDiagram
     participant Source as Content Source
     participant Engine as AutotagBaseEngine
     participant Extract as Text Extractor
-    participant AI as LLM
+    participant Prompt as AIPromptRunner
+    participant Vec as Embedding + VectorDB
     participant DB as Database
 
     Source->>Engine: Provide content items
@@ -59,9 +75,14 @@ sequenceDiagram
     Engine->>Extract: Extract text (PDF/Office/HTML)
     Extract-->>Engine: Raw text
     Engine->>Engine: Chunk text for token limits
-    Engine->>AI: Generate tags and attributes
-    AI-->>Engine: Structured metadata
-    Engine->>DB: Save ContentItem + Attributes
+    par Tagging
+        Engine->>Prompt: Run "Content Autotagging" prompt
+        Prompt-->>Engine: Tags (with weights) + Attributes
+    and Vectorization
+        Engine->>Vec: Embed text + upsert to vector DB
+        Vec-->>Engine: Vectorization result
+    end
+    Engine->>DB: Save ContentItem + Tags + Attributes
     Engine->>DB: Create ProcessRun record
 ```
 
@@ -74,7 +95,7 @@ sequenceDiagram
 | RSS Feeds | `AutotagRSSFeed` | Parses RSS/Atom feeds for articles |
 | Azure Blob | `AutotagAzureBlob` | Processes files from Azure Blob Storage |
 
-All sources extend `AutotagBase`, which provides the common interface for content discovery and ingestion.
+All sources extend `AutotagBase`, which provides the common interface for content discovery and ingestion. Each source's `Autotag()` method accepts an optional `AutotagProgressCallback` for real-time progress reporting. Sources skip gracefully when no content sources of their type are configured in the database.
 
 ## Supported File Formats
 
@@ -85,6 +106,32 @@ All sources extend `AutotagBase`, which provides the common interface for conten
 | HTML/Web Pages | `cheerio` | .html, .htm |
 | Plain Text | Native | .txt, .md, .csv |
 
+## Tag Weights
+
+The LLM prompt returns tags with relevance weights between 0.0 and 1.0 indicating how strongly each tag relates to the content. Both old-style (plain string array) and new-style (object with `tag` + `weight`) responses are supported:
+
+```json
+// New format (preferred) — returned by the "Content Autotagging" prompt
+[
+  { "tag": "machine learning", "weight": 0.95 },
+  { "tag": "neural networks", "weight": 0.82 },
+  { "tag": "data science", "weight": 0.70 }
+]
+
+// Legacy format — auto-normalized with weight 1.0
+["machine learning", "neural networks", "data science"]
+```
+
+## Embedding Model and Vector Index Resolution
+
+The engine resolves the embedding model and vector index for each content item using a three-level cascade:
+
+1. **Content Source override**: If the source has `EmbeddingModelID` and `VectorIndexID` set, those are used
+2. **Content Type default**: If the source has no override, the content type's defaults are used
+3. **Global fallback**: If neither source nor type specifies, the first active vector index in the system is used
+
+Items sharing the same (embeddingModel, vectorIndex) pair are grouped and processed together for efficient batching.
+
 ## Usage
 
 ### RSS Feed Processing
@@ -93,7 +140,9 @@ All sources extend `AutotagBase`, which provides the common interface for conten
 import { AutotagRSSFeed } from '@memberjunction/content-autotagging';
 
 const rssTagger = new AutotagRSSFeed();
-await rssTagger.Autotag(contextUser);
+await rssTagger.Autotag(contextUser, (processed, total, currentItem) => {
+    console.log(`[${processed}/${total}] Processing: ${currentItem}`);
+});
 ```
 
 ### Website Content Processing
@@ -133,13 +182,19 @@ await blobTagger.Autotag(contextUser);
 import { AutotagBaseEngine } from '@memberjunction/content-autotagging';
 
 const engine = AutotagBaseEngine.Instance;
-await engine.ExtractTextAndProcessWithLLM(contentItems, contextUser);
+
+// Process content items with custom batch size
+await engine.ExtractTextAndProcessWithLLM(contentItems, contextUser, batchSize);
+
+// Vectorize content items (runs in parallel with tagging)
+const result = await engine.VectorizeContentItems(contentItems, tagMap, contextUser, batchSize);
+console.log(`Vectorized: ${result.vectorized}, Skipped: ${result.skipped}`);
 ```
 
 ## Creating a Custom Content Source
 
 ```typescript
-import { AutotagBase } from '@memberjunction/content-autotagging';
+import { AutotagBase, AutotagProgressCallback } from '@memberjunction/content-autotagging';
 import { RegisterClass } from '@memberjunction/global';
 
 @RegisterClass(AutotagBase, 'AutotagCustomSource')
@@ -149,13 +204,14 @@ export class AutotagCustomSource extends AutotagBase {
     return contentItems;
   }
 
-  public async Autotag(contextUser) {
+  public async Autotag(contextUser, onProgress?: AutotagProgressCallback) {
     const contentSourceTypeID = await this.engine.setSubclassContentSourceType(
       'Custom Source', contextUser
     );
     const contentSources = await this.engine.getAllContentSources(
       contextUser, contentSourceTypeID
     );
+    if (contentSources.length === 0) return; // Skip gracefully
     const contentItems = await this.SetContentItemsToProcess(contentSources);
     await this.engine.ExtractTextAndProcessWithLLM(contentItems, contextUser);
   }
@@ -166,12 +222,12 @@ export class AutotagCustomSource extends AutotagBase {
 
 | Entity | Purpose |
 |--------|---------|
-| Content Sources | Configuration for each content source |
+| Content Sources | Configuration for each content source (with optional EmbeddingModelID/VectorIndexID overrides) |
 | Content Items | Individual pieces of content with extracted text |
-| Content Item Tags | AI-generated tags |
+| Content Item Tags | AI-generated tags with relevance weights (0.0--1.0) |
 | Content Item Attributes | Additional extracted metadata |
 | Content Process Runs | Processing history and audit trail |
-| Content Types | Content categorization definitions |
+| Content Types | Content categorization definitions (with default EmbeddingModelID/VectorIndexID) |
 | Content Source Types | Source type definitions |
 | Content File Types | Supported file format definitions |
 
@@ -182,8 +238,12 @@ export class AutotagCustomSource extends AutotagBase {
 | `@memberjunction/core` | Entity system and metadata |
 | `@memberjunction/global` | Class registration |
 | `@memberjunction/core-entities` | Content entity types |
-| `@memberjunction/ai` | LLM integration |
-| `@memberjunction/aiengine` | AI Engine base class |
+| `@memberjunction/ai` | Embedding model integration |
+| `@memberjunction/aiengine` | AI Engine for prompt cache access |
+| `@memberjunction/ai-prompts` | AIPromptRunner for managed prompt execution |
+| `@memberjunction/ai-core-plus` | AIPromptParams types |
+| `@memberjunction/ai-vectors` | TextChunker for content chunking |
+| `@memberjunction/ai-vectordb` | VectorDBBase for vector storage |
 | `pdf-parse` | PDF text extraction |
 | `officeparser` | Office document parsing |
 | `cheerio` | HTML parsing |

package/dist/CloudStorage/generic/CloudStorageBase.d.ts

@@ -1,4 +1,4 @@
-import { AutotagBase } from "../../Core/index.js";
+import { AutotagBase, AutotagProgressCallback } from "../../Core/index.js";
 import { AutotagBaseEngine } from "../../Engine/index.js";
 import { ContentSourceParams } from "../../Engine/index.js";
 import { UserInfo } from "@memberjunction/core";
@@ -22,7 +22,7 @@ export declare abstract class CloudStorageBase extends AutotagBase {
      * @returns - An array of content source items that have been modified or added after the most recent process run for that content source
     */
     abstract SetNewAndModifiedContentItems(contentSourceParams: ContentSourceParams, lastRunDate: Date, contextUser: UserInfo): Promise<MJContentItemEntity[]>;
-    Autotag(contextUser: UserInfo): Promise<void>;
+    Autotag(contextUser: UserInfo, onProgress?: AutotagProgressCallback): Promise<void>;
     SetContentItemsToProcess(contentSources: MJContentSourceEntity[]): Promise<MJContentItemEntity[]>;
 }
 //# sourceMappingURL=CloudStorageBase.d.ts.map

package/dist/CloudStorage/generic/CloudStorageBase.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"CloudStorageBase.d.ts","sourceRoot":"","sources":["../../../src/CloudStorage/generic/CloudStorageBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,WAAW,EAAE,MAAM,YAAY,CAAC;AACzC,OAAO,EAAE,iBAAiB,EAAE,MAAM,cAAc,CAAC;AACjD,OAAO,EAAE,mBAAmB,EAAE,MAAM,cAAc,CAAC;AACnD,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,EAAE,qBAAqB,EAAE,mBAAmB,EAAE,MAAM,+BAA+B,CAAC;AAI3F,8BAAsB,gBAAiB,SAAQ,WAAW;IACtD,SAAS,CAAC,WAAW,EAAE,QAAQ,CAAC;IAChC,SAAS,CAAC,MAAM,EAAE,iBAAiB,CAAC;IACpC,SAAS,CAAC,mBAAmB,EAAE,MAAM,CAAA;;IAOrC;;MAEE;aACc,YAAY,IAAI,OAAO,CAAC,IAAI,CAAC;IAE7C;;;;;;;;MAQE;aACc,6BAA6B,CAAC,mBAAmB,EAAE,mBAAmB,EAAE,WAAW,EAAE,IAAI,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;IAEpJ,OAAO,CAAC,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAQ7C,wBAAwB,CAAC,cAAc,EAAE,qBAAqB,EAAE,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;CAyBjH"}
+{"version":3,"file":"CloudStorageBase.d.ts","sourceRoot":"","sources":["../../../src/CloudStorage/generic/CloudStorageBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,WAAW,EAAE,uBAAuB,EAAE,MAAM,YAAY,CAAC;AAClE,OAAO,EAAE,iBAAiB,EAAE,MAAM,cAAc,CAAC;AACjD,OAAO,EAAE,mBAAmB,EAAE,MAAM,cAAc,CAAC;AACnD,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,EAAE,qBAAqB,EAAE,mBAAmB,EAAE,MAAM,+BAA+B,CAAC;AAI3F,8BAAsB,gBAAiB,SAAQ,WAAW;IACtD,SAAS,CAAC,WAAW,EAAE,QAAQ,CAAC;IAChC,SAAS,CAAC,MAAM,EAAE,iBAAiB,CAAC;IACpC,SAAS,CAAC,mBAAmB,EAAE,MAAM,CAAA;;IAOrC;;MAEE;aACc,YAAY,IAAI,OAAO,CAAC,IAAI,CAAC;IAE7C;;;;;;;;MAQE;aACc,6BAA6B,CAAC,mBAAmB,EAAE,mBAAmB,EAAE,WAAW,EAAE,IAAI,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;IAEpJ,OAAO,CAAC,WAAW,EAAE,QAAQ,EAAE,UAAU,CAAC,EAAE,uBAAuB,GAAG,OAAO,CAAC,IAAI,CAAC;IAQnF,wBAAwB,CAAC,cAAc,EAAE,qBAAqB,EAAE,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;CAyBjH"}

package/dist/CloudStorage/generic/CloudStorageBase.js

@@ -7,12 +7,12 @@ export class CloudStorageBase extends AutotagBase {
         super();
         this.engine = AutotagBaseEngine.Instance;
     }
-    async Autotag(contextUser) {
+    async Autotag(contextUser, onProgress) {
         this.contextUser = contextUser;
-        this.contentSourceTypeID = await this.engine.setSubclassContentSourceType('Cloud Storage', this.contextUser);
+        this.contentSourceTypeID = this.engine.SetSubclassContentSourceType('Cloud Storage');
         const contentSources = await this.engine.getAllContentSources(this.contextUser, this.contentSourceTypeID) || [];
         const contentItemsToProcess = await this.SetContentItemsToProcess(contentSources);
-        await this.engine.ExtractTextAndProcessWithLLM(contentItemsToProcess, this.contextUser);
+        await this.engine.ExtractTextAndProcessWithLLM(contentItemsToProcess, this.contextUser, undefined, onProgress);
     }
     async SetContentItemsToProcess(contentSources) {
         const contentItemsToProcess = [];

package/dist/CloudStorage/generic/CloudStorageBase.js.map

@@ -1 +1 @@
-{"version":3,"file":"CloudStorageBase.js","sourceRoot":"","sources":["../../../src/CloudStorage/generic/CloudStorageBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,WAAW,EAAE,MAAM,YAAY,CAAC;AACzC,OAAO,EAAE,iBAAiB,EAAE,MAAM,cAAc,CAAC;AAIjD,OAAO,MAAM,MAAM,QAAQ,CAAC;AAC5B,MAAM,CAAC,MAAM,CAAC,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAA;AAE9B,MAAM,OAAgB,gBAAiB,SAAQ,WAAW;IAKtD;QACI,KAAK,EAAE,CAAC;QACR,IAAI,CAAC,MAAM,GAAG,iBAAiB,CAAC,QAAQ,CAAC;IAC7C,CAAC;IAkBM,KAAK,CAAC,OAAO,CAAC,WAAqB;QACtC,IAAI,CAAC,WAAW,GAAG,WAAW,CAAC;QAC/B,IAAI,CAAC,mBAAmB,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,4BAA4B,CAAC,eAAe,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;QAC7G,MAAM,cAAc,GAA4B,MAAM,IAAI,CAAC,MAAM,CAAC,oBAAoB,CAAC,IAAI,CAAC,WAAW,EAAE,IAAI,CAAC,mBAAmB,CAAC,IAAI,EAAE,CAAC;QACzI,MAAM,qBAAqB,GAA0B,MAAM,IAAI,CAAC,wBAAwB,CAAC,cAAc,CAAC,CAAA;QACxG,MAAM,IAAI,CAAC,MAAM,CAAC,4BAA4B,CAAC,qBAAqB,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;IAC5F,CAAC;IAEM,KAAK,CAAC,wBAAwB,CAAC,cAAuC;QACzE,MAAM,qBAAqB,GAA0B,EAAE,CAAA;QAEvD,KAAK,MAAM,aAAa,IAAI,cAAc,EAAE,CAAC;YACzC,MAAM,IAAI,CAAC,YAAY,EAAE,CAAC;YAE1B,MAAM,mBAAmB,GAAwB;gBAC7C,eAAe,EAAE,aAAa,CAAC,EAAE;gBACjC,IAAI,EAAE,aAAa,CAAC,IAAI;gBACxB,aAAa,EAAE,aAAa,CAAC,aAAa;gBAC1C,mBAAmB,EAAE,aAAa,CAAC,mBAAmB;gBACtD,iBAAiB,EAAE,aAAa,CAAC,iBAAiB;gBAClD,GAAG,EAAE,aAAa,CAAC,GAAG;aACzB,CAAA;YAED,MAAM,WAAW,GAAS,MAAM,IAAI,CAAC,MAAM,CAAC,2BAA2B,CAAC,mBAAmB,CAAC,eAAe,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;YAE/H,IAAI,WAAW,EAAE,CAAC;gBACd,MAAM,YAAY,GAAG,MAAM,IAAI,CAAC,6BAA6B,CAAC,mBAAmB,EAAE,WAAW,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;gBAClH,qBAAqB,CAAC,IAAI,CAAC,GAAG,YAAY,CAAC,CAAC;YAChD,CAAC;QACL,CAAC;QAED,OAAO,qBAAqB,CAAC;IACjC,CAAC;CACJ"}
+{"version":3,"file":"CloudStorageBase.js","sourceRoot":"","sources":["../../../src/CloudStorage/generic/CloudStorageBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,WAAW,EAA2B,MAAM,YAAY,CAAC;AAClE,OAAO,EAAE,iBAAiB,EAAE,MAAM,cAAc,CAAC;AAIjD,OAAO,MAAM,MAAM,QAAQ,CAAC;AAC5B,MAAM,CAAC,MAAM,CAAC,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAA;AAE9B,MAAM,OAAgB,gBAAiB,SAAQ,WAAW;IAKtD;QACI,KAAK,EAAE,CAAC;QACR,IAAI,CAAC,MAAM,GAAG,iBAAiB,CAAC,QAAQ,CAAC;IAC7C,CAAC;IAkBM,KAAK,CAAC,OAAO,CAAC,WAAqB,EAAE,UAAoC;QAC5E,IAAI,CAAC,WAAW,GAAG,WAAW,CAAC;QAC/B,IAAI,CAAC,mBAAmB,GAAG,IAAI,CAAC,MAAM,CAAC,4BAA4B,CAAC,eAAe,CAAC,CAAC;QACrF,MAAM,cAAc,GAA4B,MAAM,IAAI,CAAC,MAAM,CAAC,oBAAoB,CAAC,IAAI,CAAC,WAAW,EAAE,IAAI,CAAC,mBAAmB,CAAC,IAAI,EAAE,CAAC;QACzI,MAAM,qBAAqB,GAA0B,MAAM,IAAI,CAAC,wBAAwB,CAAC,cAAc,CAAC,CAAA;QACxG,MAAM,IAAI,CAAC,MAAM,CAAC,4BAA4B,CAAC,qBAAqB,EAAE,IAAI,CAAC,WAAW,EAAE,SAAS,EAAE,UAAU,CAAC,CAAC;IACnH,CAAC;IAEM,KAAK,CAAC,wBAAwB,CAAC,cAAuC;QACzE,MAAM,qBAAqB,GAA0B,EAAE,CAAA;QAEvD,KAAK,MAAM,aAAa,IAAI,cAAc,EAAE,CAAC;YACzC,MAAM,IAAI,CAAC,YAAY,EAAE,CAAC;YAE1B,MAAM,mBAAmB,GAAwB;gBAC7C,eAAe,EAAE,aAAa,CAAC,EAAE;gBACjC,IAAI,EAAE,aAAa,CAAC,IAAI;gBACxB,aAAa,EAAE,aAAa,CAAC,aAAa;gBAC1C,mBAAmB,EAAE,aAAa,CAAC,mBAAmB;gBACtD,iBAAiB,EAAE,aAAa,CAAC,iBAAiB;gBAClD,GAAG,EAAE,aAAa,CAAC,GAAG;aACzB,CAAA;YAED,MAAM,WAAW,GAAS,MAAM,IAAI,CAAC,MAAM,CAAC,2BAA2B,CAAC,mBAAmB,CAAC,eAAe,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;YAE/H,IAAI,WAAW,EAAE,CAAC;gBACd,MAAM,YAAY,GAAG,MAAM,IAAI,CAAC,6BAA6B,CAAC,mBAAmB,EAAE,WAAW,EAAE,IAAI,CAAC,WAAW,CAAC,CAAC;gBAClH,qBAAqB,CAAC,IAAI,CAAC,GAAG,YAAY,CAAC,CAAC;YAChD,CAAC;QACL,CAAC;QAED,OAAO,qBAAqB,CAAC;IACjC,CAAC;CACJ"}

package/dist/CloudStorage/providers/AutotagAzureBlob.js

@@ -38,7 +38,7 @@ export class AutotagAzureBlob extends CloudStorageBase {
                 const text = await this.extractText(blob.name);
                 contentItem.ContentSourceID = contentSourceParams.contentSourceID;
                 contentItem.Name = blob.name;
-                contentItem.Description = await this.engine.getContentItemDescription(contentSourceParams, contextUser);
+                contentItem.Description = this.engine.GetContentItemDescription(contentSourceParams);
                 contentItem.URL = filePath;
                 contentItem.ContentTypeID = contentSourceParams.ContentTypeID;
                 contentItem.ContentSourceTypeID = contentSourceParams.ContentSourceTypeID;

package/dist/CloudStorage/providers/AutotagAzureBlob.js.map

@@ -1 +1 @@
-{"version":3,"file":"AutotagAzureBlob.js","sourceRoot":"","sources":["../../../src/CloudStorage/providers/AutotagAzureBlob.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,gBAAgB,EAAE,MAAM,6BAA6B,CAAC;AAE/D,OAAO,EAAE,iBAAiB,EAAmB,MAAM,qBAAqB,CAAC;AACzE,OAAO,MAAM,MAAM,QAAQ,CAAC;AAE5B,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,IAAI,MAAM,MAAM,CAAC;AAExB,MAAM,CAAC,MAAM,CAAC,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAA;AAE9B,MAAM,OAAO,gBAAiB,SAAQ,gBAAgB;IAMlD,YAAY,gBAAwB,EAAE,aAAqB;QACvD,KAAK,EAAE,CAAC;QACR,IAAI,CAAC,gBAAgB,GAAG,gBAAgB,CAAA;QACxC,IAAI,CAAC,aAAa,GAAG,aAAa,CAAA;IACtC,CAAC;IAGD;;;MAGE;IACK,KAAK,CAAC,YAAY;QACrB,IAAI,CAAC;YACD,IAAI,CAAC,iBAAiB,GAAG,iBAAiB,CAAC,oBAAoB,CAAC,IAAI,CAAC,gBAAgB,CAAC,CAAC;YACvF,IAAI,KAAK,EAAE,MAAM,SAAS,IAAI,IAAI,CAAC,iBAAiB,CAAC,cAAc,EAAE,EAAE,CAAC;gBACpE,OAAO,CAAC,GAAG,CAAC,cAAc,SAAS,CAAC,IAAI,EAAE,CAAC,CAAC;YAChD,CAAC;YAED,IAAI,CAAC,eAAe,GAAG,IAAI,CAAC,iBAAiB,CAAC,kBAAkB,CAAC,IAAI,CAAC,aAAa,CAAC,CAAC;QACzF,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACb,OAAO,CAAC,KAAK,CAAC,KAAK,CAAC,CAAA;YACpB,MAAM,IAAI,KAAK,CAAC,4CAA4C,CAAC,CAAA;QACjE,CAAC;IACL,CAAC;IAEM,KAAK,CAAC,6BAA6B,CAAC,mBAAwC,EAAE,WAAiB,EAAE,WAAqB,EAAE,MAAM,GAAC,EAAE;QACpI,MAAM,qBAAqB,GAA0B,EAAE,CAAA;QAEvD,IAAI,KAAK,EAAE,MAAM,IAAI,IAAI,IAAI,CAAC,eAAe,CAAC,aAAa,EAAE,EAAE,CAAC;YAC5D,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,aAAa,EAAE,IAAI,CAAC,IAAI,CAAC,CAAA;YACzD,IAAI,IAAI,CAAC,UAAU,CAAC,SAAS,IAAI,IAAI,CAAC,UAAU,CAAC,SAAS,GAAG,WAAW,EAAE,CAAC;gBACvE,4DAA4D;gBAC5D,MAAM,EAAE,GAAG,IAAI,QAAQ,EAAE,CAAA;gBACzB,MAAM,WAAW,GAAG,MAAM,EAAE,CAAC,eAAe,CAAsB,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACnG,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,WAAW,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;gBAC9C,WAAW,CAAC,eAAe,GAAG,mBAAmB,CAAC,eAAe,CAAA;gBACjE,WAAW,CAAC,IAAI,GAAG,IAAI,CAAC,IAAI,CAAA;gBAC5B,WAAW,CAAC,WAAW,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,yBAAyB,CAAC,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACvG,WAAW,CAAC,GAAG,GAAG,QAAQ,CAAA;gBAC1B,WAAW,CAAC,aAAa,GAAG,mBAAmB,CAAC,aAAa,CAAA;gBAC7D,WAAW,CAAC,mBAAmB,GAAI,mBAAmB,CAAC,mBAAmB,CAAA;gBAC1E,WAAW,CAAC,iBAAiB,GAAG,mBAAmB,CAAC,iBAAiB,CAAA;gBACrE,WAAW,CAAC,QAAQ,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,IAAI,CAAC,CAAA;gBAClE,WAAW,CAAC,IAAI,GAAG,IAAI,CAAA;gBAEvB,MAAM,WAAW,CAAC,IAAI,EAAE,CAAA;gBACxB,qBAAqB,CAAC,IAAI,CAAC,WAAW,CAAC,CAAA;YAC3C,CAAC;iBACI,IAAI,IAAI,CAAC,UAAU,CAAC,YAAY,IAAI,IAAI,CAAC,UAAU,CAAC,YAAY,GAAG,WAAW,EAAE,CAAC;gBAClF,8DAA8D;gBAC9D,MAAM,EAAE,GAAG,IAAI,QAAQ,EAAE,CAAA;gBACzB,MAAM,WAAW,GAAG,MAAM,EAAE,CAAC,eAAe,CAAsB,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACnG,MAAM,aAAa,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,uBAAuB,CAAC,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACjG,MAAM,WAAW,CAAC,IAAI,CAAC,aAAa,CAAC,CAAA;gBACrC,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,WAAW,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;gBAC9C,WAAW,CAAC,IAAI,GAAG,IAAI,CAAA;gBACvB,WAAW,CAAC,QAAQ,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,IAAI,CAAC,CAAA;gBAClE,WAAW,CAAC,IAAI,EAAE,CAAA;gBAClB,qBAAqB,CAAC,IAAI,CAAC,WAAW,CAAC,CAAA;YAC3C,CAAC;QACL,CAAC;QAED,OAAO,qBAAqB,CAAA;IAChC,CAAC;IAEM,KAAK,CAAC,WAAW,CAAC,IAAY;QACjC,MAAM,eAAe,GAAG,IAAI,CAAC,eAAe,CAAC,kBAAkB,CAAC,IAAI,CAAC,CAAA;QACrE,MAAM,yBAAyB,GAAG,MAAM,eAAe,CAAC,QAAQ,EAAE,CAAA;QAClE,MAAM,QAAQ,GAAW,MAAM,IAAI,CAAC,cAAc,CAAC,yBAAyB,CAAC,kBAAkB,CAAC,CAAA;QAChG,MAAM,IAAI,GAAW,MAAM,IAAI,CAAC,MAAM,CAAC,QAAQ,CAAC,QAAQ,CAAC,CAAA;QACzD,OAAO,IAAI,CAAA;IACf,CAAC;IAEM,KAAK,CAAC,cAAc,CAAC,cAAqC;QAC7D,OAAO,IAAI,OAAO,CAAC,CAAC,OAAO,EAAE,MAAM,EAAE,EAAE;YACnC,MAAM,MAAM,GAAa,EAAE,CAAC;YAC5B,cAAc,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,IAAI,EAAE,EAAE;gBAC/B,MAAM,CAAC,IAAI,CAAC,IAAI,YAAY,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAC;YACnE,CAAC,CAAC,CAAC;YACH,cAAc,CAAC,EAAE,CAAC,KAAK,EAAE,GAAG,EAAE;gBAC1B,OAAO,CAAC,MAAM,CAAC,MAAM,CAAC,MAAiC,CAAC,CAAC,CAAC;YAC9D,CAAC,CAAC,CAAC;YACH,cAAc,CAAC,EAAE,CAAC,OAAO,EAAE,MAAM,CAAC,CAAC;QACvC,CAAC,CAAC,CAAC;IACP,CAAC;CACJ"}
+{"version":3,"file":"AutotagAzureBlob.js","sourceRoot":"","sources":["../../../src/CloudStorage/providers/AutotagAzureBlob.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,gBAAgB,EAAE,MAAM,6BAA6B,CAAC;AAE/D,OAAO,EAAE,iBAAiB,EAAmB,MAAM,qBAAqB,CAAC;AACzE,OAAO,MAAM,MAAM,QAAQ,CAAC;AAE5B,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,IAAI,MAAM,MAAM,CAAC;AAExB,MAAM,CAAC,MAAM,CAAC,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAA;AAE9B,MAAM,OAAO,gBAAiB,SAAQ,gBAAgB;IAMlD,YAAY,gBAAwB,EAAE,aAAqB;QACvD,KAAK,EAAE,CAAC;QACR,IAAI,CAAC,gBAAgB,GAAG,gBAAgB,CAAA;QACxC,IAAI,CAAC,aAAa,GAAG,aAAa,CAAA;IACtC,CAAC;IAGD;;;MAGE;IACK,KAAK,CAAC,YAAY;QACrB,IAAI,CAAC;YACD,IAAI,CAAC,iBAAiB,GAAG,iBAAiB,CAAC,oBAAoB,CAAC,IAAI,CAAC,gBAAgB,CAAC,CAAC;YACvF,IAAI,KAAK,EAAE,MAAM,SAAS,IAAI,IAAI,CAAC,iBAAiB,CAAC,cAAc,EAAE,EAAE,CAAC;gBACpE,OAAO,CAAC,GAAG,CAAC,cAAc,SAAS,CAAC,IAAI,EAAE,CAAC,CAAC;YAChD,CAAC;YAED,IAAI,CAAC,eAAe,GAAG,IAAI,CAAC,iBAAiB,CAAC,kBAAkB,CAAC,IAAI,CAAC,aAAa,CAAC,CAAC;QACzF,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACb,OAAO,CAAC,KAAK,CAAC,KAAK,CAAC,CAAA;YACpB,MAAM,IAAI,KAAK,CAAC,4CAA4C,CAAC,CAAA;QACjE,CAAC;IACL,CAAC;IAEM,KAAK,CAAC,6BAA6B,CAAC,mBAAwC,EAAE,WAAiB,EAAE,WAAqB,EAAE,MAAM,GAAC,EAAE;QACpI,MAAM,qBAAqB,GAA0B,EAAE,CAAA;QAEvD,IAAI,KAAK,EAAE,MAAM,IAAI,IAAI,IAAI,CAAC,eAAe,CAAC,aAAa,EAAE,EAAE,CAAC;YAC5D,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,CAAC,IAAI,CAAC,aAAa,EAAE,IAAI,CAAC,IAAI,CAAC,CAAA;YACzD,IAAI,IAAI,CAAC,UAAU,CAAC,SAAS,IAAI,IAAI,CAAC,UAAU,CAAC,SAAS,GAAG,WAAW,EAAE,CAAC;gBACvE,4DAA4D;gBAC5D,MAAM,EAAE,GAAG,IAAI,QAAQ,EAAE,CAAA;gBACzB,MAAM,WAAW,GAAG,MAAM,EAAE,CAAC,eAAe,CAAsB,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACnG,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,WAAW,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;gBAC9C,WAAW,CAAC,eAAe,GAAG,mBAAmB,CAAC,eAAe,CAAA;gBACjE,WAAW,CAAC,IAAI,GAAG,IAAI,CAAC,IAAI,CAAA;gBAC5B,WAAW,CAAC,WAAW,GAAG,IAAI,CAAC,MAAM,CAAC,yBAAyB,CAAC,mBAAmB,CAAC,CAAA;gBACpF,WAAW,CAAC,GAAG,GAAG,QAAQ,CAAA;gBAC1B,WAAW,CAAC,aAAa,GAAG,mBAAmB,CAAC,aAAa,CAAA;gBAC7D,WAAW,CAAC,mBAAmB,GAAI,mBAAmB,CAAC,mBAAmB,CAAA;gBAC1E,WAAW,CAAC,iBAAiB,GAAG,mBAAmB,CAAC,iBAAiB,CAAA;gBACrE,WAAW,CAAC,QAAQ,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,IAAI,CAAC,CAAA;gBAClE,WAAW,CAAC,IAAI,GAAG,IAAI,CAAA;gBAEvB,MAAM,WAAW,CAAC,IAAI,EAAE,CAAA;gBACxB,qBAAqB,CAAC,IAAI,CAAC,WAAW,CAAC,CAAA;YAC3C,CAAC;iBACI,IAAI,IAAI,CAAC,UAAU,CAAC,YAAY,IAAI,IAAI,CAAC,UAAU,CAAC,YAAY,GAAG,WAAW,EAAE,CAAC;gBAClF,8DAA8D;gBAC9D,MAAM,EAAE,GAAG,IAAI,QAAQ,EAAE,CAAA;gBACzB,MAAM,WAAW,GAAG,MAAM,EAAE,CAAC,eAAe,CAAsB,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACnG,MAAM,aAAa,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,uBAAuB,CAAC,mBAAmB,EAAE,WAAW,CAAC,CAAA;gBACjG,MAAM,WAAW,CAAC,IAAI,CAAC,aAAa,CAAC,CAAA;gBACrC,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,WAAW,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;gBAC9C,WAAW,CAAC,IAAI,GAAG,IAAI,CAAA;gBACvB,WAAW,CAAC,QAAQ,GAAG,MAAM,IAAI,CAAC,MAAM,CAAC,mBAAmB,CAAC,IAAI,CAAC,CAAA;gBAClE,WAAW,CAAC,IAAI,EAAE,CAAA;gBAClB,qBAAqB,CAAC,IAAI,CAAC,WAAW,CAAC,CAAA;YAC3C,CAAC;QACL,CAAC;QAED,OAAO,qBAAqB,CAAA;IAChC,CAAC;IAEM,KAAK,CAAC,WAAW,CAAC,IAAY;QACjC,MAAM,eAAe,GAAG,IAAI,CAAC,eAAe,CAAC,kBAAkB,CAAC,IAAI,CAAC,CAAA;QACrE,MAAM,yBAAyB,GAAG,MAAM,eAAe,CAAC,QAAQ,EAAE,CAAA;QAClE,MAAM,QAAQ,GAAW,MAAM,IAAI,CAAC,cAAc,CAAC,yBAAyB,CAAC,kBAAkB,CAAC,CAAA;QAChG,MAAM,IAAI,GAAW,MAAM,IAAI,CAAC,MAAM,CAAC,QAAQ,CAAC,QAAQ,CAAC,CAAA;QACzD,OAAO,IAAI,CAAA;IACf,CAAC;IAEM,KAAK,CAAC,cAAc,CAAC,cAAqC;QAC7D,OAAO,IAAI,OAAO,CAAC,CAAC,OAAO,EAAE,MAAM,EAAE,EAAE;YACnC,MAAM,MAAM,GAAa,EAAE,CAAC;YAC5B,cAAc,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,IAAI,EAAE,EAAE;gBAC/B,MAAM,CAAC,IAAI,CAAC,IAAI,YAAY,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,CAAC;YACnE,CAAC,CAAC,CAAC;YACH,cAAc,CAAC,EAAE,CAAC,KAAK,EAAE,GAAG,EAAE;gBAC1B,OAAO,CAAC,MAAM,CAAC,MAAM,CAAC,MAAiC,CAAC,CAAC,CAAC;YAC9D,CAAC,CAAC,CAAC;YACH,cAAc,CAAC,EAAE,CAAC,OAAO,EAAE,MAAM,CAAC,CAAC;QACvC,CAAC,CAAC,CAAC;IACP,CAAC;CACJ"}

package/dist/Core/generic/AutotagBase.d.ts

@@ -1,7 +1,9 @@
 import { UserInfo } from '@memberjunction/core';
 import { MJContentSourceEntity, MJContentItemEntity } from '@memberjunction/core-entities';
+/** Progress callback for per-item updates during autotagging */
+export type AutotagProgressCallback = (processed: number, total: number, currentItem?: string) => void;
 export declare abstract class AutotagBase {
     abstract SetContentItemsToProcess(contentSources: MJContentSourceEntity[]): Promise<MJContentItemEntity[]>;
-    abstract Autotag(contextUser: UserInfo): Promise<void>;
+    abstract Autotag(contextUser: UserInfo, onProgress?: AutotagProgressCallback): Promise<void>;
 }
 //# sourceMappingURL=AutotagBase.d.ts.map

package/dist/Core/generic/AutotagBase.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"AutotagBase.d.ts","sourceRoot":"","sources":["../../../src/Core/generic/AutotagBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,EAAE,qBAAqB,EAAE,mBAAmB,EAAE,MAAM,+BAA+B,CAAC;AAE3F,8BAAsB,WAAW;aACb,wBAAwB,CAAC,cAAc,EAAE,qBAAqB,EAAE,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;aACjG,OAAO,CAAC,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;CAChE"}
+{"version":3,"file":"AutotagBase.d.ts","sourceRoot":"","sources":["../../../src/Core/generic/AutotagBase.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,QAAQ,EAAE,MAAM,sBAAsB,CAAC;AAChD,OAAO,EAAE,qBAAqB,EAAE,mBAAmB,EAAE,MAAM,+BAA+B,CAAC;AAE3F,gEAAgE;AAChE,MAAM,MAAM,uBAAuB,GAAG,CAAC,SAAS,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,EAAE,WAAW,CAAC,EAAE,MAAM,KAAK,IAAI,CAAC;AAEvG,8BAAsB,WAAW;aACb,wBAAwB,CAAC,cAAc,EAAE,qBAAqB,EAAE,GAAG,OAAO,CAAC,mBAAmB,EAAE,CAAC;aACjG,OAAO,CAAC,WAAW,EAAE,QAAQ,EAAE,UAAU,CAAC,EAAE,uBAAuB,GAAG,OAAO,CAAC,IAAI,CAAC;CACtG"}

package/dist/Core/generic/AutotagBase.js.map

@@ -1 +1 @@
-{"version":3,"file":"AutotagBase.js","sourceRoot":"","sources":["../../../src/Core/generic/AutotagBase.ts"],"names":[],"mappings":"AAGA,MAAM,OAAgB,WAAW;CAGhC"}
+{"version":3,"file":"AutotagBase.js","sourceRoot":"","sources":["../../../src/Core/generic/AutotagBase.ts"],"names":[],"mappings":"AAMA,MAAM,OAAgB,WAAW;CAGhC"}

package/dist/Engine/generic/AutotagBaseEngine.d.ts

@@ -1,131 +1,190 @@
-import { UserInfo } from '@memberjunction/core';
-import { MJContentSourceEntity, MJContentItemEntity } from '@memberjunction/core-entities';
-import { ContentSourceParams, ContentSourceTypeParams } from './content.types.js';
+import { BaseEngine, IMetadataProvider, UserInfo } from '@memberjunction/core';
+import { MJContentSourceEntity, MJContentItemEntity, MJContentFileTypeEntity, MJContentTypeEntity, MJContentSourceTypeEntity, MJContentTypeAttributeEntity, MJContentSourceTypeParamEntity } from '@memberjunction/core-entities';
+import { ContentSourceParams, ContentSourceTypeParams, ContentSourceTypeParamValue } from './content.types.js';
 import { ProcessRunParams, JsonObject, ContentItemProcessParams } from './process.types.js';
-import { BaseLLM } from '@memberjunction/ai';
-import { AIEngine } from '@memberjunction/aiengine';
-export declare class AutotagBaseEngine extends AIEngine {
-    constructor();
+import type { MJAIPromptEntityExtended } from '@memberjunction/ai-core-plus';
+/**
+ * Core engine for content autotagging. Extends BaseEngine to cache content metadata
+ * (types, source types, file types, attributes) at startup. Uses AIEngine via composition
+ * for AI model access, then delegates to LLM for text analysis and tagging.
+ */
+export declare class AutotagBaseEngine extends BaseEngine<AutotagBaseEngine> {
     static get Instance(): AutotagBaseEngine;
+    private _ContentTypes;
+    private _ContentSourceTypes;
+    private _ContentFileTypes;
+    private _ContentTypeAttributes;
+    private _ContentSourceTypeParams;
+    /** All content types, cached at startup */
+    get ContentTypes(): MJContentTypeEntity[];
+    /** All content source types, cached at startup */
+    get ContentSourceTypes(): MJContentSourceTypeEntity[];
+    /** All content file types, cached at startup */
+    get ContentFileTypes(): MJContentFileTypeEntity[];
+    /** All content type attributes, cached at startup */
+    get ContentTypeAttributes(): MJContentTypeAttributeEntity[];
+    /** All content source type params, cached at startup */
+    get ContentSourceTypeParams(): MJContentSourceTypeParamEntity[];
+    Config(forceRefresh?: boolean, contextUser?: UserInfo, provider?: IMetadataProvider): Promise<unknown>;
     /**
-     * Given a list of content items, extract the text from each content item with the LLM and send off the required parameters to the LLM for tagging.
-     * @param contentItems
-     * @returns
+     * Given a list of content items, extract the text from each and process with LLM for tagging.
+     * Items are processed in configurable batches with controlled concurrency within each batch.
      */
-    ExtractTextAndProcessWithLLM(contentItems: MJContentItemEntity[], contextUser: UserInfo): Promise<void>;
+    ExtractTextAndProcessWithLLM(contentItems: MJContentItemEntity[], contextUser: UserInfo, batchSize?: number, onProgress?: (processed: number, total: number, currentItem?: string) => void): Promise<void>;
     /**
-     * Given processing parameters that include the text from our content item, process the text with the LLM and extract the
-     * information related to that content type.
-     * @param params
-     * @returns
+     * Builds processing parameters for a single content item
+     */
+    private buildProcessingParams;
+    /**
+     * Process a content item's text with the LLM and save results.
      */
     ProcessContentItemText(params: ContentItemProcessParams, contextUser: UserInfo): Promise<void>;
+    /**
+     * Resolves the "Content Autotagging" prompt from the AIEngine cache.
+     * Throws if the prompt is not found or not active.
+     */
+    private getAutotagPrompt;
+    /**
+     * Builds template data for the autotagging prompt from processing params and chunk context.
+     */
+    private buildPromptData;
     promptAndRetrieveResultsFromLLM(params: ContentItemProcessParams, contextUser: UserInfo): Promise<JsonObject>;
-    processChunkWithLLM(llm: BaseLLM, systemPrompt: string, userPrompt: string, LLMResults: JsonObject, modelAPIName: string): Promise<JsonObject>;
-    getLLMPrompts(params: ContentItemProcessParams, chunk: string, LLMResults: JsonObject, contextUser: UserInfo): Promise<{
-        systemPrompt: string;
-        userPrompt: string;
-    }>;
+    /**
+     * Resolves the input token limit for chunking. Uses the model specified by modelID if available,
+     * otherwise falls back to a conservative default.
+     */
+    private resolveTokenLimit;
+    /**
+     * Processes a single text chunk using AIPromptRunner and merges results.
+     * Uses the prompt's configured model by default. If ContentType.AIModelID is set,
+     * it is passed as a runtime model override via AIPromptParams.override.
+     */
+    processChunkWithPromptRunner(prompt: MJAIPromptEntityExtended, params: ContentItemProcessParams, chunk: string, LLMResults: JsonObject, contextUser: UserInfo): Promise<JsonObject>;
     saveLLMResults(LLMResults: JsonObject, contextUser: UserInfo): Promise<void>;
     deleteInvalidContentItem(contentItemID: string, contextUser: UserInfo): Promise<void>;
+    /**
+     * Chunks text using the shared TextChunker utility for token-aware splitting.
+     * Falls back to simple character-based splitting when TextChunker is not available.
+     */
     chunkExtractedText(text: string, tokenLimit: number): string[];
     /**
-     * Given the processing results from the LLM and the Content Element Item that was saved to the database, this function saves the tags as Content Element Tags in the database.
-     * @param md: The metadata object to save the tags
-     * @param contentElementItem: The content element item that was saved to the database
-     * @param results: The results of the processing from the LLM
-     * @param contextUser: The user context to save the tags
-     * @returns
+     * Simple character-based chunking as fallback
+     */
+    private fallbackChunkText;
+    /**
+     * Saves keyword tags from LLM results as Content Item Tags.
+     * Uses batched saves for better performance.
      */
     saveContentItemTags(contentItemID: string, LLMResults: JsonObject, contextUser: UserInfo): Promise<void>;
+    /**
+     * Saves LLM-extracted attributes to the database.
+     * Updates content item name/description, then creates attribute records for other fields.
+     */
     saveResultsToContentItemAttribute(LLMResults: JsonObject, contextUser: UserInfo): Promise<void>;
-    /***
-    * Retrieves all of the content sources of a given content source type data from the database.
-    * @param contextUser: The user context to retrieve the content source data
-    * @returns A list of content sources
-    */
+    /**
+     * Retrieves all content sources for a given content source type.
+     */
     getAllContentSources(contextUser: UserInfo, contentSourceTypeID: string): Promise<MJContentSourceEntity[]>;
-    setSubclassContentSourceType(subclass: string, contextUser: UserInfo): Promise<string>;
-    getContentSourceParams(contentSource: MJContentSourceEntity, contextUser: UserInfo): Promise<any>;
-    getDefaultContentSourceTypeParams(contentSourceTypeParamID: string, contextUser: UserInfo): Promise<ContentSourceTypeParams>;
-    castValueAsCorrectType(value: string, type: string): any;
-    stringToBoolean(string: string): boolean;
+    SetSubclassContentSourceType(subclass: string): string;
+    getContentSourceParams(contentSource: MJContentSourceEntity, contextUser: UserInfo): Promise<Map<string, ContentSourceTypeParamValue>>;
+    GetDefaultContentSourceTypeParams(contentSourceTypeParamID: string): ContentSourceTypeParams;
+    castValueAsCorrectType(value: string, type: string): ContentSourceTypeParamValue;
+    stringToBoolean(str: string): boolean;
     parseStringArray(value: string): string[];
     /**
-     * Given a run date, this function converts the run date to the user's timezone and formats it as a date object.
-     * @param lastRunDate: The retrieved last run date from the database
-     * @returns The last run date converted to the user's timezone
+     * Converts a run date to the user's local timezone.
      */
     convertLastRunDateToTimezone(lastRunDate: Date): Promise<Date>;
     /**
-     * Retrieves the last run date of the provided content source from the database. If no previous runs exist, the epoch date is returned.
-     * @param contentSourceID: The ID of the content source to retrieve the last run date
-     * @param contextUser: The user context to retrieve the last run date
-     * @returns
+     * Retrieves the last run date for a content source. Returns epoch date if no runs exist.
      */
     getContentSourceLastRunDate(contentSourceID: string, contextUser: UserInfo): Promise<Date>;
-    getContentItemParams(contentTypeID: string, contextUser: UserInfo): Promise<{
+    GetContentItemParams(contentTypeID: string): {
         modelID: string;
         minTags: number;
         maxTags: number;
+    };
+    GetContentSourceTypeName(contentSourceTypeID: string): string;
+    GetContentTypeName(contentTypeID: string): string;
+    GetContentFileTypeName(contentFileTypeID: string): string;
+    GetAdditionalContentTypePrompt(contentTypeID: string): string;
+    GetContentItemDescription(contentSourceParams: ContentSourceParams): string;
+    getChecksumFromURL(url: string): Promise<string>;
+    getChecksumFromText(text: string): Promise<string>;
+    getContentItemIDFromURL(contentSourceParams: ContentSourceParams, contextUser: UserInfo): Promise<string>;
+    /**
+     * Saves process run metadata to the database.
+     */
+    saveProcessRun(processRunParams: ProcessRunParams, contextUser: UserInfo): Promise<void>;
+    parsePDF(dataBuffer: Buffer): Promise<string>;
+    parseDOCX(dataBuffer: Buffer): Promise<string>;
+    parseHTML(data: string): Promise<string>;
+    parseFileFromPath(filePath: string): Promise<string>;
+    /**
+     * Embeds content items and upserts them to the appropriate vector index.
+     * Items are grouped by their resolved (embeddingModel + vectorIndex) pair — derived
+     * from per-ContentSource overrides, per-ContentType defaults, or the global fallback
+     * (first active VectorIndex). Each group is processed in configurable batches with
+     * parallel upserts within each batch.
+     */
+    VectorizeContentItems(items: MJContentItemEntity[], contextUser: UserInfo, onProgress?: (processed: number, total: number) => void, batchSize?: number): Promise<{
+        vectorized: number;
+        skipped: number;
     }>;
     /**
-     * Given a content source type ID, this function retrieves the content source type name from the database.
-     * @param contentSourceTypeID
-     * @param contextUser
-     * @returns
+     * Process a single infrastructure group: embed texts in batches and upsert to vector DB.
+     * Upserts within each batch run in parallel for throughput.
      */
-    getContentSourceTypeName(contentSourceTypeID: string, contextUser: UserInfo): Promise<string>;
+    private vectorizeGroup;
     /**
-     * Given a content type ID, this function retrieves the content type name from the database.
-     * @param contentTypeID
-     * @param contextUser
-     * @returns
+     * Load content source and content type records for all unique source/type IDs
+     * referenced by the given items. Returns maps keyed by normalized ID.
      */
-    getContentTypeName(contentTypeID: string, contextUser: UserInfo): Promise<string>;
+    private loadContentSourceAndTypeMaps;
     /**
-     * Given a content file type ID, this function retrieves the content file type name from the database.
-     * @param contentFileTypeID
-     * @param contextUser
-     * @returns
+     * Resolve the (embeddingModelID, vectorIndexID) pair for a content item using
+     * the cascade: ContentSource override -> ContentType default -> null (global fallback).
      */
-    getContentFileTypeName(contentFileTypeID: string, contextUser: UserInfo): Promise<string>;
-    getAdditionalContentTypePrompt(contentTypeID: string, contextUser: UserInfo): Promise<string>;
+    private resolveItemInfrastructureIds;
     /**
-    * Given the content source parameters, this function creates a description of the content source item.
-    * @param contentSourceParams: The parameters of the content source item
-    * @returns The description of the content source item
-    */
-    getContentItemDescription(contentSourceParams: ContentSourceParams, contextUser: any): Promise<string>;
-    getChecksumFromURL(url: string): Promise<string>;
-    getChecksumFromText(text: string): Promise<string>;
-    getContentItemIDFromURL(contentSourceParams: ContentSourceParams, contextUser: UserInfo): Promise<string>;
+     * Group items by their resolved (embeddingModelID + vectorIndexID) key.
+     * Items with the same pair share infrastructure and can be batched together.
+     */
+    private groupItemsByInfrastructure;
+    /** Create a stable cache key for an (embeddingModelID, vectorIndexID) pair */
+    private infraGroupKey;
     /**
-     * Given the results of the processing from the LLM, this function saves the details of the process run in the database.
-     * @param processRunParams: The parameters holding the details of the process run
-     * @param contextUser: The user context to save the process run
-     * @returns
+     * Resolve a group key into concrete infrastructure instances. For the 'default|default'
+     * key, falls back to the first active VectorIndex (original behavior).
      */
-    saveProcessRun(processRunParams: ProcessRunParams, contextUser: UserInfo): Promise<void>;
+    private resolveGroupInfrastructure;
     /**
-    * Given a buffer of data, this function extracts text from a PDF file
-    * @param dataBuffer: The buffer of data to extract text from
-    * @returns The extracted text from the PDF file
-    */
-    parsePDF(dataBuffer: Buffer): Promise<string>;
+     * Build infrastructure from explicit embeddingModelID and vectorIndexID.
+     * Looks up the vector index by ID and the embedding model from AIEngine.
+     */
+    private buildVectorInfrastructure;
     /**
-    * Given a buffer of data, this function extracts text from a DOCX file
-    * @param dataBuffer: The buffer of data to extract text from
-    * @returns The extracted text from the DOCX file
-    */
-    parseDOCX(dataBuffer: Buffer): Promise<string>;
-    parseHTML(data: string): Promise<string>;
+     * Fallback: resolve infrastructure from the first active VectorIndex (original behavior).
+     */
+    private getDefaultVectorInfrastructure;
     /**
-    * Given a file path, as along as its one of the supported file types, this function choses the correct parser
-    * and returns the extracted text.
-    * @param filePath - The path to the file to extract text from
-    * @returns - The extracted text from the file
-    */
-    parseFileFromPath(filePath: string): Promise<string>;
+     * Shared helper: given a vector index record and embedding model ID, resolve all
+     * driver instances needed for embedding + upsert.
+     */
+    private createInfrastructureFromIndex;
+    /** Find an embedding model by ID in AIEngine, with helpful error reporting */
+    private findEmbeddingModel;
+    /** Create a BaseEmbeddings instance for a given driver class */
+    private createEmbeddingInstance;
+    /** Create a VectorDBBase instance for a given class key */
+    private createVectorDBInstance;
+    /** SHA-1 deterministic vector ID for a content item */
+    private contentItemVectorId;
+    /** Build the text that gets embedded: Title + Description + full Text */
+    private buildEmbeddingText;
+    /** Build metadata stored alongside the vector — truncate large text fields */
+    private buildVectorMetadata;
+    /** Load all tags for the given items in a single RunView call */
+    private loadTagsForItems;
 }
 //# sourceMappingURL=AutotagBaseEngine.d.ts.map

package/dist/Engine/generic/AutotagBaseEngine.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"AutotagBaseEngine.d.ts","sourceRoot":"","sources":["../../../src/Engine/generic/AutotagBaseEngine.ts"],"names":[],"mappings":"AAAA,OAAO,EAAqB,QAAQ,EAAE,MAAM,sBAAsB,CAAA;AAElE,OAAO,EAAE,qBAAqB,EAAE,mBAAmB,EAAgK,MAAM,+BAA+B,CAAA;AACxP,OAAO,EAAE,mBAAmB,EAAE,uBAAuB,EAAE,MAAM,iBAAiB,CAAA;AAI9E,OAAO,EAAE,gBAAgB,EAAE,UAAU,EAAE,wBAAwB,EAAE,MAAM,iBAAiB,CAAA;AAKxF,OAAO,EAAE,OAAO,EAAe,MAAM,oBAAoB,CAAA;AACzD,OAAO,EAAE,QAAQ,EAAE,MAAM,0BAA0B,CAAA;AAGnD,qBACa,iBAAkB,SAAQ,QAAQ;;IAM3C,WAAkB,QAAQ,IAAI,iBAAiB,CAE9C;IAED;;;;OAIG;IACU,4BAA4B,CAAC,YAAY,EAAE,mBAAmB,EAAE,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IA0CpH;;;;;OAKG;IACU,sBAAsB,CAAC,MAAM,EAAE,wBAAwB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAK9F,+BAA+B,CAAC,MAAM,EAAE,wBAAwB,EAAE,WAAW,EAAE,QAAQ;IAqBvF,mBAAmB,CAAC,GAAG,EAAE,OAAO,EAAE,YAAY,EAAE,MAAM,EAAE,UAAU,EAAE,MAAM,EAAE,UAAU,EAAC,UAAU,EAAE,YAAY,EAAE,MAAM,GAAG,OAAO,CAAC,UAAU,CAAC;IA+B7I,aAAa,CAAC,MAAM,EAAE,wBAAwB,EAAE,KAAK,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC;QAAE,YAAY,EAAE,MAAM,CAAC;QAAC,UAAU,EAAE,MAAM,CAAA;KAAE,CAAC;IAiCpK,cAAc,CAAC,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ;IAY5D,wBAAwB,CAAC,aAAa,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ;IAO3E,kBAAkB,CAAC,IAAI,EAAE,MAAM,EAAE,UAAU,EAAE,MAAM,GAAG,MAAM,EAAE;IAwBrE;;;;;;;OAOG;IACU,mBAAmB,CAAC,aAAa,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ;IAaxF,iCAAiC,CAAC,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ;IAiC5F;;;;MAIE;IACW,oBAAoB,CAAC,WAAW,EAAE,QAAQ,EAAE,mBAAmB,EAAE,MAAM,GAAG,OAAO,CAAC,qBAAqB,EAAE,CAAC;IAwB1G,4BAA4B,CAAC,QAAQ,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAgBtF,sBAAsB,CAAC,aAAa,EAAE,qBAAqB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,GAAG,CAAC;IA6BjG,iCAAiC,CAAC,wBAAwB,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,uBAAuB,CAAC;IAmBlI,sBAAsB,CAAC,KAAK,EAAE,MAAM,EAAE,IAAI,EAAE,MAAM,GAAG,GAAG;IAiBxD,eAAe,CAAC,MAAM,EAAE,MAAM,GAAG,OAAO;IAIxC,gBAAgB,CAAC,KAAK,EAAE,MAAM,GAAG,MAAM,EAAE;IAKhD;;;;OAIG;IACU,4BAA4B,CAAC,WAAW,EAAE,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC;IAM3E;;;;;OAKG;IACU,2BAA2B,CAAC,eAAe,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IA6B1F,oBAAoB,CAAC,aAAa,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAC;KAAE,CAAC;IAqBhJ;;;;;OAKG;IACU,wBAAwB,CAAC,mBAAmB,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAqB1G;;;;;OAKG;IACU,kBAAkB,CAAC,aAAa,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAqB9F;;;;;OAKG;IACU,sBAAsB,CAAC,iBAAiB,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAqBzF,8BAA8B,CAAC,aAAa,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAwB1G;;;;MAIE;IACW,yBAAyB,CAAC,mBAAmB,EAAE,mBAAmB,EAAE,WAAW,KAAA,GAAG,OAAO,CAAC,MAAM,CAAC;IAMjG,kBAAkB,CAAC,GAAG,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAOhD,mBAAmB,CAAC,IAAI,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAKlD,uBAAuB,CAAC,mBAAmB,EAAE,mBAAmB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAuBtH;;;;;OAKG;IACU,cAAc,CAAC,gBAAgB,EAAE,gBAAgB,EAAE,WAAW,EAAE,QAAQ;IAYrF;;;;MAIE;IACW,QAAQ,CAAC,UAAU,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAK1D;;;;MAIE;IACW,SAAS,CAAC,UAAU,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAK9C,SAAS,CAAC,IAAI,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAmBrD;;;;;MAKE;IACW,iBAAiB,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;CAYpE"}
+{"version":3,"file":"AutotagBaseEngine.d.ts","sourceRoot":"","sources":["../../../src/Engine/generic/AutotagBaseEngine.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAA4B,iBAAiB,EAAqB,QAAQ,EAAuB,MAAM,sBAAsB,CAAA;AAEhJ,OAAO,EACH,qBAAqB,EAAE,mBAAmB,EAAE,uBAAuB,EACxC,mBAAmB,EAAE,yBAAyB,EACzE,4BAA4B,EACE,8BAA8B,EAC/D,MAAM,+BAA+B,CAAA;AACtC,OAAO,EAAE,mBAAmB,EAAE,uBAAuB,EAAE,2BAA2B,EAAE,MAAM,iBAAiB,CAAA;AAI3G,OAAO,EAAE,gBAAgB,EAAE,UAAU,EAAE,wBAAwB,EAAE,MAAM,iBAAiB,CAAA;AASxF,OAAO,KAAK,EAAE,wBAAwB,EAAE,MAAM,8BAA8B,CAAA;AAkB5E;;;;GAIG;AACH,qBACa,iBAAkB,SAAQ,UAAU,CAAC,iBAAiB,CAAC;IAChE,WAAkB,QAAQ,IAAI,iBAAiB,CAE9C;IAGD,OAAO,CAAC,aAAa,CAA6B;IAClD,OAAO,CAAC,mBAAmB,CAAmC;IAC9D,OAAO,CAAC,iBAAiB,CAAiC;IAC1D,OAAO,CAAC,sBAAsB,CAAsC;IACpE,OAAO,CAAC,wBAAwB,CAAwC;IAExE,2CAA2C;IAC3C,IAAW,YAAY,IAAI,mBAAmB,EAAE,CAA+B;IAC/E,kDAAkD;IAClD,IAAW,kBAAkB,IAAI,yBAAyB,EAAE,CAAqC;IACjG,gDAAgD;IAChD,IAAW,gBAAgB,IAAI,uBAAuB,EAAE,CAAmC;IAC3F,qDAAqD;IACrD,IAAW,qBAAqB,IAAI,4BAA4B,EAAE,CAAwC;IAC1G,wDAAwD;IACxD,IAAW,uBAAuB,IAAI,8BAA8B,EAAE,CAA0C;IAEnG,MAAM,CAAC,YAAY,CAAC,EAAE,OAAO,EAAE,WAAW,CAAC,EAAE,QAAQ,EAAE,QAAQ,CAAC,EAAE,iBAAiB,GAAG,OAAO,CAAC,OAAO,CAAC;IAgCnH;;;OAGG;IACU,4BAA4B,CACrC,YAAY,EAAE,mBAAmB,EAAE,EACnC,WAAW,EAAE,QAAQ,EACrB,SAAS,GAAE,MAAqC,EAChD,UAAU,CAAC,EAAE,CAAC,SAAS,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,EAAE,WAAW,CAAC,EAAE,MAAM,KAAK,IAAI,GAC9E,OAAO,CAAC,IAAI,CAAC;IA4ChB;;OAEG;YACW,qBAAqB;IAgBnC;;OAEG;IACU,sBAAsB,CAAC,MAAM,EAAE,wBAAwB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAK3G;;;OAGG;IACH,OAAO,CAAC,gBAAgB;IAWxB;;OAEG;IACH,OAAO,CAAC,eAAe;IAqBV,+BAA+B,CAAC,MAAM,EAAE,wBAAwB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,UAAU,CAAC;IAuB1H;;;OAGG;IACH,OAAO,CAAC,iBAAiB;IAWzB;;;;OAIG;IACU,4BAA4B,CACrC,MAAM,EAAE,wBAAwB,EAChC,MAAM,EAAE,wBAAwB,EAChC,KAAK,EAAE,MAAM,EACb,UAAU,EAAE,UAAU,EACtB,WAAW,EAAE,QAAQ,GACtB,OAAO,CAAC,UAAU,CAAC;IAkDT,cAAc,CAAC,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAS5E,wBAAwB,CAAC,aAAa,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAOlG;;;OAGG;IACI,kBAAkB,CAAC,IAAI,EAAE,MAAM,EAAE,UAAU,EAAE,MAAM,GAAG,MAAM,EAAE;IA0BrE;;OAEG;IACH,OAAO,CAAC,iBAAiB;IAYzB;;;OAGG;IACU,mBAAmB,CAAC,aAAa,EAAE,MAAM,EAAE,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAiCrH;;;OAGG;IACU,iCAAiC,CAAC,UAAU,EAAE,UAAU,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IA+B5G;;OAEG;IACU,oBAAoB,CAAC,WAAW,EAAE,QAAQ,EAAE,mBAAmB,EAAE,MAAM,GAAG,OAAO,CAAC,qBAAqB,EAAE,CAAC;IAehH,4BAA4B,CAAC,QAAQ,EAAE,MAAM,GAAG,MAAM;IAQhD,sBAAsB,CAAC,aAAa,EAAE,qBAAqB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,GAAG,CAAC,MAAM,EAAE,2BAA2B,CAAC,CAAC;IA2B5I,iCAAiC,CAAC,wBAAwB,EAAE,MAAM,GAAG,uBAAuB;IAa5F,sBAAsB,CAAC,KAAK,EAAE,MAAM,EAAE,IAAI,EAAE,MAAM,GAAG,2BAA2B;IAiBhF,eAAe,CAAC,GAAG,EAAE,MAAM,GAAG,OAAO;IAIrC,gBAAgB,CAAC,KAAK,EAAE,MAAM,GAAG,MAAM,EAAE;IAIhD;;OAEG;IACU,4BAA4B,CAAC,WAAW,EAAE,IAAI,GAAG,OAAO,CAAC,IAAI,CAAC;IAK3E;;OAEG;IACU,2BAA2B,CAAC,eAAe,EAAE,MAAM,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAqBhG,oBAAoB,CAAC,aAAa,EAAE,MAAM,GAAG;QAAE,OAAO,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAA;KAAE;IAYlG,wBAAwB,CAAC,mBAAmB,EAAE,MAAM,GAAG,MAAM;IAQ7D,kBAAkB,CAAC,aAAa,EAAE,MAAM,GAAG,MAAM;IAQjD,sBAAsB,CAAC,iBAAiB,EAAE,MAAM,GAAG,MAAM;IAQzD,8BAA8B,CAAC,aAAa,EAAE,MAAM,GAAG,MAAM;IAS7D,yBAAyB,CAAC,mBAAmB,EAAE,mBAAmB,GAAG,MAAM;IAOrE,kBAAkB,CAAC,GAAG,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAMhD,mBAAmB,CAAC,IAAI,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAIlD,uBAAuB,CAAC,mBAAmB,EAAE,mBAAmB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,MAAM,CAAC;IAgBtH;;OAEG;IACU,cAAc,CAAC,gBAAgB,EAAE,gBAAgB,EAAE,WAAW,EAAE,QAAQ,GAAG,OAAO,CAAC,IAAI,CAAC;IAYxF,QAAQ,CAAC,UAAU,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAK7C,SAAS,CAAC,UAAU,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAK9C,SAAS,CAAC,IAAI,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAWxC,iBAAiB,CAAC,QAAQ,EAAE,MAAM,GAAG,OAAO,CAAC,MAAM,CAAC;IAejE;;;;;;OAMG;IACU,qBAAqB,CAC9B,KAAK,EAAE,mBAAmB,EAAE,EAC5B,WAAW,EAAE,QAAQ,EACrB,UAAU,CAAC,EAAE,CAAC,SAAS,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,KAAK,IAAI,EACvD,SAAS,GAAE,MAAqC,GACjD,OAAO,CAAC;QAAE,UAAU,EAAE,MAAM,CAAC;QAAC,OAAO,EAAE,MAAM,CAAA;KAAE,CAAC;IAmCnD;;;OAGG;YACW,cAAc;IAmD5B;;;OAGG;YACW,4BAA4B;IA2C1C;;;OAGG;IACH,OAAO,CAAC,4BAA4B;IA2BpC;;;OAGG;IACH,OAAO,CAAC,0BAA0B;IAkBlC,8EAA8E;IAC9E,OAAO,CAAC,aAAa;IAMrB;;;OAGG;YACW,0BAA0B;IAcxC;;;OAGG;YACW,yBAAyB;IAqBvC;;OAEG;YACW,8BAA8B;IAiB5C;;;OAGG;YACW,6BAA6B;IAgC3C,8EAA8E;IAC9E,OAAO,CAAC,kBAAkB;IAU1B,gEAAgE;IAChE,OAAO,CAAC,uBAAuB;IAU/B,2DAA2D;IAC3D,OAAO,CAAC,sBAAsB;IAU9B,uDAAuD;IACvD,OAAO,CAAC,mBAAmB;IAI3B,yEAAyE;IACzE,OAAO,CAAC,kBAAkB;IAQ1B,8EAA8E;IAC9E,OAAO,CAAC,mBAAmB;IAgB3B,iEAAiE;YACnD,gBAAgB;CAsBjC"}