n8n-nodes-engram 0.4.1 → 0.5.0

package/README.md

@@ -25,6 +25,7 @@
 
 <p align="center">
   <a href="#installation">Installation</a> &middot;
+  <a href="#upgrading-from-v04x">Upgrade</a> &middot;
   <a href="#node-reference">Nodes</a> &middot;
   <a href="#storage-backends">Storage</a> &middot;
   <a href="#knowledge-extraction">Extraction</a> &middot;
@@ -53,7 +54,7 @@ Every conversation is stored as an episode. An optional LLM extraction pipeline
 | **2** | Storage Backends | Embedded (zero-setup) or Neo4j (production) |
 | **5** | Extraction Stages | Entity, dedup, relationships, contradictions, embeddings |
 | **3** | Search Modes | Full-text, vector, hybrid RRF fusion |
-| **253** | Tests | Unit + integration across 26 test suites |
+| **350** | Tests | Unit + integration across 35 test suites |
 
 ---
 
@@ -100,6 +101,49 @@ npm install n8n-nodes-engram
 
 ---
 
+## Upgrading from v0.4.x
+
+Version `0.5.0` adds episode provenance and governance fields. Storage migration and n8n node-version upgrades are separate steps.
+
+1. Create a current Engram export or storage/database backup before upgrading the package.
+2. Upgrade `n8n-nodes-engram`, restart n8n, and confirm the installed package version.
+3. Complete the storage-backend steps below.
+4. Run **Engram Admin > Monitoring > Diagnostics** and confirm that no storage migration remains.
+5. Upgrade selected Engram Memory nodes to v2 in an inactive workflow copy before changing production workflows.
+
+### Embedded Storage
+
+No migration node is required. On first initialization after the package upgrade, Engram:
+
+- migrates the embedded graph before opening it;
+- creates and verifies a backup ending in `.pre-schema-2.0.backup.json`;
+- replaces the graph atomically; and
+- leaves the original graph unchanged if backup verification or migration fails.
+
+After initialization, use **Engram Admin > Monitoring > Diagnostics** to verify the migration and backup status.
+
+### Neo4j Storage
+
+Neo4j migration is intentionally operator-controlled so Engram does not perform an unbounded database rewrite during startup.
+
+1. Add an **Engram Admin** node configured with the same Neo4j credentials as the production memory workflow.
+2. Select **Lifecycle > Migrate Storage Schema** and run **Dry Run**.
+3. Review the matched legacy episode count.
+4. Select **Migrate**, set **Confirm Migration** to **Confirmed**, and execute a bounded batch.
+5. Repeat until `remaining_count` is `0`, then confirm the result with **Monitoring > Diagnostics**.
+
+The Neo4j migration is additive and only fills missing governance fields with conservative defaults.
+
+### Engram Memory v2
+
+Installing `0.5.0` does not silently change saved Engram Memory nodes. Existing v1 nodes retain their previous behavior until explicitly upgraded through n8n's node upgrade action.
+
+- Keep **Human Episode Kind > Active Human** for direct agent conversations.
+- Select **Passive Human** for observed or curated human messages stored by passive ingestion workflows.
+- Validate the upgraded node in an inactive workflow copy before replacing the production workflow.
+
+---
+
 ## Quick Start
 
 ### Minimal Setup (No LLM Required)
@@ -140,6 +184,11 @@ On each conversation turn, Engram Memory:
 | --- | --- | --- |
 | Storage Backend | Embedded (Graphology) or Neo4j | Embedded |
 | Knowledge Extraction | LLM-powered entity extraction | Disabled |
+| Store Human Episodes | Persist human messages as episodes (v2) | Enabled |
+| Human Episode Kind | Classify human input as active or passive provenance (v2) | Active Human |
+| Store AI Episodes | Persist assistant replies as episodes (v2) | Enabled |
+| Extract from Human Messages | Allow human content to produce facts (v2) | Enabled |
+| Extract from AI Messages | Allow assistant content to produce facts (v2) | Disabled |
 | Semantic Search | Vector embeddings for hybrid search | Disabled |
 | Graph Traversal | BFS enrichment from matched entities | Disabled |
 | Context Window | Recent turns to include | 10 |
@@ -147,6 +196,8 @@ On each conversation turn, Engram Memory:
 | Min Relevance Score | Threshold for inclusion (0&ndash;1) | 0.5 |
 | Retention Policy | Episode lifecycle management | Forever |
 
+Existing saved Engram Memory nodes retain their original node version and behavior when the package is upgraded. Use n8n's node upgrade action on a workflow copy to adopt v2 controls. Passive ingestion workflows should select **Human Episode Kind > Passive Human**, while direct agent conversations should keep the default **Active Human** classification.
+
 ### Engram Explorer
 
 > Regular node&mdash;CRUD operations on the knowledge graph.
@@ -154,8 +205,8 @@ On each conversation turn, Engram Memory:
 | Resource | Operations |
 | --- | --- |
 | **Entity** | Create, Get, Get by Name, List, Search, Update, Delete |
-| **Relationship** | Create, Get, Get Between, Get for Entity, Search, Update, Delete, Get Changelog |
-| **Episode** | Get, Get Recent, Get by Date Range, Get Count |
+| **Relationship** | Create, Get, Get Between, Get for Entity, Search, Review, Update, Delete, Get Changelog |
+| **Episode** | Get, Get Recent, Get by Date Range, Get Count, List, Update, Delete |
 | **Traversal** | BFS from Entity, BFS from Episodes |
 
 ### Engram Admin
@@ -165,7 +216,7 @@ On each conversation turn, Engram Memory:
 | Resource | Operations |
 | --- | --- |
 | **Monitoring** | Stats, List Groups, Group Stats, Embedding Coverage, Diagnostics |
-| **Lifecycle** | Apply Retention, Clear Group, Bulk Clear Groups, Clear All |
+| **Lifecycle** | Apply Retention, Purge Episodes, Migrate Storage Schema, Clear Group, Bulk Clear Groups, Clear All |
 | **Hygiene** | Orphaned Entities, Duplicate Entities, Expire Stale Edges, Rebuild Search Index, Backfill Embeddings |
 | **Portability** | Export, Import |
 | **Analysis** | Detect Communities |
@@ -180,9 +231,19 @@ Engram Admin includes a read-only **Monitoring > Diagnostics** operation for pro
 
 Use **Monitoring > Embedding Coverage** to check whether entities and facts have vectors before enabling hybrid search broadly. Use **Hygiene > Rebuild Search Index** to rebuild the embedded full-text index from stored graph data. Use **Hygiene > Backfill Embeddings** in dry-run mode first, then disable dry-run to fill missing embeddings with the configured embedding model.
 
+Explorer entity and relationship searches can optionally return retrieval diagnostics. The aggregate trace shows active filters, bounded candidate scores and decisions, rejection reasons, and which complete items fit the context preview budget. Diagnostics are disabled by default.
+
 ### Import, Export, and Backups
 
-Engram exports include count metadata and a SHA-256 checksum. Imports support **Dry Run** mode, optional maximum item limits, checksum verification, and dangling-edge warnings before writing data.
+Engram exports use graph format `2.0` and include count metadata and a SHA-256 checksum. Imports support **Dry Run** mode, optional maximum item limits, checksum verification before migration, migration reporting, and reference-integrity warnings before writing data. Existing `1.0` backups remain importable; episodes without provenance are classified as `legacy`, `unverified`, and `proposed` rather than being accepted automatically.
+
+Embedded storage upgrades automatically before the graph is opened. Engram creates and verifies an owner-readable backup beside the storage file, writes the migrated graph with atomic replacement, and stops without changing the source if backup verification or migration fails. The backup name ends with `.pre-schema-2.0.backup.json`, and **Monitoring > Diagnostics** reports its path and verification state.
+
+Neo4j remains available during an upgrade and does not perform an unbounded startup rewrite. Use **Lifecycle > Migrate Storage Schema** in **Dry Run** mode to inspect the remaining legacy episode count, then apply confirmed bounded batches until the remaining count reaches zero. The migration is additive: it only fills missing governance fields with conservative legacy defaults.
+
+For a staged restore, first run the import in **Dry Run** mode and review the source/target versions, default counts, and warnings. Keep the original export unchanged, then perform the write import only after the report matches expectations. Export the restored graph again to create a checksummed `2.0` backup.
+
+To remove historical monitor or tool pollution, use Explorer episode filters to inspect the affected source, kind, trust level, or date range. Then run Admin **Lifecycle > Purge Episodes** in dry-run mode before confirming the bounded purge.
 
 For production Neo4j deployments, see [`docs/production-neo4j.md`](docs/production-neo4j.md). Ready-to-import starter workflows are available in [`docs/workflows/`](docs/workflows/).
 

package/dist/extraction/EntityExtractor.d.ts

@@ -1,11 +1,15 @@
 import type { LlmClient } from './LlmClient';
+import { type ExtractionSource } from './ExtractionSource';
 export interface ExtractedEntity {
     name: string;
     entity_type: string;
     summary: string;
+    confidence: number | null;
 }
 export declare class EntityExtractor {
     private llm;
     constructor(llm: LlmClient);
     extract(humanMessage: string, aiMessage: string, entityTypes: string[], existingEntities: string[]): Promise<ExtractedEntity[]>;
+    extractSources(sources: ExtractionSource[], entityTypes: string[], existingEntities: string[], requireConfidence?: boolean): Promise<ExtractedEntity[]>;
+    private extractWithPrompt;
 }

package/dist/extraction/EntityExtractor.js

@@ -2,18 +2,22 @@
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.EntityExtractor = void 0;
 const prompts_1 = require("./prompts");
+const ExtractionSource_1 = require("./ExtractionSource");
 class EntityExtractor {
     constructor(llm) {
         this.llm = llm;
     }
     async extract(humanMessage, aiMessage, entityTypes, existingEntities) {
+        return this.extractWithPrompt((0, prompts_1.entityExtractionUser)(humanMessage, aiMessage, entityTypes, existingEntities), entityTypes, false);
+    }
+    async extractSources(sources, entityTypes, existingEntities, requireConfidence = false) {
+        return this.extractWithPrompt((0, prompts_1.entityExtractionSourcesUser)((0, ExtractionSource_1.formatExtractionSources)(sources), entityTypes, existingEntities), entityTypes, requireConfidence);
+    }
+    async extractWithPrompt(prompt, entityTypes, requireConfidence) {
         try {
             const result = await this.llm.chatJson([
                 { role: 'system', content: prompts_1.ENTITY_EXTRACTION_SYSTEM },
-                {
-                    role: 'user',
-                    content: (0, prompts_1.entityExtractionUser)(humanMessage, aiMessage, entityTypes, existingEntities),
-                },
+                { role: 'user', content: prompt },
             ]);
             if (!result.entities || !Array.isArray(result.entities)) {
                 return [];
@@ -25,11 +29,22 @@ class EntityExtractor {
                 typeof e.entity_type === 'string' &&
                 e.entity_type.trim() !== '' &&
                 typeof e.summary === 'string' &&
+                (!requireConfidence ||
+                    (typeof e.confidence === 'number' &&
+                        Number.isFinite(e.confidence) &&
+                        e.confidence >= 0 &&
+                        e.confidence <= 1)) &&
                 (allowedTypes.size === 0 || allowedTypes.has(e.entity_type.toLowerCase().trim())))
                 .map((e) => ({
                 name: e.name.trim(),
                 entity_type: e.entity_type.trim(),
                 summary: e.summary.trim(),
+                confidence: typeof e.confidence === 'number' &&
+                    Number.isFinite(e.confidence) &&
+                    e.confidence >= 0 &&
+                    e.confidence <= 1
+                    ? e.confidence
+                    : null,
             }));
         }
         catch (error) {

package/dist/extraction/EntityExtractor.js.map

@@ -1 +1 @@
-{"version":3,"file":"EntityExtractor.js","sourceRoot":"","sources":["../../src/extraction/EntityExtractor.ts"],"names":[],"mappings":";;;AACA,uCAA2E;AAY3E,MAAa,eAAe;IAG1B,YAAY,GAAc;QACxB,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;IACjB,CAAC;IAED,KAAK,CAAC,OAAO,CACX,YAAoB,EACpB,SAAiB,EACjB,WAAqB,EACrB,gBAA0B;QAE1B,IAAI,CAAC;YACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,GAAG,CAAC,QAAQ,CAAyB;gBAC7D,EAAE,IAAI,EAAE,QAAQ,EAAE,OAAO,EAAE,kCAAwB,EAAE;gBACrD;oBACE,IAAI,EAAE,MAAM;oBACZ,OAAO,EAAE,IAAA,8BAAoB,EAAC,YAAY,EAAE,SAAS,EAAE,WAAW,EAAE,gBAAgB,CAAC;iBACtF;aACF,CAAC,CAAC;YAEH,IAAI,CAAC,MAAM,CAAC,QAAQ,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,EAAE,CAAC;gBACxD,OAAO,EAAE,CAAC;YACZ,CAAC;YAED,MAAM,YAAY,GAAG,IAAI,GAAG,CAAC,WAAW,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC;YAEnF,OAAO,MAAM,CAAC,QAAQ;iBACnB,MAAM,CACL,CAAC,CAAC,EAAE,EAAE,CACJ,OAAO,CAAC,CAAC,IAAI,KAAK,QAAQ;gBAC1B,CAAC,CAAC,IAAI,CAAC,IAAI,EAAE,KAAK,EAAE;gBACpB,OAAO,CAAC,CAAC,WAAW,KAAK,QAAQ;gBACjC,CAAC,CAAC,WAAW,CAAC,IAAI,EAAE,KAAK,EAAE;gBAC3B,OAAO,CAAC,CAAC,OAAO,KAAK,QAAQ;gBAC7B,CAAC,YAAY,CAAC,IAAI,KAAK,CAAC,IAAI,YAAY,CAAC,GAAG,CAAC,CAAC,CAAC,WAAW,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC,CAAC,CACpF;iBACA,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;gBACX,IAAI,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,EAAE;gBACnB,WAAW,EAAE,CAAC,CAAC,WAAW,CAAC,IAAI,EAAE;gBACjC,OAAO,EAAE,CAAC,CAAC,OAAO,CAAC,IAAI,EAAE;aAC1B,CAAC,CAAC,CAAC;QACR,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YAEf,OAAO,CAAC,IAAI,CAAC,mCAAmC,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC5E,OAAO,EAAE,CAAC;QACZ,CAAC;IACH,CAAC;CACF;AAjDD,0CAiDC"}
+{"version":3,"file":"EntityExtractor.js","sourceRoot":"","sources":["../../src/extraction/EntityExtractor.ts"],"names":[],"mappings":";;;AACA,uCAImB;AACnB,yDAAoF;AAapF,MAAa,eAAe;IAG1B,YAAY,GAAc;QACxB,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;IACjB,CAAC;IAED,KAAK,CAAC,OAAO,CACX,YAAoB,EACpB,SAAiB,EACjB,WAAqB,EACrB,gBAA0B;QAE1B,OAAO,IAAI,CAAC,iBAAiB,CAC3B,IAAA,8BAAoB,EAAC,YAAY,EAAE,SAAS,EAAE,WAAW,EAAE,gBAAgB,CAAC,EAC5E,WAAW,EACX,KAAK,CACN,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,cAAc,CAClB,OAA2B,EAC3B,WAAqB,EACrB,gBAA0B,EAC1B,iBAAiB,GAAG,KAAK;QAEzB,OAAO,IAAI,CAAC,iBAAiB,CAC3B,IAAA,qCAA2B,EAAC,IAAA,0CAAuB,EAAC,OAAO,CAAC,EAAE,WAAW,EAAE,gBAAgB,CAAC,EAC5F,WAAW,EACX,iBAAiB,CAClB,CAAC;IACJ,CAAC;IAEO,KAAK,CAAC,iBAAiB,CAC7B,MAAc,EACd,WAAqB,EACrB,iBAA0B;QAE1B,IAAI,CAAC;YACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,GAAG,CAAC,QAAQ,CAAyB;gBAC7D,EAAE,IAAI,EAAE,QAAQ,EAAE,OAAO,EAAE,kCAAwB,EAAE;gBACrD,EAAE,IAAI,EAAE,MAAM,EAAE,OAAO,EAAE,MAAM,EAAE;aAClC,CAAC,CAAC;YAEH,IAAI,CAAC,MAAM,CAAC,QAAQ,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,EAAE,CAAC;gBACxD,OAAO,EAAE,CAAC;YACZ,CAAC;YAED,MAAM,YAAY,GAAG,IAAI,GAAG,CAAC,WAAW,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC;YAEnF,OAAO,MAAM,CAAC,QAAQ;iBACnB,MAAM,CACL,CAAC,CAAC,EAAE,EAAE,CACJ,OAAO,CAAC,CAAC,IAAI,KAAK,QAAQ;gBAC1B,CAAC,CAAC,IAAI,CAAC,IAAI,EAAE,KAAK,EAAE;gBACpB,OAAO,CAAC,CAAC,WAAW,KAAK,QAAQ;gBACjC,CAAC,CAAC,WAAW,CAAC,IAAI,EAAE,KAAK,EAAE;gBAC3B,OAAO,CAAC,CAAC,OAAO,KAAK,QAAQ;gBAC7B,CAAC,CAAC,iBAAiB;oBACjB,CAAC,OAAO,CAAC,CAAC,UAAU,KAAK,QAAQ;wBAC/B,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,UAAU,CAAC;wBAC7B,CAAC,CAAC,UAAU,IAAI,CAAC;wBACjB,CAAC,CAAC,UAAU,IAAI,CAAC,CAAC,CAAC;gBACvB,CAAC,YAAY,CAAC,IAAI,KAAK,CAAC,IAAI,YAAY,CAAC,GAAG,CAAC,CAAC,CAAC,WAAW,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC,CAAC,CACpF;iBACA,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;gBACX,IAAI,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,EAAE;gBACnB,WAAW,EAAE,CAAC,CAAC,WAAW,CAAC,IAAI,EAAE;gBACjC,OAAO,EAAE,CAAC,CAAC,OAAO,CAAC,IAAI,EAAE;gBACzB,UAAU,EACR,OAAO,CAAC,CAAC,UAAU,KAAK,QAAQ;oBAChC,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,UAAU,CAAC;oBAC7B,CAAC,CAAC,UAAU,IAAI,CAAC;oBACjB,CAAC,CAAC,UAAU,IAAI,CAAC;oBACf,CAAC,CAAC,CAAC,CAAC,UAAU;oBACd,CAAC,CAAC,IAAI;aACX,CAAC,CAAC,CAAC;QACR,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YAEf,OAAO,CAAC,IAAI,CAAC,mCAAmC,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC5E,OAAO,EAAE,CAAC;QACZ,CAAC;IACH,CAAC;CACF;AAnFD,0CAmFC"}

package/dist/extraction/ExtractionPipeline.d.ts

@@ -1,11 +1,15 @@
 import type { IGraphStorage } from '../storage/IGraphStorage';
+import { type ExtractionThresholdPolicy } from '../schemas';
 import { type LlmClientConfig } from './LlmClient';
 import { type EmbeddingConfig } from '../embeddings';
+import { type ExtractionSource } from './ExtractionSource';
 export interface ExtractionPipelineConfig {
     llmConfig: LlmClientConfig;
     entityTypes: string[];
     groupId: string;
     embeddingConfig?: EmbeddingConfig;
+    requireConfidence?: boolean;
+    thresholdPolicy?: ExtractionThresholdPolicy;
 }
 export declare class ExtractionPipeline {
     private storage;
@@ -17,11 +21,17 @@ export declare class ExtractionPipeline {
     private embeddingService;
     private entityTypes;
     private groupId;
+    private requireConfidence;
+    private thresholdPolicy?;
     constructor(storage: IGraphStorage, config: ExtractionPipelineConfig);
     process(humanMessage: string, aiMessage: string, episodeUuids?: string[]): Promise<void>;
+    processSources(sources: ExtractionSource[]): Promise<void>;
     private resolveEntity;
     private expireContradictedEdges;
     private persistRelationship;
     private buildEdgeUpdates;
+    private createExtractionMetadata;
+    private reviewStatus;
+    private mergeExtractionMetadata;
     private findEntity;
 }

package/dist/extraction/ExtractionPipeline.js

@@ -1,6 +1,7 @@
 "use strict";
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.ExtractionPipeline = void 0;
+const schemas_1 = require("../schemas");
 const LlmClient_1 = require("./LlmClient");
 const EntityExtractor_1 = require("./EntityExtractor");
 const RelationshipExtractor_1 = require("./RelationshipExtractor");
@@ -9,9 +10,10 @@ const ContradictionDetector_1 = require("./ContradictionDetector");
 const EdgeDeduplicator_1 = require("./EdgeDeduplicator");
 const embeddings_1 = require("../embeddings");
 const temporal_1 = require("../utils/temporal");
-const EXTRACTION_METADATA_VERSION = 1;
+const ExtractionSource_1 = require("./ExtractionSource");
 class ExtractionPipeline {
     constructor(storage, config) {
+        var _a;
         this.embeddingService = null;
         const llm = new LlmClient_1.LlmClient(config.llmConfig);
         this.storage = storage;
@@ -22,30 +24,62 @@ class ExtractionPipeline {
         this.edgeDeduplicator = new EdgeDeduplicator_1.EdgeDeduplicator(llm);
         this.entityTypes = config.entityTypes;
         this.groupId = config.groupId;
+        this.requireConfidence = (_a = config.requireConfidence) !== null && _a !== void 0 ? _a : false;
+        this.thresholdPolicy = config.thresholdPolicy;
+        if (this.thresholdPolicy) {
+            (0, schemas_1.decideExtractionReview)(0.5, this.thresholdPolicy);
+        }
         if (config.embeddingConfig) {
             this.embeddingService = new embeddings_1.EmbeddingService(config.embeddingConfig);
         }
     }
     async process(humanMessage, aiMessage, episodeUuids = []) {
+        var _a, _b;
+        const sources = [];
+        if (humanMessage) {
+            sources.push({
+                content: humanMessage,
+                role: 'human',
+                episode_kind: 'active_human',
+                episode_uuid: (_a = episodeUuids[0]) !== null && _a !== void 0 ? _a : null,
+            });
+        }
+        if (aiMessage) {
+            sources.push({
+                content: aiMessage,
+                role: 'ai',
+                episode_kind: 'assistant_reply',
+                episode_uuid: (_b = episodeUuids[1]) !== null && _b !== void 0 ? _b : null,
+            });
+        }
+        await this.processSources(sources);
+    }
+    async processSources(sources) {
+        const selectedSources = sources.filter((source) => source.content.trim().length > 0);
+        if (selectedSources.length === 0)
+            return;
+        const episodeUuids = (0, ExtractionSource_1.extractionEpisodeUuids)(selectedSources);
         const existingEntities = await this.storage.listEntities(this.groupId);
         const existingNames = existingEntities.map((e) => e.name);
-        const extractedEntities = await this.entityExtractor.extract(humanMessage, aiMessage, this.entityTypes, existingNames);
+        const extractedEntities = await this.entityExtractor.extractSources(selectedSources, this.entityTypes, existingNames, this.requireConfidence);
         if (extractedEntities.length === 0)
             return;
         const resolvedEntities = new Map();
         for (const extracted of extractedEntities) {
-            const resolved = await this.resolveEntity(extracted, existingEntities);
+            const resolved = await this.resolveEntity(extracted, existingEntities, episodeUuids);
             resolvedEntities.set(extracted.name.toLowerCase(), resolved);
         }
         const allEntityNames = [
             ...new Set([...existingNames, ...[...resolvedEntities.values()].map((e) => e.name)]),
         ];
-        const extractedRelationships = await this.relationshipExtractor.extract(humanMessage, aiMessage, allEntityNames);
+        const extractedRelationships = await this.relationshipExtractor.extractSources(selectedSources, allEntityNames, this.requireConfidence);
         for (const rel of extractedRelationships) {
             await this.persistRelationship(rel, resolvedEntities, existingEntities, episodeUuids);
         }
     }
-    async resolveEntity(extracted, existingEntities) {
+    async resolveEntity(extracted, existingEntities, episodeUuids) {
+        const incomingMetadata = this.createExtractionMetadata(extracted.confidence, episodeUuids);
+        const incomingStatus = incomingMetadata.review_status;
         for (const existing of existingEntities) {
             const { isDuplicate, mergedSummary } = await this.deduplicator.isDuplicate(extracted, {
                 name: existing.name,
@@ -53,10 +87,19 @@ class ExtractionPipeline {
                 entity_type: existing.entity_type,
             });
             if (isDuplicate) {
-                if (mergedSummary && mergedSummary !== existing.summary) {
-                    return await this.storage.updateEntity(existing.uuid, {
-                        summary: mergedSummary,
-                    });
+                const existingStatus = this.reviewStatus(existing.attributes);
+                const updates = {};
+                if (mergedSummary &&
+                    mergedSummary !== existing.summary &&
+                    (!this.thresholdPolicy || incomingStatus === 'accepted' || existingStatus !== 'accepted')) {
+                    updates.summary = mergedSummary;
+                }
+                const mergedMetadata = this.mergeExtractionMetadata((0, schemas_1.extractionMetadataFromAttributes)(existing.attributes), incomingMetadata, episodeUuids);
+                if (mergedMetadata) {
+                    updates.attributes = { ...existing.attributes, engram_extraction: mergedMetadata };
+                }
+                if (Object.keys(updates).length > 0) {
+                    return await this.storage.updateEntity(existing.uuid, updates);
                 }
                 return existing;
             }
@@ -78,13 +121,7 @@ class ExtractionPipeline {
             entity_type: extracted.entity_type,
             name_embedding: nameEmbedding !== null && nameEmbedding !== void 0 ? nameEmbedding : null,
             attributes: {
-                engram_extraction: {
-                    version: EXTRACTION_METADATA_VERSION,
-                    source: 'llm',
-                    confidence: null,
-                    reviewed: false,
-                    extracted_at: (0, temporal_1.nowIso)(),
-                },
+                engram_extraction: incomingMetadata,
             },
         });
     }
@@ -92,6 +129,9 @@ class ExtractionPipeline {
         for (const existingEdge of edges) {
             if (existingEdge.expired_at)
                 continue;
+            if (this.thresholdPolicy && this.reviewStatus(existingEdge.attributes) !== 'accepted') {
+                continue;
+            }
             const resolution = await this.contradictionDetector.detect(existingEdge.fact, newFact, sourceEntityName, targetEntityName, existingEdge.name, newEdgeName);
             if (resolution.isContradiction && resolution.expiredAt) {
                 await this.storage.updateEdge(existingEdge.uuid, {
@@ -107,6 +147,8 @@ class ExtractionPipeline {
         if (!sourceEntity || !targetEntity)
             return;
         const normalizedNewEdgeName = rel.name.toUpperCase().replace(/\s+/g, '_');
+        const incomingMetadata = this.createExtractionMetadata(rel.confidence, episodeUuids);
+        const incomingStatus = incomingMetadata.review_status;
         let samePairEdges = [];
         try {
             samePairEdges = await this.storage.getEdgesBetween(sourceEntity.uuid, targetEntity.uuid);
@@ -114,52 +156,62 @@ class ExtractionPipeline {
         catch (error) {
             console.warn('Engram: Failed to fetch edges between', sourceEntity.name, 'and', targetEntity.name + ':', error.message);
         }
-        try {
-            const existingMatchingEdge = samePairEdges.find((e) => e.name === normalizedNewEdgeName && !e.expired_at);
-            if (existingMatchingEdge) {
-                const { isDuplicate, mergedFact } = await this.edgeDeduplicator.isDuplicate(existingMatchingEdge.fact, rel.fact, normalizedNewEdgeName, sourceEntity.name, targetEntity.name);
-                if (isDuplicate) {
-                    const updates = await this.buildEdgeUpdates(existingMatchingEdge, mergedFact || rel.fact, episodeUuids);
-                    if (Object.keys(updates).length > 0) {
-                        await this.storage.updateEdge(existingMatchingEdge.uuid, updates);
+        if (incomingStatus !== 'rejected') {
+            try {
+                const existingMatchingEdge = samePairEdges.find((e) => e.name === normalizedNewEdgeName &&
+                    !e.expired_at &&
+                    this.reviewStatus(e.attributes) !== 'rejected');
+                if (existingMatchingEdge) {
+                    const { isDuplicate, mergedFact } = await this.edgeDeduplicator.isDuplicate(existingMatchingEdge.fact, rel.fact, normalizedNewEdgeName, sourceEntity.name, targetEntity.name);
+                    if (isDuplicate) {
+                        const updates = await this.buildEdgeUpdates(existingMatchingEdge, mergedFact || rel.fact, episodeUuids, incomingMetadata);
+                        if (Object.keys(updates).length > 0) {
+                            await this.storage.updateEdge(existingMatchingEdge.uuid, updates);
+                        }
+                        return;
                     }
-                    return;
                 }
             }
+            catch (error) {
+                console.warn('Engram: Edge deduplication failed for', sourceEntity.name, '->', targetEntity.name + ':', error.message);
+            }
         }
-        catch (error) {
-            console.warn('Engram: Edge deduplication failed for', sourceEntity.name, '->', targetEntity.name + ':', error.message);
-        }
-        try {
-            const crossNameCandidates = samePairEdges.filter((e) => e.name !== normalizedNewEdgeName && !e.expired_at);
-            if (crossNameCandidates.length > 0) {
-                const candidate = crossNameCandidates[0];
-                const { isDuplicate, mergedFact } = await this.edgeDeduplicator.isDuplicateCrossName(candidate.fact, rel.fact, candidate.name, normalizedNewEdgeName, sourceEntity.name, targetEntity.name);
-                if (isDuplicate) {
-                    const updates = await this.buildEdgeUpdates(candidate, mergedFact || rel.fact, episodeUuids);
-                    if (Object.keys(updates).length > 0) {
-                        await this.storage.updateEdge(candidate.uuid, updates);
+        if (incomingStatus !== 'rejected') {
+            try {
+                const crossNameCandidates = samePairEdges.filter((e) => e.name !== normalizedNewEdgeName &&
+                    !e.expired_at &&
+                    this.reviewStatus(e.attributes) !== 'rejected');
+                if (crossNameCandidates.length > 0) {
+                    const candidate = crossNameCandidates[0];
+                    const { isDuplicate, mergedFact } = await this.edgeDeduplicator.isDuplicateCrossName(candidate.fact, rel.fact, candidate.name, normalizedNewEdgeName, sourceEntity.name, targetEntity.name);
+                    if (isDuplicate) {
+                        const updates = await this.buildEdgeUpdates(candidate, mergedFact || rel.fact, episodeUuids, incomingMetadata);
+                        if (Object.keys(updates).length > 0) {
+                            await this.storage.updateEdge(candidate.uuid, updates);
+                        }
+                        return;
                     }
-                    return;
                 }
             }
+            catch (error) {
+                console.warn('Engram: Cross-name edge deduplication failed for', sourceEntity.name, '->', targetEntity.name + ':', error.message);
+            }
         }
-        catch (error) {
-            console.warn('Engram: Cross-name edge deduplication failed for', sourceEntity.name, '->', targetEntity.name + ':', error.message);
-        }
-        try {
-            await this.expireContradictedEdges(samePairEdges, rel.fact, sourceEntity.name, targetEntity.name, normalizedNewEdgeName);
-            const checkedUuids = new Set(samePairEdges.map((e) => e.uuid));
-            const allSourceEdges = await this.storage.getEdgesForEntity(sourceEntity.uuid);
-            const crossTargetEdges = allSourceEdges.filter((e) => e.source_node_uuid === sourceEntity.uuid &&
-                e.name === normalizedNewEdgeName &&
-                e.target_node_uuid !== targetEntity.uuid &&
-                !e.expired_at &&
-                !checkedUuids.has(e.uuid));
-            await this.expireContradictedEdges(crossTargetEdges, rel.fact, sourceEntity.name, targetEntity.name, normalizedNewEdgeName);
-        }
-        catch (error) {
-            console.warn('Engram: Contradiction detection failed for edge between', sourceEntity.name, 'and', targetEntity.name + ':', error.message);
+        if (!this.thresholdPolicy || incomingStatus === 'accepted') {
+            try {
+                await this.expireContradictedEdges(samePairEdges, rel.fact, sourceEntity.name, targetEntity.name, normalizedNewEdgeName);
+                const checkedUuids = new Set(samePairEdges.map((e) => e.uuid));
+                const allSourceEdges = await this.storage.getEdgesForEntity(sourceEntity.uuid);
+                const crossTargetEdges = allSourceEdges.filter((e) => e.source_node_uuid === sourceEntity.uuid &&
+                    e.name === normalizedNewEdgeName &&
+                    e.target_node_uuid !== targetEntity.uuid &&
+                    !e.expired_at &&
+                    !checkedUuids.has(e.uuid));
+                await this.expireContradictedEdges(crossTargetEdges, rel.fact, sourceEntity.name, targetEntity.name, normalizedNewEdgeName);
+            }
+            catch (error) {
+                console.warn('Engram: Contradiction detection failed for edge between', sourceEntity.name, 'and', targetEntity.name + ':', error.message);
+            }
         }
         let factEmbedding;
         if (this.embeddingService) {
@@ -181,20 +233,19 @@ class ExtractionPipeline {
             valid_at: (0, temporal_1.nowIso)(),
             episodes: episodeUuids,
             attributes: {
-                engram_extraction: {
-                    version: EXTRACTION_METADATA_VERSION,
-                    source: 'llm',
-                    confidence: null,
-                    reviewed: false,
-                    extracted_at: (0, temporal_1.nowIso)(),
-                    episode_uuids: episodeUuids,
-                },
+                engram_extraction: incomingMetadata,
             },
         });
     }
-    async buildEdgeUpdates(existingEdge, effectiveFact, episodeUuids) {
+    async buildEdgeUpdates(existingEdge, effectiveFact, episodeUuids, incomingMetadata) {
+        var _a;
         const updates = {};
-        if (effectiveFact !== existingEdge.fact) {
+        const existingMetadata = (0, schemas_1.extractionMetadataFromAttributes)(existingEdge.attributes);
+        const existingStatus = this.reviewStatus(existingEdge.attributes);
+        if (effectiveFact !== existingEdge.fact &&
+            (!this.thresholdPolicy ||
+                incomingMetadata.review_status === 'accepted' ||
+                existingStatus !== 'accepted')) {
             updates.fact = effectiveFact;
             if (this.embeddingService) {
                 try {
@@ -218,8 +269,46 @@ class ExtractionPipeline {
                 updates.episodes = mergedEpisodes;
             }
         }
+        const mergedEpisodeUuids = [
+            ...new Set([...((_a = existingMetadata === null || existingMetadata === void 0 ? void 0 : existingMetadata.episode_uuids) !== null && _a !== void 0 ? _a : []), ...episodeUuids]),
+        ];
+        const mergedMetadata = this.mergeExtractionMetadata(existingMetadata, incomingMetadata, mergedEpisodeUuids);
+        if (mergedMetadata) {
+            updates.attributes = {
+                ...existingEdge.attributes,
+                engram_extraction: mergedMetadata,
+            };
+        }
         return updates;
     }
+    createExtractionMetadata(confidence, episodeUuids) {
+        const decision = (0, schemas_1.decideExtractionReview)(confidence, this.thresholdPolicy);
+        return schemas_1.ExtractionMetadataV2Schema.parse({
+            version: 2,
+            source: 'llm',
+            confidence,
+            ...decision,
+            extracted_at: (0, temporal_1.nowIso)(),
+            episode_uuids: episodeUuids,
+        });
+    }
+    reviewStatus(attributes) {
+        var _a, _b;
+        return (_b = (_a = (0, schemas_1.extractionMetadataFromAttributes)(attributes)) === null || _a === void 0 ? void 0 : _a.review_status) !== null && _b !== void 0 ? _b : 'accepted';
+    }
+    mergeExtractionMetadata(existing, incoming, episodeUuids) {
+        var _a, _b;
+        if (!existing)
+            return null;
+        const rank = { rejected: 0, proposed: 1, accepted: 2 };
+        const winner = rank[incoming.review_status] > rank[existing.review_status] ? incoming : existing;
+        const confidence = Math.max((_a = existing.confidence) !== null && _a !== void 0 ? _a : 0, (_b = incoming.confidence) !== null && _b !== void 0 ? _b : 0);
+        return schemas_1.ExtractionMetadataV2Schema.parse({
+            ...winner,
+            confidence: existing.confidence === null && incoming.confidence === null ? null : confidence,
+            episode_uuids: [...new Set(episodeUuids)],
+        });
+    }
     findEntity(name, resolvedEntities, existingEntities) {
         const normalized = name.toLowerCase().trim();
         const resolved = resolvedEntities.get(normalized);

package/dist/extraction/ExtractionPipeline.js.map

@@ -1 +1 @@
-{"version":3,"file":"ExtractionPipeline.js","sourceRoot":"","sources":["../../src/extraction/ExtractionPipeline.ts"],"names":[],"mappings":";;;AAEA,2CAA8D;AAC9D,uDAAoD;AACpD,mEAAgE;AAChE,6DAA0D;AAC1D,mEAAgE;AAChE,yDAAsD;AACtD,8CAAuE;AACvE,gDAA2C;AAE3C,MAAM,2BAA2B,GAAG,CAAC,CAAC;AAmBtC,MAAa,kBAAkB;IAW7B,YAAY,OAAsB,EAAE,MAAgC;QAJ5D,qBAAgB,GAA4B,IAAI,CAAC;QAKvD,MAAM,GAAG,GAAG,IAAI,qBAAS,CAAC,MAAM,CAAC,SAAS,CAAC,CAAC;QAC5C,IAAI,CAAC,OAAO,GAAG,OAAO,CAAC;QACvB,IAAI,CAAC,eAAe,GAAG,IAAI,iCAAe,CAAC,GAAG,CAAC,CAAC;QAChD,IAAI,CAAC,qBAAqB,GAAG,IAAI,6CAAqB,CAAC,GAAG,CAAC,CAAC;QAC5D,IAAI,CAAC,YAAY,GAAG,IAAI,uCAAkB,CAAC,GAAG,CAAC,CAAC;QAChD,IAAI,CAAC,qBAAqB,GAAG,IAAI,6CAAqB,CAAC,GAAG,CAAC,CAAC;QAC5D,IAAI,CAAC,gBAAgB,GAAG,IAAI,mCAAgB,CAAC,GAAG,CAAC,CAAC;QAClD,IAAI,CAAC,WAAW,GAAG,MAAM,CAAC,WAAW,CAAC;QACtC,IAAI,CAAC,OAAO,GAAG,MAAM,CAAC,OAAO,CAAC;QAE9B,IAAI,MAAM,CAAC,eAAe,EAAE,CAAC;YAC3B,IAAI,CAAC,gBAAgB,GAAG,IAAI,6BAAgB,CAAC,MAAM,CAAC,eAAe,CAAC,CAAC;QACvE,CAAC;IACH,CAAC;IAED,KAAK,CAAC,OAAO,CACX,YAAoB,EACpB,SAAiB,EACjB,eAAyB,EAAE;QAG3B,MAAM,gBAAgB,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;QACvE,MAAM,aAAa,GAAG,gBAAgB,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC;QAG1D,MAAM,iBAAiB,GAAG,MAAM,IAAI,CAAC,eAAe,CAAC,OAAO,CAC1D,YAAY,EACZ,SAAS,EACT,IAAI,CAAC,WAAW,EAChB,aAAa,CACd,CAAC;QAEF,IAAI,iBAAiB,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO;QAG3C,MAAM,gBAAgB,GAAG,IAAI,GAAG,EAAsB,CAAC;QAEvD,KAAK,MAAM,SAAS,IAAI,iBAAiB,EAAE,CAAC;YAC1C,MAAM,QAAQ,GAAG,MAAM,IAAI,CAAC,aAAa,CAAC,SAAS,EAAE,gBAAgB,CAAC,CAAC;YACvE,gBAAgB,CAAC,GAAG,CAAC,SAAS,CAAC,IAAI,CAAC,WAAW,EAAE,EAAE,QAAQ,CAAC,CAAC;QAC/D,CAAC;QAGD,MAAM,cAAc,GAAG;YACrB,GAAG,IAAI,GAAG,CAAC,CAAC,GAAG,aAAa,EAAE,GAAG,CAAC,GAAG,gBAAgB,CAAC,MAAM,EAAE,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;SACrF,CAAC;QAEF,MAAM,sBAAsB,GAAG,MAAM,IAAI,CAAC,qBAAqB,CAAC,OAAO,CACrE,YAAY,EACZ,SAAS,EACT,cAAc,CACf,CAAC;QAGF,KAAK,MAAM,GAAG,IAAI,sBAAsB,EAAE,CAAC;YACzC,MAAM,IAAI,CAAC,mBAAmB,CAAC,GAAG,EAAE,gBAAgB,EAAE,gBAAgB,EAAE,YAAY,CAAC,CAAC;QACxF,CAAC;IACH,CAAC;IAEO,KAAK,CAAC,aAAa,CACzB,SAAiE,EACjE,gBAA8B;QAG9B,KAAK,MAAM,QAAQ,IAAI,gBAAgB,EAAE,CAAC;YACxC,MAAM,EAAE,WAAW,EAAE,aAAa,EAAE,GAAG,MAAM,IAAI,CAAC,YAAY,CAAC,WAAW,CAAC,SAAS,EAAE;gBACpF,IAAI,EAAE,QAAQ,CAAC,IAAI;gBACnB,OAAO,EAAE,QAAQ,CAAC,OAAO;gBACzB,WAAW,EAAE,QAAQ,CAAC,WAAW;aAClC,CAAC,CAAC;YAEH,IAAI,WAAW,EAAE,CAAC;gBAEhB,IAAI,aAAa,IAAI,aAAa,KAAK,QAAQ,CAAC,OAAO,EAAE,CAAC;oBACxD,OAAO,MAAM,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,QAAQ,CAAC,IAAI,EAAE;wBACpD,OAAO,EAAE,aAAa;qBACvB,CAAC,CAAC;gBACL,CAAC;gBACD,OAAO,QAAQ,CAAC;YAClB,CAAC;QACH,CAAC;QAGD,IAAI,aAAmC,CAAC;QACxC,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;YAC1B,IAAI,CAAC;gBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,SAAS,CAAC,IAAI,CAAC,CAAC;gBACjE,aAAa,GAAG,MAAM,CAAC,SAAS,CAAC;YACnC,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CAAC,mDAAmD,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC9F,CAAC;QACH,CAAC;QAED,OAAO,MAAM,IAAI,CAAC,OAAO,CAAC,SAAS,CAAC;YAClC,IAAI,EAAE,SAAS,CAAC,IAAI;YACpB,QAAQ,EAAE,IAAI,CAAC,OAAO;YACtB,OAAO,EAAE,SAAS,CAAC,OAAO;YAC1B,WAAW,EAAE,SAAS,CAAC,WAAW;YAClC,cAAc,EAAE,aAAa,aAAb,aAAa,cAAb,aAAa,GAAI,IAAI;YACrC,UAAU,EAAE;gBACV,iBAAiB,EAAE;oBACjB,OAAO,EAAE,2BAA2B;oBACpC,MAAM,EAAE,KAAK;oBACb,UAAU,EAAE,IAAI;oBAChB,QAAQ,EAAE,KAAK;oBACf,YAAY,EAAE,IAAA,iBAAM,GAAE;iBACvB;aACF;SACF,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,uBAAuB,CACnC,KAAwC,EACxC,OAAe,EACf,gBAAwB,EACxB,gBAAwB,EACxB,WAAmB;QAEnB,KAAK,MAAM,YAAY,IAAI,KAAK,EAAE,CAAC;YACjC,IAAI,YAAY,CAAC,UAAU;gBAAE,SAAS;YAEtC,MAAM,UAAU,GAAG,MAAM,IAAI,CAAC,qBAAqB,CAAC,MAAM,CACxD,YAAY,CAAC,IAAI,EACjB,OAAO,EACP,gBAAgB,EAChB,gBAAgB,EAChB,YAAY,CAAC,IAAI,EACjB,WAAW,CACZ,CAAC;YAEF,IAAI,UAAU,CAAC,eAAe,IAAI,UAAU,CAAC,SAAS,EAAE,CAAC;gBACvD,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,YAAY,CAAC,IAAI,EAAE;oBAC/C,UAAU,EAAE,UAAU,CAAC,SAAS;oBAChC,UAAU,EAAE,UAAU,CAAC,SAAS;iBACjC,CAAC,CAAC;YACL,CAAC;QACH,CAAC;IACH,CAAC;IAEO,KAAK,CAAC,mBAAmB,CAC/B,GAKC,EACD,gBAAyC,EACzC,gBAA8B,EAC9B,YAAsB;QAGtB,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC,aAAa,EAAE,gBAAgB,EAAE,gBAAgB,CAAC,CAAC;QAC5F,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC,aAAa,EAAE,gBAAgB,EAAE,gBAAgB,CAAC,CAAC;QAE5F,IAAI,CAAC,YAAY,IAAI,CAAC,YAAY;YAAE,OAAO;QAE3C,MAAM,qBAAqB,GAAG,GAAG,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,OAAO,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;QAG1E,IAAI,aAAa,GAAsC,EAAE,CAAC;QAC1D,IAAI,CAAC;YACH,aAAa,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,eAAe,CAAC,YAAY,CAAC,IAAI,EAAE,YAAY,CAAC,IAAI,CAAC,CAAC;QAC3F,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,OAAO,CAAC,IAAI,CACV,uCAAuC,EACvC,YAAY,CAAC,IAAI,EACjB,KAAK,EACL,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;QAEJ,CAAC;QAKD,IAAI,CAAC;YACH,MAAM,oBAAoB,GAAG,aAAa,CAAC,IAAI,CAC7C,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,qBAAqB,IAAI,CAAC,CAAC,CAAC,UAAU,CACzD,CAAC;YAEF,IAAI,oBAAoB,EAAE,CAAC;gBACzB,MAAM,EAAE,WAAW,EAAE,UAAU,EAAE,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,WAAW,CACzE,oBAAoB,CAAC,IAAI,EACzB,GAAG,CAAC,IAAI,EACR,qBAAqB,EACrB,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,CAClB,CAAC;gBAEF,IAAI,WAAW,EAAE,CAAC;oBAChB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,gBAAgB,CACzC,oBAAoB,EACpB,UAAU,IAAI,GAAG,CAAC,IAAI,EACtB,YAAY,CACb,CAAC;oBACF,IAAI,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;wBACpC,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,oBAAoB,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;oBACpE,CAAC;oBACD,OAAO;gBACT,CAAC;YACH,CAAC;QACH,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,OAAO,CAAC,IAAI,CACV,uCAAuC,EACvC,YAAY,CAAC,IAAI,EACjB,IAAI,EACJ,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;QAEJ,CAAC;QAOD,IAAI,CAAC;YACH,MAAM,mBAAmB,GAAG,aAAa,CAAC,MAAM,CAC9C,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,qBAAqB,IAAI,CAAC,CAAC,CAAC,UAAU,CACzD,CAAC;YAEF,IAAI,mBAAmB,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBAEnC,MAAM,SAAS,GAAG,mBAAmB,CAAC,CAAC,CAAC,CAAC;gBACzC,MAAM,EAAE,WAAW,EAAE,UAAU,EAAE,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,oBAAoB,CAClF,SAAS,CAAC,IAAI,EACd,GAAG,CAAC,IAAI,EACR,SAAS,CAAC,IAAI,EACd,qBAAqB,EACrB,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,CAClB,CAAC;gBAEF,IAAI,WAAW,EAAE,CAAC;oBAChB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,gBAAgB,CACzC,SAAS,EACT,UAAU,IAAI,GAAG,CAAC,IAAI,EACtB,YAAY,CACb,CAAC;oBACF,IAAI,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;wBACpC,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,SAAS,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;oBACzD,CAAC;oBACD,OAAO;gBACT,CAAC;YACH,CAAC;QACH,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,OAAO,CAAC,IAAI,CACV,kDAAkD,EAClD,YAAY,CAAC,IAAI,EACjB,IAAI,EACJ,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;QAEJ,CAAC;QAGD,IAAI,CAAC;YAIH,MAAM,IAAI,CAAC,uBAAuB,CAChC,aAAa,EACb,GAAG,CAAC,IAAI,EACR,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,EACjB,qBAAqB,CACtB,CAAC;YAKF,MAAM,YAAY,GAAG,IAAI,GAAG,CAAC,aAAa,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;YAC/D,MAAM,cAAc,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,iBAAiB,CAAC,YAAY,CAAC,IAAI,CAAC,CAAC;YAC/E,MAAM,gBAAgB,GAAG,cAAc,CAAC,MAAM,CAC5C,CAAC,CAAC,EAAE,EAAE,CACJ,CAAC,CAAC,gBAAgB,KAAK,YAAY,CAAC,IAAI;gBACxC,CAAC,CAAC,IAAI,KAAK,qBAAqB;gBAChC,CAAC,CAAC,gBAAgB,KAAK,YAAY,CAAC,IAAI;gBACxC,CAAC,CAAC,CAAC,UAAU;gBACb,CAAC,YAAY,CAAC,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,CAC5B,CAAC;YACF,MAAM,IAAI,CAAC,uBAAuB,CAChC,gBAAgB,EAChB,GAAG,CAAC,IAAI,EACR,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,EACjB,qBAAqB,CACtB,CAAC;QACJ,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,OAAO,CAAC,IAAI,CACV,yDAAyD,EACzD,YAAY,CAAC,IAAI,EACjB,KAAK,EACL,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;QACJ,CAAC;QAGD,IAAI,aAAmC,CAAC;QACxC,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;YAC1B,IAAI,CAAC;gBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,GAAG,CAAC,IAAI,CAAC,CAAC;gBAC3D,aAAa,GAAG,MAAM,CAAC,SAAS,CAAC;YACnC,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CAAC,iDAAiD,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC5F,CAAC;QACH,CAAC;QAED,MAAM,IAAI,CAAC,OAAO,CAAC,OAAO,CAAC;YACzB,QAAQ,EAAE,IAAI,CAAC,OAAO;YACtB,gBAAgB,EAAE,YAAY,CAAC,IAAI;YACnC,gBAAgB,EAAE,YAAY,CAAC,IAAI;YACnC,IAAI,EAAE,qBAAqB;YAC3B,IAAI,EAAE,GAAG,CAAC,IAAI;YACd,cAAc,EAAE,aAAa,aAAb,aAAa,cAAb,aAAa,GAAI,IAAI;YACrC,QAAQ,EAAE,IAAA,iBAAM,GAAE;YAClB,QAAQ,EAAE,YAAY;YACtB,UAAU,EAAE;gBACV,iBAAiB,EAAE;oBACjB,OAAO,EAAE,2BAA2B;oBACpC,MAAM,EAAE,KAAK;oBACb,UAAU,EAAE,IAAI;oBAChB,QAAQ,EAAE,KAAK;oBACf,YAAY,EAAE,IAAA,iBAAM,GAAE;oBACtB,aAAa,EAAE,YAAY;iBAC5B;aACF;SACF,CAAC,CAAC;IACL,CAAC;IAMO,KAAK,CAAC,gBAAgB,CAC5B,YAA6C,EAC7C,aAAqB,EACrB,YAAsB;QAEtB,MAAM,OAAO,GAA4B,EAAE,CAAC;QAE5C,IAAI,aAAa,KAAK,YAAY,CAAC,IAAI,EAAE,CAAC;YACxC,OAAO,CAAC,IAAI,GAAG,aAAa,CAAC;YAG7B,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;gBAC1B,IAAI,CAAC;oBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,aAAa,CAAC,CAAC;oBAChE,OAAO,CAAC,cAAc,GAAG,MAAM,CAAC,SAAS,CAAC;gBAC5C,CAAC;gBAAC,OAAO,KAAK,EAAE,CAAC;oBACf,OAAO,CAAC,IAAI,CAAC,8CAA8C,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;gBACzF,CAAC;YACH,CAAC;QACH,CAAC;QAGD,IAAI,YAAY,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YAC5B,MAAM,gBAAgB,GAAG,YAAY,CAAC,QAAQ,IAAI,EAAE,CAAC;YACrD,MAAM,cAAc,GAAG,CAAC,GAAG,gBAAgB,CAAC,CAAC;YAC7C,KAAK,MAAM,WAAW,IAAI,YAAY,EAAE,CAAC;gBACvC,IAAI,CAAC,cAAc,CAAC,QAAQ,CAAC,WAAW,CAAC,EAAE,CAAC;oBAC1C,cAAc,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC;gBACnC,CAAC;YACH,CAAC;YACD,IAAI,cAAc,CAAC,MAAM,KAAK,gBAAgB,CAAC,MAAM,EAAE,CAAC;gBACtD,OAAO,CAAC,QAAQ,GAAG,cAAc,CAAC;YACpC,CAAC;QACH,CAAC;QAED,OAAO,OAAO,CAAC;IACjB,CAAC;IAEO,UAAU,CAChB,IAAY,EACZ,gBAAyC,EACzC,gBAA8B;QAE9B,MAAM,UAAU,GAAG,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC;QAG7C,MAAM,QAAQ,GAAG,gBAAgB,CAAC,GAAG,CAAC,UAAU,CAAC,CAAC;QAClD,IAAI,QAAQ;YAAE,OAAO,QAAQ,CAAC;QAG9B,OAAO,gBAAgB,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,KAAK,UAAU,CAAC,CAAC;IAClF,CAAC;CACF;AAlZD,gDAkZC"}
+{"version":3,"file":"ExtractionPipeline.js","sourceRoot":"","sources":["../../src/extraction/ExtractionPipeline.ts"],"names":[],"mappings":";;;AACA,wCAOoB;AACpB,2CAA8D;AAC9D,uDAAoD;AACpD,mEAAgE;AAChE,6DAA0D;AAC1D,mEAAgE;AAChE,yDAAsD;AACtD,8CAAuE;AACvE,gDAA2C;AAC3C,yDAAmF;AAqBnF,MAAa,kBAAkB;IAa7B,YAAY,OAAsB,EAAE,MAAgC;;QAN5D,qBAAgB,GAA4B,IAAI,CAAC;QAOvD,MAAM,GAAG,GAAG,IAAI,qBAAS,CAAC,MAAM,CAAC,SAAS,CAAC,CAAC;QAC5C,IAAI,CAAC,OAAO,GAAG,OAAO,CAAC;QACvB,IAAI,CAAC,eAAe,GAAG,IAAI,iCAAe,CAAC,GAAG,CAAC,CAAC;QAChD,IAAI,CAAC,qBAAqB,GAAG,IAAI,6CAAqB,CAAC,GAAG,CAAC,CAAC;QAC5D,IAAI,CAAC,YAAY,GAAG,IAAI,uCAAkB,CAAC,GAAG,CAAC,CAAC;QAChD,IAAI,CAAC,qBAAqB,GAAG,IAAI,6CAAqB,CAAC,GAAG,CAAC,CAAC;QAC5D,IAAI,CAAC,gBAAgB,GAAG,IAAI,mCAAgB,CAAC,GAAG,CAAC,CAAC;QAClD,IAAI,CAAC,WAAW,GAAG,MAAM,CAAC,WAAW,CAAC;QACtC,IAAI,CAAC,OAAO,GAAG,MAAM,CAAC,OAAO,CAAC;QAC9B,IAAI,CAAC,iBAAiB,GAAG,MAAA,MAAM,CAAC,iBAAiB,mCAAI,KAAK,CAAC;QAC3D,IAAI,CAAC,eAAe,GAAG,MAAM,CAAC,eAAe,CAAC;QAC9C,IAAI,IAAI,CAAC,eAAe,EAAE,CAAC;YACzB,IAAA,gCAAsB,EAAC,GAAG,EAAE,IAAI,CAAC,eAAe,CAAC,CAAC;QACpD,CAAC;QAED,IAAI,MAAM,CAAC,eAAe,EAAE,CAAC;YAC3B,IAAI,CAAC,gBAAgB,GAAG,IAAI,6BAAgB,CAAC,MAAM,CAAC,eAAe,CAAC,CAAC;QACvE,CAAC;IACH,CAAC;IAED,KAAK,CAAC,OAAO,CACX,YAAoB,EACpB,SAAiB,EACjB,eAAyB,EAAE;;QAE3B,MAAM,OAAO,GAAuB,EAAE,CAAC;QACvC,IAAI,YAAY,EAAE,CAAC;YACjB,OAAO,CAAC,IAAI,CAAC;gBACX,OAAO,EAAE,YAAY;gBACrB,IAAI,EAAE,OAAO;gBACb,YAAY,EAAE,cAAc;gBAC5B,YAAY,EAAE,MAAA,YAAY,CAAC,CAAC,CAAC,mCAAI,IAAI;aACtC,CAAC,CAAC;QACL,CAAC;QACD,IAAI,SAAS,EAAE,CAAC;YACd,OAAO,CAAC,IAAI,CAAC;gBACX,OAAO,EAAE,SAAS;gBAClB,IAAI,EAAE,IAAI;gBACV,YAAY,EAAE,iBAAiB;gBAC/B,YAAY,EAAE,MAAA,YAAY,CAAC,CAAC,CAAC,mCAAI,IAAI;aACtC,CAAC,CAAC;QACL,CAAC;QACD,MAAM,IAAI,CAAC,cAAc,CAAC,OAAO,CAAC,CAAC;IACrC,CAAC;IAED,KAAK,CAAC,cAAc,CAAC,OAA2B;QAC9C,MAAM,eAAe,GAAG,OAAO,CAAC,MAAM,CAAC,CAAC,MAAM,EAAE,EAAE,CAAC,MAAM,CAAC,OAAO,CAAC,IAAI,EAAE,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC;QACrF,IAAI,eAAe,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO;QACzC,MAAM,YAAY,GAAG,IAAA,yCAAsB,EAAC,eAAe,CAAC,CAAC;QAG7D,MAAM,gBAAgB,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;QACvE,MAAM,aAAa,GAAG,gBAAgB,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC;QAG1D,MAAM,iBAAiB,GAAG,MAAM,IAAI,CAAC,eAAe,CAAC,cAAc,CACjE,eAAe,EACf,IAAI,CAAC,WAAW,EAChB,aAAa,EACb,IAAI,CAAC,iBAAiB,CACvB,CAAC;QAEF,IAAI,iBAAiB,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO;QAG3C,MAAM,gBAAgB,GAAG,IAAI,GAAG,EAAsB,CAAC;QAEvD,KAAK,MAAM,SAAS,IAAI,iBAAiB,EAAE,CAAC;YAC1C,MAAM,QAAQ,GAAG,MAAM,IAAI,CAAC,aAAa,CAAC,SAAS,EAAE,gBAAgB,EAAE,YAAY,CAAC,CAAC;YACrF,gBAAgB,CAAC,GAAG,CAAC,SAAS,CAAC,IAAI,CAAC,WAAW,EAAE,EAAE,QAAQ,CAAC,CAAC;QAC/D,CAAC;QAGD,MAAM,cAAc,GAAG;YACrB,GAAG,IAAI,GAAG,CAAC,CAAC,GAAG,aAAa,EAAE,GAAG,CAAC,GAAG,gBAAgB,CAAC,MAAM,EAAE,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;SACrF,CAAC;QAEF,MAAM,sBAAsB,GAAG,MAAM,IAAI,CAAC,qBAAqB,CAAC,cAAc,CAC5E,eAAe,EACf,cAAc,EACd,IAAI,CAAC,iBAAiB,CACvB,CAAC;QAGF,KAAK,MAAM,GAAG,IAAI,sBAAsB,EAAE,CAAC;YACzC,MAAM,IAAI,CAAC,mBAAmB,CAAC,GAAG,EAAE,gBAAgB,EAAE,gBAAgB,EAAE,YAAY,CAAC,CAAC;QACxF,CAAC;IACH,CAAC;IAEO,KAAK,CAAC,aAAa,CACzB,SAA4F,EAC5F,gBAA8B,EAC9B,YAAsB;QAEtB,MAAM,gBAAgB,GAAG,IAAI,CAAC,wBAAwB,CAAC,SAAS,CAAC,UAAU,EAAE,YAAY,CAAC,CAAC;QAC3F,MAAM,cAAc,GAAG,gBAAgB,CAAC,aAAa,CAAC;QAEtD,KAAK,MAAM,QAAQ,IAAI,gBAAgB,EAAE,CAAC;YACxC,MAAM,EAAE,WAAW,EAAE,aAAa,EAAE,GAAG,MAAM,IAAI,CAAC,YAAY,CAAC,WAAW,CAAC,SAAS,EAAE;gBACpF,IAAI,EAAE,QAAQ,CAAC,IAAI;gBACnB,OAAO,EAAE,QAAQ,CAAC,OAAO;gBACzB,WAAW,EAAE,QAAQ,CAAC,WAAW;aAClC,CAAC,CAAC;YAEH,IAAI,WAAW,EAAE,CAAC;gBAChB,MAAM,cAAc,GAAG,IAAI,CAAC,YAAY,CAAC,QAAQ,CAAC,UAAU,CAAC,CAAC;gBAC9D,MAAM,OAAO,GAAwB,EAAE,CAAC;gBACxC,IACE,aAAa;oBACb,aAAa,KAAK,QAAQ,CAAC,OAAO;oBAClC,CAAC,CAAC,IAAI,CAAC,eAAe,IAAI,cAAc,KAAK,UAAU,IAAI,cAAc,KAAK,UAAU,CAAC,EACzF,CAAC;oBACD,OAAO,CAAC,OAAO,GAAG,aAAa,CAAC;gBAClC,CAAC;gBACD,MAAM,cAAc,GAAG,IAAI,CAAC,uBAAuB,CACjD,IAAA,0CAAgC,EAAC,QAAQ,CAAC,UAAU,CAAC,EACrD,gBAAgB,EAChB,YAAY,CACb,CAAC;gBACF,IAAI,cAAc,EAAE,CAAC;oBACnB,OAAO,CAAC,UAAU,GAAG,EAAE,GAAG,QAAQ,CAAC,UAAU,EAAE,iBAAiB,EAAE,cAAc,EAAE,CAAC;gBACrF,CAAC;gBACD,IAAI,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;oBACpC,OAAO,MAAM,IAAI,CAAC,OAAO,CAAC,YAAY,CAAC,QAAQ,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;gBACjE,CAAC;gBACD,OAAO,QAAQ,CAAC;YAClB,CAAC;QACH,CAAC;QAGD,IAAI,aAAmC,CAAC;QACxC,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;YAC1B,IAAI,CAAC;gBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,SAAS,CAAC,IAAI,CAAC,CAAC;gBACjE,aAAa,GAAG,MAAM,CAAC,SAAS,CAAC;YACnC,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CAAC,mDAAmD,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC9F,CAAC;QACH,CAAC;QAED,OAAO,MAAM,IAAI,CAAC,OAAO,CAAC,SAAS,CAAC;YAClC,IAAI,EAAE,SAAS,CAAC,IAAI;YACpB,QAAQ,EAAE,IAAI,CAAC,OAAO;YACtB,OAAO,EAAE,SAAS,CAAC,OAAO;YAC1B,WAAW,EAAE,SAAS,CAAC,WAAW;YAClC,cAAc,EAAE,aAAa,aAAb,aAAa,cAAb,aAAa,GAAI,IAAI;YACrC,UAAU,EAAE;gBACV,iBAAiB,EAAE,gBAAgB;aACpC;SACF,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,uBAAuB,CACnC,KAAwC,EACxC,OAAe,EACf,gBAAwB,EACxB,gBAAwB,EACxB,WAAmB;QAEnB,KAAK,MAAM,YAAY,IAAI,KAAK,EAAE,CAAC;YACjC,IAAI,YAAY,CAAC,UAAU;gBAAE,SAAS;YACtC,IAAI,IAAI,CAAC,eAAe,IAAI,IAAI,CAAC,YAAY,CAAC,YAAY,CAAC,UAAU,CAAC,KAAK,UAAU,EAAE,CAAC;gBACtF,SAAS;YACX,CAAC;YAED,MAAM,UAAU,GAAG,MAAM,IAAI,CAAC,qBAAqB,CAAC,MAAM,CACxD,YAAY,CAAC,IAAI,EACjB,OAAO,EACP,gBAAgB,EAChB,gBAAgB,EAChB,YAAY,CAAC,IAAI,EACjB,WAAW,CACZ,CAAC;YAEF,IAAI,UAAU,CAAC,eAAe,IAAI,UAAU,CAAC,SAAS,EAAE,CAAC;gBACvD,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,YAAY,CAAC,IAAI,EAAE;oBAC/C,UAAU,EAAE,UAAU,CAAC,SAAS;oBAChC,UAAU,EAAE,UAAU,CAAC,SAAS;iBACjC,CAAC,CAAC;YACL,CAAC;QACH,CAAC;IACH,CAAC;IAEO,KAAK,CAAC,mBAAmB,CAC/B,GAMC,EACD,gBAAyC,EACzC,gBAA8B,EAC9B,YAAsB;QAGtB,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC,aAAa,EAAE,gBAAgB,EAAE,gBAAgB,CAAC,CAAC;QAC5F,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC,aAAa,EAAE,gBAAgB,EAAE,gBAAgB,CAAC,CAAC;QAE5F,IAAI,CAAC,YAAY,IAAI,CAAC,YAAY;YAAE,OAAO;QAE3C,MAAM,qBAAqB,GAAG,GAAG,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,OAAO,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;QAC1E,MAAM,gBAAgB,GAAG,IAAI,CAAC,wBAAwB,CAAC,GAAG,CAAC,UAAU,EAAE,YAAY,CAAC,CAAC;QACrF,MAAM,cAAc,GAAG,gBAAgB,CAAC,aAAa,CAAC;QAGtD,IAAI,aAAa,GAAsC,EAAE,CAAC;QAC1D,IAAI,CAAC;YACH,aAAa,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,eAAe,CAAC,YAAY,CAAC,IAAI,EAAE,YAAY,CAAC,IAAI,CAAC,CAAC;QAC3F,CAAC;QAAC,OAAO,KAAK,EAAE,CAAC;YACf,OAAO,CAAC,IAAI,CACV,uCAAuC,EACvC,YAAY,CAAC,IAAI,EACjB,KAAK,EACL,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;QAEJ,CAAC;QAKD,IAAI,cAAc,KAAK,UAAU,EAAE,CAAC;YAClC,IAAI,CAAC;gBACH,MAAM,oBAAoB,GAAG,aAAa,CAAC,IAAI,CAC7C,CAAC,CAAC,EAAE,EAAE,CACJ,CAAC,CAAC,IAAI,KAAK,qBAAqB;oBAChC,CAAC,CAAC,CAAC,UAAU;oBACb,IAAI,CAAC,YAAY,CAAC,CAAC,CAAC,UAAU,CAAC,KAAK,UAAU,CACjD,CAAC;gBAEF,IAAI,oBAAoB,EAAE,CAAC;oBACzB,MAAM,EAAE,WAAW,EAAE,UAAU,EAAE,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,WAAW,CACzE,oBAAoB,CAAC,IAAI,EACzB,GAAG,CAAC,IAAI,EACR,qBAAqB,EACrB,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,CAClB,CAAC;oBAEF,IAAI,WAAW,EAAE,CAAC;wBAChB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,gBAAgB,CACzC,oBAAoB,EACpB,UAAU,IAAI,GAAG,CAAC,IAAI,EACtB,YAAY,EACZ,gBAAgB,CACjB,CAAC;wBACF,IAAI,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;4BACpC,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,oBAAoB,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;wBACpE,CAAC;wBACD,OAAO;oBACT,CAAC;gBACH,CAAC;YACH,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CACV,uCAAuC,EACvC,YAAY,CAAC,IAAI,EACjB,IAAI,EACJ,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;YAEJ,CAAC;QACH,CAAC;QAOD,IAAI,cAAc,KAAK,UAAU,EAAE,CAAC;YAClC,IAAI,CAAC;gBACH,MAAM,mBAAmB,GAAG,aAAa,CAAC,MAAM,CAC9C,CAAC,CAAC,EAAE,EAAE,CACJ,CAAC,CAAC,IAAI,KAAK,qBAAqB;oBAChC,CAAC,CAAC,CAAC,UAAU;oBACb,IAAI,CAAC,YAAY,CAAC,CAAC,CAAC,UAAU,CAAC,KAAK,UAAU,CACjD,CAAC;gBAEF,IAAI,mBAAmB,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;oBAEnC,MAAM,SAAS,GAAG,mBAAmB,CAAC,CAAC,CAAC,CAAC;oBACzC,MAAM,EAAE,WAAW,EAAE,UAAU,EAAE,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,oBAAoB,CAClF,SAAS,CAAC,IAAI,EACd,GAAG,CAAC,IAAI,EACR,SAAS,CAAC,IAAI,EACd,qBAAqB,EACrB,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,CAClB,CAAC;oBAEF,IAAI,WAAW,EAAE,CAAC;wBAChB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,gBAAgB,CACzC,SAAS,EACT,UAAU,IAAI,GAAG,CAAC,IAAI,EACtB,YAAY,EACZ,gBAAgB,CACjB,CAAC;wBACF,IAAI,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;4BACpC,MAAM,IAAI,CAAC,OAAO,CAAC,UAAU,CAAC,SAAS,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;wBACzD,CAAC;wBACD,OAAO;oBACT,CAAC;gBACH,CAAC;YACH,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CACV,kDAAkD,EAClD,YAAY,CAAC,IAAI,EACjB,IAAI,EACJ,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;YAEJ,CAAC;QACH,CAAC;QAGD,IAAI,CAAC,IAAI,CAAC,eAAe,IAAI,cAAc,KAAK,UAAU,EAAE,CAAC;YAC3D,IAAI,CAAC;gBAIH,MAAM,IAAI,CAAC,uBAAuB,CAChC,aAAa,EACb,GAAG,CAAC,IAAI,EACR,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,EACjB,qBAAqB,CACtB,CAAC;gBAKF,MAAM,YAAY,GAAG,IAAI,GAAG,CAAC,aAAa,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;gBAC/D,MAAM,cAAc,GAAG,MAAM,IAAI,CAAC,OAAO,CAAC,iBAAiB,CAAC,YAAY,CAAC,IAAI,CAAC,CAAC;gBAC/E,MAAM,gBAAgB,GAAG,cAAc,CAAC,MAAM,CAC5C,CAAC,CAAC,EAAE,EAAE,CACJ,CAAC,CAAC,gBAAgB,KAAK,YAAY,CAAC,IAAI;oBACxC,CAAC,CAAC,IAAI,KAAK,qBAAqB;oBAChC,CAAC,CAAC,gBAAgB,KAAK,YAAY,CAAC,IAAI;oBACxC,CAAC,CAAC,CAAC,UAAU;oBACb,CAAC,YAAY,CAAC,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,CAC5B,CAAC;gBACF,MAAM,IAAI,CAAC,uBAAuB,CAChC,gBAAgB,EAChB,GAAG,CAAC,IAAI,EACR,YAAY,CAAC,IAAI,EACjB,YAAY,CAAC,IAAI,EACjB,qBAAqB,CACtB,CAAC;YACJ,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CACV,yDAAyD,EACzD,YAAY,CAAC,IAAI,EACjB,KAAK,EACL,YAAY,CAAC,IAAI,GAAG,GAAG,EACtB,KAAe,CAAC,OAAO,CACzB,CAAC;YACJ,CAAC;QACH,CAAC;QAGD,IAAI,aAAmC,CAAC;QACxC,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;YAC1B,IAAI,CAAC;gBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,GAAG,CAAC,IAAI,CAAC,CAAC;gBAC3D,aAAa,GAAG,MAAM,CAAC,SAAS,CAAC;YACnC,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO,CAAC,IAAI,CAAC,iDAAiD,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;YAC5F,CAAC;QACH,CAAC;QAED,MAAM,IAAI,CAAC,OAAO,CAAC,OAAO,CAAC;YACzB,QAAQ,EAAE,IAAI,CAAC,OAAO;YACtB,gBAAgB,EAAE,YAAY,CAAC,IAAI;YACnC,gBAAgB,EAAE,YAAY,CAAC,IAAI;YACnC,IAAI,EAAE,qBAAqB;YAC3B,IAAI,EAAE,GAAG,CAAC,IAAI;YACd,cAAc,EAAE,aAAa,aAAb,aAAa,cAAb,aAAa,GAAI,IAAI;YACrC,QAAQ,EAAE,IAAA,iBAAM,GAAE;YAClB,QAAQ,EAAE,YAAY;YACtB,UAAU,EAAE;gBACV,iBAAiB,EAAE,gBAAgB;aACpC;SACF,CAAC,CAAC;IACL,CAAC;IAMO,KAAK,CAAC,gBAAgB,CAC5B,YAA6C,EAC7C,aAAqB,EACrB,YAAsB,EACtB,gBAAsC;;QAEtC,MAAM,OAAO,GAA4B,EAAE,CAAC;QAC5C,MAAM,gBAAgB,GAAG,IAAA,0CAAgC,EAAC,YAAY,CAAC,UAAU,CAAC,CAAC;QACnF,MAAM,cAAc,GAAG,IAAI,CAAC,YAAY,CAAC,YAAY,CAAC,UAAU,CAAC,CAAC;QAElE,IACE,aAAa,KAAK,YAAY,CAAC,IAAI;YACnC,CAAC,CAAC,IAAI,CAAC,eAAe;gBACpB,gBAAgB,CAAC,aAAa,KAAK,UAAU;gBAC7C,cAAc,KAAK,UAAU,CAAC,EAChC,CAAC;YACD,OAAO,CAAC,IAAI,GAAG,aAAa,CAAC;YAG7B,IAAI,IAAI,CAAC,gBAAgB,EAAE,CAAC;gBAC1B,IAAI,CAAC;oBACH,MAAM,MAAM,GAAG,MAAM,IAAI,CAAC,gBAAgB,CAAC,KAAK,CAAC,aAAa,CAAC,CAAC;oBAChE,OAAO,CAAC,cAAc,GAAG,MAAM,CAAC,SAAS,CAAC;gBAC5C,CAAC;gBAAC,OAAO,KAAK,EAAE,CAAC;oBACf,OAAO,CAAC,IAAI,CAAC,8CAA8C,EAAG,KAAe,CAAC,OAAO,CAAC,CAAC;gBACzF,CAAC;YACH,CAAC;QACH,CAAC;QAGD,IAAI,YAAY,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YAC5B,MAAM,gBAAgB,GAAG,YAAY,CAAC,QAAQ,IAAI,EAAE,CAAC;YACrD,MAAM,cAAc,GAAG,CAAC,GAAG,gBAAgB,CAAC,CAAC;YAC7C,KAAK,MAAM,WAAW,IAAI,YAAY,EAAE,CAAC;gBACvC,IAAI,CAAC,cAAc,CAAC,QAAQ,CAAC,WAAW,CAAC,EAAE,CAAC;oBAC1C,cAAc,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC;gBACnC,CAAC;YACH,CAAC;YACD,IAAI,cAAc,CAAC,MAAM,KAAK,gBAAgB,CAAC,MAAM,EAAE,CAAC;gBACtD,OAAO,CAAC,QAAQ,GAAG,cAAc,CAAC;YACpC,CAAC;QACH,CAAC;QAED,MAAM,kBAAkB,GAAG;YACzB,GAAG,IAAI,GAAG,CAAC,CAAC,GAAG,CAAC,MAAA,gBAAgB,aAAhB,gBAAgB,uBAAhB,gBAAgB,CAAE,aAAa,mCAAI,EAAE,CAAC,EAAE,GAAG,YAAY,CAAC,CAAC;SAC1E,CAAC;QACF,MAAM,cAAc,GAAG,IAAI,CAAC,uBAAuB,CACjD,gBAAgB,EAChB,gBAAgB,EAChB,kBAAkB,CACnB,CAAC;QACF,IAAI,cAAc,EAAE,CAAC;YACnB,OAAO,CAAC,UAAU,GAAG;gBACnB,GAAG,YAAY,CAAC,UAAU;gBAC1B,iBAAiB,EAAE,cAAc;aAClC,CAAC;QACJ,CAAC;QAED,OAAO,OAAO,CAAC;IACjB,CAAC;IAEO,wBAAwB,CAC9B,UAAyB,EACzB,YAAsB;QAEtB,MAAM,QAAQ,GAAG,IAAA,gCAAsB,EAAC,UAAU,EAAE,IAAI,CAAC,eAAe,CAAC,CAAC;QAC1E,OAAO,oCAA0B,CAAC,KAAK,CAAC;YACtC,OAAO,EAAE,CAAC;YACV,MAAM,EAAE,KAAK;YACb,UAAU;YACV,GAAG,QAAQ;YACX,YAAY,EAAE,IAAA,iBAAM,GAAE;YACtB,aAAa,EAAE,YAAY;SAC5B,CAAC,CAAC;IACL,CAAC;IAEO,YAAY,CAAC,UAAmC;;QACtD,OAAO,MAAA,MAAA,IAAA,0CAAgC,EAAC,UAAU,CAAC,0CAAE,aAAa,mCAAI,UAAU,CAAC;IACnF,CAAC;IAEO,uBAAuB,CAC7B,QAAqC,EACrC,QAA8B,EAC9B,YAAsB;;QAEtB,IAAI,CAAC,QAAQ;YAAE,OAAO,IAAI,CAAC;QAC3B,MAAM,IAAI,GAAG,EAAE,QAAQ,EAAE,CAAC,EAAE,QAAQ,EAAE,CAAC,EAAE,QAAQ,EAAE,CAAC,EAAW,CAAC;QAChE,MAAM,MAAM,GACV,IAAI,CAAC,QAAQ,CAAC,aAAa,CAAC,GAAG,IAAI,CAAC,QAAQ,CAAC,aAAa,CAAC,CAAC,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,QAAQ,CAAC;QACpF,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,CAAC,MAAA,QAAQ,CAAC,UAAU,mCAAI,CAAC,EAAE,MAAA,QAAQ,CAAC,UAAU,mCAAI,CAAC,CAAC,CAAC;QAChF,OAAO,oCAA0B,CAAC,KAAK,CAAC;YACtC,GAAG,MAAM;YACT,UAAU,EAAE,QAAQ,CAAC,UAAU,KAAK,IAAI,IAAI,QAAQ,CAAC,UAAU,KAAK,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,UAAU;YAC5F,aAAa,EAAE,CAAC,GAAG,IAAI,GAAG,CAAC,YAAY,CAAC,CAAC;SAC1C,CAAC,CAAC;IACL,CAAC;IAEO,UAAU,CAChB,IAAY,EACZ,gBAAyC,EACzC,gBAA8B;QAE9B,MAAM,UAAU,GAAG,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,CAAC;QAG7C,MAAM,QAAQ,GAAG,gBAAgB,CAAC,GAAG,CAAC,UAAU,CAAC,CAAC;QAClD,IAAI,QAAQ;YAAE,OAAO,QAAQ,CAAC;QAG9B,OAAO,gBAAgB,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,WAAW,EAAE,CAAC,IAAI,EAAE,KAAK,UAAU,CAAC,CAAC;IAClF,CAAC;CACF;AArgBD,gDAqgBC"}

package/dist/extraction/ExtractionSource.d.ts

@@ -0,0 +1,15 @@
+import type { EpisodeKind, EpisodeReviewStatus, EpisodeRole, EpisodeTrustLevel } from '../schemas';
+export interface ExtractionSource {
+    content: string;
+    role: EpisodeRole;
+    episode_kind: EpisodeKind;
+    episode_uuid?: string | null;
+    source_message_id?: string | null;
+    sender_id?: string | null;
+    sender_name?: string | null;
+    trust_level?: EpisodeTrustLevel;
+    review_status?: EpisodeReviewStatus;
+    reference_time?: string;
+}
+export declare function formatExtractionSources(sources: ExtractionSource[]): string;
+export declare function extractionEpisodeUuids(sources: ExtractionSource[]): string[];