n8n-nodes-engram 0.6.0 → 0.7.0

package/README.md

@@ -19,13 +19,13 @@
   <a href="https://github.com/casistack/n8n-nodes-engram/blob/main/LICENSE">
     <img src="https://img.shields.io/badge/license-AGPL--3.0-blue.svg" alt="License: AGPL-3.0" />
   </a>
-  <img src="https://img.shields.io/badge/node-%3E%3D18.10-brightgreen.svg" alt="Node.js" />
+  <img src="https://img.shields.io/badge/node-%3E%3D20-brightgreen.svg" alt="Node.js" />
   <img src="https://img.shields.io/badge/n8n-community%20node-ff6d5a.svg" alt="n8n community node" />
 </p>
 
 <p align="center">
   <a href="#installation">Installation</a> &middot;
-  <a href="#upgrading-to-v060">Upgrade</a> &middot;
+  <a href="#upgrading-to-v070">Upgrade</a> &middot;
   <a href="#node-reference">Nodes</a> &middot;
   <a href="#storage-backends">Storage</a> &middot;
   <a href="#knowledge-extraction">Extraction</a> &middot;
@@ -101,6 +101,52 @@ npm install n8n-nodes-engram
 
 ---
 
+## Upgrading to v0.7.0
+
+These Memory v2 controls are optional. Existing workflows keep **Entity Resolution > Legacy**, **Knowledge Selection > Legacy**, **Extraction Execution > Synchronous** and **Graph Context Policy > Legacy**. Installing a newer package does not enable them or rewrite existing knowledge.
+
+### Back Up and Install v0.7.0
+
+1. Back up current workflows and n8n configuration. Preserve exact namespace keys and any existing alias mapping.
+2. **Embedded:** pause writers and preserve each producer workflow's graph file, storage directory and workflow-to-file mapping. Use a separate restored store for upgrade trials. Once durable work exists, use **Extraction Queue > Export Queue Backup** for portable queue-aware recovery.
+3. **Neo4j:** take a consistent database backup using your normal recovery procedure. Retain the same database and namespace identities. Graph writers coordinate through a shared store lock; validate concurrent write throughput during rollout.
+4. Install `n8n-nodes-engram@0.7.0`, restart n8n, refresh the editor and confirm the installed version. Node.js 20 or newer is required. Existing v2 stores load without a bulk migration or re-extraction; earlier provenance/schema upgrades remain separate.
+5. Run **Engram Admin > Monitoring > Diagnostics**. Saved Memory v1 nodes remain v1; upgrade selected nodes explicitly to **Memory v2** on an inactive workflow copy before enabling the new controls. Check that the copy points to the intended restored store.
+
+### Activate Bounded Extraction First
+
+Back up current workflows and both the graph and conversation records before changing settings. Preserve the exact namespace, including whitespace, and the existing embedded workflow-to-file mapping or Neo4j database. Begin with one conversation workflow and keep the current model, session identity and conversation window.
+
+Select **Entity Resolution > Bounded** and **Message Write Policy > Final Turns**. Keep eligible human/final-assistant sources stored; system/tool extraction is unsupported in this mode. Exact names and explicitly verified aliases resolve before model comparisons. Defaults limit each extraction to an eight-candidate shortlist, 16 fuzzy comparisons, 32 model/embedding requests and a 30-second shared deadline. Identity ambiguity, pruned candidates and exhausted budgets remain proposed or deferred; they are not permission to merge existing identities. Legacy contradiction expiry and automatic summary updates are not performed by the bounded path.
+
+Select **Knowledge Selection > Durable and Temporal** to keep temporary requests in conversation history without automatically accepting them as durable facts. Automatic acceptance requires accepted human provenance and complete, literal assertion evidence. Paraphrases, quotations, hypothetical or qualified statements and uncertain identities require review. This conservative policy can produce more proposed records. It does not reclassify, re-extract or delete previously stored facts. **Source Timezone** must be an explicit IANA zone such as `Europe/London`; omit it when unknown. Calendar-day resolution supports today/tomorrow/yesterday and a single explicit date. Other relative expressions remain uncertain.
+
+**Graph Context Policy > Governed Current** reconciles search/traversal duplicates by relationship UUID, omits ungrounded entity summaries and excludes unresolved or out-of-interval plans from current context. **Governed Historical** retains historical evidence with source attribution; map historical intent explicitly in the workflow. **Governed As Of** requires an ISO timestamp with `Z` or a numeric offset and tests event-interval relevance, not what the system knew at that time. Separate **Durable Fact Token Allowance** (4096) and **Historical Evidence Token Allowance** (2048) stay within the overall graph context token cap; the recent-message window remains independent. A zero allowance disables that evidence category. Governed search and traversal share a 512-source-reference hydration allowance; candidates whose complete provenance does not fit are deferred, with `source_reference_deferred` and truncation diagnostics. Existing accepted legacy records are not automatically corrected. Genuine human JSON and quoted conversation remain in the episode ledger.
+
+Inspect save diagnostics for per-stage elapsed time, model-call counts, available token usage, candidate/deferral counts and storage timing. Unavailable provider/backend measurements are `null`; overlapping stage/request/storage times must not be added together. Agree latency targets from your own normal and tool-assisted workloads before expanding the rollout.
+
+### Activate a Durable Extraction Worker
+
+Durable Queue removes model extraction from the chat save path by persisting the episode and its extraction job together. Graph facts become available only after a worker completes. It requires persistent storage, bounded resolution, Final Turns and **Retention Policy > Keep Forever**; unsupported combinations fail before the write. Use stable per-turn message/idempotency keys for retries.
+
+1. Create a separate workflow with **Schedule Trigger > Engram Admin v2 > Extraction Queue > Process Jobs**. Start with **Worker Batch Size > 1**; each execution processes at most ten jobs sequentially. No worker runs automatically merely because the package is installed.
+2. Configure the same backend and exact **Queue Group ID** as Memory. For embedded storage, set **Memory Workflow ID** to the original producer workflow ID and use the same custom storage directory. The worker's own workflow ID is not the producer's store. The existing producer file must be present. For Neo4j, use the same database and appropriate credentials.
+3. Match the producer's extraction credential endpoint, model, temperature mode/value, entity types, thresholds, embedding configuration and all bounded/quality settings. Set the same nonsecret **Extraction Route ID** on producer and worker. API keys are not stored in jobs; credential rotation can retain the binding when these settings are unchanged. Route URLs containing credentials, query strings or fragments are rejected.
+4. Activate the scheduled worker, then select **Extraction Execution > Durable Queue** on the producer. Inspect `delivery.status=queued`, job IDs, enqueue timing and `graph_fresh=false`; this is not a successful extraction result. Use **Extraction Queue > Status** for pending/failed counts, oldest pending time and bounded job summaries, then inspect worker outcomes and actual graph facts.
+5. Verify an ordinary turn, a real tool-assisted turn, a durable preference, older-fact recall and an explicit historical query. Confirm the final pair is saved once, audits remain outside conversational context, original records retain their identity and the queue drains. Only then activate additional namespaces. Evaluate passive ingestion separately.
+
+Jobs use fenced leases, bounded retry/backoff and atomic graph/completion writes. Restarts can recover work; retries do not resend chat messages. Configuration mismatch leaves work unclaimed. Use **Rebind Job** with an operator and reason only after reviewing corrected settings; this preserves the source/job identity and clears stale staged work. Pause, resume, retry and cancel are explicit reviewed operations. Capacity or durable-storage failures can reject the conversation write; monitor workflow errors rather than assuming every queued save is fail-soft. Snapshot preparation is capped at 100,000 records/100 MiB; source, request, response and staged-plan byte limits can defer oversized work without truncating original messages.
+
+### Backups, Historical Artifacts and Rollback
+
+Use **Extraction Queue > Export Queue Backup** to preserve jobs, ownership and completion markers along with graph/episode records. A generic graph export alone is not the queue recovery procedure. Imports verify checksums, namespace/endpoints and collisions; incomplete legacy source/chain references are retained with warnings. Imported active jobs are paused pending configuration review. Creating a fresh embedded import destination requires explicit review and a custom directory. Never import over newer live conversations.
+
+The historical-artifact inspection and dry-run steps below still apply. This feature does not reinterpret historical records already labelled as genuine conversation, automatically delete extracted facts or provide a record-specific correction migration.
+
+For rollback, first stop producers and workers and take a fresh queue-aware backup. Prefer restoring the previous policy settings on the new package. Before using an older binary, complete or explicitly cancel outstanding jobs and verify no worker remains active. Older binaries do not enforce queue ownership, leases or disk-sync protections; do not run old and new writers concurrently against a queue-bearing store. Keep the queue-aware backup and all new legitimate records. If an older package cannot safely read the retained operational metadata, use a separately reviewed recovery/export procedure; never overwrite live history with an old snapshot as routine rollback. Existing no-queue embedded stores retain their prior disk-sync behavior. Neo4j graph writers coordinate through a shared store lock to protect atomic extraction commits; measure concurrent write throughput before expanding a busy deployment.
+
+---
+
 ## Upgrading to v0.6.0
 
 **Installing this release makes the controls available; it does not automatically activate history filtering or final-turn writes.** Existing saved settings retain temperature `0`, History Filter `Off`, Message Write Policy `Legacy`, and Store Tool Audit `Disabled`. Saved Memory v1 nodes remain v1 until explicitly upgraded. The temperature control is available in both v1 and v2; the history/write/query controls require Memory v2.

package/dist/embeddings/EmbeddingService.d.ts

@@ -1,3 +1,5 @@
+import { RequestBudget } from '../extraction/RequestBudget';
+import { type ExtractionDiagnostics } from '../extraction/ExtractionDiagnostics';
 export interface EmbeddingConfig {
     apiKey: string;
     baseUrl: string;
@@ -13,12 +15,14 @@ export interface EmbeddingResult {
     };
 }
 export declare class EmbeddingService {
+    private diagnostics?;
+    private budget?;
     private apiKey;
     private baseUrl;
     private model;
     private dimensions;
     private timeoutMs;
-    constructor(config: EmbeddingConfig);
+    constructor(config: EmbeddingConfig, diagnostics?: ExtractionDiagnostics | undefined, budget?: RequestBudget | undefined);
     embed(text: string): Promise<EmbeddingResult>;
     embedBatch(texts: string[]): Promise<EmbeddingResult[]>;
 }

package/dist/embeddings/EmbeddingService.js

@@ -1,10 +1,14 @@
 "use strict";
 Object.defineProperty(exports, "__esModule", { value: true });
 exports.EmbeddingService = void 0;
+const RequestBudget_1 = require("../extraction/RequestBudget");
 const url_1 = require("../utils/url");
+const ExtractionDiagnostics_1 = require("../extraction/ExtractionDiagnostics");
 class EmbeddingService {
-    constructor(config) {
+    constructor(config, diagnostics, budget) {
         var _a;
+        this.diagnostics = diagnostics;
+        this.budget = budget;
         this.apiKey = config.apiKey;
         this.baseUrl = (0, url_1.normalizeHttpBaseUrl)(config.baseUrl, 'Embedding API baseUrl');
         this.model = config.model;
@@ -16,49 +20,105 @@ class EmbeddingService {
         return results[0];
     }
     async embedBatch(texts) {
+        var _a, _b, _c, _d, _e, _f, _g;
         if (texts.length === 0)
             return [];
-        const url = `${this.baseUrl}/embeddings`;
-        const body = {
-            model: this.model,
-            input: texts,
-        };
-        if (this.dimensions) {
-            body.dimensions = this.dimensions;
-        }
-        const controller = new AbortController();
-        const timeout = setTimeout(() => controller.abort(), this.timeoutMs);
-        let response;
+        const end = (_a = this.diagnostics) === null || _a === void 0 ? void 0 : _a.begin('embeddings');
+        let failed = true;
         try {
-            response = await fetch(url, {
-                method: 'POST',
-                headers: {
-                    'Content-Type': 'application/json',
-                    Authorization: `Bearer ${this.apiKey}`,
-                },
-                body: JSON.stringify(body),
-                signal: controller.signal,
-            });
-        }
-        catch (error) {
-            if (error instanceof Error && error.name === 'AbortError') {
-                throw new Error(`Embedding API request timed out after ${this.timeoutMs}ms`);
+            const url = `${this.baseUrl}/embeddings`;
+            const body = {
+                model: this.model,
+                input: texts,
+            };
+            if (this.dimensions) {
+                body.dimensions = this.dimensions;
+            }
+            const serializedBody = JSON.stringify(body);
+            const remaining = (_b = this.budget) === null || _b === void 0 ? void 0 : _b.reserve(Buffer.byteLength(serializedBody));
+            const controller = new AbortController();
+            const abort = () => controller.abort();
+            (_c = this.budget) === null || _c === void 0 ? void 0 : _c.controller.signal.addEventListener('abort', abort, { once: true });
+            const timeout = setTimeout(abort, Math.min(remaining !== null && remaining !== void 0 ? remaining : this.timeoutMs, this.timeoutMs));
+            const metric = (_d = this.diagnostics) === null || _d === void 0 ? void 0 : _d.beginRequest('embeddings');
+            try {
+                let response;
+                try {
+                    response = await fetch(url, {
+                        method: 'POST',
+                        headers: {
+                            'Content-Type': 'application/json',
+                            Authorization: `Bearer ${this.apiKey}`,
+                        },
+                        body: serializedBody,
+                        signal: controller.signal,
+                    });
+                }
+                catch (error) {
+                    if (this.budget)
+                        throw new ExtractionDiagnostics_1.ExtractionError(controller.signal.aborted ? 'timeout' : 'network');
+                    if (error instanceof Error && error.name === 'AbortError') {
+                        throw new Error(`Embedding API request timed out after ${this.timeoutMs}ms`);
+                    }
+                    throw error;
+                }
+                metric === null || metric === void 0 ? void 0 : metric.headers();
+                if (!response.ok) {
+                    const errorText = this.budget
+                        ? await (0, RequestBudget_1.readBoundedResponse)(response, this.budget.maxResponseBytes)
+                        : await response.text();
+                    if (this.budget)
+                        throw new ExtractionDiagnostics_1.ExtractionError(response.status === 401 || response.status === 403
+                            ? 'authentication'
+                            : response.status === 429
+                                ? 'rate_limit'
+                                : response.status >= 500
+                                    ? 'provider_server'
+                                    : 'invalid_request', response.status);
+                    throw new Error(`Embedding API error (${response.status}): ${errorText}`);
+                }
+                const data = (this.budget
+                    ? JSON.parse(await (0, RequestBudget_1.readBoundedResponse)(response, this.budget.maxResponseBytes))
+                    : await response.json());
+                (_e = this.budget) === null || _e === void 0 ? void 0 : _e.check();
+                if (this.budget &&
+                    (!Array.isArray(data === null || data === void 0 ? void 0 : data.data) ||
+                        data.data.length !== texts.length ||
+                        data.data.some((item) => !item ||
+                            !Number.isInteger(item.index) ||
+                            item.index < 0 ||
+                            item.index >= texts.length ||
+                            !Array.isArray(item.embedding) ||
+                            !item.embedding.length ||
+                            !item.embedding.every(Number.isFinite)) ||
+                        new Set(data.data.map((item) => item.index)).size !== texts.length))
+                    throw new Error('Invalid embedding response');
+                const sorted = [...data.data].sort((a, b) => a.index - b.index);
+                metric === null || metric === void 0 ? void 0 : metric.end('completed', data.usage, true);
+                const results = sorted.map((item) => ({
+                    embedding: item.embedding,
+                    usage: data.usage,
+                }));
+                failed = false;
+                return results;
+            }
+            catch (error) {
+                if ((_f = this.budget) === null || _f === void 0 ? void 0 : _f.controller.signal.aborted)
+                    this.budget.check();
+                if (this.budget && controller.signal.aborted)
+                    throw new ExtractionDiagnostics_1.ExtractionError('timeout');
+                throw error;
+            }
+            finally {
+                if (failed)
+                    metric === null || metric === void 0 ? void 0 : metric.end(controller.signal.aborted ? 'cancelled' : 'failed', undefined, true);
+                clearTimeout(timeout);
+                (_g = this.budget) === null || _g === void 0 ? void 0 : _g.controller.signal.removeEventListener('abort', abort);
             }
-            throw error;
         }
         finally {
-            clearTimeout(timeout);
-        }
-        if (!response.ok) {
-            const errorText = await response.text();
-            throw new Error(`Embedding API error (${response.status}): ${errorText}`);
+            end === null || end === void 0 ? void 0 : end(failed);
         }
-        const data = (await response.json());
-        const sorted = [...data.data].sort((a, b) => a.index - b.index);
-        return sorted.map((item) => ({
-            embedding: item.embedding,
-            usage: data.usage,
-        }));
     }
 }
 exports.EmbeddingService = EmbeddingService;

package/dist/embeddings/EmbeddingService.js.map

@@ -1 +1 @@
-{"version":3,"file":"EmbeddingService.js","sourceRoot":"","sources":["../../src/embeddings/EmbeddingService.ts"],"names":[],"mappings":";;;AAKA,sCAAoD;AAiBpD,MAAa,gBAAgB;IAO3B,YAAY,MAAuB;;QACjC,IAAI,CAAC,MAAM,GAAG,MAAM,CAAC,MAAM,CAAC;QAC5B,IAAI,CAAC,OAAO,GAAG,IAAA,0BAAoB,EAAC,MAAM,CAAC,OAAO,EAAE,uBAAuB,CAAC,CAAC;QAC7E,IAAI,CAAC,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC;QAC1B,IAAI,CAAC,UAAU,GAAG,MAAM,CAAC,UAAU,CAAC;QACpC,IAAI,CAAC,SAAS,GAAG,MAAA,MAAM,CAAC,SAAS,mCAAI,KAAM,CAAC;IAC9C,CAAC;IAGD,KAAK,CAAC,KAAK,CAAC,IAAY;QACtB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,UAAU,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;QAC9C,OAAO,OAAO,CAAC,CAAC,CAAC,CAAC;IACpB,CAAC;IAGD,KAAK,CAAC,UAAU,CAAC,KAAe;QAC9B,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO,EAAE,CAAC;QAElC,MAAM,GAAG,GAAG,GAAG,IAAI,CAAC,OAAO,aAAa,CAAC;QAEzC,MAAM,IAAI,GAA4B;YACpC,KAAK,EAAE,IAAI,CAAC,KAAK;YACjB,KAAK,EAAE,KAAK;SACb,CAAC;QAEF,IAAI,IAAI,CAAC,UAAU,EAAE,CAAC;YACpB,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC,UAAU,CAAC;QACpC,CAAC;QAED,MAAM,UAAU,GAAG,IAAI,eAAe,EAAE,CAAC;QACzC,MAAM,OAAO,GAAG,UAAU,CAAC,GAAG,EAAE,CAAC,UAAU,CAAC,KAAK,EAAE,EAAE,IAAI,CAAC,SAAS,CAAC,CAAC;QAErE,IAAI,QAAkB,CAAC;QACvB,IAAI,CAAC;YACH,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,EAAE;gBAC1B,MAAM,EAAE,MAAM;gBACd,OAAO,EAAE;oBACP,cAAc,EAAE,kBAAkB;oBAClC,aAAa,EAAE,UAAU,IAAI,CAAC,MAAM,EAAE;iBACvC;gBACD,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC;gBAC1B,MAAM,EAAE,UAAU,CAAC,MAAM;aAC1B,CAAC,CAAC;QACL,CAAC;QAAC,OAAO,KAAc,EAAE,CAAC;YACxB,IAAI,KAAK,YAAY,KAAK,IAAI,KAAK,CAAC,IAAI,KAAK,YAAY,EAAE,CAAC;gBAC1D,MAAM,IAAI,KAAK,CAAC,yCAAyC,IAAI,CAAC,SAAS,IAAI,CAAC,CAAC;YAC/E,CAAC;YACD,MAAM,KAAK,CAAC;QACd,CAAC;gBAAS,CAAC;YACT,YAAY,CAAC,OAAO,CAAC,CAAC;QACxB,CAAC;QAED,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;YACjB,MAAM,SAAS,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAE,CAAC;YACxC,MAAM,IAAI,KAAK,CAAC,wBAAwB,QAAQ,CAAC,MAAM,MAAM,SAAS,EAAE,CAAC,CAAC;QAC5E,CAAC;QAED,MAAM,IAAI,GAAG,CAAC,MAAM,QAAQ,CAAC,IAAI,EAAE,CAGlC,CAAC;QAGF,MAAM,MAAM,GAAG,CAAC,GAAG,IAAI,CAAC,IAAI,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC,KAAK,CAAC,CAAC;QAEhE,OAAO,MAAM,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,CAAC;YAC3B,SAAS,EAAE,IAAI,CAAC,SAAS;YACzB,KAAK,EAAE,IAAI,CAAC,KAAK;SAClB,CAAC,CAAC,CAAC;IACN,CAAC;CACF;AA7ED,4CA6EC"}
+{"version":3,"file":"EmbeddingService.js","sourceRoot":"","sources":["../../src/embeddings/EmbeddingService.ts"],"names":[],"mappings":";;;AAAA,+DAAiF;AAMjF,sCAAoD;AACpD,+EAAkG;AAiBlG,MAAa,gBAAgB;IAO3B,YACE,MAAuB,EACf,WAAmC,EACnC,MAAsB;;QADtB,gBAAW,GAAX,WAAW,CAAwB;QACnC,WAAM,GAAN,MAAM,CAAgB;QAE9B,IAAI,CAAC,MAAM,GAAG,MAAM,CAAC,MAAM,CAAC;QAC5B,IAAI,CAAC,OAAO,GAAG,IAAA,0BAAoB,EAAC,MAAM,CAAC,OAAO,EAAE,uBAAuB,CAAC,CAAC;QAC7E,IAAI,CAAC,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC;QAC1B,IAAI,CAAC,UAAU,GAAG,MAAM,CAAC,UAAU,CAAC;QACpC,IAAI,CAAC,SAAS,GAAG,MAAA,MAAM,CAAC,SAAS,mCAAI,KAAM,CAAC;IAC9C,CAAC;IAGD,KAAK,CAAC,KAAK,CAAC,IAAY;QACtB,MAAM,OAAO,GAAG,MAAM,IAAI,CAAC,UAAU,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC;QAC9C,OAAO,OAAO,CAAC,CAAC,CAAC,CAAC;IACpB,CAAC;IAGD,KAAK,CAAC,UAAU,CAAC,KAAe;;QAC9B,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC;YAAE,OAAO,EAAE,CAAC;QAElC,MAAM,GAAG,GAAG,MAAA,IAAI,CAAC,WAAW,0CAAE,KAAK,CAAC,YAAY,CAAC,CAAC;QAClD,IAAI,MAAM,GAAG,IAAI,CAAC;QAClB,IAAI,CAAC;YACH,MAAM,GAAG,GAAG,GAAG,IAAI,CAAC,OAAO,aAAa,CAAC;YAEzC,MAAM,IAAI,GAA4B;gBACpC,KAAK,EAAE,IAAI,CAAC,KAAK;gBACjB,KAAK,EAAE,KAAK;aACb,CAAC;YAEF,IAAI,IAAI,CAAC,UAAU,EAAE,CAAC;gBACpB,IAAI,CAAC,UAAU,GAAG,IAAI,CAAC,UAAU,CAAC;YACpC,CAAC;YAED,MAAM,cAAc,GAAG,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,CAAC;YAC5C,MAAM,SAAS,GAAG,MAAA,IAAI,CAAC,MAAM,0CAAE,OAAO,CAAC,MAAM,CAAC,UAAU,CAAC,cAAc,CAAC,CAAC,CAAC;YAC1E,MAAM,UAAU,GAAG,IAAI,eAAe,EAAE,CAAC;YACzC,MAAM,KAAK,GAAG,GAAG,EAAE,CAAC,UAAU,CAAC,KAAK,EAAE,CAAC;YACvC,MAAA,IAAI,CAAC,MAAM,0CAAE,UAAU,CAAC,MAAM,CAAC,gBAAgB,CAAC,OAAO,EAAE,KAAK,EAAE,EAAE,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC;YAChF,MAAM,OAAO,GAAG,UAAU,CAAC,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,SAAS,aAAT,SAAS,cAAT,SAAS,GAAI,IAAI,CAAC,SAAS,EAAE,IAAI,CAAC,SAAS,CAAC,CAAC,CAAC;YAEzF,MAAM,MAAM,GAAG,MAAA,IAAI,CAAC,WAAW,0CAAE,YAAY,CAAC,YAAY,CAAC,CAAC;YAC5D,IAAI,CAAC;gBACH,IAAI,QAAkB,CAAC;gBACvB,IAAI,CAAC;oBACH,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,EAAE;wBAC1B,MAAM,EAAE,MAAM;wBACd,OAAO,EAAE;4BACP,cAAc,EAAE,kBAAkB;4BAClC,aAAa,EAAE,UAAU,IAAI,CAAC,MAAM,EAAE;yBACvC;wBACD,IAAI,EAAE,cAAc;wBACpB,MAAM,EAAE,UAAU,CAAC,MAAM;qBAC1B,CAAC,CAAC;gBACL,CAAC;gBAAC,OAAO,KAAc,EAAE,CAAC;oBACxB,IAAI,IAAI,CAAC,MAAM;wBACb,MAAM,IAAI,uCAAe,CAAC,UAAU,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC;oBAC/E,IAAI,KAAK,YAAY,KAAK,IAAI,KAAK,CAAC,IAAI,KAAK,YAAY,EAAE,CAAC;wBAC1D,MAAM,IAAI,KAAK,CAAC,yCAAyC,IAAI,CAAC,SAAS,IAAI,CAAC,CAAC;oBAC/E,CAAC;oBACD,MAAM,KAAK,CAAC;gBACd,CAAC;gBAED,MAAM,aAAN,MAAM,uBAAN,MAAM,CAAE,OAAO,EAAE,CAAC;gBAClB,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;oBACjB,MAAM,SAAS,GAAG,IAAI,CAAC,MAAM;wBAC3B,CAAC,CAAC,MAAM,IAAA,mCAAmB,EAAC,QAAQ,EAAE,IAAI,CAAC,MAAM,CAAC,gBAAgB,CAAC;wBACnE,CAAC,CAAC,MAAM,QAAQ,CAAC,IAAI,EAAE,CAAC;oBAC1B,IAAI,IAAI,CAAC,MAAM;wBACb,MAAM,IAAI,uCAAe,CACvB,QAAQ,CAAC,MAAM,KAAK,GAAG,IAAI,QAAQ,CAAC,MAAM,KAAK,GAAG;4BAChD,CAAC,CAAC,gBAAgB;4BAClB,CAAC,CAAC,QAAQ,CAAC,MAAM,KAAK,GAAG;gCACvB,CAAC,CAAC,YAAY;gCACd,CAAC,CAAC,QAAQ,CAAC,MAAM,IAAI,GAAG;oCACtB,CAAC,CAAC,iBAAiB;oCACnB,CAAC,CAAC,iBAAiB,EACzB,QAAQ,CAAC,MAAM,CAChB,CAAC;oBACJ,MAAM,IAAI,KAAK,CAAC,wBAAwB,QAAQ,CAAC,MAAM,MAAM,SAAS,EAAE,CAAC,CAAC;gBAC5E,CAAC;gBAED,MAAM,IAAI,GAAG,CACX,IAAI,CAAC,MAAM;oBACT,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,MAAM,IAAA,mCAAmB,EAAC,QAAQ,EAAE,IAAI,CAAC,MAAM,CAAC,gBAAgB,CAAC,CAAC;oBAC/E,CAAC,CAAC,MAAM,QAAQ,CAAC,IAAI,EAAE,CAI1B,CAAC;gBAEF,MAAA,IAAI,CAAC,MAAM,0CAAE,KAAK,EAAE,CAAC;gBACrB,IACE,IAAI,CAAC,MAAM;oBACX,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,IAAI,aAAJ,IAAI,uBAAJ,IAAI,CAAE,IAAI,CAAC;wBACzB,IAAI,CAAC,IAAI,CAAC,MAAM,KAAK,KAAK,CAAC,MAAM;wBACjC,IAAI,CAAC,IAAI,CAAC,IAAI,CACZ,CAAC,IAAI,EAAE,EAAE,CACP,CAAC,IAAI;4BACL,CAAC,MAAM,CAAC,SAAS,CAAC,IAAI,CAAC,KAAK,CAAC;4BAC7B,IAAI,CAAC,KAAK,GAAG,CAAC;4BACd,IAAI,CAAC,KAAK,IAAI,KAAK,CAAC,MAAM;4BAC1B,CAAC,KAAK,CAAC,OAAO,CAAC,IAAI,CAAC,SAAS,CAAC;4BAC9B,CAAC,IAAI,CAAC,SAAS,CAAC,MAAM;4BACtB,CAAC,IAAI,CAAC,SAAS,CAAC,KAAK,CAAC,MAAM,CAAC,QAAQ,CAAC,CACzC;wBACD,IAAI,GAAG,CAAC,IAAI,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,IAAI,KAAK,KAAK,CAAC,MAAM,CAAC;oBAErE,MAAM,IAAI,KAAK,CAAC,4BAA4B,CAAC,CAAC;gBAEhD,MAAM,MAAM,GAAG,CAAC,GAAG,IAAI,CAAC,IAAI,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC,KAAK,CAAC,CAAC;gBAEhE,MAAM,aAAN,MAAM,uBAAN,MAAM,CAAE,GAAG,CAAC,WAAW,EAAE,IAAI,CAAC,KAAK,EAAE,IAAI,CAAC,CAAC;gBAC3C,MAAM,OAAO,GAAG,MAAM,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,EAAE,CAAC,CAAC;oBACpC,SAAS,EAAE,IAAI,CAAC,SAAS;oBACzB,KAAK,EAAE,IAAI,CAAC,KAAK;iBAClB,CAAC,CAAC,CAAC;gBACJ,MAAM,GAAG,KAAK,CAAC;gBACf,OAAO,OAAO,CAAC;YACjB,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,IAAI,MAAA,IAAI,CAAC,MAAM,0CAAE,UAAU,CAAC,MAAM,CAAC,OAAO;oBAAE,IAAI,CAAC,MAAM,CAAC,KAAK,EAAE,CAAC;gBAChE,IAAI,IAAI,CAAC,MAAM,IAAI,UAAU,CAAC,MAAM,CAAC,OAAO;oBAAE,MAAM,IAAI,uCAAe,CAAC,SAAS,CAAC,CAAC;gBACnF,MAAM,KAAK,CAAC;YACd,CAAC;oBAAS,CAAC;gBACT,IAAI,MAAM;oBACR,MAAM,aAAN,MAAM,uBAAN,MAAM,CAAE,GAAG,CAAC,UAAU,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC,WAAW,CAAC,CAAC,CAAC,QAAQ,EAAE,SAAS,EAAE,IAAI,CAAC,CAAC;gBACnF,YAAY,CAAC,OAAO,CAAC,CAAC;gBACtB,MAAA,IAAI,CAAC,MAAM,0CAAE,UAAU,CAAC,MAAM,CAAC,mBAAmB,CAAC,OAAO,EAAE,KAAK,CAAC,CAAC;YACrE,CAAC;QACH,CAAC;gBAAS,CAAC;YACT,GAAG,aAAH,GAAG,uBAAH,GAAG,CAAG,MAAM,CAAC,CAAC;QAChB,CAAC;IACH,CAAC;CACF;AA9ID,4CA8IC"}

package/dist/extraction/AssertionEvidence.d.ts

@@ -0,0 +1 @@
+export declare function isDurableAssertion(content: string, start: number, end: number): boolean;

package/dist/extraction/AssertionEvidence.js

@@ -0,0 +1,21 @@
+"use strict";
+Object.defineProperty(exports, "__esModule", { value: true });
+exports.isDurableAssertion = isDurableAssertion;
+function isDurableAssertion(content, start, end) {
+    if (start < 0 || end <= start || end > content.length)
+        return false;
+    const text = content.slice(start, end).trim();
+    const before = content.slice(0, start).trimEnd();
+    const after = content.slice(end).trimStart();
+    if (before && !/[.!?\n]$/.test(before))
+        return false;
+    if (after && !/[.!?]$/.test(text))
+        return false;
+    if (content.includes('"') || /[“”]|^\s*>/m.test(content))
+        return false;
+    return (!text.includes('?') &&
+        !/\b(said|says|according to|hypothetical|might|maybe|not|never|false|denies|denied|without|no longer|if|unless|would|suppose|supposing|assuming|incorrect|untrue)\b|\b\w+n['’]t\b/i.test(text) &&
+        !/^\s*(what|when|where|which|who|how|can you|could you|please|tell me|show me|find me|asks?\b)/i.test(text) &&
+        !/\b(today|tomorrow|yesterday|later|next\s+(week|month|tuesday|monday|wednesday|thursday|friday|saturday|sunday)|this weekend)\b/i.test(text));
+}
+//# sourceMappingURL=AssertionEvidence.js.map

package/dist/extraction/AssertionEvidence.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"AssertionEvidence.js","sourceRoot":"","sources":["../../src/extraction/AssertionEvidence.ts"],"names":[],"mappings":";;AACA,gDAqBC;AArBD,SAAgB,kBAAkB,CAAC,OAAe,EAAE,KAAa,EAAE,GAAW;IAC5E,IAAI,KAAK,GAAG,CAAC,IAAI,GAAG,IAAI,KAAK,IAAI,GAAG,GAAG,OAAO,CAAC,MAAM;QAAE,OAAO,KAAK,CAAC;IACpE,MAAM,IAAI,GAAG,OAAO,CAAC,KAAK,CAAC,KAAK,EAAE,GAAG,CAAC,CAAC,IAAI,EAAE,CAAC;IAC9C,MAAM,MAAM,GAAG,OAAO,CAAC,KAAK,CAAC,CAAC,EAAE,KAAK,CAAC,CAAC,OAAO,EAAE,CAAC;IACjD,MAAM,KAAK,GAAG,OAAO,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,SAAS,EAAE,CAAC;IAE7C,IAAI,MAAM,IAAI,CAAC,UAAU,CAAC,IAAI,CAAC,MAAM,CAAC;QAAE,OAAO,KAAK,CAAC;IACrD,IAAI,KAAK,IAAI,CAAC,QAAQ,CAAC,IAAI,CAAC,IAAI,CAAC;QAAE,OAAO,KAAK,CAAC;IAChD,IAAI,OAAO,CAAC,QAAQ,CAAC,GAAG,CAAC,IAAI,aAAa,CAAC,IAAI,CAAC,OAAO,CAAC;QAAE,OAAO,KAAK,CAAC;IACvE,OAAO,CACL,CAAC,IAAI,CAAC,QAAQ,CAAC,GAAG,CAAC;QACnB,CAAC,kLAAkL,CAAC,IAAI,CACtL,IAAI,CACL;QACD,CAAC,+FAA+F,CAAC,IAAI,CACnG,IAAI,CACL;QACD,CAAC,iIAAiI,CAAC,IAAI,CACrI,IAAI,CACL,CACF,CAAC;AACJ,CAAC"}

package/dist/extraction/BoundedExtraction.d.ts

@@ -0,0 +1,15 @@
+import { type EmbeddingConfig } from '../embeddings';
+import type { IGraphStorage } from '../storage/IGraphStorage';
+import { type ExtractionPolicyInput, type ExtractionThresholdPolicy } from '../schemas';
+import { type LlmClientConfig } from './LlmClient';
+import { ExtractionDiagnostics } from './ExtractionDiagnostics';
+import type { ExtractionSource } from './ExtractionSource';
+export declare function boundedExtract(storage: IGraphStorage, group: string, sources: ExtractionSource[], config: {
+    llm: LlmClientConfig;
+    policy?: ExtractionPolicyInput;
+    types: string[];
+    threshold?: ExtractionThresholdPolicy;
+    embeddings?: EmbeddingConfig;
+    signal?: AbortSignal;
+    deadlineMs?: number;
+}, diagnostics: ExtractionDiagnostics): Promise<void>;