n8n-nodes-redactor 6.0.0 → 7.0.0

package/README.md

@@ -15,13 +15,13 @@
   <a href="https://github.com/mjmirza/n8n-nodes-redactor/actions/workflows/ci.yml"><img src="https://img.shields.io/github/actions/workflow/status/mjmirza/n8n-nodes-redactor/ci.yml?branch=master&label=CI" alt="CI status" /></a>
   <a href="https://www.npmjs.com/package/n8n-nodes-redactor#provenance"><img src="https://img.shields.io/badge/npm-provenance%20signed-brightgreen" alt="npm provenance" /></a>
   <a href="#license"><img src="https://img.shields.io/npm/l/n8n-nodes-redactor" alt="MIT License" /></a>
-  <img src="https://img.shields.io/badge/PII%20patterns-216-blue" alt="216 PII patterns" />
+  <img src="https://img.shields.io/badge/PII%20patterns-218-blue" alt="218 PII patterns" />
   <img src="https://img.shields.io/badge/n8n-Cloud%20%2B%20self--hosted-FF6D5A" alt="n8n Cloud and self-hosted" />
 </p>
 
 ## What you get
 
-- **Personal data never reaches the model.** Emails, phone numbers, IBANs, card numbers, national IDs and 200 more kinds of data are swapped for safe tokens before the LLM call.
+- **Personal data is kept from the model.** Emails, phone numbers, IBANs, card numbers, national IDs and 200 more kinds of data are swapped for safe tokens before the LLM call. Pattern detection cannot know every name, so add Presidio for free-text names, and keep Verify in the chain to catch what slips through.
 - **The answer still makes sense.** After the model replies, the node puts the real values back, so your output reads naturally.
 - **Fewer false alarms.** Card numbers are Luhn checked, IBANs checksum verified, NHS numbers mod 11 validated, so random digits are left alone.
 - **Proof for your records.** An optional audit report, and a GDPR Article 30 processing record built from each run.
@@ -71,9 +71,13 @@ Version 4.0.0 uses no local disk. The vault lives in workflow storage and audit
 The recommended production chain looks like this.
 
 ```
-Data source > Detect > Redact > LLM > Verify > Restore > Output > Purge
+Data source > Redact > Verify > LLM > Restore > Output > Purge
 ```
 
+Detect is for a dry run before you set up redaction. It adds a summary item to its output by default, so keep it out of this chain, or turn on Include Audit Report, which moves the summary to a second output.
+
+Set Verify Output on the Verify node to Items, Stop on FAIL. Verify then passes the redacted items on unchanged when nothing leaks, and stops the run before the LLM when something does, so the model never receives data that failed the check. With the default Report output, Verify returns one report instead of the items, so it cannot sit in this chain. Verify also fails when an item carries a binary attachment, because attachments are not scanned. Redact removes attachments by default. Set Binary Attachments to Keep Unscanned only when the files hold no personal data.
+
 ## Redaction modes
 
 | Mode | Output | Reversible | Best for |
@@ -88,7 +92,7 @@ Data source > Detect > Redact > LLM > Verify > Restore > Output > Purge
 
 ## What it detects
 
-216 patterns across 11 categories.
+218 patterns across 11 categories.
 
 | Category | Examples |
 |---|---|
@@ -117,7 +121,7 @@ Data source > Detect > Redact > LLM > Verify > Restore > Output > Purge
 | Audit report | A second output with hits by category and pattern |
 | Audit log | Turn on Audit Log to get an `audit` record (counts, labels, timing, never values) on the Report output. Send it to any database, sheet or SIEM node |
 | ROPA record | Turn on Include Audit Report, then Include GDPR Art.30 ROPA Record, and fill in the controller details |
-| Presidio | Optional Microsoft Presidio container for names and organisations in free text. See [docs/PRESIDIO_SETUP.md](https://github.com/mjmirza/n8n-nodes-redactor/blob/master/docs/PRESIDIO_SETUP.md). Falls back to built-in patterns when unreachable |
+| Presidio | Optional Microsoft Presidio container for names and organisations in free text. See [docs/PRESIDIO_SETUP.md](https://github.com/mjmirza/n8n-nodes-redactor/blob/master/docs/PRESIDIO_SETUP.md). When Presidio cannot scan a text the run stops, unless If Presidio Fails is set to continue with patterns only |
 | Per-tenant profiles | Turn on Use Tenant Profile and paste JSON. Validated on every run. Fields are listed in [docs/MIGRATION.md](https://github.com/mjmirza/n8n-nodes-redactor/blob/master/docs/MIGRATION.md#tenant-profile-fields) |
 
 This node reduces what reaches a model. It is not legal advice and does not on its own make a workflow GDPR or HIPAA compliant.

package/dist/nodes/Redactor/Redactor.node.js

@@ -13,7 +13,7 @@ const profiles_1 = require("./profiles");
 const ropa_1 = require("./ropa");
 const runtime_1 = require("./runtime");
 const RECOMMENDED_PATTERNS = [
-    'email', 'phone', 'phoneDE', 'phoneUK', 'phoneAT', 'phoneCH', 'phoneFR',
+    'email', 'phone', 'phoneE164', 'phoneDE', 'phoneUK', 'phoneAT', 'phoneCH', 'phoneFR',
     'phoneNL', 'phoneES', 'phoneIT', 'phoneAU', 'phoneIN', 'phoneBR',
     'personName', 'ssn', 'itinUS', 'sinCA', 'ninoUK', 'passportUS', 'passportEU',
     'passportDE', 'nationalIdDE', 'nhsNumber', 'taxIdUS', 'taxIdDE',
@@ -35,7 +35,7 @@ const RECOMMENDED_PATTERNS = [
     'internalHostname', 'uncPath', 'ldapDN', 'adUsername',
     'dbConnectionString', 'connStringKV',
     'awsAccessKey', 'gcpApiKey', 'stripeKey', 'openaiKey', 'githubToken',
-    'slackToken', 'bearerToken', 'jwtToken', 'pemPrivateKey', 'sshPublicKey',
+    'slackToken', 'bearerToken', 'httpBasicAuth', 'httpBasicCredential', 'jwtToken', 'pemPrivateKey', 'sshPublicKey',
     'genericSecret', 'azureKey', 'slackWebhook',
     'sendgridKey', 'twilioKey', 'anthropicKey', 'gitlabToken',
     'x509Certificate', 'pgpPrivateKey', 'envSecrets',
@@ -43,6 +43,19 @@ const RECOMMENDED_PATTERNS = [
     'vin',
     'uuid', 'imei', 'iccid',
 ];
+function verifyMessage(leaks, attachments) {
+    if (leaks === 0 && attachments === 0)
+        return 'No PII detected in values. Data appears properly redacted.';
+    const parts = [];
+    if (leaks > 0)
+        parts.push(`Found ${leaks} potential PII leak(s). Values contain detectable sensitive data.`);
+    if (attachments > 0)
+        parts.push(`${attachments} binary attachment(s) were not scanned and may contain PII.`);
+    return parts.join(' ');
+}
+function withBinary(out, source) {
+    return source.binary ? { ...out, binary: source.binary } : out;
+}
 function versionRopaSummary(ropa, byLevel, typeVersion) {
     const summary = ropa.processingSummary;
     if (typeVersion >= 2) {
@@ -529,6 +542,54 @@ class Redactor {
                     default: false,
                     description: 'Whether to scan input for prompt injection attempts (jailbreaks, instruction overrides, delimiter escapes, encoded payloads) before it reaches an LLM. Detected injections are flagged in the output.',
                 },
+                {
+                    displayName: 'Verify Output',
+                    name: 'verifyOutput',
+                    type: 'options',
+                    displayOptions: {
+                        show: {
+                            operation: ['verify'],
+                        },
+                    },
+                    options: [
+                        {
+                            name: 'Report',
+                            value: 'report',
+                            description: 'Return one report with PASS or FAIL',
+                        },
+                        {
+                            name: 'Items, Stop on FAIL',
+                            value: 'gate',
+                            description: 'Pass the checked items on unchanged when they pass, and stop the run when they fail. Place it before the LLM.',
+                        },
+                    ],
+                    default: 'report',
+                    description: 'What Verify returns',
+                },
+                {
+                    displayName: 'Binary Attachments',
+                    name: 'binaryAttachments',
+                    type: 'options',
+                    displayOptions: {
+                        show: {
+                            operation: ['redact'],
+                        },
+                    },
+                    options: [
+                        {
+                            name: 'Remove',
+                            value: 'remove',
+                            description: 'Drop attachments from the output, so no unscanned data reaches the next node',
+                        },
+                        {
+                            name: 'Keep Unscanned',
+                            value: 'keep',
+                            description: 'Pass attachments through unchanged. Their content is not scanned or redacted.',
+                        },
+                    ],
+                    default: 'remove',
+                    description: 'What to do with binary attachments. The node redacts JSON only, so a file can still hold personal data.',
+                },
                 {
                     displayName: 'Audit Log',
                     name: 'auditLog',
@@ -551,7 +612,7 @@ class Redactor {
                         },
                     },
                     default: false,
-                    description: 'Whether to add NLP-based detection using Microsoft Presidio. Catches person names, locations, and organizations in free text that regex cannot detect. Requires a Presidio Docker container running locally. Setup: docker run -d -p 5002:3000 mcr.microsoft.com/presidio-analyzer',
+                    description: 'Whether to add NLP-based detection using Microsoft Presidio. Catches person names, locations, and organizations in free text that regex cannot detect. Requires a Presidio Docker container running locally. Setup: docker run -d -p 127.0.0.1:5002:3000 mcr.microsoft.com/presidio-analyzer',
                 },
                 {
                     displayName: 'Presidio URL',
@@ -567,6 +628,31 @@ class Redactor {
                     placeholder: 'http://localhost:5002',
                     description: 'URL of the Presidio Analyzer service. Default: http://localhost:5002. If using docker-compose, use the service name: http://presidio:3000',
                 },
+                {
+                    displayName: 'If Presidio Fails',
+                    name: 'presidioOnFailure',
+                    type: 'options',
+                    displayOptions: {
+                        show: {
+                            operation: ['redact'],
+                            enablePresidio: [true],
+                        },
+                    },
+                    options: [
+                        {
+                            name: 'Stop the Run',
+                            value: 'stop',
+                            description: 'Output nothing when any text could not be scanned by Presidio',
+                        },
+                        {
+                            name: 'Continue With Patterns Only',
+                            value: 'continue',
+                            description: 'Output the pattern-only result and count the unscanned texts in the report',
+                        },
+                    ],
+                    default: 'stop',
+                    description: 'What to do when Presidio cannot be reached or returns an error for a text',
+                },
                 {
                     displayName: 'Presidio Language',
                     name: 'presidioLanguage',
@@ -778,12 +864,11 @@ class Redactor {
         };
     }
     async execute() {
-        var _a, _b, _c, _d, _e, _f, _g, _h;
+        var _a, _b, _c, _d, _e, _f, _g, _h, _j;
         const items = this.getInputData();
         const allPaired = items.map((_, i) => ({ item: i }));
-        const operation = this.getNodeParameter('operation', 0);
+        const operation = (0, runtime_1.runSetting)(this, 'operation');
         const startTime = Date.now();
-        (0, presidio_1.resetCircuitBreaker)();
         if (operation === 'detect' || operation === 'verify') {
             const enabledPatterns = (0, patterns_1.getPatternOptions)().map((p) => p.value);
             const customPatterns = [];
@@ -798,6 +883,7 @@ class Redactor {
                 fieldRules: [],
                 fieldMode: 'all',
                 skipSemantic: operation === 'verify',
+                skipNames: operation === 'verify' && this.getNode().typeVersion < 2,
                 scanNumbers: true,
             };
             const allHits = [];
@@ -809,7 +895,7 @@ class Redactor {
             }
             tempVault.deleteSession(tempSessionId);
             if (operation === 'detect') {
-                const returnData = items.map((item, i) => ({ json: item.json, pairedItem: { item: i } }));
+                const returnData = items.map((item, i) => withBinary({ json: item.json, pairedItem: { item: i } }, item));
                 const report = (0, engine_1.buildReport)(tempSessionId, allHits);
                 const summary = {
                     _redactorScan: true,
@@ -820,16 +906,8 @@ class Redactor {
                     hitsByPattern: report.hitsByPattern,
                     timestamp: report.timestamp,
                 };
-                let includeReport = false;
-                try {
-                    includeReport = this.getNodeParameter('includeReport', 0, false);
-                }
-                catch { }
-                let auditLog = false;
-                try {
-                    auditLog = this.getNodeParameter('auditLog', 0, false);
-                }
-                catch { }
+                const includeReport = (0, runtime_1.runSetting)(this, 'includeReport', false);
+                const auditLog = (0, runtime_1.runSetting)(this, 'auditLog', false);
                 if (includeReport || auditLog) {
                     const reportJson = includeReport
                         ? { ...summary, hits: report.hits }
@@ -844,17 +922,25 @@ class Redactor {
                 returnData.push({ json: summary, pairedItem: allPaired });
                 return [returnData];
             }
-            const passed = allHits.length === 0;
+            const unscannedAttachments = items.reduce((n, item) => { var _a; return n + Object.keys((_a = item.binary) !== null && _a !== void 0 ? _a : {}).length; }, 0);
+            const passed = allHits.length === 0 && unscannedAttachments === 0;
             const verifyReport = (0, engine_1.buildReport)(tempSessionId, allHits);
+            if ((0, runtime_1.runSetting)(this, 'verifyOutput', 'report') === 'gate') {
+                if (!passed) {
+                    throw new n8n_workflow_1.NodeOperationError(this.getNode(), verifyMessage(allHits.length, unscannedAttachments), {
+                        description: 'Verify stopped the run before the data reached the next node. Fix the redaction settings and run again.',
+                    });
+                }
+                return [items.map((item, i) => ({ ...item, pairedItem: { item: i } }))];
+            }
             return [[{
                         json: {
                             verified: passed,
                             status: passed ? 'PASS' : 'FAIL',
                             leaksFound: allHits.length,
+                            unscannedAttachments,
                             itemsScanned: items.length,
-                            message: passed
-                                ? 'No PII detected in values. Data appears properly redacted.'
-                                : `Found ${allHits.length} potential PII leak(s). Values contain detectable sensitive data.`,
+                            message: verifyMessage(allHits.length, unscannedAttachments),
                             hitsByCategory: verifyReport.hitsByCategory,
                             hitsByPattern: verifyReport.hitsByPattern,
                             leaks: allHits.map((h) => ({
@@ -899,7 +985,7 @@ class Redactor {
                         pairedItem: allPaired,
                     }]];
         }
-        const vaultStorage = this.getNodeParameter('vaultStorage', 0, 'workflow');
+        const vaultStorage = (0, runtime_1.runSetting)(this, 'vaultStorage', 'workflow');
         const vaultPassphrase = vaultStorage === 'memory' ? '' : await (0, runtime_1.resolvePassphrase)(this);
         const vault = (0, vault_1.createVault)(vaultStorage, vaultStorage === 'memory' ? undefined : this.getWorkflowStaticData('global'), vaultPassphrase || undefined, (0, runtime_1.workflowNamespace)(this));
         if (operation === 'stats') {
@@ -926,32 +1012,27 @@ class Redactor {
         }
         let sessionId = '';
         if (operation === 'redact' || operation === 'restore') {
-            sessionId = this.getNodeParameter('sessionId', 0);
+            sessionId = String((_a = (0, runtime_1.runSetting)(this, 'sessionId')) !== null && _a !== void 0 ? _a : '');
             if (!sessionId) {
                 throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'Session ID is required');
             }
         }
         if (operation === 'redact') {
-            let mode = this.getNodeParameter('redactionMode', 0, 'token');
-            const detectionScope = this.getNodeParameter('detectionScope', 0, 'recommended');
-            let enabledPatterns;
-            if (detectionScope === 'all') {
-                enabledPatterns = (0, patterns_1.getPatternOptions)().map((p) => p.value);
-            }
-            else if (detectionScope === 'recommended') {
-                enabledPatterns = RECOMMENDED_PATTERNS;
-            }
-            else {
-                enabledPatterns = this.getNodeParameter('piiTypes', 0);
+            let mode = (0, runtime_1.runSetting)(this, 'redactionMode', 'token');
+            if (!profiles_1.MODES.includes(mode)) {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), `Unknown redaction mode "${String(mode)}"`, {
+                    description: `Use one of: ${profiles_1.MODES.join(', ')}.`,
+                });
             }
-            let dedup = this.getNodeParameter('dedup', 0, true);
-            let fieldMode = this.getNodeParameter('fieldMode', 0, 'all');
-            let sessionTtl = this.getNodeParameter('sessionTtl', 0, 60);
-            const includeReport = this.getNodeParameter('includeReport', 0, false);
-            const customPatternsRaw = this.getNodeParameter('customPatterns', 0, {});
-            let customPatterns = (_a = customPatternsRaw.patterns) !== null && _a !== void 0 ? _a : [];
-            const fieldRulesRaw = this.getNodeParameter('fieldRules', 0, {});
-            let fieldRules = ((_b = fieldRulesRaw.rules) !== null && _b !== void 0 ? _b : []).map((r) => ({
+            let enabledPatterns = (0, runtime_1.selectedPatterns)(this, (0, patterns_1.getPatternOptions)().map((p) => p.value), RECOMMENDED_PATTERNS);
+            let dedup = (0, runtime_1.runSetting)(this, 'dedup', true);
+            let fieldMode = (0, runtime_1.runSetting)(this, 'fieldMode', 'all');
+            let sessionTtl = (0, runtime_1.runSetting)(this, 'sessionTtl', 60);
+            const includeReport = (0, runtime_1.runSetting)(this, 'includeReport', false);
+            const customPatternsRaw = (0, runtime_1.runSetting)(this, 'customPatterns', {});
+            let customPatterns = (_b = customPatternsRaw.patterns) !== null && _b !== void 0 ? _b : [];
+            const fieldRulesRaw = (0, runtime_1.runSetting)(this, 'fieldRules', {});
+            let fieldRules = ((_c = fieldRulesRaw.rules) !== null && _c !== void 0 ? _c : []).map((r) => ({
                 field: r.field,
                 mode: fieldMode === 'allowlist' ? 'include' : 'exclude',
             }));
@@ -967,33 +1048,39 @@ class Redactor {
                 });
                 return { statusCode: response.statusCode, body: response.body };
             };
-            let enablePresidio = false;
+            const binaryAttachments = (0, runtime_1.runSetting)(this, 'binaryAttachments', 'remove');
+            const enablePresidio = (0, runtime_1.runSetting)(this, 'enablePresidio', false);
             let presidioUrl = '';
             let presidioLanguage = 'en';
-            try {
-                enablePresidio = this.getNodeParameter('enablePresidio', 0, false);
-                if (enablePresidio) {
-                    presidioUrl = this.getNodeParameter('presidioUrl', 0, 'http://localhost:5002');
-                    presidioLanguage = this.getNodeParameter('presidioLanguage', 0, 'en');
+            let presidioOnFailure = 'stop';
+            if (enablePresidio) {
+                presidioUrl = (0, runtime_1.runSetting)(this, 'presidioUrl', 'http://localhost:5002');
+                presidioLanguage = (0, runtime_1.runSetting)(this, 'presidioLanguage', 'en');
+                presidioOnFailure = (0, runtime_1.runSetting)(this, 'presidioOnFailure', 'stop');
+                if (presidioOnFailure !== 'stop' && presidioOnFailure !== 'continue') {
+                    throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'If Presidio Fails must be stop or continue');
+                }
+                if (!/^https?:[/][/][^/\s]/i.test(String(presidioUrl).trim())) {
+                    throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'Presidio URL must be an http or https address', {
+                        description: 'Set Presidio URL, for example http://localhost:5002, or turn off Enhanced NLP Detection.',
+                    });
                 }
             }
-            catch {
-            }
-            const allowListRaw = this.getNodeParameter('allowList', 0, {});
-            let allowList = ((_c = allowListRaw.entries) !== null && _c !== void 0 ? _c : []).map((e) => ({
+            const allowListRaw = (0, runtime_1.runSetting)(this, 'allowList', {});
+            let allowList = ((_d = allowListRaw.entries) !== null && _d !== void 0 ? _d : []).map((e) => ({
                 value: e.value,
                 type: (e.type || 'contains'),
             }));
-            const denyListRaw = this.getNodeParameter('denyList', 0, {});
-            let denyList = ((_d = denyListRaw.entries) !== null && _d !== void 0 ? _d : []).map((e) => ({
+            const denyListRaw = (0, runtime_1.runSetting)(this, 'denyList', {});
+            let denyList = ((_e = denyListRaw.entries) !== null && _e !== void 0 ? _e : []).map((e) => ({
                 value: e.value,
                 type: (e.type || 'exact'),
             }));
-            let confidenceThreshold = this.getNodeParameter('confidenceThreshold', 0, 0);
-            const hasReportOutput = includeReport || this.getNodeParameter('auditLog', 0, false);
-            let auditLog = this.getNodeParameter('auditLog', 0, false);
-            const useTenantProfile = this.getNodeParameter('useTenantProfile', 0, false);
-            const profileRaw = useTenantProfile ? this.getNodeParameter('tenantProfile', 0, '') : '';
+            let confidenceThreshold = (0, runtime_1.runSetting)(this, 'confidenceThreshold', 0);
+            const hasReportOutput = includeReport || (0, runtime_1.runSetting)(this, 'auditLog', false);
+            let auditLog = (0, runtime_1.runSetting)(this, 'auditLog', false);
+            const useTenantProfile = (0, runtime_1.runSetting)(this, 'useTenantProfile', false);
+            const profileRaw = useTenantProfile ? (0, runtime_1.runSetting)(this, 'tenantProfile', '') : '';
             if (profileRaw !== '' && profileRaw !== undefined && profileRaw !== null) {
                 let profile;
                 try {
@@ -1026,13 +1113,28 @@ class Redactor {
                     sessionTtl = profile.retentionMinutes;
                 if (profile.auditLog !== undefined)
                     auditLog = profile.auditLog;
+                if (profile.fieldMode && !profile.fieldRules) {
+                    fieldRules = fieldRules.map((rule) => ({
+                        field: rule.field,
+                        mode: fieldMode === 'allowlist' ? 'include' : 'exclude',
+                    }));
+                }
+            }
+            if (typeof confidenceThreshold !== 'number' || !Number.isFinite(confidenceThreshold) || confidenceThreshold < 0 || confidenceThreshold > 1) {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), `Confidence Threshold must be a number from 0 to 1, got ${String(confidenceThreshold)}`);
+            }
+            if (typeof sessionTtl !== 'number' || !Number.isFinite(sessionTtl) || sessionTtl < 0) {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), `Session TTL must be 0 or more minutes, got ${String(sessionTtl)}`, {
+                    description: 'Use 0 to keep the session until it is purged.',
+                });
             }
             (0, runtime_1.assertUserRegexes)(this, customPatterns, [
                 { name: 'Allow list', entries: allowList },
                 { name: 'Deny list', entries: denyList },
             ]);
             try {
-                vault.getOrCreateSession(sessionId, sessionTtl * 60 * 1000);
+                const session = vault.getOrCreateSession(sessionId, sessionTtl * 60 * 1000);
+                sessionTtl = session.ttl / 60000;
             }
             catch (error) {
                 throw new n8n_workflow_1.NodeOperationError(this.getNode(), error.message);
@@ -1054,9 +1156,10 @@ class Redactor {
                 reservedTokens: (0, engine_1.collectTokenLike)(items.map((it) => it.json)),
                 keyOrigins: new WeakMap(),
                 inputText: (0, engine_1.collectInputText)(items.map((it) => it.json)),
+                inputIndex: {},
                 lockedSpans: new WeakMap(),
                 keyLocks: new WeakMap(),
-                priorTokens: (0, engine_1.priorTokenMatcher)((_e = vault.getSession(sessionId)) === null || _e === void 0 ? void 0 : _e.entries),
+                priorTokens: (0, engine_1.priorTokenMatcher)((_f = vault.getSession(sessionId)) === null || _f === void 0 ? void 0 : _f.entries),
             };
             const allHits = [];
             const returnData = [];
@@ -1064,34 +1167,50 @@ class Redactor {
                 const item = items[i];
                 const hits = [];
                 let redacted = (0, engine_1.redactValue)(item.json, ctx, vault, sessionId, hits, i);
-                if (ctx.presidioUrl) {
+                if (enablePresidio) {
                     try {
                         redacted = await (0, engine_1.enhanceWithPresidio)(redacted, ctx, vault, sessionId, hits, i);
                     }
-                    catch {
+                    catch (error) {
+                        if (presidioOnFailure === 'stop') {
+                            throw new n8n_workflow_1.NodeOperationError(this.getNode(), `Presidio scan failed: ${error.message}`, { itemIndex: i });
+                        }
+                        (0, presidio_1.markUnscanned)(presidioRequester);
                     }
                 }
-                returnData.push({ json: redacted, pairedItem: { item: i } });
+                const redactedItem = { json: redacted, pairedItem: { item: i } };
+                returnData.push(binaryAttachments === 'keep' ? withBinary(redactedItem, items[i]) : redactedItem);
                 for (const hit of hits)
                     allHits.push(hit);
             }
+            const restorable = (0, engine_1.ensureRestorable)(items.map((it) => it.json), returnData.map((r) => r.json), ctx, vault, sessionId, allHits);
+            restorable.forEach((json, i) => {
+                returnData[i].json = json;
+            });
+            const unscannedTexts = enablePresidio ? (0, presidio_1.presidioUnscanned)(presidioRequester) : 0;
+            if (unscannedTexts > 0 && presidioOnFailure === 'stop') {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), `Presidio could not scan ${unscannedTexts} text(s), so nothing was output`, {
+                    description: 'Check that Presidio is running at the Presidio URL, or set If Presidio Fails to Continue With Patterns Only.',
+                });
+            }
+            const promptInjection = (0, runtime_1.runSetting)(this, 'promptInjection', false);
+            if (!vault.getSession(sessionId)) {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'Session expired during the run', {
+                    description: 'Its TTL ran out before Redact finished, so nothing was output. Run again, or raise Session TTL.',
+                });
+            }
             vault.save(sessionId);
             let injectionResult = null;
-            try {
-                const promptInjection = this.getNodeParameter('promptInjection', 0, false);
-                if (promptInjection) {
-                    for (let i = 0; i < items.length; i++) {
-                        const result = (0, injection_1.scanForInjection)(items[i].json);
-                        if (result.detected && (!injectionResult || result.score > injectionResult.score)) {
-                            injectionResult = (0, runtime_1.sanitizeInjection)(result);
-                        }
+            if (promptInjection) {
+                for (let i = 0; i < items.length; i++) {
+                    const result = (0, injection_1.scanForInjection)(items[i].json);
+                    if (result.detected && (!injectionResult || result.score > injectionResult.score)) {
+                        injectionResult = (0, runtime_1.sanitizeInjection)(result);
                     }
                 }
             }
-            catch {
-            }
             const auditEntry = auditLog && hasReportOutput
-                ? (0, audit_1.buildAuditEntry)('REDACT', mode, allHits, items.length, Date.now() - startTime, enabledPatterns.length, !!ctx.presidioUrl, (0, classification_1.classifyData)(allHits), sessionId)
+                ? (0, audit_1.buildAuditEntry)('REDACT', mode, allHits, items.length, Date.now() - startTime, enabledPatterns.length, !!ctx.presidioUrl, (0, classification_1.classifyData)(allHits), sessionId, unscannedTexts)
                 : undefined;
             if (injectionResult && injectionResult.detected) {
                 returnData.push({
@@ -1105,10 +1224,12 @@ class Redactor {
                 const report = includeReport ? (0, engine_1.buildReport)(sessionId, allHits) : {};
                 if (auditEntry)
                     report.audit = auditEntry;
-                if (includeReport && this.getNodeParameter('includeRopa', 0, false)) {
-                    const d = this.getNodeParameter('ropa', 0, {});
+                if (unscannedTexts > 0)
+                    report.presidioUnscannedTexts = unscannedTexts;
+                if (includeReport && (0, runtime_1.runSetting)(this, 'includeRopa', false)) {
+                    const d = (0, runtime_1.runSetting)(this, 'ropa', {});
                     const list = (v) => String(v !== null && v !== void 0 ? v : '').split(',').map((x) => x.trim()).filter(Boolean);
-                    report.ropa = (0, ropa_1.generateRopaRecord)(allHits, (0, classification_1.classifyData)(allHits), items.length, enabledPatterns.length, mode, sessionTtl, !!vaultPassphrase, auditLog, { name: String((_f = d.controllerName) !== null && _f !== void 0 ? _f : ''), contactEmail: String((_g = d.controllerContact) !== null && _g !== void 0 ? _g : ''), dpo: d.dpo ? String(d.dpo) : undefined }, list(d.purposes), String((_h = d.legalBasis) !== null && _h !== void 0 ? _h : 'legitimate_interest'), list(d.dataSubjects), list(d.recipients), []);
+                    report.ropa = (0, ropa_1.generateRopaRecord)(allHits, (0, classification_1.classifyData)(allHits), items.length, enabledPatterns.length, mode, sessionTtl, !!vaultPassphrase, auditLog, { name: String((_g = d.controllerName) !== null && _g !== void 0 ? _g : ''), contactEmail: String((_h = d.controllerContact) !== null && _h !== void 0 ? _h : ''), dpo: d.dpo ? String(d.dpo) : undefined }, list(d.purposes), String((_j = d.legalBasis) !== null && _j !== void 0 ? _j : 'legitimate_interest'), list(d.dataSubjects), list(d.recipients), []);
                     versionRopaSummary(report.ropa, (0, classification_1.classifyData)(allHits).hitCountByLevel, this.getNode().typeVersion);
                 }
                 return [returnData, [{ json: report, pairedItem: allPaired }]];
@@ -1116,18 +1237,24 @@ class Redactor {
             return [returnData];
         }
         if (operation === 'restore') {
-            const deleteAfterRestore = this.getNodeParameter('deleteAfterRestore', 0, true);
+            const deleteAfterRestore = (0, runtime_1.runSetting)(this, 'deleteAfterRestore', true);
             const session = vault.getSession(sessionId);
             if (!session) {
-                throw new n8n_workflow_1.NodeOperationError(this.getNode(), `No vault found for session "${sessionId}" that this passphrase can open. Ensure a Redact node ran first with the same Session ID, vault storage type and passphrase.`, {
+                throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'No vault found for this session that this passphrase can open. Ensure a Redact node ran first with the same Session ID, vault storage type and passphrase.', {
                     description: 'Testing step by step? Each "Execute step" gets a new execution ID, and n8n saves workflow storage only after production runs of an active workflow. Run the whole workflow, or set the same fixed Session ID (for example "test-1") on both nodes. Restore only works in the workflow that ran Redact.',
                 });
             }
             const returnData = [];
             for (let i = 0; i < items.length; i++) {
                 const item = items[i];
-                const restored = (0, engine_1.restoreValue)(item.json, vault, sessionId);
-                returnData.push({ json: restored, pairedItem: { item: i } });
+                let restored;
+                try {
+                    restored = (0, engine_1.restoreFromSession)(item.json, session);
+                }
+                catch (error) {
+                    throw new n8n_workflow_1.NodeOperationError(this.getNode(), error.message, { itemIndex: i });
+                }
+                returnData.push(withBinary({ json: restored, pairedItem: { item: i } }, item));
             }
             if (deleteAfterRestore) {
                 vault.deleteSession(sessionId);
@@ -1135,9 +1262,9 @@ class Redactor {
             return [returnData];
         }
         if (operation === 'purge') {
-            const purgeScope = this.getNodeParameter('purgeScope', 0, 'all');
+            const purgeScope = (0, runtime_1.runSetting)(this, 'purgeScope', 'all');
             if (purgeScope === 'specific') {
-                const purgeSessionId = this.getNodeParameter('purgeSessionId', 0, '');
+                const purgeSessionId = (0, runtime_1.runSetting)(this, 'purgeSessionId', '');
                 if (!purgeSessionId) {
                     throw new n8n_workflow_1.NodeOperationError(this.getNode(), 'Session ID is required for purging a specific session.');
                 }

package/dist/nodes/Redactor/audit.js

@@ -33,8 +33,20 @@ var __importStar = (this && this.__importStar) || (function () {
     };
 })();
 Object.defineProperty(exports, "__esModule", { value: true });
+exports.sessionReference = sessionReference;
+exports.countHits = countHits;
 exports.buildAuditEntry = buildAuditEntry;
 const crypto = __importStar(require("crypto"));
+function sessionReference(sessionId) {
+    return `session:${crypto.createHash('sha256').update('redactor-session:').update(sessionId).digest('hex')}`;
+}
+function countHits(hits, field) {
+    var _a;
+    const counts = new Map();
+    for (const hit of hits)
+        counts.set(hit[field], ((_a = counts.get(hit[field])) !== null && _a !== void 0 ? _a : 0) + 1);
+    return Object.fromEntries(counts);
+}
 function determineSeverity(classificationLevel, totalHits = 0) {
     if (classificationLevel === 'RESTRICTED' || totalHits >= 50)
         return 'CRITICAL';
@@ -44,13 +56,9 @@ function determineSeverity(classificationLevel, totalHits = 0) {
         return 'MEDIUM';
     return 'LOW';
 }
-function buildAuditEntry(action, mode, hits, inputItemCount, processingTimeMs, patternsUsed, presidioEnabled, classification, sessionId) {
-    const hitsByCategory = {};
-    const hitsByPattern = {};
-    for (const hit of hits) {
-        hitsByCategory[hit.category] = (hitsByCategory[hit.category] || 0) + 1;
-        hitsByPattern[hit.patternLabel] = (hitsByPattern[hit.patternLabel] || 0) + 1;
-    }
+function buildAuditEntry(action, mode, hits, inputItemCount, processingTimeMs, patternsUsed, presidioEnabled, classification, sessionId, presidioUnscannedTexts = 0) {
+    const hitsByCategory = countHits(hits, 'category');
+    const hitsByPattern = countHits(hits, 'patternLabel');
     return {
         version: '2.0',
         timestamp: new Date().toISOString(),
@@ -58,7 +66,7 @@ function buildAuditEntry(action, mode, hits, inputItemCount, processingTimeMs, p
         severity: determineSeverity(classification === null || classification === void 0 ? void 0 : classification.level, hits.length),
         action,
         mode,
-        status: 'SUCCESS',
+        status: presidioUnscannedTexts > 0 ? 'PARTIAL' : 'SUCCESS',
         totalHits: hits.length,
         hitsByCategory,
         hitsByPattern,
@@ -67,6 +75,7 @@ function buildAuditEntry(action, mode, hits, inputItemCount, processingTimeMs, p
         processingTimeMs,
         patternsUsed,
         presidioEnabled,
-        sessionId,
+        ...(presidioUnscannedTexts > 0 ? { presidioUnscannedTexts } : {}),
+        sessionId: sessionId === undefined ? undefined : sessionReference(sessionId),
     };
 }