@link-foundation/sensitive-data-sanitizer 0.17.1 → 0.19.0

package/docs/COVERAGE.md

@@ -60,7 +60,7 @@ The `documents` profile also reads employers from CV experience lines anchored o
 a date range: `Title, Employer (2019-05 – 2021-03)`, `Title — Employer, 2019–2021`
 and `Title (Employer), 2019–2021`. Ranges use years, `YYYY-MM`, `MM.YYYY`, full
 dates or `month YYYY`, with `по настоящее время`, `н.в.`, `по н.в.`, `present` and
-similar open ends. Titles have one to nine words. A label of one or two words
+similar open ends. For the non-parenthesized layouts, titles have one to nine words. A label of one or two words
 before the title (`Опыт: `, `Опыт работы - `, `Опыт — `) is read like a list marker,
 and a segment after `|` is read like a line start, so
 `Должность: Менеджер | Опыт: Аналитик, Ромашка (2018 – 2020)` also yields the
@@ -68,9 +68,9 @@ employer. The date range stays the anchor and the employer must still start with
 capital letter, a digit or a quote. Confidence is 0.60, and the employer then
 propagates through the document like other organizations. The default profile
 ignores these lines. Lines
-with more fields (`Title, Employer, City (dates)`) and titles containing a comma
-are not targeted and can leave the employer in place; date-anchored prose with
-the same shape can be flagged.
+with parenthesized ranges additionally support arbitrary title prefixes,
+comma-containing employers and titles, as described below. Date-anchored prose
+with the same shape can be flagged.
 
 The gazetteer has only the cities/regions explicitly listed in that module,
 including Springfield and Riverton. It is not a worldwide geocoder. Location
@@ -243,16 +243,17 @@ The `documents` profile additionally recognizes:
 - Company/employer/workplace labels, capitalized company/holding/bank names,
   employment prose and year-range employer lines; residence/metro/district
   labels and contextual six-digit postal codes.
-- Russian street-plus-house/flat structures at line start or after
-  `проживает по адресу`. Public-place prose such as
-  `Музей находится на ул. Ленина, д. 5, кв. 12` stays unchanged. Public addresses
-  presented alone have the same shape as personal addresses and may be flagged;
-  inspect and review standalone public addresses before publication.
+- Russian street-plus-house/flat structures, including inline addresses added
+  by #117. `Музей находится на ул. Ленина, д. 5, кв. 12` now removes the full
+  street/house/apartment span. Public addresses have the same shape as personal
+  addresses and may be flagged; inspect them before publication.
 
 Explicit limits accepted for the ambiguous examples in #82/#83:
-`Спасибо, Анна!`, `Анна, добрый день!`, `Менеджер Анна` and `Лютик, менеджер`
+`Спасибо, Анна!`, `Анна, добрый день!` and `Менеджер Анна`
 remain unchanged without known values or additional context. Bare given names
 and unmarked employer/title fragments cannot reliably establish identity.
+The reversed employer cue `Лютик, менеджер` now redacts `Лютик`, as requested
+by #117. English `Worked at Romashka` now redacts the employer under #115.
 `зарплата 150 000 руб.` and `Salary: 150000` also remain unchanged: salary is
 outside the native document rules. Supply `knownPersonal` or an additional
 recognizer when these fields must be removed. Initial/name rules do not cover
@@ -376,7 +377,8 @@ Employer labels consume multi-word values to a comma or line/quote boundary.
 Dated CV entries additionally support compound titles, title parentheses/slashes,
 quoted group names, legal-form/location suffixes, empty/`null` range ends,
 multiple entries, employer-first role entries and pipe-separated entries.
-The supplemental grammar uses finite title cues and bounded entries. Undated
+The parenthesized date-anchor scanner accepts arbitrary forward titles and
+lead-ins. The reversed `Company, manager` layout retains finite role cues. Undated
 `Менеджер, Ромашка Лютик`, `- Ромашка Лютик 5 лет` and
 `Последнее место работы Ромашка Лютик` remain explicit ambiguous limits, as
 permitted by #94. Use known values or schema declarations for them.
@@ -385,8 +387,7 @@ Company prose recognizes `компании «…»`, `опыт в`, `Роль в
 capitalized lists after those cues, `опыт (Company Name)`, and names followed
 by `(2 года)`/`(3 года)`-style durations. Arbitrary uncued company words remain
 ambiguous; synchronous callers can supply `knownPersonal` lists or precomputed
-`findings`. Custom `detectors` callbacks are still used by `createSanitizer`
-only. No model or network service is required for these native rules.
+`findings`. Array-returning custom `detectors` also run in synchronous methods; Promise-returning callbacks require `createSanitizer`. No model or network service is required for these native rules.
 
 `контакт:` and `пишите,` introduce domestic mobile numbers. A complete line
 consisting of an 11-digit `79…` or `89…` mobile shape is also sensitive. Arbitrary
@@ -402,3 +403,124 @@ redaction replaces the fragment instead of repeating an unchanged result until
 
 The [requirement inventory and research](case-studies/issue-100/README.md)
 records the complete scope and regression evidence.
+
+## Dated entries and optional prose (issues 104–106)
+
+Parenthesized date anchors now delimit successive entries on the same line,
+including arbitrary title words and lead-ins (`Стаж = 5 лет:`, `= 3 года,`).
+Employers can contain comma suffixes, nested parentheses, slash-separated names,
+legal forms and multiple words. A pipe after the employer preserves the industry
+suffix. `Founder, consultant, Romashka (2019–2021)` and equivalent Russian entries
+share the parser. The employer must start with a capital letter, a quote, or a
+company-style digit/letter combination. **Lowercase employers remain a limit**:
+`Менеджер, romashka (2019–2021)` / `Менеджер, ромашка (2019–2021)` stay, preserving
+ambiguous controls such as `Встреча, понедельник (2019–2021)`.
+
+`ГК` and `группа компаний` introduce quoted or unquoted group names. Employment
+lists continue through repeated `, потом в` and `, затем в` items. Domestic
+`79…`/`89…` mobile shapes after a comma work in Russian and English text; plain
+`order`/`id` numbers stay. School detection also covers `(МГУ, 2012)`,
+`Образование (МГУ)`, `в МГТУ им. Баумана` and `Обучение: Skillbox, 2020`.
+The acronym vocabulary remains finite.
+
+Weak organization experience/duration cues preserve a small explicit technology
+set: Python, Go, SQL, Excel, Power BI, Kubernetes, PostgreSQL, Telegram and Scrum.
+This is an ambiguity policy, not general recognition of every product; a real
+employer with one of those names needs `knownPersonal` or a declared sensitive
+field. Explicit private values/fields and stronger legal-form cues still win.
+
+Document share-link detection also recognizes HTTP(S) URLs containing `/d/<id>`
+for any host and nonempty id length. Ordinary website roots remain a limit.
+Relative operational paths such as `{"location":"apps/api"}` stay; explicit
+personal paths and credential rules remain active. Caller-sensitive field names
+now use the same case/underscore/hyphen normalization as built-in document names.
+
+For no-cue prose, enable [`properNames: 'capitalized'`](API.md#structural-prose-redaction).
+It activates per value, defaults to Cyrillic script letters or structural data
+triggers, and supports configurable Unicode scripts. It intentionally loses
+capitalized ordinary words. Labels, lowercase words, dates, paths, JSON keys and
+untriggered values are outside this additional rule. English untriggered prose,
+lowercase names and a name immediately before a colon remain documented limits.
+The API describes the interaction with existing detectors and placeholder modes.
+
+The date-anchor scan visits each preceding entry once; the optional prose scanner
+classifies maximal tokens in fixed passes, avoiding repeated suffix searches on
+long unspaced input. This is not a latency guarantee for the whole pipeline.
+[The requirement inventory](case-studies/issue-106/README.md) records alternatives,
+research, regression evidence and reproducible bounded performance measurements.
+
+## Stored-log policy and expanded document catalog
+
+The documents profile now covers the exact positive/control rows of issues
+115 and 117: spaced/obfuscated contacts, Discord/MAX handles, additional
+personal-link routes, birthday/age cues, military/VIN identifiers, employer and
+school layouts, patronymics/initials/mixed scripts, complete street/house spans,
+regions, citizenship and plates. Regression tests compare complete text output
+and JSON/JSONL output in both engines. `ОГРНИП` without a value, operational logs,
+work durations, weekdays and technologies remain unchanged. Bare `Сергей`,
+`Смирнова`, `Смирновой`, `СПб`, `Питер` and `Вчера Анна написала` deliberately remain
+ambiguous without explicit known values, the optional recognizer or aggressive
+proper-name mode. Romashka Inc keeps its existing legal-form treatment.
+
+`strict: true` independently opts into personal attributes (gender, family,
+ethnicity, religion, health, criminal/political status) and bare dates, ages,
+passport/mobile/postal shapes. It is intended for stored personal prose and can
+remove ordinary uses of these words. It preserves ISO timestamps, work durations,
+unit-bearing request timings and `Дети: нет`. In JSON/JSONL, numeric primitives
+stay numeric, and `structuralFields` suppresses strict findings in declared
+string metadata. Credentials/known values still take priority. Strict is off by
+default and does not claim to identify every sensitive attribute or validate
+that every date/number belongs to a real person.
+
+## Optional offline recognition measurements
+
+The `/ner` entry uses the separately installed optional
+[NLP.js](https://github.com/axa-group/nlp.js) regex extractor, finite multilingual
+name/place dictionaries and bounded contextual rules. It has synchronous
+inference after `await createNerDetector(...)`. There is no analysis-time network,
+external service, Python process or model download. The core import graph never
+imports `/ner` or NLP.js, so the optional component has no runtime or loading cost
+when disabled. This is symbolic recognition, not general statistical NER; unknown
+cue-free surnames, schools, employers and locations can be missed.
+
+[Test set](../experiments/issue-118/ner-corpus.json): 32 synthetic sentences,
+including all six requested positives, eight benign controls and eight challenge
+misses. Exact type and UTF-16 start/end must all match. **All** rows, including
+challenge rows, contribute to these scores. Each language/type has two true
+positives, zero false positives and one false negative:
+
+| Language | Type         | Precision | Recall | TP / FP / FN |
+| -------- | ------------ | --------- | ------ | ------------ |
+| ru       | PERSON       | 100%      | 66.7%  | 2 / 0 / 1    |
+| ru       | ORGANIZATION | 100%      | 66.7%  | 2 / 0 / 1    |
+| ru       | EDUCATION    | 100%      | 66.7%  | 2 / 0 / 1    |
+| ru       | LOCATION     | 100%      | 66.7%  | 2 / 0 / 1    |
+| en       | PERSON       | 100%      | 66.7%  | 2 / 0 / 1    |
+| en       | ORGANIZATION | 100%      | 66.7%  | 2 / 0 / 1    |
+| en       | EDUCATION    | 100%      | 66.7%  | 2 / 0 / 1    |
+| en       | LOCATION     | 100%      | 66.7%  | 2 / 0 / 1    |
+
+These small authored regression scores do not estimate accuracy on arbitrary
+user documents. The test includes explicit misses such as `Zephyr Quill`,
+`Asterion expanded rapidly`, `ETHZ` and `Reykjavik` so dictionary limits remain
+visible. Acceptance rows also test both sanitizers and unchanged controls.
+
+On Node v26.13.0, Linux x64, five bounded groups, the median warm detector cost
+was **0.0434 ms per 1 KiB** of ASCII employer prose; module loading plus factory
+initialization took **48.6 ms** once. Cost excludes the sanitizer's other
+recognizers and varies with text and hardware. No latency guarantee is implied.
+
+## Compiled known-value measurements
+
+On the same host and 1 KiB operational record, median complete `sanitize` cost
+was **2.80 ms** without a list, **3.30 ms** with 500 compiled values and **8.56 ms**
+with a plain array. A direct 500-value matching pass cost **0.73 ms**. Validation
+cost was **0.00416 ms** without a list and **0.00356 ms** compiled (the difference
+is measurement noise), below the allowed 10% of the no-list call, excluding
+matching. Compilation skips per-record entry validation, normalization and regex
+construction; matching itself still scales with list length and pipeline passes.
+
+Reproduce with `node --max-old-space-size=384 experiments/issue-118/measure.mjs`.
+The [raw results](case-studies/issue-118/measurements.json) include environment,
+exact-span counts and measurement method. This fixed experiment uses no large
+corpus, unbounded input, parallel builds or external analysis service.

package/docs/RULES.md

@@ -0,0 +1,403 @@
+# Stable finding rule identifiers
+
+Use keys from the exported frozen `builtInRules` list in `rules: {id: false}`.
+Unknown ids fail with ERR_CONFIG. Credential and mixed encoded/scanner rules
+require `allowCredentialDisable: true`. A disabled rule does not suppress
+another rule's overlapping finding. Rules gate automatic built-in findings;
+explicit findings and custom callbacks retain caller policy. See [API](API.md#rule-type-and-field-policy).
+
+Regenerate with `node experiments/issue-118/generate-rule-catalog.mjs`.
+
+- `age-context`
+- `anthropic`
+- `authorization`
+- `aws`
+- `birth-context`
+- `birth-year`
+- `booking-context`
+- `booking-filename`
+- `catalog/aws`
+- `catalog/azure`
+- `catalog/google`
+- `cli-password`
+- `context`
+- `cookie`
+- `databricks`
+- `detect-secrets`
+- `digitalocean`
+- `discord`
+- `document-age-unit`
+- `document-at-employer`
+- `document-bank-suffix`
+- `document-birthday`
+- `document-citizenship`
+- `document-email-obfuscation`
+- `document-email-spaces`
+- `document-employer-dash`
+- `document-employer-prefix`
+- `document-industry`
+- `document-introduction`
+- `document-legal-lowercase`
+- `document-local-phone`
+- `document-messenger`
+- `document-military-id`
+- `document-mixed-name`
+- `document-mobile-bare`
+- `document-mobile-comma`
+- `document-mobile-context`
+- `document-msu`
+- `document-patronymic`
+- `document-personal-path`
+- `document-phone`
+- `document-phone-label`
+- `document-propagation`
+- `document-region`
+- `document-resume-link`
+- `document-reversed-role`
+- `document-role`
+- `document-role-employer`
+- `document-school-context`
+- `document-school-year`
+- `document-share-link`
+- `document-share-path`
+- `document-social-link`
+- `document-spaced-mobile`
+- `document-street`
+- `document-street-complete`
+- `document-unfamiliar-name`
+- `document-uppercase-initials`
+- `document-vehicle-plate`
+- `document-vin`
+- `education-acronym`
+- `education-bracket`
+- `education-label`
+- `education-named-acronym`
+- `education-russian`
+- `education-training`
+- `education-type`
+- `email`
+- `employer-label`
+- `employer-prose`
+- `employer-years`
+- `encoded`
+- `encoded-engine`
+- `encoded-limit`
+- `entity-format`
+- `entropy`
+- `firebase`
+- `gender-context`
+- `github`
+- `gitlab`
+- `gitlab-runner`
+- `gitleaks/1password-secret-key`
+- `gitleaks/1password-service-account-token`
+- `gitleaks/adafruit-api-key`
+- `gitleaks/adobe-client-id`
+- `gitleaks/adobe-client-secret`
+- `gitleaks/age-secret-key`
+- `gitleaks/airtable-api-key`
+- `gitleaks/airtable-personnal-access-token`
+- `gitleaks/algolia-api-key`
+- `gitleaks/alibaba-access-key-id`
+- `gitleaks/alibaba-secret-key`
+- `gitleaks/anthropic-admin-api-key`
+- `gitleaks/anthropic-api-key`
+- `gitleaks/artifactory-api-key`
+- `gitleaks/artifactory-reference-token`
+- `gitleaks/asana-client-id`
+- `gitleaks/asana-client-secret`
+- `gitleaks/atlassian-api-token`
+- `gitleaks/authress-service-client-access-key`
+- `gitleaks/aws-access-token`
+- `gitleaks/aws-amazon-bedrock-api-key-long-lived`
+- `gitleaks/aws-amazon-bedrock-api-key-short-lived`
+- `gitleaks/azure-ad-client-secret`
+- `gitleaks/beamer-api-token`
+- `gitleaks/bitbucket-client-id`
+- `gitleaks/bitbucket-client-secret`
+- `gitleaks/bittrex-access-key`
+- `gitleaks/bittrex-secret-key`
+- `gitleaks/cisco-meraki-api-key`
+- `gitleaks/clickhouse-cloud-api-secret-key`
+- `gitleaks/clojars-api-token`
+- `gitleaks/cloudflare-api-key`
+- `gitleaks/cloudflare-global-api-key`
+- `gitleaks/cloudflare-origin-ca-key`
+- `gitleaks/codecov-access-token`
+- `gitleaks/cohere-api-token`
+- `gitleaks/coinbase-access-token`
+- `gitleaks/confluent-access-token`
+- `gitleaks/confluent-secret-key`
+- `gitleaks/contentful-delivery-api-token`
+- `gitleaks/curl-auth-header`
+- `gitleaks/curl-auth-user`
+- `gitleaks/databricks-api-token`
+- `gitleaks/datadog-access-token`
+- `gitleaks/defined-networking-api-token`
+- `gitleaks/digitalocean-access-token`
+- `gitleaks/digitalocean-pat`
+- `gitleaks/digitalocean-refresh-token`
+- `gitleaks/discord-api-token`
+- `gitleaks/discord-client-id`
+- `gitleaks/discord-client-secret`
+- `gitleaks/doppler-api-token`
+- `gitleaks/droneci-access-token`
+- `gitleaks/dropbox-api-token`
+- `gitleaks/dropbox-long-lived-api-token`
+- `gitleaks/dropbox-short-lived-api-token`
+- `gitleaks/duffel-api-token`
+- `gitleaks/dynatrace-api-token`
+- `gitleaks/easypost-api-token`
+- `gitleaks/easypost-test-api-token`
+- `gitleaks/etsy-access-token`
+- `gitleaks/facebook-access-token`
+- `gitleaks/facebook-page-access-token`
+- `gitleaks/facebook-secret`
+- `gitleaks/fastly-api-token`
+- `gitleaks/finicity-api-token`
+- `gitleaks/finicity-client-secret`
+- `gitleaks/finnhub-access-token`
+- `gitleaks/flickr-access-token`
+- `gitleaks/flutterwave-encryption-key`
+- `gitleaks/flutterwave-public-key`
+- `gitleaks/flutterwave-secret-key`
+- `gitleaks/flyio-access-token`
+- `gitleaks/frameio-api-token`
+- `gitleaks/freemius-secret-key`
+- `gitleaks/freshbooks-access-token`
+- `gitleaks/gcp-api-key`
+- `gitleaks/generic-api-key`
+- `gitleaks/github-app-token`
+- `gitleaks/github-fine-grained-pat`
+- `gitleaks/github-oauth`
+- `gitleaks/github-pat`
+- `gitleaks/github-refresh-token`
+- `gitleaks/gitlab-cicd-job-token`
+- `gitleaks/gitlab-deploy-token`
+- `gitleaks/gitlab-feature-flag-client-token`
+- `gitleaks/gitlab-feed-token`
+- `gitleaks/gitlab-incoming-mail-token`
+- `gitleaks/gitlab-kubernetes-agent-token`
+- `gitleaks/gitlab-oauth-app-secret`
+- `gitleaks/gitlab-pat`
+- `gitleaks/gitlab-pat-routable`
+- `gitleaks/gitlab-ptt`
+- `gitleaks/gitlab-rrt`
+- `gitleaks/gitlab-runner-authentication-token`
+- `gitleaks/gitlab-runner-authentication-token-routable`
+- `gitleaks/gitlab-scim-token`
+- `gitleaks/gitlab-session-cookie`
+- `gitleaks/gitter-access-token`
+- `gitleaks/gocardless-api-token`
+- `gitleaks/grafana-api-key`
+- `gitleaks/grafana-cloud-api-token`
+- `gitleaks/grafana-service-account-token`
+- `gitleaks/harness-api-key`
+- `gitleaks/hashicorp-tf-api-token`
+- `gitleaks/hashicorp-tf-password`
+- `gitleaks/heroku-api-key`
+- `gitleaks/heroku-api-key-v2`
+- `gitleaks/hubspot-api-key`
+- `gitleaks/huggingface-access-token`
+- `gitleaks/huggingface-organization-api-token`
+- `gitleaks/infracost-api-token`
+- `gitleaks/intercom-api-key`
+- `gitleaks/intra42-client-secret`
+- `gitleaks/jfrog-api-key`
+- `gitleaks/jfrog-identity-token`
+- `gitleaks/jwt`
+- `gitleaks/jwt-base64`
+- `gitleaks/kraken-access-token`
+- `gitleaks/kubernetes-secret-yaml`
+- `gitleaks/kucoin-access-token`
+- `gitleaks/kucoin-secret-key`
+- `gitleaks/launchdarkly-access-token`
+- `gitleaks/linear-api-key`
+- `gitleaks/linear-client-secret`
+- `gitleaks/linkedin-client-id`
+- `gitleaks/linkedin-client-secret`
+- `gitleaks/lob-api-key`
+- `gitleaks/lob-pub-api-key`
+- `gitleaks/looker-client-id`
+- `gitleaks/looker-client-secret`
+- `gitleaks/mailchimp-api-key`
+- `gitleaks/mailgun-private-api-token`
+- `gitleaks/mailgun-pub-key`
+- `gitleaks/mailgun-signing-key`
+- `gitleaks/mapbox-api-token`
+- `gitleaks/mattermost-access-token`
+- `gitleaks/maxmind-license-key`
+- `gitleaks/messagebird-api-token`
+- `gitleaks/messagebird-client-id`
+- `gitleaks/microsoft-teams-webhook`
+- `gitleaks/netlify-access-token`
+- `gitleaks/new-relic-browser-api-token`
+- `gitleaks/new-relic-insert-key`
+- `gitleaks/new-relic-user-api-id`
+- `gitleaks/new-relic-user-api-key`
+- `gitleaks/notion-api-token`
+- `gitleaks/npm-access-token`
+- `gitleaks/nuget-config-password`
+- `gitleaks/nytimes-access-token`
+- `gitleaks/octopus-deploy-api-key`
+- `gitleaks/okta-access-token`
+- `gitleaks/openai-api-key`
+- `gitleaks/openshift-user-token`
+- `gitleaks/perplexity-api-key`
+- `gitleaks/pkcs12-file`
+- `gitleaks/plaid-api-token`
+- `gitleaks/plaid-client-id`
+- `gitleaks/plaid-secret-key`
+- `gitleaks/planetscale-api-token`
+- `gitleaks/planetscale-oauth-token`
+- `gitleaks/planetscale-password`
+- `gitleaks/postman-api-token`
+- `gitleaks/prefect-api-token`
+- `gitleaks/private-key`
+- `gitleaks/privateai-api-token`
+- `gitleaks/pulumi-api-token`
+- `gitleaks/pypi-upload-token`
+- `gitleaks/rapidapi-access-token`
+- `gitleaks/readme-api-token`
+- `gitleaks/rubygems-api-token`
+- `gitleaks/scalingo-api-token`
+- `gitleaks/sendbird-access-id`
+- `gitleaks/sendbird-access-token`
+- `gitleaks/sendgrid-api-token`
+- `gitleaks/sendinblue-api-token`
+- `gitleaks/sentry-access-token`
+- `gitleaks/sentry-org-token`
+- `gitleaks/sentry-user-token`
+- `gitleaks/settlemint-application-access-token`
+- `gitleaks/settlemint-personal-access-token`
+- `gitleaks/settlemint-service-access-token`
+- `gitleaks/shippo-api-token`
+- `gitleaks/shopify-access-token`
+- `gitleaks/shopify-custom-access-token`
+- `gitleaks/shopify-private-app-access-token`
+- `gitleaks/shopify-shared-secret`
+- `gitleaks/sidekiq-secret`
+- `gitleaks/sidekiq-sensitive-url`
+- `gitleaks/slack-app-token`
+- `gitleaks/slack-bot-token`
+- `gitleaks/slack-config-access-token`
+- `gitleaks/slack-config-refresh-token`
+- `gitleaks/slack-legacy-bot-token`
+- `gitleaks/slack-legacy-token`
+- `gitleaks/slack-legacy-workspace-token`
+- `gitleaks/slack-user-token`
+- `gitleaks/slack-webhook-url`
+- `gitleaks/snyk-api-token`
+- `gitleaks/sonar-api-token`
+- `gitleaks/sourcegraph-access-token`
+- `gitleaks/square-access-token`
+- `gitleaks/squarespace-access-token`
+- `gitleaks/stripe-access-token`
+- `gitleaks/sumologic-access-id`
+- `gitleaks/sumologic-access-token`
+- `gitleaks/telegram-bot-api-token`
+- `gitleaks/travisci-access-token`
+- `gitleaks/twilio-api-key`
+- `gitleaks/twitch-api-token`
+- `gitleaks/twitter-access-secret`
+- `gitleaks/twitter-access-token`
+- `gitleaks/twitter-api-key`
+- `gitleaks/twitter-api-secret`
+- `gitleaks/twitter-bearer-token`
+- `gitleaks/typeform-api-token`
+- `gitleaks/vault-batch-token`
+- `gitleaks/vault-service-token`
+- `gitleaks/yandex-access-token`
+- `gitleaks/yandex-api-key`
+- `gitleaks/yandex-aws-access-token`
+- `gitleaks/zendesk-secret-key`
+- `google`
+- `grafana`
+- `home-path`
+- `huggingface`
+- `iban-checksum`
+- `identity-number`
+- `international-phone`
+- `ipv4`
+- `ipv6`
+- `jwt`
+- `known-personal`
+- `known-secret`
+- `label`
+- `linear`
+- `location-gazetteer`
+- `location-label`
+- `location-residence`
+- `luhn`
+- `mac`
+- `mailchimp`
+- `messenger-handle`
+- `messenger-label`
+- `mrz`
+- `name-case`
+- `name-document`
+- `name-gazetteer`
+- `name-identity`
+- `name-initials`
+- `name-title`
+- `name-variant`
+- `national-format`
+- `national-phone`
+- `ner/offline`
+- `netrc`
+- `notion`
+- `npm`
+- `nuget`
+- `numbered-school`
+- `obfuscated-email`
+- `openai`
+- `organization-context`
+- `organization-continuation`
+- `organization-core`
+- `organization-cue`
+- `organization-duration`
+- `organization-experience`
+- `organization-experience-prose`
+- `organization-group`
+- `organization-group-cue`
+- `organization-legal-form`
+- `passport-format`
+- `passport-issuer`
+- `passport-series`
+- `personal-profile-url`
+- `phone-context`
+- `postal-address`
+- `postal-code`
+- `presidio`
+- `private-key`
+- `profile-attribute`
+- `profile-prose`
+- `proper-name-prose`
+- `putty-private-key`
+- `pypi`
+- `quoted-entropy`
+- `residence-prose`
+- `school-acronym-context`
+- `secretlint`
+- `sendgrid`
+- `shopify`
+- `slack`
+- `square`
+- `strict-age`
+- `strict-attribute`
+- `strict-date`
+- `strict-number`
+- `stripe`
+- `tel-uri`
+- `telegram`
+- `ticket-context`
+- `twilio`
+- `url-userinfo`
+- `us-ssn`
+- `vault`
+- `vercel`
+- `visa-context`
+- `vocabulary-cue`
+- `vocabulary-role`
+- `webhook`
+- `wordpress`

package/examples/custom-log-policy.mjs

@@ -0,0 +1,23 @@
+import { compileKnown, createSyncSanitizer } from '../src/index.js';
+
+// Reuse caller-owned compilation in a synchronous logging hook.
+const known = compileKnown([{ type: 'ORGANIZATION', value: 'Ромашка' }]);
+const loggerPolicy = createSyncSanitizer({
+  profile: 'documents',
+  knownPersonal: known,
+  vocabulary: { roles: ['маркетолог'] },
+  structured: 'json',
+  allowedFields: ['level', 'msg'],
+  fields: { location: 'scan' },
+  transformations: { ORGANIZATION: () => 'PrivateCompany' },
+});
+console.log(
+  loggerPolicy.sanitize(
+    JSON.stringify({
+      level: 'info',
+      msg: 'работал в Ромашке',
+      privateNote: 'caller-private text',
+      count: 1,
+    })
+  ).text
+);

package/examples/prose-logs.mjs

@@ -0,0 +1,16 @@
+import { sanitize } from '../src/index.js';
+
+// Synthetic mixed records: only the prose string activates the extra rule.
+const source = JSON.stringify({
+  note: 'Работал в Ромашке менеджером по продажам.',
+  operational: 'Connection to Postgres lost, retrying',
+  count: 42,
+});
+console.log(
+  sanitize(source, {
+    profile: 'documents',
+    properNames: 'capitalized',
+    scripts: ['Cyrillic'],
+    structured: 'json',
+  }).text
+);

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@link-foundation/sensitive-data-sanitizer",
-  "version": "0.17.1",
+  "version": "0.19.0",
   "description": "Offline sensitive-text sanitization with credential, multilingual personal-data and scanner union detection",
   "type": "module",
   "main": "src/index.js",
@@ -24,7 +24,10 @@
     "LICENSE",
     "README.md",
     "examples/shared-tool-logs.mjs",
-    "examples/reversible-placeholders.mjs"
+    "examples/reversible-placeholders.mjs",
+    "examples/prose-logs.mjs",
+    "docs/RULES.md",
+    "examples/custom-log-policy.mjs"
   ],
   "exports": {
     ".": {
@@ -39,6 +42,10 @@
       "types": "./src/legacy.d.ts",
       "browser": "./src/arithmetic.js",
       "import": "./src/legacy.js"
+    },
+    "./ner": {
+      "types": "./src/ner.d.ts",
+      "import": "./src/ner.js"
     }
   },
   "scripts": {
@@ -95,6 +102,7 @@
   "devDependencies": {
     "@changesets/cli": "^3.0.3",
     "@eslint/js": "^10.0.1",
+    "@nlpjs/ner": "4.27.0",
     "browser-commander": "0.34.1",
     "cmd-shim": "^9.0.2",
     "command-stream": "2.6.0",
@@ -150,5 +158,13 @@
   },
   "overrides": {
     "minimatch@>=7 <11": "^11.0.5"
+  },
+  "peerDependencies": {
+    "@nlpjs/ner": "^4.27.0"
+  },
+  "peerDependenciesMeta": {
+    "@nlpjs/ner": {
+      "optional": true
+    }
   }
 }