@mailwoman/normalize 4.11.0 → 4.13.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +2 -2
- package/out/index.d.ts +1 -1
- package/out/index.js +1 -1
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
**Stage 1 of the Mailwoman runtime pipeline** — deterministic input preprocessing.
|
|
4
4
|
|
|
5
5
|
Pure-function text normalization that prepares free-text address strings for
|
|
6
|
-
downstream parsing stages. Every transform produces
|
|
6
|
+
downstream parsing stages. Every transform produces an essential `offsetMap`
|
|
7
7
|
so downstream stages can map normalized-string spans back to raw-string character
|
|
8
8
|
offsets.
|
|
9
9
|
|
|
@@ -54,7 +54,7 @@ Stage 1 in the [Staged Pipeline Contract](https://mailwoman.sister.software/arti
|
|
|
54
54
|
## Design
|
|
55
55
|
|
|
56
56
|
- **Pure functions, no side effects, no ML.** The output is byte-for-byte deterministic for the same input.
|
|
57
|
-
- **`offsetMap` is
|
|
57
|
+
- **`offsetMap` is critical.** Every transform tracks how normalized positions map back to raw input positions. This is essential for the parser to report spans in the original string.
|
|
58
58
|
- **Configurable via `NormalizeOpts`:** toggle `expandAbbreviations`, `normalizeCase`, and `cjk`.
|
|
59
59
|
|
|
60
60
|
## Related
|
package/out/index.d.ts
CHANGED
|
@@ -6,7 +6,7 @@
|
|
|
6
6
|
* `@mailwoman/normalize` — Stage 1 of the runtime pipeline.
|
|
7
7
|
*
|
|
8
8
|
* Deterministic input preprocessing: NFC, punctuation, whitespace, optional case-fold +
|
|
9
|
-
* abbreviation expansion. Pure functions. Produces a `NormalizedInput` with a
|
|
9
|
+
* abbreviation expansion. Pure functions. Produces a `NormalizedInput` with a critical
|
|
10
10
|
* `offsetMap` so downstream stages can map normalized-string spans back to raw-string character
|
|
11
11
|
* offsets.
|
|
12
12
|
*
|
package/out/index.js
CHANGED
|
@@ -6,7 +6,7 @@
|
|
|
6
6
|
* `@mailwoman/normalize` — Stage 1 of the runtime pipeline.
|
|
7
7
|
*
|
|
8
8
|
* Deterministic input preprocessing: NFC, punctuation, whitespace, optional case-fold +
|
|
9
|
-
* abbreviation expansion. Pure functions. Produces a `NormalizedInput` with a
|
|
9
|
+
* abbreviation expansion. Pure functions. Produces a `NormalizedInput` with a critical
|
|
10
10
|
* `offsetMap` so downstream stages can map normalized-string spans back to raw-string character
|
|
11
11
|
* offsets.
|
|
12
12
|
*
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@mailwoman/normalize",
|
|
3
|
-
"version": "4.
|
|
3
|
+
"version": "4.13.0",
|
|
4
4
|
"description": "Stage 1 of the runtime pipeline — deterministic input preprocessing (Unicode NFC, punctuation, whitespace, abbreviation). Pure functions, no ML.",
|
|
5
5
|
"license": "AGPL-3.0-only",
|
|
6
6
|
"repository": {
|