extract-cli 0.1.8__tar.gz → 0.1.10__tar.gz

{extract_cli-0.1.8 → extract_cli-0.1.10}/CHANGELOG.md

@@ -6,6 +6,58 @@ to [Semantic Versioning](https://semver.org/). Per the suite convention
 (see [`docs/INTEROP.md`](docs/INTEROP.md)), **backward-incompatible changes to
 the output schema require a major version bump**; new optional fields are minor.
 
+## [0.1.10] - 2026-05-22
+
+### Fixed
+- **The `[docx]` (python-docx) reader now honors Word heading styles**, matching
+  the stdlib reader. Previously the python-docx path concatenated paragraph text
+  and dropped `Heading1-9`/`Title` styles and `w:numPr` numbering, so installing
+  the `[docx]` extra produced an **empty clause map** on heading-styled Word
+  contracts (worse than the no-extra stdlib reader). Both readers now share one
+  emitter (`_emit_docx_paragraph`) that turns heading-styled / auto-numbered
+  paragraphs into `## headings`, so the two paths agree. New tests:
+  `test_emit_docx_paragraph` and `test_docx_readers_agree_on_clause_map` (the
+  latter asserts the python-docx and stdlib readers produce the same clause map).
+  No output-schema change.
+
+### Tests / quality
+- **Line coverage raised to 100%** (was 92%/94%). Added a targeted test battery
+  for the remaining reachable branches (color/`FORCE_COLOR`, `_warn` silent,
+  date/jurisdiction/title/clause edge returns, LLM request/parse/clause-map
+  branches, PDF `TJ`-array + stream/budget edges, HTML malformed fallback, DOCX
+  empty paragraph, `_is_low_signal` branches, CLI silent/help paths). Genuinely
+  unreachable defensive lines and `[docx]`/`[pdf]`-extra fidelity branches are
+  marked `# pragma: no cover`. `make coverage` now installs the extras and
+  enforces `--fail-under=100`; a CI `coverage` job gates it. No code-behavior or
+  schema change.
+
+## [0.1.9] - 2026-05-22
+
+### Security / robustness
+- **Resource bounds for untrusted input.** A hard on-disk file cap
+  (`MAX_INPUT_BYTES`, 100 MB) and a decompressed-size cap
+  (`MAX_DECOMPRESSED_BYTES`, 200 MB) so a zip-bomb `.docx` or zlib-bomb `.pdf`
+  can't exhaust memory: the DOCX reader checks `word/document.xml`'s
+  uncompressed size before reading, and the PDF reader decompresses streams
+  with a bounded budget. Both degrade gracefully (warning, empty text), never
+  crash. (Verified fast/bounded on a 2 MB doc: ~0.6 s, ~10 MB peak.)
+
+### Added (output schema — minor, backward-compatible additions)
+- **`jurisdiction`** — governing law normalized to a stable code
+  (`State of Delaware` → `US-DE`, `Province of Ontario` → `CA-ON`, …).
+- **`amounts[]`** — every distinct monetary amount (`value` remains the headline one).
+- **`signatories[]`** — `{name, title}` from signature blocks (`By:` / `Name:` /
+  `Title:`); empty on unsigned templates.
+
+### Changed
+- **Clause vocabulary round 2** (from the corpus survey): canonical
+  `Suspension`, `Support`, `Service Levels` + `invoicing`→Payment,
+  customer-data/protection-by-* → Data Protection. Noise filter now also drops
+  recitals/preamble/signature sections, definition fragments (a title starting
+  with a quote), and unfilled placeholders (`[ # ]%`). Mapped clause coverage
+  across the 58-document corpus rose from 57% → **64%**, no over-matching.
+- Test coverage raised to **92%** (94% with the `[docx]`/`[pdf]` extras).
+
 ## [0.1.8] - 2026-05-22
 
 Clause-detection breadth, driven by a 58-document real-corpus survey.
@@ -244,6 +296,8 @@ Initial release — the open-loop front door of the contract-ops CLI suite.
   intentionally *not* governed by the output schema (the schema describes the
   full default output).
 
+[0.1.10]: https://github.com/DrBaher/extract-cli/releases/tag/v0.1.10
+[0.1.9]: https://github.com/DrBaher/extract-cli/releases/tag/v0.1.9
 [0.1.8]: https://github.com/DrBaher/extract-cli/releases/tag/v0.1.8
 [0.1.7]: https://github.com/DrBaher/extract-cli/releases/tag/v0.1.7
 [0.1.6]: https://github.com/DrBaher/extract-cli/releases/tag/v0.1.6

{extract_cli-0.1.8 → extract_cli-0.1.10}/Makefile

@@ -31,8 +31,11 @@ test-quick:
 	$(PYTHON) -m pytest -x -q -k "not property"
 
 coverage:
+	# Install the [docx]/[pdf] extras so the fidelity-reader paths execute too;
+	# without them two extras-only branches stay uncovered (98% vs 100%).
+	$(PIP) install -q -e ".[dev,docx,pdf]"
 	$(PYTHON) -m coverage run --source=extract_cli -m pytest -q
-	$(PYTHON) -m coverage report -m
+	$(PYTHON) -m coverage report -m --fail-under=100
 
 typecheck:
 	$(PYTHON) -m mypy --strict extract_cli.py

{extract_cli-0.1.8 → extract_cli-0.1.10}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: extract-cli
-Version: 0.1.8
+Version: 0.1.10
 Summary: Open-loop front door of the contract-ops CLI suite: ingest any contract (.md/.txt/.html/.docx/.pdf) and emit structured JSON.
 Project-URL: Homepage, https://cli.drbaher.com/
 Project-URL: Repository, https://github.com/DrBaher/extract-cli
@@ -174,10 +174,13 @@ Streams follow the suite convention: **stdout** is the machine payload (JSON),
   "dates":      { "effective": { "value": "2024-03-01", "confidence": 0.85, "source": "deterministic" }, "expiration": { "value": null, "confidence": 0.0, "source": "none" } },
   "term":       { "length": { "value": "3 years", ... }, "auto_renew": { "value": true, ... }, "notice_period_days": { "value": 60, ... } },
   "governing_law": { "value": "State of Delaware", "confidence": 0.85, "source": "deterministic" },
+  "jurisdiction": { "value": "US-DE", "confidence": 0.8, "source": "deterministic" },
   "clauses":    [ { "canonical_title": "Confidentiality", "detected_title": "## Confidentiality Obligations", "tier": "h2", "span": {"start": 0, "end": 120}, "confidence": 0.95, "source": "deterministic", "mapped": true } ],
   "defined_terms": [ { "term": "Confidential Information", "confidence": 0.6, "source": "deterministic" } ],
   "value":      { "value": "$50,000", "confidence": 0.6, "source": "deterministic" },
-  "_meta":      { "extractor_version": "0.1.0", "tiers_used": ["deterministic"], "llm_used": false }
+  "amounts":    [ { "value": "$50,000", "confidence": 0.6, "source": "deterministic" } ],
+  "signatories": [ { "name": "Jane Doe", "title": "CEO", "confidence": 0.55, "source": "deterministic" } ],
+  "_meta":      { "extractor_version": "0.1.9", "tiers_used": ["deterministic"], "llm_used": false }
 }
 ```
 

{extract_cli-0.1.8 → extract_cli-0.1.10}/README.md

@@ -136,10 +136,13 @@ Streams follow the suite convention: **stdout** is the machine payload (JSON),
   "dates":      { "effective": { "value": "2024-03-01", "confidence": 0.85, "source": "deterministic" }, "expiration": { "value": null, "confidence": 0.0, "source": "none" } },
   "term":       { "length": { "value": "3 years", ... }, "auto_renew": { "value": true, ... }, "notice_period_days": { "value": 60, ... } },
   "governing_law": { "value": "State of Delaware", "confidence": 0.85, "source": "deterministic" },
+  "jurisdiction": { "value": "US-DE", "confidence": 0.8, "source": "deterministic" },
   "clauses":    [ { "canonical_title": "Confidentiality", "detected_title": "## Confidentiality Obligations", "tier": "h2", "span": {"start": 0, "end": 120}, "confidence": 0.95, "source": "deterministic", "mapped": true } ],
   "defined_terms": [ { "term": "Confidential Information", "confidence": 0.6, "source": "deterministic" } ],
   "value":      { "value": "$50,000", "confidence": 0.6, "source": "deterministic" },
-  "_meta":      { "extractor_version": "0.1.0", "tiers_used": ["deterministic"], "llm_used": false }
+  "amounts":    [ { "value": "$50,000", "confidence": 0.6, "source": "deterministic" } ],
+  "signatories": [ { "name": "Jane Doe", "title": "CEO", "confidence": 0.55, "source": "deterministic" } ],
+  "_meta":      { "extractor_version": "0.1.9", "tiers_used": ["deterministic"], "llm_used": false }
 }
 ```
 

{extract_cli-0.1.8 → extract_cli-0.1.10}/docs/INTEROP.md

@@ -52,10 +52,12 @@ is a self-contained reference validator.
 
 Top-level keys: `document` {title, format, sha256, source_path}, `parties[]`,
 `dates` {effective, expiration}, `term` {length, auto_renew,
-notice_period_days, *renewal_mechanics?*}, `governing_law`, `clauses[]`
-{canonical_title, detected_title, tier, span, confidence, source, mapped},
-`defined_terms[]`, `value`, *`obligations[]?`*, and `_meta` {extractor_version,
-tiers_used, llm_used}. **Every extracted field carries a `confidence` (0–1) and
+notice_period_days, *renewal_mechanics?*}, `governing_law`, `jurisdiction`
+(normalized code, e.g. `US-DE`), `clauses[]` {canonical_title, detected_title,
+tier, span, confidence, source, mapped}, `defined_terms[]`, `value`,
+`amounts[]` (all monetary amounts), `signatories[]` {name, title}, *`obligations[]?`*,
+and `_meta` {extractor_version, tiers_used, llm_used}. Formats: markdown, text,
+html, docx, pdf. **Every extracted field carries a `confidence` (0–1) and
 a `source` ∈ {deterministic, llm, none}.** Scalar fields use the envelope
 `{value, confidence, source}`; "not found" is `{value: null, confidence: 0.0,
 source: "none"}`. Italic fields are added only under `--llm`.

{extract_cli-0.1.8 → extract_cli-0.1.10}/docs/spec/extract-output.schema.json

@@ -10,9 +10,12 @@
     "dates",
     "term",
     "governing_law",
+    "jurisdiction",
     "clauses",
     "defined_terms",
     "value",
+    "amounts",
+    "signatories",
     "_meta"
   ],
   "additionalProperties": false,
@@ -157,6 +160,9 @@
     "governing_law": {
       "$ref": "#/$defs/field"
     },
+    "jurisdiction": {
+      "$ref": "#/$defs/field"
+    },
     "clauses": {
       "type": "array",
       "items": {
@@ -247,6 +253,58 @@
     "value": {
       "$ref": "#/$defs/field"
     },
+    "amounts": {
+      "type": "array",
+      "items": {
+        "type": "object",
+        "required": [
+          "value",
+          "confidence",
+          "source"
+        ],
+        "properties": {
+          "value": {
+            "type": "string"
+          },
+          "confidence": {
+            "$ref": "#/$defs/confidence"
+          },
+          "source": {
+            "$ref": "#/$defs/source"
+          }
+        },
+        "additionalProperties": false
+      }
+    },
+    "signatories": {
+      "type": "array",
+      "items": {
+        "type": "object",
+        "required": [
+          "name",
+          "confidence",
+          "source"
+        ],
+        "properties": {
+          "name": {
+            "type": "string"
+          },
+          "title": {
+            "type": [
+              "string",
+              "null"
+            ]
+          },
+          "confidence": {
+            "$ref": "#/$defs/confidence"
+          },
+          "source": {
+            "$ref": "#/$defs/source"
+          }
+        },
+        "additionalProperties": false
+      }
+    },
     "obligations": {
       "type": "array",
       "items": {