brewdoc-linux-x64-glibc 0.3.1 → 0.3.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,411 +0,0 @@
1
- Metadata-Version: 2.5
2
- Name: brewdoc
3
- Version: 0.3.1
4
- Summary: Brew any document into LLM-ready Markdown: PDF tables, spreadsheets, docx - no ML, deterministic, with a JSON receipt
5
- Project-URL: Homepage, https://github.com/kochetkov-ma/brewdoc
6
- Project-URL: Repository, https://github.com/kochetkov-ma/brewdoc
7
- Project-URL: Issues, https://github.com/kochetkov-ma/brewdoc/issues
8
- Author-email: Maksim Kochetkov <apmatypa88@gmail.com>
9
- License-Expression: MIT
10
- License-File: LICENSE
11
- Keywords: docx,llm,markdown,pdf,rag,table-extraction,xlsx
12
- Classifier: Development Status :: 3 - Alpha
13
- Classifier: Environment :: Console
14
- Classifier: Intended Audience :: Developers
15
- Classifier: License :: OSI Approved :: MIT License
16
- Classifier: Operating System :: OS Independent
17
- Classifier: Programming Language :: Python :: 3
18
- Classifier: Programming Language :: Python :: 3 :: Only
19
- Classifier: Programming Language :: Python :: 3.12
20
- Classifier: Topic :: Text Processing :: Markup :: Markdown
21
- Requires-Python: >=3.12
22
- Requires-Dist: pdfplumber==0.11.10
23
- Requires-Dist: python-calamine==0.8.2
24
- Requires-Dist: selectolax==0.4.13; python_version < '3.15' and platform_python_implementation == 'CPython'
25
- Provides-Extra: render-js
26
- Requires-Dist: quickjs-ng==0.17.0.1; (python_version < '3.15' and platform_python_implementation == 'CPython') and extra == 'render-js'
27
- Description-Content-Type: text/markdown
28
-
29
- # brewdoc
30
-
31
- [![PyPI](https://img.shields.io/pypi/v/brewdoc)](https://pypi.org/project/brewdoc/)
32
- [![CI](https://github.com/kochetkov-ma/brewdoc/actions/workflows/ci.yml/badge.svg?branch=main)](https://github.com/kochetkov-ma/brewdoc/actions/workflows/ci.yml)
33
- [![Release](https://img.shields.io/github/v/release/kochetkov-ma/brewdoc)](https://github.com/kochetkov-ma/brewdoc/releases/latest)
34
- [![MIT](https://img.shields.io/github/license/kochetkov-ma/brewdoc)](LICENSE)
35
-
36
- Document to Markdown for agent systems: PDF, Word, PPTX presentations, spreadsheets, EPUB and static
37
- HTML in, one Markdown file plus a JSON receipt out. No models or OCR. Local conversion
38
- is offline and deterministic (same file, same bytes). Explicit `--url` acquires a page.
39
- The receipt says what was rendered,
40
- what was dropped and what the route structurally cannot carry.
41
-
42
- ## Install
43
-
44
- Choose one method. [Latest release](https://github.com/kochetkov-ma/brewdoc/releases/latest)
45
- contains its complete installation guide. Python releases 0.2.0 and 0.3.0 are public.
46
- These commands select 0.3.1 and apply when that version is published; its
47
- [release guide](https://github.com/kochetkov-ma/brewdoc/releases/tag/v0.3.1)
48
- records accepted channels. Badges show published versions and main CI, not universal OS support.
49
-
50
- | channel | command |
51
- |---|---|
52
- | pip | `python -m pip install "brewdoc==0.3.1"` in a dedicated virtual environment |
53
- | uvx, temporary | `uvx --python 3.12 --from "brewdoc==0.3.1" brewdoc file.pdf --out file.md` |
54
- | uv tool, installed | `uv tool install --python 3.12 "brewdoc==0.3.1"` |
55
- | pipx, installed | `pipx install --python 3.12 "brewdoc==0.3.1"` |
56
- | Container recipe (pip) | `RUN pip install brewdoc==0.3.1` |
57
-
58
- pip needs an installed Python 3.12. Use explicit environment paths without activation.
59
- Linux/macOS:
60
-
61
- ```sh
62
- python3.12 -m venv .venv
63
- .venv/bin/python -m pip install "brewdoc==0.3.1"
64
- .venv/bin/python -c "from importlib.metadata import version; print(version('brewdoc'))"
65
- .venv/bin/brewdoc --self-check
66
- .venv/bin/brewdoc file.pdf --out file.md
67
- ```
68
-
69
- Windows PowerShell:
70
-
71
- ```powershell
72
- py -3.12 -m venv .venv
73
- .\.venv\Scripts\python.exe -m pip install "brewdoc==0.3.1"
74
- .\.venv\Scripts\python.exe -c "from importlib.metadata import version; print(version('brewdoc'))"
75
- .\.venv\Scripts\brewdoc.exe --self-check
76
- .\.venv\Scripts\brewdoc.exe file.pdf --out file.md
77
- ```
78
-
79
- uv and pipx must already be installed. After installation, run `uv tool update-shell`
80
- or `pipx ensurepath`, open a new terminal, then run `brewdoc --self-check` and
81
- `brewdoc file.pdf --out file.md`. `uv tool list` or `pipx list` shows the managed version.
82
- Check PATH selection with `command -v brewdoc` on Unix or `Get-Command brewdoc` in PowerShell.
83
-
84
- For an exact published version X.Y.Z, update with the environment's Python and
85
- `-m pip install --upgrade "brewdoc==X.Y.Z"`,
86
- `uv tool install --force --python 3.12 "brewdoc==X.Y.Z"` or
87
- `pipx install --force --python 3.12 "brewdoc==X.Y.Z"`. Replace X.Y.Z before running.
88
- Remove with the same Python's `-m pip uninstall brewdoc`, `uv tool uninstall brewdoc`
89
- or `pipx uninstall brewdoc`. pip leaves dependencies; remove the dedicated virtual
90
- environment when no longer needed. uvx uses temporary cached environments, adds no
91
- persistent PATH command and needs no tool uninstall. Choose another exact version to update.
92
-
93
- ### Standalone and npm
94
-
95
- The links and commands below work when the named release is published and its
96
- native/public consumer checks pass. Check the
97
- [release guide](https://github.com/kochetkov-ma/brewdoc/releases/tag/v0.3.1)
98
- for that version's accepted channels and targets. Download badges select assets;
99
- they do not establish runtime acceptance. The npm badge shows the registry version.
100
- Existing 0.2.0/0.3.0 releases contain Python wheel/sdist archives only.
101
-
102
- [![npm](https://img.shields.io/npm/v/brewdoc)](https://www.npmjs.com/package/brewdoc)
103
- [![Linux x64 download](https://img.shields.io/badge/Linux_x64-download-blue)](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-linux-x64.tar.gz)
104
- [![Windows x64 download](https://img.shields.io/badge/Windows_x64-download-blue)](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-windows-x64.zip)
105
- [![macOS ARM64 download](https://img.shields.io/badge/macOS_ARM64-download-blue)](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-macos-arm64.tar.gz)
106
-
107
- | Native target | Version-specific download | Verification target | JavaScript |
108
- |---|---|---|---|
109
- | Linux x86_64, glibc | [Linux archive](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-linux-x64.tar.gz) | Ubuntu 22.04, glibc 2.35 | Bundled; requires target acceptance |
110
- | Windows x86_64 | [Windows archive](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-windows-x64.zip) | Windows Server 2025 | Refused before requests |
111
- | macOS ARM64 | [macOS archive](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/brewdoc-0.3.1-macos-arm64.tar.gz) | macOS 15, Apple Silicon | Bundled; requires target acceptance |
112
-
113
- Download [SHA256SUMS](https://github.com/kochetkov-ma/brewdoc/releases/download/v0.3.1/SHA256SUMS)
114
- beside the archive. Compare its SHA-256 before extraction with `sha256sum ARCHIVE`
115
- on Linux, `shasum -a 256 ARCHIVE` on macOS or `Get-FileHash ARCHIVE -Algorithm SHA256`
116
- in PowerShell. Keep the complete brewdoc directory, including _internal and licenses.
117
- Read brewdoc/version.json for version/source/target, then run
118
- `./brewdoc/brewdoc --self-check` or `.\brewdoc\brewdoc.exe --self-check` and use that
119
- executable with `file.pdf --out file.md`. Add its absolute directory to your shell
120
- profile or Windows user PATH for persistent use. Update by verifying and extracting
121
- a fresh complete release directory, self-checking it, then repointing PATH. Remove
122
- the dedicated directory and PATH entry to uninstall. Full download/extraction commands
123
- are in the generated guide attached to the published release.
124
-
125
- Verification targets do not establish older OS support. Linux musl/ARM64 and macOS
126
- Intel are outside this initial binary set. Windows is unsigned; macOS uses an ad hoc
127
- build signature without Developer ID/notarization. Linux uses checksums without a
128
- detached publisher signature. OS policy may prevent launch.
129
-
130
- npm requires Node 24.21.0/npm 12.2.0 for the tested flow; Python is bundled on admitted
131
- targets. Once this exact npm release is publicly verified:
132
-
133
- ```sh
134
- npm install --global brewdoc@0.3.1
135
- npm list --global brewdoc --depth=0
136
- brewdoc --self-check
137
- brewdoc file.pdf --out file.md
138
- ```
139
-
140
- Temporary cached invocation:
141
-
142
- ```sh
143
- npx --yes --package brewdoc@0.3.1 brewdoc --self-check
144
- npx --yes --package brewdoc@0.3.1 brewdoc file.pdf --out file.md
145
- ```
146
-
147
- Update with `npm install --global brewdoc@X.Y.Z` for an exact published version;
148
- remove with `npm uninstall --global brewdoc`. npx installs no persistent global tool;
149
- choose another exact version to update. Keep optional platform packages enabled.
150
- Missing packages or unsupported platforms refuse. The launcher adds no runtime downloads.
151
-
152
- Python package installations require Python >= 3.12. Base runtime dependencies: `pdfplumber` (pulls pypdfium2, Pillow,
153
- cryptography) and `python-calamine`. HTML requires CPython 3.12-3.14 and the native Lexbor
154
- parser from this exact conditional dependency:
155
-
156
- ```text
157
- selectolax==0.4.13; python_version < '3.15' and platform_python_implementation == 'CPython'
158
- ```
159
-
160
- Other runtimes retain the `.html` route and Python API but explicitly refuse HTML. On supported
161
- CPython, a missing or broken parser is an environment failure and `--self-check` exits 1.
162
- On an unsupported HTML runtime, self-check verifies HTML refusal and checks all other formats.
163
-
164
- Version 0.3.0 includes URL acquisition and optional JavaScript capture.
165
- Install the extra with `python -m pip install 'brewdoc[render-js]==0.3.1'`. It uses QuickJS-ng 0.17.0.1
166
- and bundled LinkeDOM 0.18.13. From this source checkout, install the locked extra
167
- with `uv sync --locked --extra render-js`. Run it with
168
- `uv run --locked --extra render-js brewdoc --url URL --render-js`.
169
- Python and standalone invocations need no Node or browser engine. npm/npx use Node
170
- as a launcher; no invocation downloads runtime components.
171
-
172
- ## Usage
173
-
174
- ```
175
- brewdoc file.pdf --out file.md
176
- brewdoc slides.pptx --out slides.md
177
- brewdoc book.epub --out book.md
178
- brewdoc page.html --out page.md
179
- brewdoc --url https://example.com/article --out article.md
180
- brewdoc --url https://example.com/article --render-js --timeout 30 --out article.md
181
- brewdoc file.xlsx # no --out: receipt line, then the Markdown, on stdout
182
- brewdoc file.xlsx --sheet Calc --sheet Inputs
183
- brewdoc file.xlsm --artifact formula/sheet/000002=formulas.json
184
- brewdoc file.xlsm --artifact vba/project/000001=vbaProject.bin
185
- brewdoc --self-check # renders synthetic fixtures twice, compares sha256, exit 0 when green
186
- ```
187
-
188
- `--sheet` is repeatable. Names are exact and case-sensitive. Output follows caller order while
189
- keeping each sheet's full-workbook ordinal. `--artifact` is also repeatable. Use keys listed in the
190
- Markdown artifact table. Both options are workbook-only. brewdoc validates every request and
191
- output collision before writing.
192
-
193
- URL mode accepts one public HTTP(S) HTML page with strict UTF-8 decoding. Initial
194
- page acquisition uses GET, verified TLS and default ports only. Private destinations, URL credentials
195
- and HTTPS downgrades are refused; proxy environment settings are ignored. Each redirect and
196
- resource is validated. Acquisition allows at most five redirects and an 8 MiB
197
- body limit. `--timeout SECONDS` sets one maximum waiting budget for loading and
198
- optional JS, default 30 seconds. It accepts positive finite seconds within the
199
- supported clock range and returns earlier when ready. Increase it for pages
200
- that need longer loading or JS waiting.
201
- Bounded cleanup and local conversion can add time after waiting ends.
202
- No login, cookie profile or bot bypass is offered.
203
- Local files and default static URL capture do not execute JavaScript.
204
-
205
- `--render-js` explicitly executes the selected page's scripts locally in a separate
206
- process with bounded APIs and resources. No filesystem or shell APIs are exposed,
207
- and captures do not reuse browser state. This is not a general operating-system
208
- security sandbox. It supports DOM mutations, bounded jobs/timers and guarded GET
209
- requests. Async XHR also supports the public Algolia search endpoint used by
210
- hn.algolia.com, with its original string body and no cookies or user credentials.
211
- Other POST requests remain unsupported; search redirects are refused without replay.
212
- Supported module loading uses the native engine. Temporary `localStorage`
213
- starts empty for each capture; accessing it marks the result partial.
214
- Each capture starts with a writable `innerWidth` of 1024 CSS pixels.
215
- Width changes stay within that capture.
216
- It does not provide browser layout, iframe execution,
217
- workers, WebSockets, media or browser-wide compatibility. Native JS requires a
218
- verified QuickJS public ABI on macOS ARM64 or 64-bit glibc Linux (x86_64/aarch64).
219
- Windows, macOS Intel, musl Linux and 32-bit systems refuse JS. Missing components or unsupported
220
- runtimes refuse before fetching.
221
- See [URL acquisition limits](FORMATS.md#url-acquisition).
222
-
223
- URL receipts use `brewdoc.receipt/2` with redacted acquisition provenance and the
224
- frozen snapshot identity. Timing-only expiry preserves available valid content
225
- with `acquisition.capture_status=partial` and a diagnostic.
226
- The receipt distinguishes the current DOM from an explicitly marked fallback to
227
- the already acquired original HTML, where JS completion is unknown. No HTML is
228
- returned from an incomplete response. Hard network, security, heap, native fault,
229
- tamper or resource failures exit 1 and preserve an existing output file.
230
- Exit 0 confirms conversion, not script completion or article fidelity.
231
- Live acquisition can change; conversion of the same frozen snapshot remains
232
- deterministic. No 90% coverage or
233
- global JavaScript compatibility is claimed.
234
-
235
- Combining `--url` with a local path or `--self-check`, or using `--render-js` without
236
- `--url`, exits 2 before acquisition. Invalid timeout values and an explicit
237
- `--timeout` without `--url` also exit 2. URL requests with `--sheet` or `--artifact`
238
- exit 1 with an HTML refusal receipt before HTTP.
239
-
240
- Every successful document uses `brewdoc.markdown/2`. A quoted source title is followed by Metadata,
241
- Artifacts, Known omissions, Contents, then anchored content units. PDF keys are `page/000001`,
242
- workbook keys are `sheet/000001`, DOCX keys are `chapter/000001`, PPTX keys are `slide/000001`,
243
- EPUB keys follow declared spine ordinals as `chapter/000001`, and HTML has one `chapter/000001`.
244
- Metadata contains deterministic source identity, selection, content hashes, conversion tallies, and
245
- artifact capabilities. It excludes paths, timestamps, permissions, host data, and unsupported author
246
- metadata. EPUB adds source-declared publication titles, creators, languages and identifiers.
247
-
248
- For a conversion request, one JSON receipt line goes to stdout first (wrapped here, `unit_keys` omitted):
249
-
250
- ```json
251
- {"artifacts": [], "broken_ligature_words": 0, "columns_split": 1,
252
- "dropped": {"cid_survivors": 0, "control_chars": 0, "ligatures": 0, "nbsp": 0,
253
- "non_ascii_replaced": 0, "page_numbers": 3, "pua_glyphs": 0,
254
- "running_heads": 0, "soft_hyphens": 0},
255
- "file_ok": true, "markdown_schema": "brewdoc.markdown/2",
256
- "not_carried": ["images, figures and the text drawn inside them",
257
- "a table that spans a page break",
258
- "text rotated out of the horizontal reading order"],
259
- "out": "file.md",
260
- "reason": "pdf rendered: 7 pages, 1 tables, 26 text regions, 1 column splits",
261
- "receipt_schema": "brewdoc.receipt/1",
262
- "route": "pdf", "source": "nist-sp800-145.pdf", "tables": 1,
263
- "text_regions": 26, "unit_kind": "page", "units": 7}
264
- ```
265
-
266
- | key | meaning |
267
- |---|---|
268
- | `file_ok`, `reason` | `false` when the file was refused (no text layer, unreadable, unsupported suffix); `reason` names why, or summarises what was rendered |
269
- | `route` | which reader ran: `pdf`, `doc`, `presentation`, `sheet`, `epub` or `html` |
270
- | `source` | the local filename, or the redacted requested URL in URL mode |
271
- | `unit_kind`, `units` | the route's content unit and how many were rendered; one pair for every format. `page` for PDF, `chapter` for DOCX, EPUB and HTML, `slide` for PPTX, `sheet` for a workbook, and `none` on a suffix brewdoc does not read |
272
- | `tables`, `text_regions`, `columns_split` | what else was rendered |
273
- | `receipt_schema` | the receipt key contract; `brewdoc.receipt/1` replaced the per-format `pages` and `sheets` counters |
274
- | `broken_ligature_words` | words with a ligature the font mapped to a stray code point, folded to ASCII, not repaired |
275
- | `dropped` | sanitised items removed on purpose, counted by kind (running heads, page numbers, ...) |
276
- | `not_carried` | what this route structurally cannot represent - read it before concluding a fact is absent |
277
- | `out` | the Markdown path, or `null` when it went to stdout |
278
- | `markdown_schema`, `unit_keys` | the contract and ordered full-source content keys; success only |
279
- | `artifacts` | available keyed formula or opaque VBA outputs and requested output paths; success only |
280
- | `selected_sheets` | the `--sheet` names in caller order; present only when sheets were selected |
281
-
282
- Paths resolve against the current working directory; `--out` creates parent directories.
283
- Exit code is non-zero on refusal; the receipt line is still printed.
284
-
285
- ## Formats
286
-
287
- | in | reader | notes |
288
- |---|---|---|
289
- | `.pdf` | pdfplumber | needs a text layer; route chosen per region, never per page |
290
- | `.docx` | stdlib zip + XML | paragraphs and tables |
291
- | `.pptx` | stdlib zip + XML | slides in declared order; text, tables, notes and picture metadata |
292
- | `.epub` | stdlib zip + XML | EPUB 2/3 static XHTML in declared spine order; Unicode metadata and navigation |
293
- | `.xlsx` `.xlsm` `.xls` `.xlsb` `.ods` | python-calamine | selected sheets keep full-source ordinals; numbers as stored (`85.0`), dates as ISO days |
294
- | `.html` | selectolax Lexbor | full static body or fragment, complete tables and source-declared controls; CPython 3.12-3.14 |
295
-
296
- `.xlsx` and `.xlsm` expose original OOXML formulas as one deterministic JSON artifact per
297
- formula-bearing selected sheet. Markdown still contains cached values. `.xlsm` and `.xlsb` can expose
298
- one complete related `vbaProject.bin` as opaque bytes. brewdoc does not execute macros, decompile VBA,
299
- report source-module counts, evaluate formulas, or infer dependency graphs.
300
-
301
- HTML reads local strict UTF-8, with an optional BOM. It preserves meaningful Unicode, navigation,
302
- main content, sidebars and footers in recovered DOM order. It never fetches links or resources,
303
- executes scripts, submits forms or infers interactive values. Links use a restricted scheme policy;
304
- form actions remain inert metadata. Inline code outside tables becomes a literal fenced block;
305
- surrounding emphasis and links remain balanced. Safe links in literal code and around code/images
306
- retain destination records without changing the source literals. Table-cell code uses labelled
307
- escaped text. Quotes and list items containing standalone child blocks use explicit nesting
308
- boundaries in place of visual Markdown
309
- containers. Plain list paragraphs retain their item marker and continuation indentation.
310
- See [HTML scope and limits](FORMATS.md#static-html).
311
-
312
- EPUB reads one package with static XHTML in EPUB 2 or 3. Each declared spine item becomes
313
- a chapter, including empty and non-linear items, front matter and back matter. Publication
314
- navigation retains source hierarchy and links to generated chapter and fragment anchors.
315
- Declared metadata and meaningful Unicode are preserved. Images remain inert alt/title/target
316
- records; no pixels or external resources are read. EPUB adds no parser dependency.
317
- Malformed required content, unsafe archives, unavailable navigation targets, encrypted reading
318
- text, declared fixed layout and unsupported required media without an XHTML fallback refuse
319
- the whole book before output writes. Multiple rootfiles are outside this supported profile.
320
- See [EPUB scope and limits](FORMATS.md#epub).
321
-
322
- The public Python API exposes EPUB, HTML and presentation rendering and generic workbook artifact access:
323
-
324
- ```python
325
- import brewdoc
326
-
327
- markdown, tally = brewdoc.render_epub("book.epub")
328
- code, receipt, markdown = brewdoc.run("book.epub", out="book.md")
329
- markdown, tally = brewdoc.render_html("page.html")
330
- code, receipt, markdown = brewdoc.run("page.html", out="page.md")
331
- markdown, tally = brewdoc.render_presentation("slides.pptx")
332
- refs = brewdoc.list_book_artifacts("book.xlsm", sheets=("Calc",))
333
- payload = brewdoc.read_book_artifact("book.xlsm", refs[0].key, sheets=("Calc",))
334
- code, receipt, markdown = brewdoc.run(
335
- "book.xlsm", out="book.md", sheets=("Calc",),
336
- artifact_outputs={refs[0].key: "formulas.json"},
337
- )
338
- ```
339
-
340
- `artifact_outputs` maps artifact keys to paths. The CLI builds it from repeated `--artifact KEY=PATH`.
341
-
342
- CSV and TSV are intentionally unsupported and are not planned. LLMs can read their text tables
343
- directly, so brewdoc does not convert them to Markdown.
344
-
345
- Planned formats, excluded ones, deferred ones and the never-list: `FORMATS.md`.
346
- A planned format is refused by name today. The adapter contract and the ordered checklist for
347
- adding one are in [`docs/architecture.md`](docs/architecture.md).
348
-
349
- PDF regions, in the order tried:
350
-
351
- | region looks like | rendered as |
352
- |---|---|
353
- | ruled on all sides | Markdown table from the drawn ruling |
354
- | ruling unfinished (cells never closed) | source baselines recovered as logical rows on the inferred structural grid |
355
- | ruled across only (head and foot rules) | column grid from the rule segment ends |
356
- | unruled, tabular band | layout-preserved text |
357
- | unruled, captioned `Table N` | the band is bounded first (caption to next blank band), then read as a table |
358
- | two-column prose | split at the gutter (relative density on the character x-histogram), left then right |
359
- | plain prose | lines |
360
-
361
- ## What it does not do
362
-
363
- | gap | behaviour |
364
- |---|---|
365
- | OCR | a PDF with no text layer is refused by name, never rendered empty |
366
- | PDF and DOCX images, figures, text drawn inside them | not carried; listed in `not_carried` |
367
- | PPTX pictures | represented by deterministic name, size, alt text, caption, source and byte-count placeholders; pixels are never emitted |
368
- | EPUB layout, scripts, media and graphics | CSS, pagination, font rendering, scripts, active media, image pixels and unsupported SVG/MathML semantics are omitted |
369
- | PPTX charts, SmartArt, audio, video and embedded objects | not carried; listed in `not_carried` |
370
- | a table spanning a page break | columns recovered, wrapped rows stay separate rows |
371
- | text rotated out of horizontal reading order | not carried |
372
- | sub/superscripts | folded back into their line (`NH4H2PO4`, not `NHHPO` over `4 2 4`) |
373
- | broken font CMaps (ligatures mapped to wrong code points) | counted (`broken_ligature_words`), folded to ASCII, never guessed back |
374
- | formula calculation | cached values in Markdown; passive source formulas only for `.xlsx` and `.xlsm` |
375
- | readable VBA source | unavailable; `.xlsm` and `.xlsb` preserve a related project only as opaque bytes |
376
-
377
- ## Determinism
378
-
379
- No timestamps or unordered iteration. Two renders of one file have the same sha256;
380
- `--self-check` pins it. PDF, DOCX, PPTX and workbook output remains ASCII. HTML and EPUB Markdown use
381
- UTF-8 without BOM and LF newlines, with the same bytes in the API, file output and CLI stdout.
382
- Receipt JSON keeps ASCII escaping.
383
-
384
- ## Size and speed
385
-
386
- These measurements cover the existing PDF/workbook baseline before the HTML parser addition.
387
- They do not measure HTML or EPUB conversion or the new installed footprint.
388
-
389
- | measure | value |
390
- |---|---|
391
- | installed footprint | ~45 MB (pdfplumber, pypdfium2, Pillow, cryptography, python-calamine) |
392
- | import | 0.08 s |
393
- | 130-page PDF | ~5.5 s |
394
- | 14-sheet xlsx | ~0.9 s |
395
-
396
- ## Benchmarks
397
-
398
- Browse the [corpus catalog](benchmarks/CATALOG.md), follow the
399
- [measurement method](benchmarks/METHODOLOGY.md), and inspect the
400
- [full-run results](benchmarks/results/README.md). Completed runs include actual
401
- outputs and known failures; capture completion does not mean content quality passed.
402
-
403
- ## Releasing
404
-
405
- Tag-triggered, see `RELEASING.md`.
406
- Coding agents can start with the compact [llms.txt](llms.txt) guide. It does not imply
407
- automatic discovery by any client.
408
-
409
- ## License
410
-
411
- MIT, see `LICENSE`.
@@ -1 +0,0 @@
1
- {"timestamp":{"secs_since_epoch":1791747921,"nanos_since_epoch":303598638},"commit":null,"tags":null,"env":{},"directories":{}}