md-chunk-lite 1.0.0__tar.gz

md_chunk_lite-1.0.0/CHANGELOG.md

@@ -0,0 +1,12 @@
+# Changelog
+
+What changed in md-chunk-lite, newest first.
+
+## 1.0.0 - 2026-11-04
+
+- First release.
+- Splits Markdown into chunks by heading. Each chunk keeps its heading path, anchor and start and end line numbers.
+- Big sections are split at blank lines. Tables repeat their header row and code blocks get their fence again when they must be split.
+- Options: `--max-chars`, `--overlap-chars`, `--prefix-path`, `--outline` and `--json`.
+- Free MCP server with four tools: `chunk_markdown`, `outline_markdown`, `get_section` and `save_chunks_jsonl`. Start it with `uvx md-chunk-lite mcp`.
+- Needs Python 3.10 or newer.

md_chunk_lite-1.0.0/LICENSE

@@ -0,0 +1,9 @@
+MIT License
+
+Copyright (c) 2026 tidybyte
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

md_chunk_lite-1.0.0/MANIFEST.in

@@ -0,0 +1,4 @@
+include CHANGELOG.md
+include llms.txt
+include server.json
+recursive-include tests *.py *.md

md_chunk_lite-1.0.0/PKG-INFO

@@ -0,0 +1,236 @@
+Metadata-Version: 2.4
+Name: md-chunk-lite
+Version: 1.0.0
+Summary: Split Markdown into chunks by heading. Each chunk keeps its heading path and line numbers. CLI and MCP server. Runs locally.
+Author: Tidy Byte Tools
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/tidybytetools/md-chunk-lite
+Project-URL: Source, https://github.com/tidybytetools/md-chunk-lite
+Project-URL: Issues, https://github.com/tidybytetools/md-chunk-lite/issues
+Project-URL: Changelog, https://github.com/tidybytetools/md-chunk-lite/blob/main/CHANGELOG.md
+Keywords: markdown,chunking,text-splitter,rag,llm,embeddings,headings,jsonl,cli,mcp,mcp-server
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Text Processing :: Markup :: Markdown
+Classifier: Topic :: Text Processing :: Indexing
+Classifier: Topic :: Utilities
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: mcp<2,>=1.10
+Dynamic: license-file
+
+<p>
+  <a href="https://github.com/tidybytetools">
+    <picture>
+      <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/tidybytetools/md-chunk-lite/main/assets/tidybytetools-lockup-dark.png">
+      <img alt="Tidy Byte Tools" src="https://raw.githubusercontent.com/tidybytetools/md-chunk-lite/main/assets/tidybytetools-lockup-light.png" height="44">
+    </picture>
+  </a>
+</p>
+
+# md-chunk-lite
+
+[![License: MIT](https://img.shields.io/badge/license-MIT-green.svg)](https://github.com/tidybytetools/md-chunk-lite/blob/main/LICENSE)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/)
+[![MCP server](https://img.shields.io/badge/MCP-stdio-purple.svg)](#use-it-from-claude-desktop-or-cursor-mcp)
+[![Tests](https://github.com/tidybytetools/md-chunk-lite/actions/workflows/tests.yml/badge.svg)](https://github.com/tidybytetools/md-chunk-lite/actions/workflows/tests.yml)
+
+Free tool that splits Markdown into chunks by heading. Every chunk knows its heading path and the line numbers it came from.
+Need PDF, Word or web page files turned into chunks (with page numbers for PDFs), or whole folders? The paid doc2md does that: **[doc2md on Gumroad](https://tidybyte.gumroad.com/l/frlkv)**
+
+Good for AI search (RAG), embeddings, and docs bots. Plain code, not AI, so the same file always gives the same chunks. Runs on your own computer. MIT license. Python 3.10 or newer, on Windows, Mac and Linux.
+
+<!-- mcp-name: io.github.tidybytetools/md-chunk-lite -->
+
+## Install
+
+```
+pip install md-chunk-lite
+```
+
+Or use pipx, which keeps it in its own space:
+
+```
+pipx install md-chunk-lite
+```
+
+Want the newest code from GitHub instead?
+
+```
+pip install git+https://github.com/tidybytetools/md-chunk-lite
+```
+
+## Use it
+
+```
+md-chunk-lite guide.md                     # writes guide.chunks.jsonl
+md-chunk-lite docs/*.md -o all.jsonl       # many files into one file
+md-chunk-lite guide.md -o -                # print the chunks on screen
+md-chunk-lite guide.md --max-chars 800     # smaller chunks
+md-chunk-lite guide.md --outline           # just show the headings
+cat guide.md | md-chunk-lite -             # read from stdin
+```
+
+Example run:
+
+```
+Saved: guide.chunks.jsonl  (7 chunks, biggest 151 chars)
+```
+
+Each line of the `.jsonl` file is one chunk:
+
+```json
+{
+  "id": "guide.md#3",
+  "source": "guide.md",
+  "index": 3,
+  "heading_path": ["Garden Guide", "Planting", "Tomatoes"],
+  "heading_level": 3,
+  "anchor": "tomatoes",
+  "start_line": 16,
+  "end_line": 24,
+  "part": 1,
+  "parts": 1,
+  "chars": 151,
+  "text": "### Tomatoes\n\nPlant tomatoes after the last frost. Give them sun.\n\n```python\n..."
+}
+```
+
+- `heading_path`: all the headings above this chunk, from the top.
+- `anchor`: the `#link` GitHub makes for that heading, so you can link straight to it.
+- `start_line` and `end_line`: where the chunk is in the file (the first line is 1).
+- `part` and `parts`: a big section is split into parts. `part 2, parts 3` means the 2nd of 3.
+- `chars`: how long `text` is.
+
+`--outline` prints the headings:
+
+```
+Garden Guide  [line 8, #garden-guide, 14 chars]
+  Tools  [line 10, #tools, 47 chars]
+  Planting  [line 14, #planting, 11 chars]
+    Tomatoes  [line 16, #tomatoes, 151 chars]
+```
+
+When you run it in a terminal it ends with one short line about the paid doc2md. `--quiet` turns it off, and it never shows when output is piped or redirected.
+
+## How it splits
+
+1. Each heading starts a new section. A chunk never mixes two sections, so every chunk has one clear heading path.
+2. A small section becomes one chunk. Its text is copied straight from your file, so the line numbers match.
+3. A big section is split at blank lines. Lists, tables and code blocks stay whole when they fit.
+4. A table that is too big is split by rows, and each part gets the header row again.
+5. A code block that is too big is split by lines, and each part gets its own ``` fence again, with the same language.
+6. A very long line is cut at the end of a sentence, then at a space if it has to be.
+7. A heading with no text of its own (just more headings under it) does not get its own chunk, but it still shows in the `heading_path` of the chunks under it.
+
+It knows `#` headings and underlined headings (`===` and `---`). It skips headings inside code blocks and YAML front matter (the `---` block at the very top).
+
+Options:
+
+- `--max-chars N`: biggest chunk, in characters (default 1500, smallest 200). About 4 characters make 1 token in English.
+- `--overlap-chars N`: when a section is split, start each part with up to N characters from the end of the part before it (default 0). It is never added inside a code block or table, and never between two different sections.
+- `--prefix-path`: start each chunk's text with its heading path, like `Garden Guide > Planting > Tomatoes`. This often helps search. It counts toward `--max-chars`.
+- `--json`: print one JSON object for scripts and AI agents instead of saving a file.
+
+## Known limits
+
+- **Sizes are characters, not tokens.** It does not load a tokenizer.
+- **Markdown and plain text only.** PDF, Word and HTML are not read. The paid doc2md turns those into chunks (with page numbers for PDFs).
+- **No folders.** Give it files (your shell can expand `docs/*.md`). The paid doc2md walks whole folders.
+- **Not a full Markdown parser.** A heading inside an HTML block, or an underlined heading that spans more than one line, may be handled wrong.
+- **Overlap uses whole words** from the part before, so it can be a little shorter than you asked for.
+
+## Lite vs paid
+
+| | md-chunk-lite (free) | [doc2md](https://tidybyte.gumroad.com/l/frlkv) (paid) |
+|---|---|---|
+| Reads | Markdown and text files | PDF, Word (.docx) and HTML |
+| Chunks with the heading path | yes | yes |
+| Line numbers and anchors | yes | no (page numbers for PDFs instead) |
+| Rough token count on each chunk | no | yes |
+| Whole folders, sub-folders too | no | yes |
+| MCP server | yes | no |
+
+## Other good free tools
+
+Pick what fits you. If you already use LangChain, its `MarkdownHeaderTextSplitter` also splits by heading. [Chonkie](https://github.com/feyninc/chonkie) and [semchunk](https://github.com/isaacus-dev/semchunk) split any text by token count. md-chunk-lite is small, MIT, has no AI or tokenizer parts, gives you line numbers and anchors, and has an MCP server built in.
+
+## Use it from Claude Desktop or Cursor (MCP)
+
+There is a small free MCP server built in. It needs [uv](https://docs.astral.sh/uv/).
+
+Run it by hand to check it starts (it waits quietly for an app to talk to it):
+
+```
+uvx md-chunk-lite mcp
+```
+
+Claude Desktop (`claude_desktop_config.json`) or Cursor (`~/.cursor/mcp.json`):
+
+```json
+{
+  "mcpServers": {
+    "md-chunk-lite": {
+      "command": "uvx",
+      "args": ["md-chunk-lite", "mcp"]
+    }
+  }
+}
+```
+
+`uvx --from md-chunk-lite md-chunk-lite-mcp` starts the same server.
+
+Tools (each one takes a file `path` or Markdown `text`):
+
+| Tool | What it does | Changes files? |
+|---|---|---|
+| `chunk_markdown` | Splits into chunks. Returns 100 at a time; use `start` for more. | No |
+| `outline_markdown` | Lists the headings with line numbers and anchors. | No |
+| `get_section` | Gets one section by heading or anchor. | No |
+| `save_chunks_jsonl` | Saves the chunks to a `.jsonl` file. | Writes one `.jsonl` file (replaces it if it is there) |
+
+None of them use the internet.
+
+## For AI agents
+
+- **Use when:** you have a Markdown or text file (docs, notes, a README) and need chunks with heading paths and line numbers for search, embeddings or citing sources. Use `outline_markdown` and `get_section` to read just one part of a long file.
+- **Don't use when:** the file is PDF, Word or HTML (convert it first), or you need token-exact sizes.
+- **Input:** a file path or Markdown text, plus `max_chars` (default 1500), `overlap_chars` (default 0) and `prefix_path` (default false).
+- **Output:** chunks with `id`, `source`, `index`, `heading_path`, `heading_level`, `anchor`, `start_line`, `end_line`, `part`, `parts`, `chars`, `text`.
+- CLI exit code is 0 on success and 1 on error (message on stderr, or `{"ok": false, "error": ...}` with `--json`). See also [`llms.txt`](https://github.com/tidybytetools/md-chunk-lite/blob/main/llms.txt).
+
+## Python
+
+```python
+from md_chunk_lite import chunk_file, chunk_markdown, outline, get_section
+
+chunks = chunk_file("guide.md", max_chars=1000)
+for c in chunks:
+    print(c["heading_path"], c["start_line"], c["end_line"])
+
+install = get_section(open("README.md").read(), heading="Install")
+```
+
+The chunker file uses only Python's standard library. Installing with pip also adds the `mcp` package for the MCP server.
+
+## Tests
+
+```
+pip install "mcp>=1.10,<2"
+python3 -m unittest discover -s tests
+```
+
+The MCP tests are skipped if `mcp` is not installed.
+
+## License
+
+MIT. See `LICENSE`.

md_chunk_lite-1.0.0/README.md

@@ -0,0 +1,206 @@
+<p>
+  <a href="https://github.com/tidybytetools">
+    <picture>
+      <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/tidybytetools/md-chunk-lite/main/assets/tidybytetools-lockup-dark.png">
+      <img alt="Tidy Byte Tools" src="https://raw.githubusercontent.com/tidybytetools/md-chunk-lite/main/assets/tidybytetools-lockup-light.png" height="44">
+    </picture>
+  </a>
+</p>
+
+# md-chunk-lite
+
+[![License: MIT](https://img.shields.io/badge/license-MIT-green.svg)](https://github.com/tidybytetools/md-chunk-lite/blob/main/LICENSE)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/)
+[![MCP server](https://img.shields.io/badge/MCP-stdio-purple.svg)](#use-it-from-claude-desktop-or-cursor-mcp)
+[![Tests](https://github.com/tidybytetools/md-chunk-lite/actions/workflows/tests.yml/badge.svg)](https://github.com/tidybytetools/md-chunk-lite/actions/workflows/tests.yml)
+
+Free tool that splits Markdown into chunks by heading. Every chunk knows its heading path and the line numbers it came from.
+Need PDF, Word or web page files turned into chunks (with page numbers for PDFs), or whole folders? The paid doc2md does that: **[doc2md on Gumroad](https://tidybyte.gumroad.com/l/frlkv)**
+
+Good for AI search (RAG), embeddings, and docs bots. Plain code, not AI, so the same file always gives the same chunks. Runs on your own computer. MIT license. Python 3.10 or newer, on Windows, Mac and Linux.
+
+<!-- mcp-name: io.github.tidybytetools/md-chunk-lite -->
+
+## Install
+
+```
+pip install md-chunk-lite
+```
+
+Or use pipx, which keeps it in its own space:
+
+```
+pipx install md-chunk-lite
+```
+
+Want the newest code from GitHub instead?
+
+```
+pip install git+https://github.com/tidybytetools/md-chunk-lite
+```
+
+## Use it
+
+```
+md-chunk-lite guide.md                     # writes guide.chunks.jsonl
+md-chunk-lite docs/*.md -o all.jsonl       # many files into one file
+md-chunk-lite guide.md -o -                # print the chunks on screen
+md-chunk-lite guide.md --max-chars 800     # smaller chunks
+md-chunk-lite guide.md --outline           # just show the headings
+cat guide.md | md-chunk-lite -             # read from stdin
+```
+
+Example run:
+
+```
+Saved: guide.chunks.jsonl  (7 chunks, biggest 151 chars)
+```
+
+Each line of the `.jsonl` file is one chunk:
+
+```json
+{
+  "id": "guide.md#3",
+  "source": "guide.md",
+  "index": 3,
+  "heading_path": ["Garden Guide", "Planting", "Tomatoes"],
+  "heading_level": 3,
+  "anchor": "tomatoes",
+  "start_line": 16,
+  "end_line": 24,
+  "part": 1,
+  "parts": 1,
+  "chars": 151,
+  "text": "### Tomatoes\n\nPlant tomatoes after the last frost. Give them sun.\n\n```python\n..."
+}
+```
+
+- `heading_path`: all the headings above this chunk, from the top.
+- `anchor`: the `#link` GitHub makes for that heading, so you can link straight to it.
+- `start_line` and `end_line`: where the chunk is in the file (the first line is 1).
+- `part` and `parts`: a big section is split into parts. `part 2, parts 3` means the 2nd of 3.
+- `chars`: how long `text` is.
+
+`--outline` prints the headings:
+
+```
+Garden Guide  [line 8, #garden-guide, 14 chars]
+  Tools  [line 10, #tools, 47 chars]
+  Planting  [line 14, #planting, 11 chars]
+    Tomatoes  [line 16, #tomatoes, 151 chars]
+```
+
+When you run it in a terminal it ends with one short line about the paid doc2md. `--quiet` turns it off, and it never shows when output is piped or redirected.
+
+## How it splits
+
+1. Each heading starts a new section. A chunk never mixes two sections, so every chunk has one clear heading path.
+2. A small section becomes one chunk. Its text is copied straight from your file, so the line numbers match.
+3. A big section is split at blank lines. Lists, tables and code blocks stay whole when they fit.
+4. A table that is too big is split by rows, and each part gets the header row again.
+5. A code block that is too big is split by lines, and each part gets its own ``` fence again, with the same language.
+6. A very long line is cut at the end of a sentence, then at a space if it has to be.
+7. A heading with no text of its own (just more headings under it) does not get its own chunk, but it still shows in the `heading_path` of the chunks under it.
+
+It knows `#` headings and underlined headings (`===` and `---`). It skips headings inside code blocks and YAML front matter (the `---` block at the very top).
+
+Options:
+
+- `--max-chars N`: biggest chunk, in characters (default 1500, smallest 200). About 4 characters make 1 token in English.
+- `--overlap-chars N`: when a section is split, start each part with up to N characters from the end of the part before it (default 0). It is never added inside a code block or table, and never between two different sections.
+- `--prefix-path`: start each chunk's text with its heading path, like `Garden Guide > Planting > Tomatoes`. This often helps search. It counts toward `--max-chars`.
+- `--json`: print one JSON object for scripts and AI agents instead of saving a file.
+
+## Known limits
+
+- **Sizes are characters, not tokens.** It does not load a tokenizer.
+- **Markdown and plain text only.** PDF, Word and HTML are not read. The paid doc2md turns those into chunks (with page numbers for PDFs).
+- **No folders.** Give it files (your shell can expand `docs/*.md`). The paid doc2md walks whole folders.
+- **Not a full Markdown parser.** A heading inside an HTML block, or an underlined heading that spans more than one line, may be handled wrong.
+- **Overlap uses whole words** from the part before, so it can be a little shorter than you asked for.
+
+## Lite vs paid
+
+| | md-chunk-lite (free) | [doc2md](https://tidybyte.gumroad.com/l/frlkv) (paid) |
+|---|---|---|
+| Reads | Markdown and text files | PDF, Word (.docx) and HTML |
+| Chunks with the heading path | yes | yes |
+| Line numbers and anchors | yes | no (page numbers for PDFs instead) |
+| Rough token count on each chunk | no | yes |
+| Whole folders, sub-folders too | no | yes |
+| MCP server | yes | no |
+
+## Other good free tools
+
+Pick what fits you. If you already use LangChain, its `MarkdownHeaderTextSplitter` also splits by heading. [Chonkie](https://github.com/feyninc/chonkie) and [semchunk](https://github.com/isaacus-dev/semchunk) split any text by token count. md-chunk-lite is small, MIT, has no AI or tokenizer parts, gives you line numbers and anchors, and has an MCP server built in.
+
+## Use it from Claude Desktop or Cursor (MCP)
+
+There is a small free MCP server built in. It needs [uv](https://docs.astral.sh/uv/).
+
+Run it by hand to check it starts (it waits quietly for an app to talk to it):
+
+```
+uvx md-chunk-lite mcp
+```
+
+Claude Desktop (`claude_desktop_config.json`) or Cursor (`~/.cursor/mcp.json`):
+
+```json
+{
+  "mcpServers": {
+    "md-chunk-lite": {
+      "command": "uvx",
+      "args": ["md-chunk-lite", "mcp"]
+    }
+  }
+}
+```
+
+`uvx --from md-chunk-lite md-chunk-lite-mcp` starts the same server.
+
+Tools (each one takes a file `path` or Markdown `text`):
+
+| Tool | What it does | Changes files? |
+|---|---|---|
+| `chunk_markdown` | Splits into chunks. Returns 100 at a time; use `start` for more. | No |
+| `outline_markdown` | Lists the headings with line numbers and anchors. | No |
+| `get_section` | Gets one section by heading or anchor. | No |
+| `save_chunks_jsonl` | Saves the chunks to a `.jsonl` file. | Writes one `.jsonl` file (replaces it if it is there) |
+
+None of them use the internet.
+
+## For AI agents
+
+- **Use when:** you have a Markdown or text file (docs, notes, a README) and need chunks with heading paths and line numbers for search, embeddings or citing sources. Use `outline_markdown` and `get_section` to read just one part of a long file.
+- **Don't use when:** the file is PDF, Word or HTML (convert it first), or you need token-exact sizes.
+- **Input:** a file path or Markdown text, plus `max_chars` (default 1500), `overlap_chars` (default 0) and `prefix_path` (default false).
+- **Output:** chunks with `id`, `source`, `index`, `heading_path`, `heading_level`, `anchor`, `start_line`, `end_line`, `part`, `parts`, `chars`, `text`.
+- CLI exit code is 0 on success and 1 on error (message on stderr, or `{"ok": false, "error": ...}` with `--json`). See also [`llms.txt`](https://github.com/tidybytetools/md-chunk-lite/blob/main/llms.txt).
+
+## Python
+
+```python
+from md_chunk_lite import chunk_file, chunk_markdown, outline, get_section
+
+chunks = chunk_file("guide.md", max_chars=1000)
+for c in chunks:
+    print(c["heading_path"], c["start_line"], c["end_line"])
+
+install = get_section(open("README.md").read(), heading="Install")
+```
+
+The chunker file uses only Python's standard library. Installing with pip also adds the `mcp` package for the MCP server.
+
+## Tests
+
+```
+pip install "mcp>=1.10,<2"
+python3 -m unittest discover -s tests
+```
+
+The MCP tests are skipped if `mcp` is not installed.
+
+## License
+
+MIT. See `LICENSE`.

md_chunk_lite-1.0.0/llms.txt

@@ -0,0 +1,21 @@
+# md-chunk-lite
+
+> Free, MIT-licensed tool that splits Markdown into chunks by heading for RAG, embeddings and search. Every chunk keeps its heading path, GitHub-style anchor, and 1-based start and end line numbers. Deterministic (no AI, no tokenizer). Runs offline. Has a CLI, a Python API and a stdio MCP server.
+
+- Install: `pip install md-chunk-lite` (or from GitHub: `pip install git+https://github.com/tidybytetools/md-chunk-lite`)
+- CLI: `md-chunk-lite FILE... [-o out.jsonl | -o -] [--max-chars 1500] [--overlap-chars 0] [--prefix-path] [--outline] [--json]`. Default output is FILE.chunks.jsonl. `-` reads stdin. Exit 0 ok, 1 error.
+- Chunk fields: id, source, index, heading_path (list), heading_level (0 = text before the first heading), anchor, start_line, end_line, part, parts, chars, text.
+- Python: `from md_chunk_lite import chunk_markdown, chunk_file, outline, get_section`.
+- MCP: `uvx md-chunk-lite mcp` (or `uvx --from md-chunk-lite md-chunk-lite-mcp`). Tools: `chunk_markdown(path|text, max_chars, overlap_chars, prefix_path, start, limit)`, `outline_markdown(path|text)`, `get_section(path|text, heading|anchor, include_subsections)` (all read-only), and `save_chunks_jsonl(path, output_path, ...)` (writes one .jsonl file).
+
+## Use when
+- You need Markdown docs, notes or READMEs split into chunks that never mix two sections, with line numbers for citing sources.
+- You want just one section of a long Markdown file (get_section) or a map of its headings (outline_markdown).
+
+## Don't use when
+- The input is PDF, Word or HTML. The paid doc2md turns PDF, Word and HTML into chunks (page numbers for PDFs) and walks folders: https://tidybyte.gumroad.com/l/frlkv
+- You need sizes measured in tokens. Sizes here are characters.
+
+## Links
+- [README](https://github.com/tidybytetools/md-chunk-lite/blob/main/README.md)
+- [Paid doc2md](https://tidybyte.gumroad.com/l/frlkv)