smol-html 0.1.6__tar.gz → 0.1.7__tar.gz

{smol_html-0.1.6 → smol_html-0.1.7}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: smol-html
-Version: 0.1.6
+Version: 0.1.7
 Summary: Small, dependable HTML cleaner/minifier with sensible defaults
 Project-URL: Homepage, https://github.com/NosibleAI/smol-html
 Project-URL: Repository, https://github.com/NosibleAI/smol-html
@@ -35,6 +35,21 @@ Description-Content-Type: text/markdown
 
 Small, dependable HTML cleaner/minifier with sensible defaults.
 
+---
+
+## Credits
+
+This package is built on top of excellent open-source projects:
+
+- [**minify-html**](https://github.com/wilsonzlin/minify-html) (MIT License) – High-performance HTML minifier.
+- [**lxml**](https://lxml.de/) (BSD-like License) – Fast and feature-rich XML/HTML parsing and cleaning.
+- [**BeautifulSoup4**](https://www.crummy.com/software/BeautifulSoup/) (MIT License) – Python library for parsing and navigating HTML/XML.
+- [**Brotli**](https://github.com/google/brotli) (MIT License) – Compression algorithm developed by Google.
+
+We are grateful to the maintainers and contributors of these projects — `smol-html` wouldn’t be possible without their work.
+
+---
+
 ## Motivation
 
 Nosible is a search engine, which means we need to store and process a very large number of webpages. To make this tractable, we strip out visual chrome and other non-essential components that don’t matter for downstream tasks (indexing, ranking, retrieval, and LLM pipelines) while preserving the important content and structure. This package cleans and minifies HTML, greatly reducing size on disk; combined with Brotli compression (by Google), the savings are even larger.

{smol_html-0.1.6 → smol_html-0.1.7}/README.md

@@ -5,6 +5,21 @@
 
 Small, dependable HTML cleaner/minifier with sensible defaults.
 
+---
+
+## Credits
+
+This package is built on top of excellent open-source projects:
+
+- [**minify-html**](https://github.com/wilsonzlin/minify-html) (MIT License) – High-performance HTML minifier.
+- [**lxml**](https://lxml.de/) (BSD-like License) – Fast and feature-rich XML/HTML parsing and cleaning.
+- [**BeautifulSoup4**](https://www.crummy.com/software/BeautifulSoup/) (MIT License) – Python library for parsing and navigating HTML/XML.
+- [**Brotli**](https://github.com/google/brotli) (MIT License) – Compression algorithm developed by Google.
+
+We are grateful to the maintainers and contributors of these projects — `smol-html` wouldn’t be possible without their work.
+
+---
+
 ## Motivation
 
 Nosible is a search engine, which means we need to store and process a very large number of webpages. To make this tractable, we strip out visual chrome and other non-essential components that don’t matter for downstream tasks (indexing, ranking, retrieval, and LLM pipelines) while preserving the important content and structure. This package cleans and minifies HTML, greatly reducing size on disk; combined with Brotli compression (by Google), the savings are even larger.
@@ -17,22 +32,22 @@ Nosible is a search engine, which means we need to store and process a very larg
 pip install smol-html
 ```
 
-### ⚡ Installing with uv 
-
-```bash
-uv pip install smol-html
-```
-
-### Requirements
-
-- Python: 3.9
-- Dependencies:
-  - beautifulsoup4>=4.0.1
-  - brotli>=0.5.2
-  - lxml[html-clean]>=1.3.2
-  - minify-html>=0.2.6
-
-## Quick Start
+### ⚡ Installing with uv 
+
+```bash
+uv pip install smol-html
+```
+
+### Requirements
+
+- Python: 3.9
+- Dependencies:
+  - beautifulsoup4>=4.0.1
+  - brotli>=0.5.2
+  - lxml[html-clean]>=1.3.2
+  - minify-html>=0.2.6
+
+## Quick Start
 
 Clean an HTML string (or page contents):
 
@@ -93,58 +108,58 @@ cleaner = SmolHtmlCleaner(
 out = cleaner.make_smol(raw_html="<p>Hi</p>")
 ```
 
-## Compressed Bytes Output
-
-Produce compressed bytes using Brotli with `make_smol_bytes`.
-
-- By default, the compressed bytes are URL-safe Base64 encoded (`base64_encode=True`).
-- If you enable Base64, you must decode before Brotli-decompressing.
-- You can disable Base64 by passing `base64_encode=False` and decompress directly.
-
-Default (Base64-encoded) output:
-
-```python
-from smol_html import SmolHtmlCleaner
-import base64
-import brotli  # only needed if you want to decompress here in the example
-
-html = """
-<html>
-  <body>
-    <div>  Hello <span> world </span> </div>
-  </body>
-</html>
-"""
-
-cleaner = SmolHtmlCleaner()
-
-# Get compressed bytes (quality 11 is strong compression)
-compressed = cleaner.make_smol_bytes(raw_html=html, compression_level=11)
-
-# Because Base64 is enabled by default, decode before decompressing
-decoded = base64.urlsafe_b64decode(compressed)
-decompressed = brotli.decompress(decoded).decode("utf-8")
-print(decompressed)
-
-# Or write Base64-encoded compressed output directly to a file
-with open("page.html.br.b64", "wb") as f:
-    f.write(compressed)
-```
-
-Disable Base64 and decompress directly:
-
-```python
-from smol_html import SmolHtmlCleaner
-import brotli
-
-cleaner = SmolHtmlCleaner()
-compressed_raw = cleaner.make_smol_bytes(
-    raw_html="<p>Hi</p>",
-    compression_level=11,
-    base64_encode=False,
-)
-print(brotli.decompress(compressed_raw).decode("utf-8"))
-```
+## Compressed Bytes Output
+
+Produce compressed bytes using Brotli with `make_smol_bytes`.
+
+- By default, the compressed bytes are URL-safe Base64 encoded (`base64_encode=True`).
+- If you enable Base64, you must decode before Brotli-decompressing.
+- You can disable Base64 by passing `base64_encode=False` and decompress directly.
+
+Default (Base64-encoded) output:
+
+```python
+from smol_html import SmolHtmlCleaner
+import base64
+import brotli  # only needed if you want to decompress here in the example
+
+html = """
+<html>
+  <body>
+    <div>  Hello <span> world </span> </div>
+  </body>
+</html>
+"""
+
+cleaner = SmolHtmlCleaner()
+
+# Get compressed bytes (quality 11 is strong compression)
+compressed = cleaner.make_smol_bytes(raw_html=html, compression_level=11)
+
+# Because Base64 is enabled by default, decode before decompressing
+decoded = base64.urlsafe_b64decode(compressed)
+decompressed = brotli.decompress(decoded).decode("utf-8")
+print(decompressed)
+
+# Or write Base64-encoded compressed output directly to a file
+with open("page.html.br.b64", "wb") as f:
+    f.write(compressed)
+```
+
+Disable Base64 and decompress directly:
+
+```python
+from smol_html import SmolHtmlCleaner
+import brotli
+
+cleaner = SmolHtmlCleaner()
+compressed_raw = cleaner.make_smol_bytes(
+    raw_html="<p>Hi</p>",
+    compression_level=11,
+    base64_encode=False,
+)
+print(brotli.decompress(compressed_raw).decode("utf-8"))
+```
 
 ## Parameter Reference
 
@@ -179,7 +194,7 @@ To improve readability, the reference is split into two tables:
 | `safe_attrs_only` | Only allow attributes listed in `safe_attrs`. | Set `False` if you need to keep arbitrary attributes. |
 | `safe_attrs` | Allowed HTML attributes when `safe_attrs_only=True`. | Extend to keep additional attributes you trust. |
 
-### Types and Defaults
+### Types and Defaults
 
 | Parameter | Type | Default |
 |---|---|---|
@@ -204,11 +219,11 @@ To improve readability, the reference is split into two tables:
 | `kill_tags` | `set[str] &#124; None` | `None` |
 | `remove_unknown_tags` | `bool` | `True` |
 | `safe_attrs_only` | `bool` | `True` |
-| `safe_attrs` | `set[str]` | curated set |
-
-### `make_smol_bytes` Options
-
-| Parameter | Type | Default |
-|---|---|---|
-| `compression_level` | `int` | `4` |
-| `base64_encode` | `bool` | `True` |
+| `safe_attrs` | `set[str]` | curated set |
+
+### `make_smol_bytes` Options
+
+| Parameter | Type | Default |
+|---|---|---|
+| `compression_level` | `int` | `4` |
+| `base64_encode` | `bool` | `True` |

{smol_html-0.1.6 → smol_html-0.1.7}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "smol-html"
-version = "0.1.6"
+version = "0.1.7"
 description = "Small, dependable HTML cleaner/minifier with sensible defaults"
 readme = { file = "README.md", content-type = "text/markdown" }
 requires-python = ">=3.9"