smol-html 0.1.6__py3-none-any.whl → 0.1.7__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.4
|
2
2
|
Name: smol-html
|
3
|
-
Version: 0.1.
|
3
|
+
Version: 0.1.7
|
4
4
|
Summary: Small, dependable HTML cleaner/minifier with sensible defaults
|
5
5
|
Project-URL: Homepage, https://github.com/NosibleAI/smol-html
|
6
6
|
Project-URL: Repository, https://github.com/NosibleAI/smol-html
|
@@ -35,6 +35,21 @@ Description-Content-Type: text/markdown
|
|
35
35
|
|
36
36
|
Small, dependable HTML cleaner/minifier with sensible defaults.
|
37
37
|
|
38
|
+
---
|
39
|
+
|
40
|
+
## Credits
|
41
|
+
|
42
|
+
This package is built on top of excellent open-source projects:
|
43
|
+
|
44
|
+
- [**minify-html**](https://github.com/wilsonzlin/minify-html) (MIT License) – High-performance HTML minifier.
|
45
|
+
- [**lxml**](https://lxml.de/) (BSD-like License) – Fast and feature-rich XML/HTML parsing and cleaning.
|
46
|
+
- [**BeautifulSoup4**](https://www.crummy.com/software/BeautifulSoup/) (MIT License) – Python library for parsing and navigating HTML/XML.
|
47
|
+
- [**Brotli**](https://github.com/google/brotli) (MIT License) – Compression algorithm developed by Google.
|
48
|
+
|
49
|
+
We are grateful to the maintainers and contributors of these projects — `smol-html` wouldn’t be possible without their work.
|
50
|
+
|
51
|
+
---
|
52
|
+
|
38
53
|
## Motivation
|
39
54
|
|
40
55
|
Nosible is a search engine, which means we need to store and process a very large number of webpages. To make this tractable, we strip out visual chrome and other non-essential components that don’t matter for downstream tasks (indexing, ranking, retrieval, and LLM pipelines) while preserving the important content and structure. This package cleans and minifies HTML, greatly reducing size on disk; combined with Brotli compression (by Google), the savings are even larger.
|
@@ -0,0 +1,4 @@
|
|
1
|
+
smol_html-0.1.7.dist-info/METADATA,sha256=z62fJR48fIqXyaCKEFyX6_N5D9GOFf2G8JQukboEXFg,10058
|
2
|
+
smol_html-0.1.7.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
|
3
|
+
smol_html-0.1.7.dist-info/licenses/LICENSE,sha256=88yg3BujRGq8MYlWhbrzB2YMNWJaXnBck3c7l23labs,1089
|
4
|
+
smol_html-0.1.7.dist-info/RECORD,,
|
smol_html-0.1.6.dist-info/RECORD
DELETED
@@ -1,4 +0,0 @@
|
|
1
|
-
smol_html-0.1.6.dist-info/METADATA,sha256=UMpbTACIgx8ne9nQNR_Gv3CVpgaGFHHq3DzAA1o-rds,9369
|
2
|
-
smol_html-0.1.6.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
|
3
|
-
smol_html-0.1.6.dist-info/licenses/LICENSE,sha256=88yg3BujRGq8MYlWhbrzB2YMNWJaXnBck3c7l23labs,1089
|
4
|
-
smol_html-0.1.6.dist-info/RECORD,,
|
File without changes
|
File without changes
|