ssc_codegen 0.17.1__tar.gz → 0.18.0__tar.gz

{ssc_codegen-0.17.1 → ssc_codegen-0.18.0}/.gitignore

@@ -1,147 +1,147 @@
-# Byte-compiled / optimized / DLL files
-__pycache__/
-*.py[cod]
-*$py.class
-
-# C extensions / native shared libs
-*.so
-*.dll
-*.dylib
-*.exp
-*.lib
-
-# Distribution / packaging
-.Python
-build/
-develop-eggs/
-dist/
-downloads/
-eggs/
-.eggs/
-lib/
-lib64/
-parts/
-sdist/
-var/
-wheels/
-pip-wheel-metadata/
-share/python-wheels/
-.ruff_cache/
-*.egg-info/
-.installed.cfg
-*.egg
-MANIFEST
-
-# PyInstaller
-#  Usually these files are written by a python script from a template
-#  before PyInstaller builds the exe, so as to inject date/other infos into it.
-*.manifest
-*.spec
-
-# Installer logs
-pip-log.txt
-pip-delete-this-directory.txt
-
-# Unit tests / coverage reports
-htmlcov/
-.tox/
-.nox/
-.coverage
-.coverage.*
-.cache
-nosetests.xml
-coverage.xml
-*.cover
-*.py,cover
-.hypothesis/
-.pytest_cache/
-
-# Translations
-*.mo
-*.pot
-
-# Django stuff:
-*.log
-local_settings.py
-db.sqlite3
-db.sqlite3-journal
-
-# Flask stuff:
-instance/
-.webassets-cache
-
-# Scrapy stuff:
-.scrapy
-
-# Sphinx documentation
-docs/source/_build/
-
-# PyBuilder
-target/
-
-# Jupyter Notebook
-.ipynb_checkpoints
-
-# IPython
-profile_default/
-ipython_config.py
-
-# pyenv
-.python-version
-
-# pipenv
-#   According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
-#   However, in case of collaboration, if having platform-specific dependencies or dependencies
-#   having no cross-platform support, pipenv may install dependencies that don't work, or not
-#   install all needed dependencies.
-#Pipfile.lock
-
-# PEP 582; used by e.g. github.com/David-OConnor/pyflow
-__pypackages__/
-
-# Celery stuff
-celerybeat-schedule
-celerybeat.pid
-
-# SageMath parsed files
-*.sage.py
-
-# Environments
-.env
-.venv
-env/
-venv/
-ENV/
-env.bak/
-venv.bak/
-
-# Spyder project settings
-.spyderproject
-.spyproject
-
-# Rope project settings
-.ropeproject
-
-# mkdocs documentation
-/site
-
-# mypy
-.mypy_cache/
-.dmypy.json
-dmypy.json
-
-# Pyre type checker
-.pyre/
-
-# project
-test_schemas/
-.idea/.gitignore
-.idea/.name
-.idea/misc.xml
-.idea/modules.xml
-.idea/selector_schema_codegen.iml
-.idea/vcs.xml
-.idea/yh_parser.iml
-.idea/inspectionProfiles/profiles_settings.xml
-.idea/inspectionProfiles/Project_Default.xml
-.idea/libraries/Dart_SDK.xml
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions / native shared libs
+*.so
+*.dll
+*.dylib
+*.exp
+*.lib
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+pip-wheel-metadata/
+share/python-wheels/
+.ruff_cache/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+#  Usually these files are written by a python script from a template
+#  before PyInstaller builds the exe, so as to inject date/other infos into it.
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit tests / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+*.log
+local_settings.py
+db.sqlite3
+db.sqlite3-journal
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/source/_build/
+
+# PyBuilder
+target/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+.python-version
+
+# pipenv
+#   According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
+#   However, in case of collaboration, if having platform-specific dependencies or dependencies
+#   having no cross-platform support, pipenv may install dependencies that don't work, or not
+#   install all needed dependencies.
+#Pipfile.lock
+
+# PEP 582; used by e.g. github.com/David-OConnor/pyflow
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+.venv
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# Pyre type checker
+.pyre/
+
+# project
+test_schemas/
+.idea/.gitignore
+.idea/.name
+.idea/misc.xml
+.idea/modules.xml
+.idea/selector_schema_codegen.iml
+.idea/vcs.xml
+.idea/yh_parser.iml
+.idea/inspectionProfiles/profiles_settings.xml
+.idea/inspectionProfiles/Project_Default.xml
+.idea/libraries/Dart_SDK.xml

{ssc_codegen-0.17.1 → ssc_codegen-0.18.0}/LICENSE

@@ -1,21 +1,21 @@
-MIT License
-
-Copyright (c) 2023 Georgiy
-
-Permission is hereby granted, free of charge, to any person obtaining a copy
-of this software and associated documentation files (the "Software"), to deal
-in the Software without restriction, including without limitation the rights
-to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
-copies of the Software, and to permit persons to whom the Software is
-furnished to do so, subject to the following conditions:
-
-The above copyright notice and this permission notice shall be included in all
-copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
-OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+MIT License
+
+Copyright (c) 2023 Georgiy
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
 SOFTWARE.

{ssc_codegen-0.17.1 → ssc_codegen-0.18.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: ssc_codegen
-Version: 0.17.1
+Version: 0.18.0
 Summary: Python-dsl code converter to html parser for web scraping 
 Project-URL: Documentation, https://github.com/vypivshiy/selector_schema_codegen#readme
 Project-URL: Issues, https://github.com/vypivshiy/selector_schema_codegen/issues
@@ -86,7 +86,7 @@ ssc-gen generate examples/ -t js-pure -o ./output
 ssc-gen generate schema.kdl -t go-goquery -o ./parsers --package scraper
 ```
 
-Targets: `py-bs4`, `py-lxml`, `py-parsel`, `py-slax`, `js-pure`
+Targets: `py-bs4`, `py-lxml`, `py-parsel`, `py-slax`, `js-pure`, `go-goquery`
 
 ### Lint schemas
 

{ssc_codegen-0.17.1 → ssc_codegen-0.18.0}/README.md

@@ -1,124 +1,124 @@
-# ssc-codegen
-
-Code generator for web scraping parsers. Describe HTML extraction rules in a declarative KDL 2.0 DSL, then generate ready-to-use parser code for multiple languages and libraries.
-
-```
-.kdl schema --> [kdl parser] --> AST --> [linter] --> [converter] --> output code
-```
-
-## Features
-
-- Declarative DSL based on KDL 2.0 syntax
-- Static type checking and linting before code generation
-- Multiple output targets: Python (bs4, lxml, parsel, selectolax), JavaScript (DOM API)
-- Struct types: `item`, `list`, `dict`, `table`, `flat`
-- LLM-friendly: system prompt + linter loop for AI-assisted schema generation
-
-## Install
-
-```bash
-uv tool install ssc_codegen
-```
-
-## Quick example
-
-`books.kdl`:
-
-```kdl
-struct Book type=list {
-    @split-doc { css-all ".product-card" }
-
-    title { css ".title"; text }
-    price { css ".price"; text; re #"(\d+\.\d+)"#; to-float }
-    url   { css "a[href]"; attr "href"; fallback #null }
-}
-```
-
-Generate Python parser:
-
-```bash
-ssc-gen generate books.kdl -t py-bs4 -o ./output
-```
-
-## Usage
-
-### Generate code
-
-```bash
-# single file
-ssc-gen generate schema.kdl -t py-bs4 -o ./output
-
-# all .kdl files in a directory
-ssc-gen generate examples/ -t js-pure -o ./output
-
-# with custom package name (for Go and other targets)
-ssc-gen generate schema.kdl -t go-goquery -o ./parsers --package scraper
-```
-
-Targets: `py-bs4`, `py-lxml`, `py-parsel`, `py-slax`, `js-pure`
-
-### Lint schemas
-
-```bash
-# human-readable output
-ssc-gen check schema.kdl
-
-# JSON output (for LLM pipelines)
-ssc-gen check schema.kdl -f json
-
-# check all files in a directory
-ssc-gen check examples/
-```
-
-### Test schema against HTML
-
-```bash
-# from file
-ssc-gen run examples/booksToScrape.kdl:MainCatalogue -t py-bs4 -i page.html
-
-# from stdin
-curl https://books.toscrape.com/ | ssc-gen run examples/booksToScrape.kdl:MainCatalogue -t py-bs4
-```
-
-### Health check (verify selectors match elements)
-
-```bash
-# from file
-ssc-gen health examples/booksToScrape.kdl:MainCatalogue -i page.html
-
-# from stdin
-curl https://books.toscrape.com/ | ssc-gen health examples/booksToScrape.kdl:MainCatalogue
-```
-
-## Documentation
-
-- [Quick start](docs2/guide.md)
-- [Syntax and file structure](docs2/syntax.md)
-- [Type system](docs2/types.md)
-- [Pipeline operations](docs2/operations.md)
-- [Predicates and logic](docs2/predicates.md)
-- [JSON schemas and jsonify](docs2/json.md)
-- [Transforms and dsl blocks](docs2/transforms.md)
-- [LLM-compact reference](docs2/llm.txt) -- full DSL spec in one file for LLM context
-- [Examples](examples/)
-
-## LLM integration
-
-LLM agents can generate and validate `.kdl` schemas automatically using the linter feedback loop.
-
-### In chats (ChatGPT, Claude, etc.)
-
-Use [SYSTEM_PROMPT.md](SYSTEM_PROMPT.md) as system prompt. After generation, run `ssc-gen check -f json` and send errors back to the LLM for correction.
-
-### In AI-powered IDEs (Claude Code, Cursor, etc.)
-
-Use the [kdl-schema-dsl](.agents/skills/kdl-schema-dsl) skill for automatic generation, validation, and iteration.
-
-## Development
-
-```bash
-uv sync                  # install dependencies
-uv build --wheel         # build wheel
-uv run pytest            # run tests
-uv run ruff check ssc_codegen/
-```
+# ssc-codegen
+
+Code generator for web scraping parsers. Describe HTML extraction rules in a declarative KDL 2.0 DSL, then generate ready-to-use parser code for multiple languages and libraries.
+
+```
+.kdl schema --> [kdl parser] --> AST --> [linter] --> [converter] --> output code
+```
+
+## Features
+
+- Declarative DSL based on KDL 2.0 syntax
+- Static type checking and linting before code generation
+- Multiple output targets: Python (bs4, lxml, parsel, selectolax), JavaScript (DOM API)
+- Struct types: `item`, `list`, `dict`, `table`, `flat`
+- LLM-friendly: system prompt + linter loop for AI-assisted schema generation
+
+## Install
+
+```bash
+uv tool install ssc_codegen
+```
+
+## Quick example
+
+`books.kdl`:
+
+```kdl
+struct Book type=list {
+    @split-doc { css-all ".product-card" }
+
+    title { css ".title"; text }
+    price { css ".price"; text; re #"(\d+\.\d+)"#; to-float }
+    url   { css "a[href]"; attr "href"; fallback #null }
+}
+```
+
+Generate Python parser:
+
+```bash
+ssc-gen generate books.kdl -t py-bs4 -o ./output
+```
+
+## Usage
+
+### Generate code
+
+```bash
+# single file
+ssc-gen generate schema.kdl -t py-bs4 -o ./output
+
+# all .kdl files in a directory
+ssc-gen generate examples/ -t js-pure -o ./output
+
+# with custom package name (for Go and other targets)
+ssc-gen generate schema.kdl -t go-goquery -o ./parsers --package scraper
+```
+
+Targets: `py-bs4`, `py-lxml`, `py-parsel`, `py-slax`, `js-pure`, `go-goquery`
+
+### Lint schemas
+
+```bash
+# human-readable output
+ssc-gen check schema.kdl
+
+# JSON output (for LLM pipelines)
+ssc-gen check schema.kdl -f json
+
+# check all files in a directory
+ssc-gen check examples/
+```
+
+### Test schema against HTML
+
+```bash
+# from file
+ssc-gen run examples/booksToScrape.kdl:MainCatalogue -t py-bs4 -i page.html
+
+# from stdin
+curl https://books.toscrape.com/ | ssc-gen run examples/booksToScrape.kdl:MainCatalogue -t py-bs4
+```
+
+### Health check (verify selectors match elements)
+
+```bash
+# from file
+ssc-gen health examples/booksToScrape.kdl:MainCatalogue -i page.html
+
+# from stdin
+curl https://books.toscrape.com/ | ssc-gen health examples/booksToScrape.kdl:MainCatalogue
+```
+
+## Documentation
+
+- [Quick start](docs2/guide.md)
+- [Syntax and file structure](docs2/syntax.md)
+- [Type system](docs2/types.md)
+- [Pipeline operations](docs2/operations.md)
+- [Predicates and logic](docs2/predicates.md)
+- [JSON schemas and jsonify](docs2/json.md)
+- [Transforms and dsl blocks](docs2/transforms.md)
+- [LLM-compact reference](docs2/llm.txt) -- full DSL spec in one file for LLM context
+- [Examples](examples/)
+
+## LLM integration
+
+LLM agents can generate and validate `.kdl` schemas automatically using the linter feedback loop.
+
+### In chats (ChatGPT, Claude, etc.)
+
+Use [SYSTEM_PROMPT.md](SYSTEM_PROMPT.md) as system prompt. After generation, run `ssc-gen check -f json` and send errors back to the LLM for correction.
+
+### In AI-powered IDEs (Claude Code, Cursor, etc.)
+
+Use the [kdl-schema-dsl](.agents/skills/kdl-schema-dsl) skill for automatic generation, validation, and iteration.
+
+## Development
+
+```bash
+uv sync                  # install dependencies
+uv build --wheel         # build wheel
+uv run pytest            # run tests
+uv run ruff check ssc_codegen/
+```