tree-sitter-bloblang 0.2.1__tar.gz

tree_sitter_bloblang-0.2.1/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Henrik Christensen
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

tree_sitter_bloblang-0.2.1/PKG-INFO

@@ -0,0 +1,79 @@
+Metadata-Version: 2.4
+Name: tree-sitter-bloblang
+Version: 0.2.1
+Summary: parser for bento bloblang
+Author-email: Henrik Christensen <henrik@hsctech.eu>
+License: MIT
+Project-URL: Homepage, https://codeberg.org/hsctech/blobl_sitter
+Keywords: incremental,parsing,tree-sitter,bloblang
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Compilers
+Classifier: Topic :: Text Processing :: Linguistic
+Classifier: Typing :: Typed
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Provides-Extra: core
+Requires-Dist: tree-sitter~=0.24; extra == "core"
+Dynamic: license-file
+
+# Tree-sitter Grammar for Bento Bloblang
+
+This project aims to create a Tree-sitter grammar for Bento Bloblang, a powerful data transformation language used in the Bento ecosystem.
+
+## About Bloblang
+
+Bloblang is a declarative mapping language designed for transforming data structures. It's used in Bento for processing and manipulating data in pipelines.
+
+## Project Structure
+
+```
+.
+├── grammar.js      # Tree-sitter grammar definition
+├── bindings/       # Language bindings (Node.js, etc.)
+├── queries/         # Syntax highlighting queries
+├── src/            # Supporting code
+└── tests/          # Test cases
+```
+
+## Getting Started
+
+### Prerequisites
+
+- Node.js (for building and testing)
+- Tree-sitter CLI
+
+### Installation
+
+```bash
+npm install
+```
+
+### Building
+
+```bash
+npm run build
+```
+
+### Testing
+
+```bash
+npm test
+```
+
+## Grammar Development
+
+The grammar is defined in `grammar.js` using Tree-sitter's JavaScript DSL. Key components include:
+
+- Lexical rules (tokens, keywords, operators)
+- Syntax rules (expressions, statements, mappings)
+- Error recovery patterns
+
+## Resources
+
+- [Bento Bloblang Documentation](https://github.com/warpstreamlabs/bento/tree/main/website/docs/guides/bloblang)
+- [Tree-sitter Documentation](https://tree-sitter.github.io/tree-sitter/)
+
+## Contributing
+
+Contributions are welcome! Please open issues for bugs or feature requests, and submit pull requests for improvements.

tree_sitter_bloblang-0.2.1/README.md

@@ -0,0 +1,60 @@
+# Tree-sitter Grammar for Bento Bloblang
+
+This project aims to create a Tree-sitter grammar for Bento Bloblang, a powerful data transformation language used in the Bento ecosystem.
+
+## About Bloblang
+
+Bloblang is a declarative mapping language designed for transforming data structures. It's used in Bento for processing and manipulating data in pipelines.
+
+## Project Structure
+
+```
+.
+├── grammar.js      # Tree-sitter grammar definition
+├── bindings/       # Language bindings (Node.js, etc.)
+├── queries/         # Syntax highlighting queries
+├── src/            # Supporting code
+└── tests/          # Test cases
+```
+
+## Getting Started
+
+### Prerequisites
+
+- Node.js (for building and testing)
+- Tree-sitter CLI
+
+### Installation
+
+```bash
+npm install
+```
+
+### Building
+
+```bash
+npm run build
+```
+
+### Testing
+
+```bash
+npm test
+```
+
+## Grammar Development
+
+The grammar is defined in `grammar.js` using Tree-sitter's JavaScript DSL. Key components include:
+
+- Lexical rules (tokens, keywords, operators)
+- Syntax rules (expressions, statements, mappings)
+- Error recovery patterns
+
+## Resources
+
+- [Bento Bloblang Documentation](https://github.com/warpstreamlabs/bento/tree/main/website/docs/guides/bloblang)
+- [Tree-sitter Documentation](https://tree-sitter.github.io/tree-sitter/)
+
+## Contributing
+
+Contributions are welcome! Please open issues for bugs or feature requests, and submit pull requests for improvements.

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang/__init__.py

@@ -0,0 +1,42 @@
+"""parser for bento bloblang"""
+
+from importlib.resources import files as _files
+
+from ._binding import language
+
+
+def _get_query(name, file):
+    query = _files(f"{__package__}.queries") / file
+    globals()[name] = query.read_text()
+    return globals()[name]
+
+
+def __getattr__(name):
+    # NOTE: uncomment these to include any queries that this grammar contains:
+
+    # if name == "HIGHLIGHTS_QUERY":
+    #     return _get_query("HIGHLIGHTS_QUERY", "highlights.scm")
+    # if name == "INJECTIONS_QUERY":
+    #     return _get_query("INJECTIONS_QUERY", "injections.scm")
+    # if name == "LOCALS_QUERY":
+    #     return _get_query("LOCALS_QUERY", "locals.scm")
+    # if name == "TAGS_QUERY":
+    #     return _get_query("TAGS_QUERY", "tags.scm")
+
+    raise AttributeError(f"module {__name__!r} has no attribute {name!r}")
+
+
+__all__ = [
+    "language",
+    # "HIGHLIGHTS_QUERY",
+    # "INJECTIONS_QUERY",
+    # "LOCALS_QUERY",
+    # "TAGS_QUERY",
+]
+
+
+def __dir__():
+    return sorted(__all__ + [
+        "__all__", "__builtins__", "__cached__", "__doc__", "__file__",
+        "__loader__", "__name__", "__package__", "__path__", "__spec__",
+    ])

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang/__init__.pyi

@@ -0,0 +1,10 @@
+from typing import Final
+
+# NOTE: uncomment these to include any queries that this grammar contains:
+
+# HIGHLIGHTS_QUERY: Final[str]
+# INJECTIONS_QUERY: Final[str]
+# LOCALS_QUERY: Final[str]
+# TAGS_QUERY: Final[str]
+
+def language() -> object: ...

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang/binding.c

@@ -0,0 +1,35 @@
+#include <Python.h>
+
+typedef struct TSLanguage TSLanguage;
+
+TSLanguage *tree_sitter_bloblang(void);
+
+static PyObject* _binding_language(PyObject *Py_UNUSED(self), PyObject *Py_UNUSED(args)) {
+    return PyCapsule_New(tree_sitter_bloblang(), "tree_sitter.Language", NULL);
+}
+
+static struct PyModuleDef_Slot slots[] = {
+#ifdef Py_GIL_DISABLED
+    {Py_mod_gil, Py_MOD_GIL_NOT_USED},
+#endif
+    {0, NULL}
+};
+
+static PyMethodDef methods[] = {
+    {"language", _binding_language, METH_NOARGS,
+     "Get the tree-sitter language for this grammar."},
+    {NULL, NULL, 0, NULL}
+};
+
+static struct PyModuleDef module = {
+    .m_base = PyModuleDef_HEAD_INIT,
+    .m_name = "_binding",
+    .m_doc = NULL,
+    .m_size = 0,
+    .m_methods = methods,
+    .m_slots = slots,
+};
+
+PyMODINIT_FUNC PyInit__binding(void) {
+    return PyModuleDef_Init(&module);
+}

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/PKG-INFO

@@ -0,0 +1,79 @@
+Metadata-Version: 2.4
+Name: tree-sitter-bloblang
+Version: 0.2.1
+Summary: parser for bento bloblang
+Author-email: Henrik Christensen <henrik@hsctech.eu>
+License: MIT
+Project-URL: Homepage, https://codeberg.org/hsctech/blobl_sitter
+Keywords: incremental,parsing,tree-sitter,bloblang
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Software Development :: Compilers
+Classifier: Topic :: Text Processing :: Linguistic
+Classifier: Typing :: Typed
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Provides-Extra: core
+Requires-Dist: tree-sitter~=0.24; extra == "core"
+Dynamic: license-file
+
+# Tree-sitter Grammar for Bento Bloblang
+
+This project aims to create a Tree-sitter grammar for Bento Bloblang, a powerful data transformation language used in the Bento ecosystem.
+
+## About Bloblang
+
+Bloblang is a declarative mapping language designed for transforming data structures. It's used in Bento for processing and manipulating data in pipelines.
+
+## Project Structure
+
+```
+.
+├── grammar.js      # Tree-sitter grammar definition
+├── bindings/       # Language bindings (Node.js, etc.)
+├── queries/         # Syntax highlighting queries
+├── src/            # Supporting code
+└── tests/          # Test cases
+```
+
+## Getting Started
+
+### Prerequisites
+
+- Node.js (for building and testing)
+- Tree-sitter CLI
+
+### Installation
+
+```bash
+npm install
+```
+
+### Building
+
+```bash
+npm run build
+```
+
+### Testing
+
+```bash
+npm test
+```
+
+## Grammar Development
+
+The grammar is defined in `grammar.js` using Tree-sitter's JavaScript DSL. Key components include:
+
+- Lexical rules (tokens, keywords, operators)
+- Syntax rules (expressions, statements, mappings)
+- Error recovery patterns
+
+## Resources
+
+- [Bento Bloblang Documentation](https://github.com/warpstreamlabs/bento/tree/main/website/docs/guides/bloblang)
+- [Tree-sitter Documentation](https://tree-sitter.github.io/tree-sitter/)
+
+## Contributing
+
+Contributions are welcome! Please open issues for bugs or feature requests, and submit pull requests for improvements.

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/SOURCES.txt

@@ -0,0 +1,15 @@
+LICENSE
+README.md
+pyproject.toml
+setup.py
+bindings/python/tree_sitter_bloblang/__init__.py
+bindings/python/tree_sitter_bloblang/__init__.pyi
+bindings/python/tree_sitter_bloblang/binding.c
+bindings/python/tree_sitter_bloblang/py.typed
+bindings/python/tree_sitter_bloblang.egg-info/PKG-INFO
+bindings/python/tree_sitter_bloblang.egg-info/SOURCES.txt
+bindings/python/tree_sitter_bloblang.egg-info/dependency_links.txt
+bindings/python/tree_sitter_bloblang.egg-info/not-zip-safe
+bindings/python/tree_sitter_bloblang.egg-info/requires.txt
+bindings/python/tree_sitter_bloblang.egg-info/top_level.txt
+src/parser.c

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/not-zip-safe

@@ -0,0 +1 @@
+

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/requires.txt

@@ -0,0 +1,3 @@
+
+[core]
+tree-sitter~=0.24

tree_sitter_bloblang-0.2.1/bindings/python/tree_sitter_bloblang.egg-info/top_level.txt

@@ -0,0 +1,2 @@
+_binding
+tree_sitter_bloblang

tree_sitter_bloblang-0.2.1/pyproject.toml

@@ -0,0 +1,29 @@
+[build-system]
+requires = ["setuptools>=62.4.0", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "tree-sitter-bloblang"
+description = "parser for bento bloblang"
+version = "0.2.1"
+keywords = ["incremental", "parsing", "tree-sitter", "bloblang"]
+classifiers = [
+  "Intended Audience :: Developers",
+  "Topic :: Software Development :: Compilers",
+  "Topic :: Text Processing :: Linguistic",
+  "Typing :: Typed",
+]
+authors = [{ name = "Henrik Christensen", email = "henrik@hsctech.eu" }]
+requires-python = ">=3.10"
+license.text = "MIT"
+readme = "README.md"
+
+[project.urls]
+Homepage = "https://codeberg.org/hsctech/blobl_sitter"
+
+[project.optional-dependencies]
+core = ["tree-sitter~=0.24"]
+
+[tool.cibuildwheel]
+build = "cp310-*"
+build-frontend = "build"

tree_sitter_bloblang-0.2.1/queries/highlights.scm

@@ -0,0 +1,110 @@
+; Bloblang highlights for tree-sitter
+; =====================================
+
+; Keywords — only anonymous tokens from the grammar are valid as string patterns.
+; "root" and "this" are named node types, so they are captured below via (root)/(this).
+[
+  "let"
+  "meta"
+  "map"
+  "import"
+  "if"
+  "else"
+  "match"
+] @keyword
+
+; Operators
+[
+  "="
+  "=>"
+  "->"
+  "+"
+  "-"
+  "*"
+  "/"
+  "%"
+  "!"
+  ">"
+  ">="
+  "<"
+  "<="
+  "=="
+  "!="
+  "&&"
+  "||"
+  "|"
+] @operator
+
+; Punctuation
+["{" "}"] @punctuation.bracket
+["[" "]"] @punctuation.bracket
+["(" ")"] @punctuation.bracket
+["." "," ":"] @punctuation.delimiter
+
+; Literals
+(number) @constant.numeric
+(boolean) @constant.builtin
+(null) @constant.builtin
+
+; Strings
+(string) @string
+
+; Comments
+(comment) @comment
+
+; Variables ($var)
+(variable) @variable.parameter
+
+; Metadata (@key)
+(metadata) @variable.special
+
+; Wildcard in match
+(wildcard) @constant.builtin
+
+; map Name { }
+(map_definition
+  name: (identifier) @namespace)
+
+; import "path"
+(import_statement
+  path: (string) @string.special)
+
+; let foo = ...  (name is plain identifier)
+(let_statement
+  name: (identifier) @variable.parameter)
+
+; Built-in functions: call_expression where function is a plain identifier
+(call_expression
+  function: (identifier) @function.builtin
+  (#match? @function.builtin
+    "^(uuid_v4|now|hostname|range|content|timestamp|timestamp_unix|timestamp_unix_nano|random_int|env|var|count|batch_size|ksuid|nanoid|error|errored|metadata|deleted|throw)$"))
+
+; Other plain function calls
+(call_expression
+  function: (identifier) @function)
+
+; Built-in method calls: call_expression where function is member_expression
+(call_expression
+  function: (member_expression
+    property: (identifier) @function.builtin)
+  (#match? @function.builtin
+    "^(map_each|apply|catch|or|exists|not_null|length|string|number|bool|bytes|type|uppercase|lowercase|trim|reverse|sort|unique|flatten|explode|collapse|parse_json|format_json|parse_yaml|format_yaml|parse_csv|format_csv|encode|decode|hash|hmac|split|join|replace|replace_all|contains|has_prefix|has_suffix|index|slice|keys|values|items|assign|merge|filter|find|find_all|all|any|sum|min|max|abs|floor|ceil|round|round_precise|log|pow|sqrt|format|timediff_days_absolute|ts_strptime|re_match|re_find|re_find_all|re_replace|re_replace_all|re_split|xpath|jmespath|not|not_null|satser)$"))
+
+; Other method calls
+(call_expression
+  function: (member_expression
+    property: (identifier) @function.method))
+
+; Arrow function parameter
+(arrow_function
+  param: (identifier) @variable.parameter)
+
+; Named arguments
+(named_argument
+  name: (identifier) @variable.parameter)
+
+; root and this keywords in member expressions and assignments
+(member_expression object: (root) @keyword)
+(member_expression object: (this) @keyword)
+(assignment left: (root) @keyword)
+(assignment left: (this) @keyword)

tree_sitter_bloblang-0.2.1/queries/locals.scm

@@ -0,0 +1,15 @@
+; Bloblang locals for tree-sitter
+
+; Map definitions create a scope
+(map_definition) @local.scope
+
+; let foo = ...  defines a local variable
+(let_statement
+  name: (identifier) @local.definition)
+
+; $var references
+(variable) @local.reference
+
+; arrow function parameter
+(arrow_function
+  param: (identifier) @local.definition)

tree_sitter_bloblang-0.2.1/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

tree_sitter_bloblang-0.2.1/setup.py

@@ -0,0 +1,77 @@
+from os import path
+from sysconfig import get_config_var
+
+from setuptools import Extension, find_packages, setup
+from setuptools.command.build import build
+from setuptools.command.build_ext import build_ext
+from setuptools.command.egg_info import egg_info
+from wheel.bdist_wheel import bdist_wheel
+
+
+class Build(build):
+    def run(self):
+        if path.isdir("queries"):
+            dest = path.join(self.build_lib, "tree_sitter_bloblang", "queries")
+            self.copy_tree("queries", dest)
+        super().run()
+
+
+class BuildExt(build_ext):
+    def build_extension(self, ext: Extension):
+        if self.compiler.compiler_type != "msvc":
+            ext.extra_compile_args = ["-std=c11", "-fvisibility=hidden"]
+        else:
+            ext.extra_compile_args = ["/std:c11", "/utf-8"]
+        if path.exists("src/scanner.c"):
+            ext.sources.append("src/scanner.c")
+        if ext.py_limited_api:
+            ext.define_macros.append(("Py_LIMITED_API", "0x030A0000"))
+        super().build_extension(ext)
+
+
+class BdistWheel(bdist_wheel):
+    def get_tag(self):
+        python, abi, platform = super().get_tag()
+        if python.startswith("cp"):
+            python, abi = "cp310", "abi3"
+        return python, abi, platform
+
+
+class EggInfo(egg_info):
+    def find_sources(self):
+        super().find_sources()
+        self.filelist.recursive_include("queries", "*.scm")
+        self.filelist.include("src/tree_sitter/*.h")
+
+
+setup(
+    packages=find_packages("bindings/python"),
+    package_dir={"": "bindings/python"},
+    package_data={
+        "tree_sitter_bloblang": ["*.pyi", "py.typed"],
+        "tree_sitter_bloblang.queries": ["*.scm"],
+    },
+    ext_package="tree_sitter_bloblang",
+    ext_modules=[
+        Extension(
+            name="_binding",
+            sources=[
+                "bindings/python/tree_sitter_bloblang/binding.c",
+                "src/parser.c",
+            ],
+            define_macros=[
+                ("PY_SSIZE_T_CLEAN", None),
+                ("TREE_SITTER_HIDE_SYMBOLS", None),
+            ],
+            include_dirs=["src"],
+            py_limited_api=not get_config_var("Py_GIL_DISABLED"),
+        )
+    ],
+    cmdclass={
+        "build": Build,
+        "build_ext": BuildExt,
+        "bdist_wheel": BdistWheel,
+        "egg_info": EggInfo,
+    },
+    zip_safe=False
+)