individu8 0.1.0__tar.gz

individu8-0.1.0/.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,35 @@
+---
+name: Bug report
+about: Something isn't working as expected
+title: '[BUG] '
+labels: bug
+assignees: ''
+---
+
+## Environment
+
+- OS: <!-- e.g. macOS 15.2, Ubuntu 24.04, Windows 11 -->
+- Python version: <!-- e.g. 3.12.3 -->
+- individu8 version: <!-- e.g. 0.2.0 — run: python -c "import individu8; print(individu8.__version__)" -->
+- json_backend: <!-- orjson (default) or stdlib -->
+
+## Steps to reproduce
+
+```python
+# minimal example that reproduces the issue
+from individu8 import individu8
+
+individu8(...)
+```
+
+## Expected result
+
+<!-- what you expected to happen -->
+
+## Actual result
+
+<!-- what actually happened — include the full error message and traceback if applicable -->
+
+## Additional context
+
+<!-- anything else that might be relevant -->

individu8-0.1.0/.github/ISSUE_TEMPLATE/config.yml

@@ -0,0 +1 @@
+blank_issues_enabled: false

individu8-0.1.0/.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,19 @@
+---
+name: Feature request
+about: Suggest an idea or improvement
+title: '[FEAT] '
+labels: enhancement
+assignees: ''
+---
+
+## Problem
+
+<!-- what problem would this solve? -->
+
+## Proposed solution
+
+<!-- how would you like it to work? -->
+
+## Alternatives considered
+
+<!-- any other approaches you thought of? -->

individu8-0.1.0/.github/workflows/ci.yml

@@ -0,0 +1,36 @@
+#.github/workflows/ci.yml
+name: CI
+
+on:
+  push:
+    branches: [main]
+  pull_request:
+    branches: [main]
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        python-version: ["3.10", "3.11", "3.12", "3.13"]
+
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Install uv
+        uses: astral-sh/setup-uv@v4
+
+      - name: Set up Python ${{ matrix.python-version }}
+        run: uv python install ${{ matrix.python-version }}
+
+      - name: Install dependencies
+        run: uv sync --all-extras
+
+      - name: Lint
+        run: uv run ruff check src/ tests/
+
+      - name: Test
+        run: uv run pytest --tb=short -q
+
+      - name: Security audit
+        run: uv run pip-audit        

individu8-0.1.0/.github/workflows/dependabot.yml

@@ -0,0 +1,7 @@
+# .github/dependabot.yml
+version: 2
+updates:
+  - package-ecosystem: "pip"
+    directory: "/"
+    schedule:
+      interval: "weekly"

individu8-0.1.0/.github/workflows/publish.yml

@@ -0,0 +1,40 @@
+name: Publish to PyPI
+
+on:
+  release:
+    types: [published]
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Install uv
+        uses: astral-sh/setup-uv@v4
+
+      - name: Build
+        run: uv build
+
+      - name: Upload dist
+        uses: actions/upload-artifact@v4
+        with:
+          name: dist
+          path: dist/
+
+  publish:
+    needs: build
+    runs-on: ubuntu-latest
+    environment: pypi
+    permissions:
+      id-token: write  # required for OIDC trusted publishing
+
+    steps:
+      - name: Download dist
+        uses: actions/download-artifact@v4
+        with:
+          name: dist
+          path: dist/
+
+      - name: Publish to PyPI
+        uses: pypa/gh-action-pypi-publish@release/v1

individu8-0.1.0/.gitignore

@@ -0,0 +1,38 @@
+# Python
+__pycache__/
+*.py[cod]
+*.pyo
+*.pyd
+.Python
+*.egg-info/
+dist/
+build/
+.eggs/
+
+# uv / pip
+.venv/
+venv/
+*.lock
+
+# Testing
+.pytest_cache/
+.coverage
+htmlcov/
+.tox/
+
+# Ruff
+.ruff_cache/
+
+# IDE
+.vscode/
+.idea/
+*.swp
+*.swo
+
+# OS
+.DS_Store
+Thumbs.db
+
+# Build artifacts
+*.whl
+*.tar.gz

individu8-0.1.0/.pre-commit-config.yaml

@@ -0,0 +1,14 @@
+# .pre-commit-config.yaml
+repos:
+  - repo: local
+    hooks:
+      - id: ruff
+        name: ruff
+        entry: uv run ruff check src/ tests/
+        language: system
+        pass_filenames: false
+      - id: pytest
+        name: pytest
+        entry: uv run pytest --tb=short -q
+        language: system
+        pass_filenames: false

individu8-0.1.0/CHANGELOG.md

@@ -0,0 +1,21 @@
+# Changelog
+
+All notable changes to this project will be documented in this file.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [Unreleased]
+
+## [0.1.0] - 2025-06-21
+
+### Added
+- Initial release
+- `individu8()` function for deterministic hashing of dicts, lists, and JSON/YAML strings
+- Filter pipeline: `exclude_all_keys_starting_with`, `exclude_all_keys_ending_with`,
+  `exclude_all_keys_containing`, `exclude`, `include`
+- Jsonpath support in `exclude` and `include` via jsonpath-ng
+- Hash algorithms: `blake2b` (default), `blake2s`, `sha256`, `md5`, `shake128`
+- JSON backends: `orjson` (default, fast), `stdlib` (compatibility)
+- Output formats: `same_as_input` (default), `python`, `json`, `yaml`
+- YAML string input support via pyyaml

individu8-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Niklas Sköldmark
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

individu8-0.1.0/PKG-INFO

@@ -0,0 +1,246 @@
+Metadata-Version: 2.4
+Name: individu8
+Version: 0.1.0
+Summary: Deterministic hashing of Python dicts, lists, and JSON/YAML strings
+Project-URL: Homepage, https://github.com/yourusername/individu8
+Project-URL: Repository, https://github.com/yourusername/individu8
+Project-URL: Issues, https://github.com/yourusername/individu8/issues
+Project-URL: Changelog, https://github.com/yourusername/individu8/blob/main/CHANGELOG.md
+Author: Niklas Sköldmark
+License: MIT License
+        
+        Copyright (c) 2026 Niklas Sköldmark
+        
+        Permission is hereby granted, free of charge, to any person obtaining a copy
+        of this software and associated documentation files (the "Software"), to deal
+        in the Software without restriction, including without limitation the rights
+        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+        copies of the Software, and to permit persons to whom the Software is
+        furnished to do so, subject to the following conditions:
+        
+        The above copyright notice and this permission notice shall be included in all
+        copies or substantial portions of the Software.
+        
+        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+        SOFTWARE.
+License-File: LICENSE
+Keywords: blake2,content-hash,deduplication,deterministic,etl,fingerprint,jsonpath,uuid-v8
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: Utilities
+Requires-Python: >=3.10
+Requires-Dist: jsonpath-ng>=1.6
+Requires-Dist: orjson>=3.9
+Requires-Dist: pyyaml>=6.0
+Description-Content-Type: text/markdown
+
+# individu8
+
+Deterministic hashing of Python dicts, lists, and JSON/YAML strings.
+
+```python
+from individu8 import individu8
+
+individu8({"id": 1, "name": "Alice"})
+# "FszF+jYmhYS17K"
+
+individu8([{"id": 1}, {"id": 2}])
+# ["GICezwtC7+vhEA", "DxgzKROIe5u0sQ"]
+```
+
+## Why
+
+- **Stable across runs** — same data always produces the same hash, regardless of key insertion order
+- **Flexible filtering** — exclude volatile fields (timestamps, system columns) before hashing
+- **Multiple input formats** — pass a dict, list, JSON string, or YAML string
+- **Multiple output formats** — base64 (default), hex, or UUID v8
+- **Multiple hash algorithms** — blake2b (default), blake2s, sha256, md5, shake128
+- **Predictable length** — `hash_length` controls the exact number of characters returned
+- **Fast** — uses orjson for serialisation by default (5-10x faster than stdlib json)
+
+## Install
+
+```bash
+pip install individu8
+# or
+uv add individu8
+```
+
+## Usage
+
+### Basic
+
+```python
+from individu8 import individu8
+
+# hash a dict — returns exactly hash_length characters (default 14)
+individu8({"id": 1, "name": "Alice"})
+# "FszF+jYmhYS17K"
+
+# hash a list — returns a list of hashes in the same order
+individu8([{"id": 1}, {"id": 2}])
+# ["GICezwtC7+vhEA", "DxgzKROIe5u0sQ"]
+
+# hash a JSON string — identical to dict input
+individu8('{"id": 1, "name": "Alice"}')
+# "FszF+jYmhYS17K"
+
+# hash a YAML string — identical to dict input
+individu8("id: 1\nname: Alice")
+# "FszF+jYmhYS17K"
+```
+
+### Filtering
+
+Filtering is applied as a pipeline in this order:
+
+1. `exclude_all_keys_starting_with` / `ending_with` / `containing` — removes matching keys recursively at any depth
+2. `exclude` — removes specific keys or jsonpath paths from the full document
+3. `include` — narrows to only the specified keys or paths
+
+```python
+# exclude system/metadata keys at any depth
+individu8(data, exclude_all_keys_starting_with=["_meta", "_dlt"])
+individu8(data, exclude_all_keys_ending_with=["_at", "_id"])
+individu8(data, exclude_all_keys_containing=["temp"])
+
+# exclude specific top-level keys
+individu8(data, exclude=["updated_at", "created_at"])
+
+# exclude a nested key using jsonpath — only removes "code" inside this specific path,
+# not other keys named "code" elsewhere in the document
+individu8(data, exclude=["person.address[*].street.number.code"])
+
+# hash only specific fields
+individu8(data, include=["id", "name"])
+
+# combine: hash only street data, excluding volatile subfields
+individu8(
+    data,
+    exclude=["person.address[*].street.updated_at"],
+    include=["person.address[*].street"],
+)
+```
+
+### Hash length
+
+`hash_length` controls the exact number of characters in the returned string.
+The library computes as many bytes as needed internally and truncates to exactly
+`hash_length` characters — you always get exactly what you asked for.
+
+```python
+individu8(data, hash_length=8)    # 8 chars
+individu8(data, hash_length=14)   # 14 chars (default)
+individu8(data, hash_length=20)   # 20 chars
+individu8(data, hash_length=32)   # 32 chars
+```
+
+For clean alignment with base64 encoding use multiples of 4 (12, 16, 20, 24) —
+other values work fine but the last 1–3 characters of entropy are discarded by
+truncation.
+
+For expert control over digest size in bytes, use `hash_bytes` instead:
+
+```python
+individu8(data, hash_bytes=16)   # 16-byte digest → 22 base64 chars
+individu8(data, hash_bytes=32)   # 32-byte digest → 43 base64 chars
+```
+
+### Hash format
+
+```python
+# base64 (default) — URL-safe ASCII, no padding
+individu8(data)
+# "FszF+jYmhYS17K"
+
+# hex — lowercase hexadecimal, hash_bytes * 2 characters
+individu8(data, hash_format="hex")
+# "19ccbe8d3d2f6b"
+
+# UUID v8 — deterministic, RFC 9562 compliant, always 36 characters
+# 122 bits of entropy (128 minus 6 version/variant bits)
+# accepted anywhere a UUID is expected
+individu8(data, hash_format="uuid")
+# "6b5dc393-b52a-8ea0-a003-4f6986d2db77"
+```
+
+UUID v8 is the RFC 9562 "custom" variant — designed for exactly this use case
+where you want deterministic, content-based UUIDs using your own hash algorithm.
+
+### Hash algorithms
+
+```python
+individu8(data, hash_algorithm="blake2b")   # default — fast, modern, recommended
+individu8(data, hash_algorithm="blake2s")   # 32-bit optimised, max hash_bytes=32
+individu8(data, hash_algorithm="sha256")    # widely compatible, matches git/AWS
+individu8(data, hash_algorithm="md5")       # legacy, used for ETags/checksums
+individu8(data, hash_algorithm="shake128")  # SHA-3, matches dlt _dlt_id format
+```
+
+### Output structure
+
+Controls what wraps the hash string(s) — separate from `hash_format` which
+controls how each individual hash is encoded.
+
+```python
+individu8(data, output="same_as_input")  # default — matches input type
+individu8(data, output="python")         # always str or list[str]
+individu8(data, output="json")           # always a JSON string
+individu8(data, output="yaml")           # always a YAML string
+```
+
+### JSON backend
+
+```python
+individu8(data, json_backend="orjson")   # default — 5-10x faster
+individu8(data, json_backend="stdlib")   # stdlib json, no extra dependencies
+```
+
+Both backends produce identical hashes for the same input.
+
+## Supported input types
+
+The following Python types are handled automatically when they appear as values
+in the data being hashed:
+
+| Type | Serialised as |
+|---|---|
+| `Decimal` | string (avoids float precision loss) |
+| `datetime` / `date` / `time` | ISO 8601 string |
+| `UUID` | string |
+| `bytes` | base64 string |
+| `namedtuple` | dict via `_asdict()` |
+| `@dataclass` | dict via `dataclasses.asdict()` |
+| `Enum` | `.value` |
+| pydantic `BaseModel` | dict via `.model_dump()` |
+| objects with `.asdict()` | dict via `.asdict()` |
+
+## Development
+
+```bash
+git clone https://github.com/niklasskoldmark/individu8
+cd individu8
+uv sync
+uv run pytest
+uv run ruff check src/ tests/
+```
+
+## Changelog
+
+See [CHANGELOG.md](CHANGELOG.md).
+
+## License
+
+MIT — see [LICENSE](LICENSE).

individu8-0.1.0/README.md

@@ -0,0 +1,198 @@
+# individu8
+
+Deterministic hashing of Python dicts, lists, and JSON/YAML strings.
+
+```python
+from individu8 import individu8
+
+individu8({"id": 1, "name": "Alice"})
+# "FszF+jYmhYS17K"
+
+individu8([{"id": 1}, {"id": 2}])
+# ["GICezwtC7+vhEA", "DxgzKROIe5u0sQ"]
+```
+
+## Why
+
+- **Stable across runs** — same data always produces the same hash, regardless of key insertion order
+- **Flexible filtering** — exclude volatile fields (timestamps, system columns) before hashing
+- **Multiple input formats** — pass a dict, list, JSON string, or YAML string
+- **Multiple output formats** — base64 (default), hex, or UUID v8
+- **Multiple hash algorithms** — blake2b (default), blake2s, sha256, md5, shake128
+- **Predictable length** — `hash_length` controls the exact number of characters returned
+- **Fast** — uses orjson for serialisation by default (5-10x faster than stdlib json)
+
+## Install
+
+```bash
+pip install individu8
+# or
+uv add individu8
+```
+
+## Usage
+
+### Basic
+
+```python
+from individu8 import individu8
+
+# hash a dict — returns exactly hash_length characters (default 14)
+individu8({"id": 1, "name": "Alice"})
+# "FszF+jYmhYS17K"
+
+# hash a list — returns a list of hashes in the same order
+individu8([{"id": 1}, {"id": 2}])
+# ["GICezwtC7+vhEA", "DxgzKROIe5u0sQ"]
+
+# hash a JSON string — identical to dict input
+individu8('{"id": 1, "name": "Alice"}')
+# "FszF+jYmhYS17K"
+
+# hash a YAML string — identical to dict input
+individu8("id: 1\nname: Alice")
+# "FszF+jYmhYS17K"
+```
+
+### Filtering
+
+Filtering is applied as a pipeline in this order:
+
+1. `exclude_all_keys_starting_with` / `ending_with` / `containing` — removes matching keys recursively at any depth
+2. `exclude` — removes specific keys or jsonpath paths from the full document
+3. `include` — narrows to only the specified keys or paths
+
+```python
+# exclude system/metadata keys at any depth
+individu8(data, exclude_all_keys_starting_with=["_meta", "_dlt"])
+individu8(data, exclude_all_keys_ending_with=["_at", "_id"])
+individu8(data, exclude_all_keys_containing=["temp"])
+
+# exclude specific top-level keys
+individu8(data, exclude=["updated_at", "created_at"])
+
+# exclude a nested key using jsonpath — only removes "code" inside this specific path,
+# not other keys named "code" elsewhere in the document
+individu8(data, exclude=["person.address[*].street.number.code"])
+
+# hash only specific fields
+individu8(data, include=["id", "name"])
+
+# combine: hash only street data, excluding volatile subfields
+individu8(
+    data,
+    exclude=["person.address[*].street.updated_at"],
+    include=["person.address[*].street"],
+)
+```
+
+### Hash length
+
+`hash_length` controls the exact number of characters in the returned string.
+The library computes as many bytes as needed internally and truncates to exactly
+`hash_length` characters — you always get exactly what you asked for.
+
+```python
+individu8(data, hash_length=8)    # 8 chars
+individu8(data, hash_length=14)   # 14 chars (default)
+individu8(data, hash_length=20)   # 20 chars
+individu8(data, hash_length=32)   # 32 chars
+```
+
+For clean alignment with base64 encoding use multiples of 4 (12, 16, 20, 24) —
+other values work fine but the last 1–3 characters of entropy are discarded by
+truncation.
+
+For expert control over digest size in bytes, use `hash_bytes` instead:
+
+```python
+individu8(data, hash_bytes=16)   # 16-byte digest → 22 base64 chars
+individu8(data, hash_bytes=32)   # 32-byte digest → 43 base64 chars
+```
+
+### Hash format
+
+```python
+# base64 (default) — URL-safe ASCII, no padding
+individu8(data)
+# "FszF+jYmhYS17K"
+
+# hex — lowercase hexadecimal, hash_bytes * 2 characters
+individu8(data, hash_format="hex")
+# "19ccbe8d3d2f6b"
+
+# UUID v8 — deterministic, RFC 9562 compliant, always 36 characters
+# 122 bits of entropy (128 minus 6 version/variant bits)
+# accepted anywhere a UUID is expected
+individu8(data, hash_format="uuid")
+# "6b5dc393-b52a-8ea0-a003-4f6986d2db77"
+```
+
+UUID v8 is the RFC 9562 "custom" variant — designed for exactly this use case
+where you want deterministic, content-based UUIDs using your own hash algorithm.
+
+### Hash algorithms
+
+```python
+individu8(data, hash_algorithm="blake2b")   # default — fast, modern, recommended
+individu8(data, hash_algorithm="blake2s")   # 32-bit optimised, max hash_bytes=32
+individu8(data, hash_algorithm="sha256")    # widely compatible, matches git/AWS
+individu8(data, hash_algorithm="md5")       # legacy, used for ETags/checksums
+individu8(data, hash_algorithm="shake128")  # SHA-3, matches dlt _dlt_id format
+```
+
+### Output structure
+
+Controls what wraps the hash string(s) — separate from `hash_format` which
+controls how each individual hash is encoded.
+
+```python
+individu8(data, output="same_as_input")  # default — matches input type
+individu8(data, output="python")         # always str or list[str]
+individu8(data, output="json")           # always a JSON string
+individu8(data, output="yaml")           # always a YAML string
+```
+
+### JSON backend
+
+```python
+individu8(data, json_backend="orjson")   # default — 5-10x faster
+individu8(data, json_backend="stdlib")   # stdlib json, no extra dependencies
+```
+
+Both backends produce identical hashes for the same input.
+
+## Supported input types
+
+The following Python types are handled automatically when they appear as values
+in the data being hashed:
+
+| Type | Serialised as |
+|---|---|
+| `Decimal` | string (avoids float precision loss) |
+| `datetime` / `date` / `time` | ISO 8601 string |
+| `UUID` | string |
+| `bytes` | base64 string |
+| `namedtuple` | dict via `_asdict()` |
+| `@dataclass` | dict via `dataclasses.asdict()` |
+| `Enum` | `.value` |
+| pydantic `BaseModel` | dict via `.model_dump()` |
+| objects with `.asdict()` | dict via `.asdict()` |
+
+## Development
+
+```bash
+git clone https://github.com/niklasskoldmark/individu8
+cd individu8
+uv sync
+uv run pytest
+uv run ruff check src/ tests/
+```
+
+## Changelog
+
+See [CHANGELOG.md](CHANGELOG.md).
+
+## License
+
+MIT — see [LICENSE](LICENSE).