pointblank 0.11.5__tar.gz → 0.12.0__tar.gz

{pointblank-0.11.5 → pointblank-0.12.0}/.github/workflows/ci-tests.yaml

@@ -24,11 +24,21 @@ jobs:
         uses: actions/setup-python@v5
         with:
           python-version: ${{ matrix.python-version }}
+      - name: Set up Java for PySpark
+        uses: actions/setup-java@v4
+        with:
+          distribution: "temurin"
+          java-version: "11"
       - name: Install uv
         uses: astral-sh/setup-uv@v5
       - name: pytest unit tests
         run: |
           make test
+        env:
+          # Optimize PySpark for CI environment
+          PYSPARK_DRIVER_MEMORY: 1g
+          PYSPARK_EXECUTOR_MEMORY: 1g
+          SPARK_LOCAL_IP: 127.0.0.1
       - name: Upload coverage reports to Codecov
         uses: codecov/codecov-action@v5
         with:

{pointblank-0.11.5 → pointblank-0.12.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: pointblank
-Version: 0.11.5
+Version: 0.12.0
 Summary: Find out if your data is what you think it is.
 Author-email: Richard Iannone <riannone@me.com>
 License: MIT License
@@ -43,7 +43,7 @@ License-File: LICENSE
 Requires-Dist: commonmark>=0.9.1
 Requires-Dist: importlib-metadata
 Requires-Dist: great_tables>=0.17.0
-Requires-Dist: narwhals>=1.41.0
+Requires-Dist: narwhals>=2.0.1
 Requires-Dist: typing_extensions>=3.10.0.0
 Requires-Dist: requests>=2.31.0
 Requires-Dist: click>=8.0.0
@@ -53,6 +53,8 @@ Provides-Extra: pd
 Requires-Dist: pandas>=2.2.3; extra == "pd"
 Provides-Extra: pl
 Requires-Dist: polars>=1.24.0; extra == "pl"
+Provides-Extra: pyspark
+Requires-Dist: pyspark==3.5.6; extra == "pyspark"
 Provides-Extra: generate
 Requires-Dist: chatlas>=0.3.0; extra == "generate"
 Requires-Dist: anthropic[bedrock]>=0.45.2; extra == "generate"
@@ -70,8 +72,6 @@ Provides-Extra: mssql
 Requires-Dist: ibis-framework[mssql]>=9.5.0; extra == "mssql"
 Provides-Extra: postgres
 Requires-Dist: ibis-framework[postgres]>=9.5.0; extra == "postgres"
-Provides-Extra: pyspark
-Requires-Dist: ibis-framework[pyspark]>=9.5.0; extra == "pyspark"
 Provides-Extra: snowflake
 Requires-Dist: ibis-framework[snowflake]>=9.5.0; extra == "snowflake"
 Provides-Extra: sqlite
@@ -83,6 +83,7 @@ Requires-Dist: nbformat>=5.10.4; extra == "docs"
 Requires-Dist: quartodoc>=0.8.1; python_version >= "3.9" and extra == "docs"
 Requires-Dist: pandas>=2.2.3; extra == "docs"
 Requires-Dist: polars>=1.17.1; extra == "docs"
+Requires-Dist: pyspark==3.5.6; extra == "docs"
 Dynamic: license-file
 
 <div align="center">
@@ -236,6 +237,48 @@ validation.get_step_report(i=3).show("browser")  # Get failing records from step
 
 <br>
 
+## YAML Configuration
+
+For teams that need portable, version-controlled validation workflows, Pointblank supports YAML configuration files. This makes it easy to share validation logic across different environments and team members, ensuring everyone is on the same page.
+
+**validation.yaml**
+
+```yaml
+validate:
+  data: small_table
+  tbl_name: "small_table"
+  label: "Getting started validation"
+
+steps:
+  - col_vals_gt:
+      columns: "d"
+      value: 100
+  - col_vals_le:
+      columns: "c"
+      value: 5
+  - col_exists:
+      columns: ["date", "date_time"]
+```
+
+**Execute the YAML validation**
+
+```python
+import pointblank as pb
+
+# Run validation from YAML configuration
+validation = pb.yaml_interrogate("validation.yaml")
+
+# Get the results just like any other validation
+validation.get_tabular_report().show()
+```
+
+This approach is perfect for:
+
+- **CI/CD pipelines**: Store validation rules alongside your code
+- **Team collaboration**: Share validation logic in a readable format
+- **Environment consistency**: Use the same validation across dev, staging, and production
+- **Documentation**: YAML files serve as living documentation of your data quality requirements
+
 ## Command Line Interface (CLI)
 
 Pointblank includes a powerful CLI utility called `pb` that lets you run data validation workflows directly from the command line. Perfect for CI/CD pipelines, scheduled data quality checks, or quick validation tasks.
@@ -263,6 +306,12 @@ pb scan "duckdb:///data/sales.ddb::customers"
 **Run Essential Validations**
 
 ```bash
+# Run validation from YAML configuration file
+pb run validation.yaml
+
+# Run validation from Python file
+pb run validation.py
+
 # Check for duplicate rows
 pb validate small_table --check rows-distinct
 
@@ -279,8 +328,12 @@ pb validate small_table --check col-vals-gt --column a --value 5 --show-extract
 **Integrate with CI/CD**
 
 ```bash
-# Use exit codes for automation (0 = pass, 1 = fail)
+# Use exit codes for automation in one-liner validations (0 = pass, 1 = fail)
 pb validate small_table --check rows-distinct --exit-code
+
+# Run validation workflows with exit codes
+pb run validation.yaml --exit-code
+pb run validation.py --exit-code
 ```
 
 Click the following headings to see some video demonstrations of the CLI:

{pointblank-0.11.5 → pointblank-0.12.0}/README.md

@@ -149,6 +149,48 @@ validation.get_step_report(i=3).show("browser")  # Get failing records from step
 
 <br>
 
+## YAML Configuration
+
+For teams that need portable, version-controlled validation workflows, Pointblank supports YAML configuration files. This makes it easy to share validation logic across different environments and team members, ensuring everyone is on the same page.
+
+**validation.yaml**
+
+```yaml
+validate:
+  data: small_table
+  tbl_name: "small_table"
+  label: "Getting started validation"
+
+steps:
+  - col_vals_gt:
+      columns: "d"
+      value: 100
+  - col_vals_le:
+      columns: "c"
+      value: 5
+  - col_exists:
+      columns: ["date", "date_time"]
+```
+
+**Execute the YAML validation**
+
+```python
+import pointblank as pb
+
+# Run validation from YAML configuration
+validation = pb.yaml_interrogate("validation.yaml")
+
+# Get the results just like any other validation
+validation.get_tabular_report().show()
+```
+
+This approach is perfect for:
+
+- **CI/CD pipelines**: Store validation rules alongside your code
+- **Team collaboration**: Share validation logic in a readable format
+- **Environment consistency**: Use the same validation across dev, staging, and production
+- **Documentation**: YAML files serve as living documentation of your data quality requirements
+
 ## Command Line Interface (CLI)
 
 Pointblank includes a powerful CLI utility called `pb` that lets you run data validation workflows directly from the command line. Perfect for CI/CD pipelines, scheduled data quality checks, or quick validation tasks.
@@ -176,6 +218,12 @@ pb scan "duckdb:///data/sales.ddb::customers"
 **Run Essential Validations**
 
 ```bash
+# Run validation from YAML configuration file
+pb run validation.yaml
+
+# Run validation from Python file
+pb run validation.py
+
 # Check for duplicate rows
 pb validate small_table --check rows-distinct
 
@@ -192,8 +240,12 @@ pb validate small_table --check col-vals-gt --column a --value 5 --show-extract
 **Integrate with CI/CD**
 
 ```bash
-# Use exit codes for automation (0 = pass, 1 = fail)
+# Use exit codes for automation in one-liner validations (0 = pass, 1 = fail)
 pb validate small_table --check rows-distinct --exit-code
+
+# Run validation workflows with exit codes
+pb run validation.yaml --exit-code
+pb run validation.py --exit-code
 ```
 
 Click the following headings to see some video demonstrations of the CLI:

{pointblank-0.11.5 → pointblank-0.12.0}/docs/_quarto.yml

@@ -79,7 +79,10 @@ website:
             - user-guide/schema-validation.qmd
             - user-guide/assertions.qmd
             - user-guide/draft-validation.qmd
+        - section: "YAML"
+          contents:
             - user-guide/yaml-validation-workflows.qmd
+            - user-guide/yaml-reference.qmd
         - section: "Post Interrogation"
           contents:
             - user-guide/step-reports.qmd
@@ -94,6 +97,7 @@ website:
           contents:
             - user-guide/cli-data-inspection.qmd
             - user-guide/cli-data-validation.qmd
+            - user-guide/cli-reference.qmd
 
   page-footer:
     left: 'Proudly supported by <a href="https://www.posit.co/" class="no-icon"><img src="/assets/posit-logo-black.svg" alt="Posit" width="80" style="padding-left: 3px;vertical-align:text-top;"></a>'
@@ -176,6 +180,11 @@ quartodoc:
         - name: first_n
         - name: last_n
         - name: expr_col
+    - title: Segment Groups
+      desc: >
+        Combine multiple values into a single segment using `seg_*()` helper functions.
+      contents:
+        - name: seg_group
     - title: Interrogation and Reporting
       desc: >
         The validation plan is put into action when `interrogate()` is called. The workflow for

{pointblank-0.11.5 → pointblank-0.12.0}/docs/index.qmd

@@ -120,6 +120,50 @@ validation.get_step_report(i=3).show("browser")  # Get failing records from step
 
 </div>
 
+## YAML Configuration
+
+For teams that need portable, version-controlled validation workflows, Pointblank supports YAML
+configuration files. This makes it easy to share validation logic across different environments and
+team members, ensuring everyone is on the same page.
+
+**validation.yaml**
+
+```yaml
+validate:
+  data: small_table
+  tbl_name: "small_table"
+  label: "Getting started validation"
+
+steps:
+  - col_vals_gt:
+      columns: "d"
+      value: 100
+  - col_vals_le:
+      columns: "c"
+      value: 5
+  - col_exists:
+      columns: ["date", "date_time"]
+```
+
+**Execute the YAML validation**
+
+```python
+import pointblank as pb
+
+# Run validation from YAML configuration
+validation = pb.yaml_interrogate("validation.yaml")
+
+# Get the results just like any other validation
+validation.get_tabular_report().show()
+```
+
+This approach is perfect for:
+
+- **CI/CD pipelines**: Store validation rules alongside your code
+- **Team collaboration**: Share validation logic in a readable format
+- **Environment consistency**: Use the same validation across dev, staging, and production
+- **Documentation**: YAML files serve as living documentation of your data quality requirements
+
 ## Command Line Interface
 
 Pointblank includes a powerful CLI utility called `pb` that lets you run data validation workflows
@@ -148,6 +192,12 @@ pb scan small_table
 **Run Essential Validations**
 
 ```bash
+# Run validation from YAML configuration file
+pb run validation.yaml
+
+# Run validation from Python file
+pb run validation.py
+
 # Check for duplicate rows
 pb validate small_table --check rows-distinct
 
@@ -161,8 +211,12 @@ pb validate small_table --check col-vals-gt --column a --value 5 --show-extract
 **Integrate with CI/CD**
 
 ```bash
-# Use exit codes for automation (0 = pass, 1 = fail)
+# Use exit codes for automation in one-liner validations (0 = pass, 1 = fail)
 pb validate small_table --check rows-distinct --exit-code
+
+# Run validation workflows with exit codes
+pb run validation.yaml --exit-code
+pb run validation.py --exit-code
 ```
 
 ## Join the Community

{pointblank-0.11.5 → pointblank-0.12.0}/docs/styles.css

@@ -38,6 +38,12 @@ code {
     color: rgb(18, 18, 18);
 }
 
+.blockquote {
+    font-size: 13px;
+    background-color: #E8E8E8;
+    border-left-color: #4682B4;
+}
+
 p,h1,h2,h3,#toc-title,#toc-function-reference,.nav-link,.table {
     font-family: "Open Sans", -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", Arial, sans-serif;
 }