datacheck-cli 2.1.3__tar.gz → 2.1.4__tar.gz

datacheck_cli-2.1.4/PKG-INFO

@@ -0,0 +1,205 @@
+Metadata-Version: 2.4
+Name: datacheck-cli
+Version: 2.1.4
+Summary: A linter for data pipelines. Enforce deterministic validation rules in CI/CD, Airflow, and beyond.
+License: Apache-2.0
+License-File: LICENSE
+Keywords: data-validation,data-linter,cli,data-engineering,pipeline,ci-cd,yaml,testing,csv,parquet,postgres,data-testing,great-expectations-alternative,soda-alternative,dbt-testing,data-contracts,airflow,snowflake,bigquery,redshift,schema-contracts,schema-validation,data-pipeline,etl-testing
+Author: Squrtech
+Author-email: contact@squrtech.com
+Requires-Python: >=3.10,<4.0
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Intended Audience :: System Administrators
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
+Classifier: Topic :: Database :: Database Engines/Servers
+Classifier: Topic :: Scientific/Engineering :: Information Analysis
+Classifier: Topic :: Software Development :: Quality Assurance
+Provides-Extra: all
+Provides-Extra: bigquery
+Provides-Extra: cloud
+Provides-Extra: databases
+Provides-Extra: mysql
+Provides-Extra: postgres
+Provides-Extra: postgresql
+Provides-Extra: redshift
+Provides-Extra: s3
+Provides-Extra: snowflake
+Provides-Extra: statistical
+Provides-Extra: validation
+Provides-Extra: warehouses
+Requires-Dist: boto3 (>=1.34.0,<2.0.0) ; extra == "s3" or extra == "cloud" or extra == "redshift" or extra == "warehouses" or extra == "all"
+Requires-Dist: click (>=8.1.0,<9.0.0)
+Requires-Dist: duckdb (>=1.0.0,<2.0.0)
+Requires-Dist: google-auth (>=2.0.0,<3.0.0) ; extra == "bigquery" or extra == "warehouses" or extra == "all"
+Requires-Dist: google-cloud-bigquery (>=3.0.0,<4.0.0) ; extra == "bigquery" or extra == "warehouses" or extra == "all"
+Requires-Dist: jsonschema (>=4.17.0,<5.0.0) ; extra == "validation" or extra == "all"
+Requires-Dist: mysql-connector-python (>=8.2.0,<10.0.0) ; extra == "mysql" or extra == "databases" or extra == "all"
+Requires-Dist: numpy (>=1.24.0,<3.0.0)
+Requires-Dist: pandas (>=2.0.0,<3.0.0)
+Requires-Dist: psycopg2-binary (>=2.9.9,<3.0.0) ; extra == "postgresql" or extra == "postgres" or extra == "databases" or extra == "redshift" or extra == "warehouses" or extra == "all"
+Requires-Dist: pyarrow (>=14.0.0,<24.0.0)
+Requires-Dist: pyyaml (>=6.0,<7.0)
+Requires-Dist: rich (>=13,<15)
+Requires-Dist: scipy (>=1.11.0,<2.0.0) ; (python_version >= "3.11") and (extra == "statistical" or extra == "all")
+Requires-Dist: snowflake-connector-python (>=3.0.0,<4.0.0) ; extra == "snowflake" or extra == "warehouses" or extra == "all"
+Requires-Dist: sqlalchemy (>=2.0.23,<3.0.0) ; extra == "postgresql" or extra == "postgres" or extra == "mysql" or extra == "databases" or extra == "redshift" or extra == "warehouses" or extra == "all"
+Requires-Dist: typer (>=0.12,<1.0.0)
+Project-URL: Homepage, https://github.com/squrtech/datacheck
+Project-URL: Repository, https://github.com/squrtech/datacheck
+Description-Content-Type: text/markdown
+
+# DataCheck — Data Validation Made Easy
+
+[![PyPI version](https://img.shields.io/pypi/v/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/downloads/)
+[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
+
+**DataCheck is a dataset validation tool.** Define rules in YAML, point it at your data, and it fails fast if anything is wrong — in CI or locally.
+
+---
+
+## Install
+
+```bash
+pip install datacheck-cli
+```
+
+For database connectivity, install the extras you need:
+
+```bash
+pip install datacheck-cli[postgresql]   # PostgreSQL
+pip install datacheck-cli[mysql]        # MySQL
+pip install datacheck-cli[snowflake]    # Snowflake
+pip install datacheck-cli[bigquery]     # BigQuery
+pip install datacheck-cli[redshift]     # Redshift
+pip install datacheck-cli[s3]           # S3 (CSV/Parquet)
+pip install datacheck-cli[all]          # Everything
+```
+
+---
+
+## Write a config
+
+```bash
+datacheck config init
+```
+
+This creates `datacheck.yaml`. Edit it to define your validation rules:
+
+```yaml
+# datacheck.yaml
+version: "1.0"
+sources_file: sources.yaml
+source: my_data
+
+checks:
+  - column: id
+    rules:
+      - not_null
+      - unique
+
+  - column: email
+    rules:
+      - not_null
+      - regex: "^[^@]+@[^@]+$"
+
+  - column: amount
+    rules:
+      - type: numeric
+      - positive
+```
+
+---
+
+## Add sources
+
+Create `sources.yaml` to define where your data lives:
+
+```yaml
+# sources.yaml
+version: "1.0"
+
+sources:
+  # Local CSV or Parquet file
+  my_data:
+    type: duckdb
+    path: ./data/customers.csv
+
+  # PostgreSQL
+  # my_data:
+  #   type: postgresql
+  #   host: ${PG_HOST}
+  #   database: ${PG_DATABASE}
+  #   user: ${PG_USER}
+  #   password: ${PG_PASSWORD}
+
+  # Snowflake
+  # my_data:
+  #   type: snowflake
+  #   account: ${SF_ACCOUNT}
+  #   user: ${SF_USER}
+  #   password: ${SF_PASSWORD}
+  #   warehouse: ${SF_WAREHOUSE}
+  #   database: ${SF_DATABASE}
+  #   schema: ${SF_SCHEMA}
+```
+
+Supported sources: **CSV/Parquet** (via DuckDB), **PostgreSQL**, **MySQL**, **Snowflake**, **BigQuery**, **Redshift**.
+
+Credentials use environment variables — `sources.yaml` never needs secrets hardcoded.
+
+---
+
+## Validate
+
+```bash
+datacheck validate
+```
+
+DataCheck runs all checks against your source and exits `0` on pass, `1` on failure.
+
+```
+✅  id         not_null    passed   10,000 rows
+✅  id         unique      passed   10,000 rows
+❌  email      regex       FAILED   142/10,000 rows (1.4%)
+✅  amount     type        passed   10,000 rows
+✅  amount     positive    passed   10,000 rows
+```
+
+For database sources validation runs as a single aggregate SQL query — no data is pulled out of your warehouse.
+
+---
+
+## Rules reference
+
+| Category  | Rules                                                                 |
+| :-------- | :-------------------------------------------------------------------- |
+| Presence  | `not_null`, `unique`                                                  |
+| Type      | `type: integer`, `type: numeric`, `type: string`, `type: date`        |
+| Numeric   | `positive`, `range: {min, max}`                                       |
+| String    | `regex`, `allowed_values`, `min_length`, `max_length`                 |
+| Boolean   | `boolean`                                                             |
+| Temporal  | `no_future_timestamps`, `date_range: {min, max}`                      |
+
+---
+
+## Documentation
+
+[squrtech.github.io/datacheck](https://squrtech.github.io/datacheck/)
+
+---
+
+## License
+
+Apache 2.0
+

datacheck_cli-2.1.4/README_PYPI.md

@@ -0,0 +1,144 @@
+# DataCheck — Data Validation Made Easy
+
+[![PyPI version](https://img.shields.io/pypi/v/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/downloads/)
+[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
+
+**DataCheck is a dataset validation tool.** Define rules in YAML, point it at your data, and it fails fast if anything is wrong — in CI or locally.
+
+---
+
+## Install
+
+```bash
+pip install datacheck-cli
+```
+
+For database connectivity, install the extras you need:
+
+```bash
+pip install datacheck-cli[postgresql]   # PostgreSQL
+pip install datacheck-cli[mysql]        # MySQL
+pip install datacheck-cli[snowflake]    # Snowflake
+pip install datacheck-cli[bigquery]     # BigQuery
+pip install datacheck-cli[redshift]     # Redshift
+pip install datacheck-cli[s3]           # S3 (CSV/Parquet)
+pip install datacheck-cli[all]          # Everything
+```
+
+---
+
+## Write a config
+
+```bash
+datacheck config init
+```
+
+This creates `datacheck.yaml`. Edit it to define your validation rules:
+
+```yaml
+# datacheck.yaml
+version: "1.0"
+sources_file: sources.yaml
+source: my_data
+
+checks:
+  - column: id
+    rules:
+      - not_null
+      - unique
+
+  - column: email
+    rules:
+      - not_null
+      - regex: "^[^@]+@[^@]+$"
+
+  - column: amount
+    rules:
+      - type: numeric
+      - positive
+```
+
+---
+
+## Add sources
+
+Create `sources.yaml` to define where your data lives:
+
+```yaml
+# sources.yaml
+version: "1.0"
+
+sources:
+  # Local CSV or Parquet file
+  my_data:
+    type: duckdb
+    path: ./data/customers.csv
+
+  # PostgreSQL
+  # my_data:
+  #   type: postgresql
+  #   host: ${PG_HOST}
+  #   database: ${PG_DATABASE}
+  #   user: ${PG_USER}
+  #   password: ${PG_PASSWORD}
+
+  # Snowflake
+  # my_data:
+  #   type: snowflake
+  #   account: ${SF_ACCOUNT}
+  #   user: ${SF_USER}
+  #   password: ${SF_PASSWORD}
+  #   warehouse: ${SF_WAREHOUSE}
+  #   database: ${SF_DATABASE}
+  #   schema: ${SF_SCHEMA}
+```
+
+Supported sources: **CSV/Parquet** (via DuckDB), **PostgreSQL**, **MySQL**, **Snowflake**, **BigQuery**, **Redshift**.
+
+Credentials use environment variables — `sources.yaml` never needs secrets hardcoded.
+
+---
+
+## Validate
+
+```bash
+datacheck validate
+```
+
+DataCheck runs all checks against your source and exits `0` on pass, `1` on failure.
+
+```
+✅  id         not_null    passed   10,000 rows
+✅  id         unique      passed   10,000 rows
+❌  email      regex       FAILED   142/10,000 rows (1.4%)
+✅  amount     type        passed   10,000 rows
+✅  amount     positive    passed   10,000 rows
+```
+
+For database sources validation runs as a single aggregate SQL query — no data is pulled out of your warehouse.
+
+---
+
+## Rules reference
+
+| Category  | Rules                                                                 |
+| :-------- | :-------------------------------------------------------------------- |
+| Presence  | `not_null`, `unique`                                                  |
+| Type      | `type: integer`, `type: numeric`, `type: string`, `type: date`        |
+| Numeric   | `positive`, `range: {min, max}`                                       |
+| String    | `regex`, `allowed_values`, `min_length`, `max_length`                 |
+| Boolean   | `boolean`                                                             |
+| Temporal  | `no_future_timestamps`, `date_range: {min, max}`                      |
+
+---
+
+## Documentation
+
+[squrtech.github.io/datacheck](https://squrtech.github.io/datacheck/)
+
+---
+
+## License
+
+Apache 2.0

{datacheck_cli-2.1.3 → datacheck_cli-2.1.4}/datacheck/__init__.py

@@ -25,7 +25,7 @@ from datacheck.schema import (
     SchemaDetector,
 )
 
-__version__ = "2.1.3"
+__version__ = "2.1.4"
 __author__ = "Squrtech"
 __email__ = "contact@squrtech.com"
 

{datacheck_cli-2.1.3 → datacheck_cli-2.1.4}/datacheck/rules/numeric_rules.py

@@ -1,6 +1,7 @@
 """Numeric validation rules."""
 
 import pandas as pd
+import logging
 
 from datacheck.exceptions import ColumnNotFoundError, RuleDefinitionError
 from datacheck.results import RuleResult
@@ -17,6 +18,7 @@ def _ensure_numeric(series: pd.Series) -> pd.Series:
       ``pd.read_parquet()`` for Parquet decimal128 columns. ``is_numeric_dtype()``
       returns False, and numpy ops fail on Decimal/float mixing.
     """
+    logger = logging.getLogger(__name__)
     try:
         import pyarrow as pa
 
@@ -24,8 +26,12 @@ def _ensure_numeric(series: pd.Series) -> pd.Series:
             series.dtype.pyarrow_dtype
         ):
             return series.astype("float64")
-    except Exception:
+    except ImportError:
+        # pyarrow is an optional dependency; if unavailable, fall back to original series
         pass
+    except Exception as e:
+        # Unexpected failure when handling Arrow-backed decimals; fall back to original series
+        logger.debug("Failed to coerce Arrow decimal series to float64: %s", e)
     # Handle object dtype containing Python decimal.Decimal objects
     if series.dtype == object:
         try:
@@ -33,8 +39,13 @@ def _ensure_numeric(series: pd.Series) -> pd.Series:
             first_valid = series.dropna()
             if len(first_valid) > 0 and isinstance(first_valid.iloc[0], decimal.Decimal):
                 return pd.to_numeric(series, errors="coerce")
-        except Exception:
+        except ImportError:
+            # decimal is part of the standard library; this is highly unexpected.
+            # If it occurs, simply fall back to returning the original series.
             pass
+        except Exception as e:
+            # Unexpected failure when handling Decimal objects; fall back to original series
+            logger.debug("Failed to coerce Decimal series to numeric: %s", e)
     return series
 
 

{datacheck_cli-2.1.3 → datacheck_cli-2.1.4}/datacheck/rules/temporal_rules.py

@@ -36,8 +36,13 @@ def _to_datetime_fast(series: pd.Series) -> pd.Series:
                         name=series.name,
                     )
                 except Exception:
+                    # If the Arrow-based fast path fails for any reason, fall back
+                    # to the standard pandas to_datetime conversion below.
                     pass
     except Exception:
+        # If pyarrow is unavailable or any unexpected error occurs in the
+        # detection/casting logic above, skip the optimization and fall back
+        # to the standard pandas to_datetime conversion below.
         pass
     return pd.to_datetime(series, errors="coerce", format="mixed")
 

{datacheck_cli-2.1.3 → datacheck_cli-2.1.4}/datacheck/schema/detector.py

@@ -2,6 +2,7 @@
 
 from __future__ import annotations
 
+import logging
 import re
 import warnings
 from typing import TYPE_CHECKING
@@ -14,6 +15,8 @@ if TYPE_CHECKING:
     from datacheck.config.source import SourceConfig
     from datacheck.connectors.base import DatabaseConnector
 
+logger = logging.getLogger(__name__)
+
 # Regex for date-only strings like "2024-01-15"
 _DATE_PATTERN = re.compile(r"^\d{4}-\d{2}-\d{2}$")
 
@@ -177,8 +180,13 @@ class SchemaDetector:
             if approx_unique is not None and str(approx_unique) not in ("None", "nan"):
                 try:
                     unique_count = int(approx_unique)
-                except (ValueError, TypeError):
-                    pass
+                except (ValueError, TypeError) as exc:
+                    logger.debug(
+                        "Could not parse approx_unique value %r for column %r: %s",
+                        approx_unique,
+                        col_name,
+                        exc,
+                    )
 
             columns.append(ColumnSchema(
                 name=col_name,
@@ -573,11 +581,16 @@ class SchemaDetector:
 
         # Boolean-like values
         bool_values = {True, False, "true", "false", "True", "False", "1", "0"}
-        try:
-            if all(v in bool_values for v in sample):
-                return ColumnType.BOOLEAN
-        except TypeError:
-            pass
+
+        def _is_bool_like(value: object) -> bool:
+            """Safely test membership in bool_values without raising TypeError."""
+            try:
+                return value in bool_values
+            except TypeError:
+                return False
+
+        if all(_is_bool_like(v) for v in sample):
+            return ColumnType.BOOLEAN
 
         # Numeric strings
         try:

{datacheck_cli-2.1.3 → datacheck_cli-2.1.4}/pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "datacheck-cli"
-version = "2.1.3"
+version = "2.1.4"
 description = "A linter for data pipelines. Enforce deterministic validation rules in CI/CD, Airflow, and beyond."
 authors = ["Squrtech <contact@squrtech.com>"]
 readme = "README_PYPI.md"
@@ -99,7 +99,7 @@ all = [
 # Testing framework
 pytest = ">=7.4.0,<10.0.0"
 pytest-cov = ">=4.1,<8.0"
-pytest-asyncio = ">=0.23.0,<1.0.0"
+pytest-asyncio = ">=0.23.0,<2.0.0"
 pytest-timeout = ">=2.2.0,<3.0.0"
 
 # Code quality
@@ -135,6 +135,7 @@ build-backend = "poetry.core.masonry.api"
 [tool.ruff]
 line-length = 100
 target-version = "py310"
+exclude = ["testing", "security"]
 
 [tool.ruff.lint]
 select = [

datacheck_cli-2.1.3/PKG-INFO

@@ -1,296 +0,0 @@
-Metadata-Version: 2.4
-Name: datacheck-cli
-Version: 2.1.3
-Summary: A linter for data pipelines. Enforce deterministic validation rules in CI/CD, Airflow, and beyond.
-License: Apache-2.0
-License-File: LICENSE
-Keywords: data-validation,data-linter,cli,data-engineering,pipeline,ci-cd,yaml,testing,csv,parquet,postgres,data-testing,great-expectations-alternative,soda-alternative,dbt-testing,data-contracts,airflow,snowflake,bigquery,redshift,schema-contracts,schema-validation,data-pipeline,etl-testing
-Author: Squrtech
-Author-email: contact@squrtech.com
-Requires-Python: >=3.10,<4.0
-Classifier: Development Status :: 5 - Production/Stable
-Classifier: Environment :: Console
-Classifier: Intended Audience :: Developers
-Classifier: Intended Audience :: Science/Research
-Classifier: Intended Audience :: System Administrators
-Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Operating System :: OS Independent
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Classifier: Programming Language :: Python :: 3.14
-Classifier: Topic :: Database :: Database Engines/Servers
-Classifier: Topic :: Scientific/Engineering :: Information Analysis
-Classifier: Topic :: Software Development :: Quality Assurance
-Provides-Extra: all
-Provides-Extra: bigquery
-Provides-Extra: cloud
-Provides-Extra: databases
-Provides-Extra: mysql
-Provides-Extra: postgres
-Provides-Extra: postgresql
-Provides-Extra: redshift
-Provides-Extra: s3
-Provides-Extra: snowflake
-Provides-Extra: statistical
-Provides-Extra: validation
-Provides-Extra: warehouses
-Requires-Dist: boto3 (>=1.34.0,<2.0.0) ; extra == "s3" or extra == "cloud" or extra == "redshift" or extra == "warehouses" or extra == "all"
-Requires-Dist: click (>=8.1.0,<9.0.0)
-Requires-Dist: duckdb (>=1.0.0,<2.0.0)
-Requires-Dist: google-auth (>=2.0.0,<3.0.0) ; extra == "bigquery" or extra == "warehouses" or extra == "all"
-Requires-Dist: google-cloud-bigquery (>=3.0.0,<4.0.0) ; extra == "bigquery" or extra == "warehouses" or extra == "all"
-Requires-Dist: jsonschema (>=4.17.0,<5.0.0) ; extra == "validation" or extra == "all"
-Requires-Dist: mysql-connector-python (>=8.2.0,<10.0.0) ; extra == "mysql" or extra == "databases" or extra == "all"
-Requires-Dist: numpy (>=1.24.0,<3.0.0)
-Requires-Dist: pandas (>=2.0.0,<3.0.0)
-Requires-Dist: psycopg2-binary (>=2.9.9,<3.0.0) ; extra == "postgresql" or extra == "postgres" or extra == "databases" or extra == "redshift" or extra == "warehouses" or extra == "all"
-Requires-Dist: pyarrow (>=14.0.0,<24.0.0)
-Requires-Dist: pyyaml (>=6.0,<7.0)
-Requires-Dist: rich (>=13,<15)
-Requires-Dist: scipy (>=1.11.0,<2.0.0) ; (python_version >= "3.11") and (extra == "statistical" or extra == "all")
-Requires-Dist: snowflake-connector-python (>=3.0.0,<4.0.0) ; extra == "snowflake" or extra == "warehouses" or extra == "all"
-Requires-Dist: sqlalchemy (>=2.0.23,<3.0.0) ; extra == "postgresql" or extra == "postgres" or extra == "mysql" or extra == "databases" or extra == "redshift" or extra == "warehouses" or extra == "all"
-Requires-Dist: typer (>=0.12,<1.0.0)
-Project-URL: Homepage, https://github.com/squrtech/datacheck
-Project-URL: Repository, https://github.com/squrtech/datacheck
-Description-Content-Type: text/markdown
-
-# DataCheck: The Linter for Data Contracts
-
-[![PyPI version](https://img.shields.io/pypi/v/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
-[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/downloads/)
-[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
-[![Downloads](https://img.shields.io/pypi/dm/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
-
-**Enforce deterministic data gates at the pipeline boundary. No servers. No side-effects. Just valid data.**
-
-DataCheck is a CLI-first enforcement layer for the modern data stack. It brings the discipline of **Software Linting** to data engineering, allowing you to "Fail Fast" in CI/CD before bad data ever hits your warehouse.
-
-## Why DataCheck?
-
-* **SQL Pushdown:** For Snowflake, BigQuery, Redshift, PostgreSQL, and MySQL, validation runs as a single aggregate `SELECT`. We don't pull your data; we move the logic to the database.
-* **Zero Infrastructure:** No databases to manage or SaaS accounts to pay for. It's a stateless binary that runs anywhere.
-* **CI-Native:** Generates native **SARIF** output so data failures appear directly in your GitHub Security tab.
-* **Schema Guard:** Capture a baseline and detect breaking changes (`schema compare`) with a single command.
-
-## How it compares
-
-| Feature | DataCheck | Great Expectations / SaaS |
-| :--- | :--- | :--- |
-| **Philosophy** | **Gatekeeper** (Block bad data) | **Reporter** (Find it later) |
-| **Compute** | **Pushdown** (Zero Egress) | **Pull** (Expensive compute) |
-| **Setup** | < 1 Minute | Hours / Days |
-| **CI/CD** | Native SARIF / GitHub Action | Webhooks / APIs |
-
-## Installation
-
-```bash
-pip install datacheck-cli
-```
-
-To install with support for a specific data source, use extras:
-
-```bash
-pip install datacheck-cli[postgresql]    # PostgreSQL
-pip install datacheck-cli[mysql]         # MySQL
-pip install datacheck-cli[snowflake]     # Snowflake
-pip install datacheck-cli[bigquery]      # BigQuery
-pip install datacheck-cli[redshift]      # Redshift
-pip install datacheck-cli[s3]            # S3
-pip install datacheck-cli[all]           # All data sources
-```
-
-## Quickstart
-
-**Option 1 - Start from a template:**
-
-```bash
-datacheck config init --with-sample-data
-datacheck config init --template ecommerce --with-sample-data
-```
-
-**Option 2 - Write manually.** Create a `sources.yaml` and `.datacheck.yaml` with your data source and validation rules:
-
-```yaml
-# sources.yaml
-sources:
-  orders:
-    type: duckdb
-    path: ./data/orders.csv
-```
-
-```yaml
-# .datacheck.yaml
-sources_file: sources.yaml
-source: orders
-
-checks:
-  - name: id_check
-    column: id
-    rules:
-      not_null: true
-      unique: true
-
-  - name: amount_check
-    column: amount
-    rules:
-      not_null: true
-      min: 0
-      max: 10000
-```
-
-Run validation:
-
-```bash
-datacheck validate                          # auto-discover config
-datacheck validate --config checks.yaml     # explicit config path
-echo $?  # 1 if any error-severity rule fails
-```
-
-## CI/CD Integration
-
-### GitHub Actions (with SARIF to Security tab)
-
-```yaml
-# .github/workflows/data-quality.yml
-name: Data Quality Gate
-on: [push, pull_request]
-
-permissions:
-  contents: read
-  security-events: write
-
-jobs:
-  validate:
-    runs-on: ubuntu-latest
-    steps:
-      - uses: actions/checkout@v4
-      - uses: squrtech/datacheck-action@v1
-        with:
-          config: .datacheck.yaml
-```
-
-Or generate SARIF manually and upload to the GitHub Security tab:
-
-```yaml
-      - name: Run data quality gate
-        run: |
-          pip install datacheck-cli
-          datacheck validate -c .datacheck.yaml --format sarif --output results.sarif
-
-      - name: Upload SARIF
-        uses: github/codeql-action/upload-sarif@v3
-        if: always()
-        with:
-          sarif_file: results.sarif
-```
-
-### Apache Airflow
-
-```python
-from airflow_provider_datacheck.operators.datacheck import DataCheckOperator
-
-validate_orders = DataCheckOperator(
-    task_id="validate_orders",
-    config_path="/config/orders.datacheck.yaml",
-    source_name="production_db",
-    table="orders",
-    fail_on_error=True,
-)
-```
-
-## Database and Cloud Sources
-
-For databases and cloud storage, define named sources in a `sources.yaml` file:
-
-```yaml
-# sources.yaml
-sources:
-  production_db:
-    type: postgresql
-    host: ${DB_HOST}
-    port: ${DB_PORT:-5432}
-    database: ${DB_NAME}
-    user: ${DB_USER}
-    password: ${DB_PASSWORD}
-
-  analytics_wh:
-    type: snowflake
-    account: ${SF_ACCOUNT}
-    user: ${SF_USER}
-    password: ${SF_PASSWORD}
-    warehouse: ${SF_WAREHOUSE:-COMPUTE_WH}
-    database: ${SF_DATABASE}
-    schema: ${SF_SCHEMA:-PUBLIC}
-
-  s3_data:
-    type: s3
-    bucket: ${S3_BUCKET}
-    path: data/orders.csv
-    region: ${AWS_REGION:-us-east-1}
-    access_key: ${AWS_ACCESS_KEY_ID}
-    secret_key: ${AWS_SECRET_ACCESS_KEY}
-```
-
-Reference in your config:
-
-```yaml
-# datacheck.yaml
-sources_file: ./sources.yaml
-source: production_db
-table: orders
-```
-
-## Enforce Schema Contracts
-
-```bash
-datacheck schema capture                                                          # Save current schema as baseline
-datacheck schema capture data.csv                                                 # Direct file path
-datacheck schema capture --source production_db --sources-file sources.yaml       # Named source
-datacheck schema compare                                                          # Compare against baseline
-datacheck schema compare --fail-on-breaking                                       # Exit 1 on breaking changes
-```
-
-## Python API
-
-```python
-from datacheck import ValidationEngine
-
-engine = ValidationEngine(config_path=".datacheck.yaml")
-summary = engine.validate_sources()
-
-print(f"Passed: {summary.passed_rules}/{summary.total_rules}")
-
-for result in summary.get_failed_results():
-    print(f"  FAIL: {result.rule_name} on {result.column} ({result.failed_rows} rows)")
-
-if not summary.all_passed:
-    raise ValueError("Data quality gate failed - halting pipeline")
-```
-
-## Available Rules
-
-| Category | Rules |
-|----------|-------|
-| Null & Uniqueness | `not_null`, `unique`, `unique_combination` |
-| Numeric | `min`, `max`, `range`, `boolean` |
-| String & Pattern | `regex`, `allowed_values`, `length`, `min_length`, `max_length`, `type` |
-| Temporal | `max_age`, `timestamp_range` (or `date_range`), `no_future_timestamps`, `date_format_valid` (or `date_format`) |
-| Cross-Column | `unique_combination`, `sum_equals` |
-
-## Links
-
-- [Full Documentation](https://squrtech.github.io/datacheck/)
-- [Available Rules Reference](https://squrtech.github.io/datacheck/#available-rules)
-- [CLI Command Reference](https://squrtech.github.io/datacheck/#cli-command-reference)
-- [GitHub](https://github.com/squrtech/datacheck)
-- [Issues](https://github.com/squrtech/datacheck/issues)
-- [Changelog](https://github.com/squrtech/datacheck/blob/main/CHANGELOG.md)
-
-## License
-
-Copyright © 2026 Squrtech. Licensed under the **Apache License, Version 2.0**.
-

datacheck_cli-2.1.3/README_PYPI.md

@@ -1,235 +0,0 @@
-# DataCheck: The Linter for Data Contracts
-
-[![PyPI version](https://img.shields.io/pypi/v/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
-[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/downloads/)
-[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
-[![Downloads](https://img.shields.io/pypi/dm/datacheck-cli.svg)](https://pypi.org/project/datacheck-cli/)
-
-**Enforce deterministic data gates at the pipeline boundary. No servers. No side-effects. Just valid data.**
-
-DataCheck is a CLI-first enforcement layer for the modern data stack. It brings the discipline of **Software Linting** to data engineering, allowing you to "Fail Fast" in CI/CD before bad data ever hits your warehouse.
-
-## Why DataCheck?
-
-* **SQL Pushdown:** For Snowflake, BigQuery, Redshift, PostgreSQL, and MySQL, validation runs as a single aggregate `SELECT`. We don't pull your data; we move the logic to the database.
-* **Zero Infrastructure:** No databases to manage or SaaS accounts to pay for. It's a stateless binary that runs anywhere.
-* **CI-Native:** Generates native **SARIF** output so data failures appear directly in your GitHub Security tab.
-* **Schema Guard:** Capture a baseline and detect breaking changes (`schema compare`) with a single command.
-
-## How it compares
-
-| Feature | DataCheck | Great Expectations / SaaS |
-| :--- | :--- | :--- |
-| **Philosophy** | **Gatekeeper** (Block bad data) | **Reporter** (Find it later) |
-| **Compute** | **Pushdown** (Zero Egress) | **Pull** (Expensive compute) |
-| **Setup** | < 1 Minute | Hours / Days |
-| **CI/CD** | Native SARIF / GitHub Action | Webhooks / APIs |
-
-## Installation
-
-```bash
-pip install datacheck-cli
-```
-
-To install with support for a specific data source, use extras:
-
-```bash
-pip install datacheck-cli[postgresql]    # PostgreSQL
-pip install datacheck-cli[mysql]         # MySQL
-pip install datacheck-cli[snowflake]     # Snowflake
-pip install datacheck-cli[bigquery]      # BigQuery
-pip install datacheck-cli[redshift]      # Redshift
-pip install datacheck-cli[s3]            # S3
-pip install datacheck-cli[all]           # All data sources
-```
-
-## Quickstart
-
-**Option 1 - Start from a template:**
-
-```bash
-datacheck config init --with-sample-data
-datacheck config init --template ecommerce --with-sample-data
-```
-
-**Option 2 - Write manually.** Create a `sources.yaml` and `.datacheck.yaml` with your data source and validation rules:
-
-```yaml
-# sources.yaml
-sources:
-  orders:
-    type: duckdb
-    path: ./data/orders.csv
-```
-
-```yaml
-# .datacheck.yaml
-sources_file: sources.yaml
-source: orders
-
-checks:
-  - name: id_check
-    column: id
-    rules:
-      not_null: true
-      unique: true
-
-  - name: amount_check
-    column: amount
-    rules:
-      not_null: true
-      min: 0
-      max: 10000
-```
-
-Run validation:
-
-```bash
-datacheck validate                          # auto-discover config
-datacheck validate --config checks.yaml     # explicit config path
-echo $?  # 1 if any error-severity rule fails
-```
-
-## CI/CD Integration
-
-### GitHub Actions (with SARIF to Security tab)
-
-```yaml
-# .github/workflows/data-quality.yml
-name: Data Quality Gate
-on: [push, pull_request]
-
-permissions:
-  contents: read
-  security-events: write
-
-jobs:
-  validate:
-    runs-on: ubuntu-latest
-    steps:
-      - uses: actions/checkout@v4
-      - uses: squrtech/datacheck-action@v1
-        with:
-          config: .datacheck.yaml
-```
-
-Or generate SARIF manually and upload to the GitHub Security tab:
-
-```yaml
-      - name: Run data quality gate
-        run: |
-          pip install datacheck-cli
-          datacheck validate -c .datacheck.yaml --format sarif --output results.sarif
-
-      - name: Upload SARIF
-        uses: github/codeql-action/upload-sarif@v3
-        if: always()
-        with:
-          sarif_file: results.sarif
-```
-
-### Apache Airflow
-
-```python
-from airflow_provider_datacheck.operators.datacheck import DataCheckOperator
-
-validate_orders = DataCheckOperator(
-    task_id="validate_orders",
-    config_path="/config/orders.datacheck.yaml",
-    source_name="production_db",
-    table="orders",
-    fail_on_error=True,
-)
-```
-
-## Database and Cloud Sources
-
-For databases and cloud storage, define named sources in a `sources.yaml` file:
-
-```yaml
-# sources.yaml
-sources:
-  production_db:
-    type: postgresql
-    host: ${DB_HOST}
-    port: ${DB_PORT:-5432}
-    database: ${DB_NAME}
-    user: ${DB_USER}
-    password: ${DB_PASSWORD}
-
-  analytics_wh:
-    type: snowflake
-    account: ${SF_ACCOUNT}
-    user: ${SF_USER}
-    password: ${SF_PASSWORD}
-    warehouse: ${SF_WAREHOUSE:-COMPUTE_WH}
-    database: ${SF_DATABASE}
-    schema: ${SF_SCHEMA:-PUBLIC}
-
-  s3_data:
-    type: s3
-    bucket: ${S3_BUCKET}
-    path: data/orders.csv
-    region: ${AWS_REGION:-us-east-1}
-    access_key: ${AWS_ACCESS_KEY_ID}
-    secret_key: ${AWS_SECRET_ACCESS_KEY}
-```
-
-Reference in your config:
-
-```yaml
-# datacheck.yaml
-sources_file: ./sources.yaml
-source: production_db
-table: orders
-```
-
-## Enforce Schema Contracts
-
-```bash
-datacheck schema capture                                                          # Save current schema as baseline
-datacheck schema capture data.csv                                                 # Direct file path
-datacheck schema capture --source production_db --sources-file sources.yaml       # Named source
-datacheck schema compare                                                          # Compare against baseline
-datacheck schema compare --fail-on-breaking                                       # Exit 1 on breaking changes
-```
-
-## Python API
-
-```python
-from datacheck import ValidationEngine
-
-engine = ValidationEngine(config_path=".datacheck.yaml")
-summary = engine.validate_sources()
-
-print(f"Passed: {summary.passed_rules}/{summary.total_rules}")
-
-for result in summary.get_failed_results():
-    print(f"  FAIL: {result.rule_name} on {result.column} ({result.failed_rows} rows)")
-
-if not summary.all_passed:
-    raise ValueError("Data quality gate failed - halting pipeline")
-```
-
-## Available Rules
-
-| Category | Rules |
-|----------|-------|
-| Null & Uniqueness | `not_null`, `unique`, `unique_combination` |
-| Numeric | `min`, `max`, `range`, `boolean` |
-| String & Pattern | `regex`, `allowed_values`, `length`, `min_length`, `max_length`, `type` |
-| Temporal | `max_age`, `timestamp_range` (or `date_range`), `no_future_timestamps`, `date_format_valid` (or `date_format`) |
-| Cross-Column | `unique_combination`, `sum_equals` |
-
-## Links
-
-- [Full Documentation](https://squrtech.github.io/datacheck/)
-- [Available Rules Reference](https://squrtech.github.io/datacheck/#available-rules)
-- [CLI Command Reference](https://squrtech.github.io/datacheck/#cli-command-reference)
-- [GitHub](https://github.com/squrtech/datacheck)
-- [Issues](https://github.com/squrtech/datacheck/issues)
-- [Changelog](https://github.com/squrtech/datacheck/blob/main/CHANGELOG.md)
-
-## License
-
-Copyright © 2026 Squrtech. Licensed under the **Apache License, Version 2.0**.