sql-testing-library 0.10.0__tar.gz → 0.11.0__tar.gz

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/CHANGELOG.md

@@ -5,6 +5,18 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## 0.11.0 (2025-06-16)
+
+### Feat
+
+- **snowflake**: ad support for map datatype in snowflake (#101)
+
+## 0.10.1 (2025-06-15)
+
+### Fix
+
+- run unittests against different os/python versions (#100)
+
 ## 0.10.0 (2025-06-15)
 
 ### Feat

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.3
 Name: sql-testing-library
-Version: 0.10.0
+Version: 0.11.0
 Summary: A powerful Python framework for unit testing SQL queries across BigQuery, Snowflake, Redshift, Athena, and Trino with mock data
 License: MIT
 Keywords: sql,testing,unit-testing,mock-data,database-testing,bigquery,snowflake,redshift,athena,trino,data-engineering,etl-testing,sql-validation,query-testing
@@ -136,7 +136,7 @@ The library supports different data types across database engines. All checkmark
 | **Integer Array** | `List[int]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Decimal Array** | `List[Decimal]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Optional Array** | `Optional[List[T]]` | ✅ | ✅ | ✅ | ✅ | ✅ |
-| **Map/Dict** | `Dict[K, V]` | ✅ | ✅ | ✅ | ✅ | ❌ |
+| **Map/Dict** | `Dict[K, V]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Struct/Record** | `dataclass` | ❌ | ❌ | ❌ | ❌ | ❌ |
 | **Nested Arrays** | `List[List[T]]` | ❌ | ❌ | ❌ | ❌ | ❌ |
 
@@ -146,7 +146,7 @@ The library supports different data types across database engines. All checkmark
 - **Athena**: 256KB query size limit; supports arrays and maps using `ARRAY[]` and `MAP(ARRAY[], ARRAY[])` syntax
 - **Redshift**: Arrays and maps implemented via SUPER type (JSON parsing); 16MB query size limit
 - **Trino**: Memory catalog for testing; excellent decimal precision; supports arrays and maps
-- **Snowflake**: Column names normalized to lowercase; 1MB query size limit
+- **Snowflake**: Column names normalized to lowercase; 1MB query size limit; dict/map types implemented via VARIANT type (JSON parsing)
 
 ## Execution Modes Support
 
@@ -842,20 +842,83 @@ The adapter_type parameter will use the configuration from the corresponding sec
 
 ## Development Setup
 
+### Quick Start with Make
+
+The project includes a Makefile for common development tasks:
+
+```bash
+# Install all dependencies
+make install
+
+# Run unit tests
+make test
+
+# Run linting and type checking
+make lint
+
+# Format code
+make format
+
+# Run all checks (lint + format check + tests)
+make check
+
+# See all available commands
+make help
+```
+
+### Available Make Commands
+
+| Command | Description |
+|---------|-------------|
+| `make install` | Install all dependencies with poetry |
+| `make test` | Run unit tests with coverage |
+| `make test-unit` | Run unit tests (excludes integration tests) |
+| `make test-integration` | Run integration tests (requires DB credentials) |
+| `make test-all` | Run all tests (unit + integration) |
+| `make test-tox` | Run tests across all Python versions (3.9-3.12) |
+| `make lint` | Run ruff and mypy checks |
+| `make format` | Format code with black and ruff |
+| `make check` | Run all checks (lint + format + tests) |
+| `make clean` | Remove build artifacts and cache files |
+| `make build` | Build distribution packages |
+| `make docs` | Build documentation |
+
+### Testing Across Python Versions
+
+The project supports Python 3.9-3.12. You can test across all versions using:
+
+```bash
+# Using tox (automatically tests all Python versions)
+make test-tox
+
+# Or directly with tox
+tox
+
+# Test specific Python version
+tox -e py39  # Python 3.9
+tox -e py310 # Python 3.10
+tox -e py311 # Python 3.11
+tox -e py312 # Python 3.12
+```
+
 ### Code Quality
 
 The project uses comprehensive tools to ensure code quality:
 
 1. **Ruff** for linting and formatting
-2. **Pyright** for static type checking
-3. **Pre-commit hooks** for automated checks
+2. **Black** for code formatting
+3. **Mypy** for static type checking
+4. **Pre-commit hooks** for automated checks
 
 To set up the development environment:
 
 1. Install development dependencies:
    ```bash
-   # Install all dependencies including database adapters and dev tools
-   poetry install --with bigquery,athena,redshift,trino,snowflake,dev
+   # Using make
+   make install
+
+   # Or directly with poetry
+   poetry install --all-extras
    ```
 
 2. Set up pre-commit hooks:
@@ -985,7 +1048,6 @@ The library has a few known limitations that are planned to be addressed in futu
 
 ### Snowflake Support
 - Physical table tests for Snowflake are currently skipped due to complex mocking requirements
-- Need better support for Snowflake-specific data types (VARIANT, OBJECT, ARRAY)
 
 ### General Improvements
 - Add support for more SQL dialects

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/README.md

@@ -79,7 +79,7 @@ The library supports different data types across database engines. All checkmark
 | **Integer Array** | `List[int]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Decimal Array** | `List[Decimal]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Optional Array** | `Optional[List[T]]` | ✅ | ✅ | ✅ | ✅ | ✅ |
-| **Map/Dict** | `Dict[K, V]` | ✅ | ✅ | ✅ | ✅ | ❌ |
+| **Map/Dict** | `Dict[K, V]` | ✅ | ✅ | ✅ | ✅ | ✅ |
 | **Struct/Record** | `dataclass` | ❌ | ❌ | ❌ | ❌ | ❌ |
 | **Nested Arrays** | `List[List[T]]` | ❌ | ❌ | ❌ | ❌ | ❌ |
 
@@ -89,7 +89,7 @@ The library supports different data types across database engines. All checkmark
 - **Athena**: 256KB query size limit; supports arrays and maps using `ARRAY[]` and `MAP(ARRAY[], ARRAY[])` syntax
 - **Redshift**: Arrays and maps implemented via SUPER type (JSON parsing); 16MB query size limit
 - **Trino**: Memory catalog for testing; excellent decimal precision; supports arrays and maps
-- **Snowflake**: Column names normalized to lowercase; 1MB query size limit
+- **Snowflake**: Column names normalized to lowercase; 1MB query size limit; dict/map types implemented via VARIANT type (JSON parsing)
 
 ## Execution Modes Support
 
@@ -785,20 +785,83 @@ The adapter_type parameter will use the configuration from the corresponding sec
 
 ## Development Setup
 
+### Quick Start with Make
+
+The project includes a Makefile for common development tasks:
+
+```bash
+# Install all dependencies
+make install
+
+# Run unit tests
+make test
+
+# Run linting and type checking
+make lint
+
+# Format code
+make format
+
+# Run all checks (lint + format check + tests)
+make check
+
+# See all available commands
+make help
+```
+
+### Available Make Commands
+
+| Command | Description |
+|---------|-------------|
+| `make install` | Install all dependencies with poetry |
+| `make test` | Run unit tests with coverage |
+| `make test-unit` | Run unit tests (excludes integration tests) |
+| `make test-integration` | Run integration tests (requires DB credentials) |
+| `make test-all` | Run all tests (unit + integration) |
+| `make test-tox` | Run tests across all Python versions (3.9-3.12) |
+| `make lint` | Run ruff and mypy checks |
+| `make format` | Format code with black and ruff |
+| `make check` | Run all checks (lint + format + tests) |
+| `make clean` | Remove build artifacts and cache files |
+| `make build` | Build distribution packages |
+| `make docs` | Build documentation |
+
+### Testing Across Python Versions
+
+The project supports Python 3.9-3.12. You can test across all versions using:
+
+```bash
+# Using tox (automatically tests all Python versions)
+make test-tox
+
+# Or directly with tox
+tox
+
+# Test specific Python version
+tox -e py39  # Python 3.9
+tox -e py310 # Python 3.10
+tox -e py311 # Python 3.11
+tox -e py312 # Python 3.12
+```
+
 ### Code Quality
 
 The project uses comprehensive tools to ensure code quality:
 
 1. **Ruff** for linting and formatting
-2. **Pyright** for static type checking
-3. **Pre-commit hooks** for automated checks
+2. **Black** for code formatting
+3. **Mypy** for static type checking
+4. **Pre-commit hooks** for automated checks
 
 To set up the development environment:
 
 1. Install development dependencies:
    ```bash
-   # Install all dependencies including database adapters and dev tools
-   poetry install --with bigquery,athena,redshift,trino,snowflake,dev
+   # Using make
+   make install
+
+   # Or directly with poetry
+   poetry install --all-extras
    ```
 
 2. Set up pre-commit hooks:
@@ -928,7 +991,6 @@ The library has a few known limitations that are planned to be addressed in futu
 
 ### Snowflake Support
 - Physical table tests for Snowflake are currently skipped due to complex mocking requirements
-- Need better support for Snowflake-specific data types (VARIANT, OBJECT, ARRAY)
 
 ### General Improvements
 - Add support for more SQL dialects

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "poetry.core.masonry.api"
 
 [tool.poetry]
 name = "sql-testing-library"
-version = "0.10.0"
+version = "0.11.0"
 description = "A powerful Python framework for unit testing SQL queries across BigQuery, Snowflake, Redshift, Athena, and Trino with mock data"
 authors = ["Gurmeet Saran <gurmeetx@gmail.com>", "Kushal Thakkar <kushal.thakkar@gmail.com>"]
 maintainers = ["Gurmeet Saran <gurmeetx@gmail.com>", "Kushal Thakkar <kushal.thakkar@gmail.com>"]

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/src/sql_testing_library/_adapters/snowflake.py

@@ -30,6 +30,32 @@ class SnowflakeTypeConverter(BaseTypeConverter):
 
     def convert(self, value: Any, target_type: Type) -> Any:
         """Convert Snowflake result value to target type."""
+        # Handle None/NULL values first
+        if value is None:
+            return None
+
+        # Handle Optional types
+        if self.is_optional_type(target_type):
+            if value is None:
+                return None
+            target_type = self.get_optional_inner_type(target_type)
+
+        # Handle dict/map types from Snowflake VARIANT columns
+        if hasattr(target_type, "__origin__") and target_type.__origin__ is dict:
+            # Snowflake returns VARIANT types as Python dicts already
+            if isinstance(value, dict):
+                return value
+            # If it's a string, parse it
+            elif isinstance(value, str):
+                import json
+
+                try:
+                    return json.loads(value)
+                except json.JSONDecodeError:
+                    return {}
+            else:
+                return {}
+
         # Snowflake returns proper Python types in most cases, so use base converter
         return super().convert(value, target_type)
 
@@ -248,7 +274,11 @@ class SnowflakeAdapter(DatabaseAdapter):
                     if non_none_types:
                         col_type = non_none_types[0]
 
-                snowflake_type = type_mapping.get(col_type, "VARCHAR")
+                # Handle dict/map types
+                if hasattr(col_type, "__origin__") and col_type.__origin__ is dict:
+                    snowflake_type = "VARIANT"
+                else:
+                    snowflake_type = type_mapping.get(col_type, "VARCHAR")
                 column_defs.append(f'"{col_name}" {snowflake_type}')
 
             columns_sql = ",\n  ".join(column_defs)

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/src/sql_testing_library/_exceptions.py

@@ -50,6 +50,17 @@ class TypeConversionError(SQLTestingError):
         self.value = value
         self.target_type = target_type
         self.column_name = column_name
-        super().__init__(
-            f"Cannot convert '{value}' to {target_type.__name__} for column '{column_name}'"
-        )
+
+        # Handle type name extraction for various type forms
+        try:
+            type_name = target_type.__name__
+        except AttributeError:
+            # For types like Optional, Union, etc that don't have __name__
+            type_name = str(target_type)
+
+        if column_name:
+            message = f"Cannot convert '{value}' to {type_name} for column '{column_name}'"
+        else:
+            message = f"Cannot convert '{value}' to {type_name}"
+
+        super().__init__(message)

{sql_testing_library-0.10.0 → sql_testing_library-0.11.0}/src/sql_testing_library/_sql_utils.py

@@ -170,6 +170,9 @@ def format_sql_value(value: Any, column_type: Type, dialect: str = "standard") -
             elif dialect == "bigquery":
                 # BigQuery JSON type handles NULL maps
                 return "NULL"
+            elif dialect == "snowflake":
+                # Snowflake VARIANT type handles NULL maps
+                return "NULL::VARIANT"
             else:
                 return "NULL"
 
@@ -298,6 +301,12 @@ def format_sql_value(value: Any, column_type: Type, dialect: str = "standard") -
             # Escape single quotes in JSON string for SQL
             json_str = json_str.replace("'", "''")
             return f"'{json_str}'"
+        elif dialect == "snowflake":
+            # Snowflake uses VARIANT type with PARSE_JSON function
+            json_str = json.dumps(value, cls=DecimalEncoder)
+            # Escape single quotes in JSON string for SQL
+            json_str = json_str.replace("'", "''")
+            return f"PARSE_JSON('{json_str}')"
         else:
             # Other databases don't have native map support yet
             raise NotImplementedError(f"Map type not yet supported for dialect: {dialect}")