splurge-dsv 2025.2.0__tar.gz → 2025.3.1__tar.gz

{splurge_dsv-2025.2.0/splurge_dsv.egg-info → splurge_dsv-2025.3.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: splurge-dsv
-Version: 2025.2.0
+Version: 2025.3.1
 Summary: A utility library for working with DSV (Delimited String Values) files
 Author: Jim Schilling
 License-Expression: MIT
@@ -21,10 +21,11 @@ Classifier: Topic :: Text Processing :: Filters
 Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
+Requires-Dist: splurge-safe-io>=2025.0.5
+Requires-Dist: PyYAML>=6.0
 Provides-Extra: dev
 Requires-Dist: pytest>=7.0.0; extra == "dev"
 Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
-Requires-Dist: pytest-xdist>=3.0.0; extra == "dev"
 Requires-Dist: mypy>=1.0.0; extra == "dev"
 Requires-Dist: ruff>=0.0.241; extra == "dev"
 Requires-Dist: pytest-mock>=3.0.0; extra == "dev"
@@ -38,7 +39,7 @@ Dynamic: license-file
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
 
 [![CI](https://github.com/jim-schilling/splurge-dsv/actions/workflows/ci-quick-test.yml/badge.svg)](https://github.com/jim-schilling/splurge-dsv/actions/workflows/ci-quick-test.yml)
-[![Coverage](https://img.shields.io/badge/coverage-94%25-brightgreen.svg)](https://github.com/jim-schilling/splurge-dsv)
+[![Coverage](https://img.shields.io/badge/coverage-93%25-brightgreen.svg)](https://github.com/jim-schilling/splurge-dsv)
 [![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)
 [![mypy](https://img.shields.io/badge/mypy-checked-black)](https://mypy-lang.org/)
 
@@ -46,12 +47,49 @@ A robust Python library for parsing and processing delimited-separated value (DS
 
 ## Features
 
-- **Multi-format DSV Support**: Parse CSV, TSV, pipe-delimited, and custom delimiter files
+- **Multi-format DSV Support**: Parse CSV, TSV, pipe-delimited, and custom delimiter separated value files/objects
+- **Configurable Parsing**: Flexible options for delimiters, quote characters, escape characters, header/footer row(s) handling
 - **Memory-Efficient Streaming**: Process large files without loading entire content into memory
 - **Security & Validation**: Comprehensive path validation and file permission checks
 - **Unicode Support**: Full Unicode character and encoding support
 - **Type Safety**: Full type annotations with mypy validation
-- **Comprehensive Testing**: 420 tests (409 passed, 11 skipped) with 94% code coverage including property-based testing, edge case testing, and cross-platform compatibility
+- **Deterministic Newline Handling**: Consistent handling of CRLF, CR, and LF newlines across platforms
+- **CLI Tool**: Command-line interface for quick parsing and inspection of DSV files
+- **Robust Error Handling**: Clear and specific exceptions for various error scenarios
+- **Modern API**: Object-oriented API with `Dsv` and `DsvConfig` classes for easy configuration and reuse
+- **Comprehensive Documentation**: In-depth API reference and usage examples
+- **Exhaustive Testing**: 283 tests with 93% code coverage including property-based testing, edge case testing, and cross-platform compatibility validation
+
+**⚠️ CHANGES in v2025.3.1**
+> - **skip_empty_lines** option added to `DsvConfig`, `DsvHelper`, and CLI.
+>   - This option allows users to skip logical empty lines when parsing DSV files.
+
+**⚠️ CHANGES in v2025.3.0**
+> - **Commit-Only Release**: v2025.3.0 is a commit-only release and will not be published to PyPI.
+> - The legacy `parse_stream()` helpers were removed in release 2025.3.0.
+>   - Use `parse_file_stream()` on `Dsv`/`DsvHelper` for stream-based parsing of files. This standardizes the API naming and clarifies that streaming helpers accept file paths rather than arbitrary iterables.
+> - TextFileHelper, SafeTextFileReader, SafeTextFileWriter, and PathValidator, as well as all their associated tests have been removed in this release.
+>   - Their functionality has been migrated in favor of the `splurge-safe-io` package, which provides robust and secure file I/O operations.
+>   - This change reduces code duplication and improves maintainability by leveraging the functionality of `splurge-safe-io`.
+>   - Users should refer to the `splurge-safe-io` documentation for details on its usage and features.
+> - **See API-REFERENCE.md for migration guidance and complete reference documentation, with usage examples.**
+
+**⚠️ CHANGES in v2025.2.2**
+> - **Deprecated Warning**: The following modules and their associated classes and functions are deprecated and will be removed in a future release (2025.3.0). Users are encouraged to transition to the `splurge-safe-io` package for these functionalities:
+>   - `splurge_dsv.safe_text_file_reader`
+>   - `splurge_dsv.safe_text_file_writer`
+>   - `splurge_dsv.path_validator`
+>   - `splurge_dsv.text_file_helper`
+> - **New Exception**: Added `SplurgeDsvFileExistsError` to handle file existence errors.
+> - **Fixed Exception Mapping**: Many errors were incorrectly mapped to SplurgeDsvEncodingError; this has been corrected to use appropriate exception types. 
+>   - Some exceptions were not mapped to any SplurgeDsv* exception; these have also been corrected.
+> - **3rd-Party Dependency Additions**: Added `splurge-safe-io (v2025.0.4)`.
+>   - `splurge-safe-io` is a new dependency that provides robust and secure file I/O operations, including safe text file reading and writing with deterministic newline handling and path validation.
+>   - This change reduces code duplication and improves maintainability by leveraging the functionality of `splurge-safe-io`.
+>   - Users should refer to the `splurge-safe-io` documentation for details on its usage and features.
+> - **Code Refactoring**: Refactored `SafeTextFileReader`, `SafeTextFileWriter`, and `PathValidator` to utilize `splurge-safe-io` implementations internally, ensuring consistent behavior and reducing maintenance overhead.
+> - **This release maintains backward compatibility** for existing users, but users are encouraged to transition to `splurge-safe-io` for future-proofing their codebases.
+>   - **_This release is a commit-only release and will not be published to PyPI._**
 
 **⚠️ BREAKING CHANGES in v2025.2.0**
 >
@@ -78,6 +116,41 @@ python -m splurge_dsv data.csv --delimiter ,
 python -m splurge_dsv large_file.csv --delimiter , --stream --chunk-size 1000
 ```
 
+### YAML configuration file
+
+You can place CLI-equivalent options in a YAML file and pass it to the CLI
+using `--config` (or `-c`). CLI arguments override values found in the
+YAML file. Example `config.yaml`:
+
+```yaml
+delimiter: ","
+strip: true
+bookend: '"'
+encoding: utf-8
+skip_header_rows: 1
+skip_footer_rows: 0
+skip_empty_lines: false
+detect_columns: true
+chunk_size: 500
+max_detect_chunks: 5
+raise_on_missing_columns: false
+raise_on_extra_columns: false
+```
+
+Usage with CLI:
+
+```bash
+python -m splurge_dsv data.csv --config config.yaml --delimiter "|"
+# The CLI delimiter '|' overrides the YAML delimiter
+```
+
+Example using the shipped example config in the repository:
+
+```bash
+# Use the example file provided at examples/config.yaml
+python -m splurge_dsv data.csv --config examples/config.yaml
+```
+
 ### API Usage
 
 ```python

{splurge_dsv-2025.2.0 → splurge_dsv-2025.3.1}/README.md

@@ -5,7 +5,7 @@
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
 
 [![CI](https://github.com/jim-schilling/splurge-dsv/actions/workflows/ci-quick-test.yml/badge.svg)](https://github.com/jim-schilling/splurge-dsv/actions/workflows/ci-quick-test.yml)
-[![Coverage](https://img.shields.io/badge/coverage-94%25-brightgreen.svg)](https://github.com/jim-schilling/splurge-dsv)
+[![Coverage](https://img.shields.io/badge/coverage-93%25-brightgreen.svg)](https://github.com/jim-schilling/splurge-dsv)
 [![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)
 [![mypy](https://img.shields.io/badge/mypy-checked-black)](https://mypy-lang.org/)
 
@@ -13,12 +13,49 @@ A robust Python library for parsing and processing delimited-separated value (DS
 
 ## Features
 
-- **Multi-format DSV Support**: Parse CSV, TSV, pipe-delimited, and custom delimiter files
+- **Multi-format DSV Support**: Parse CSV, TSV, pipe-delimited, and custom delimiter separated value files/objects
+- **Configurable Parsing**: Flexible options for delimiters, quote characters, escape characters, header/footer row(s) handling
 - **Memory-Efficient Streaming**: Process large files without loading entire content into memory
 - **Security & Validation**: Comprehensive path validation and file permission checks
 - **Unicode Support**: Full Unicode character and encoding support
 - **Type Safety**: Full type annotations with mypy validation
-- **Comprehensive Testing**: 420 tests (409 passed, 11 skipped) with 94% code coverage including property-based testing, edge case testing, and cross-platform compatibility
+- **Deterministic Newline Handling**: Consistent handling of CRLF, CR, and LF newlines across platforms
+- **CLI Tool**: Command-line interface for quick parsing and inspection of DSV files
+- **Robust Error Handling**: Clear and specific exceptions for various error scenarios
+- **Modern API**: Object-oriented API with `Dsv` and `DsvConfig` classes for easy configuration and reuse
+- **Comprehensive Documentation**: In-depth API reference and usage examples
+- **Exhaustive Testing**: 283 tests with 93% code coverage including property-based testing, edge case testing, and cross-platform compatibility validation
+
+**⚠️ CHANGES in v2025.3.1**
+> - **skip_empty_lines** option added to `DsvConfig`, `DsvHelper`, and CLI.
+>   - This option allows users to skip logical empty lines when parsing DSV files.
+
+**⚠️ CHANGES in v2025.3.0**
+> - **Commit-Only Release**: v2025.3.0 is a commit-only release and will not be published to PyPI.
+> - The legacy `parse_stream()` helpers were removed in release 2025.3.0.
+>   - Use `parse_file_stream()` on `Dsv`/`DsvHelper` for stream-based parsing of files. This standardizes the API naming and clarifies that streaming helpers accept file paths rather than arbitrary iterables.
+> - TextFileHelper, SafeTextFileReader, SafeTextFileWriter, and PathValidator, as well as all their associated tests have been removed in this release.
+>   - Their functionality has been migrated in favor of the `splurge-safe-io` package, which provides robust and secure file I/O operations.
+>   - This change reduces code duplication and improves maintainability by leveraging the functionality of `splurge-safe-io`.
+>   - Users should refer to the `splurge-safe-io` documentation for details on its usage and features.
+> - **See API-REFERENCE.md for migration guidance and complete reference documentation, with usage examples.**
+
+**⚠️ CHANGES in v2025.2.2**
+> - **Deprecated Warning**: The following modules and their associated classes and functions are deprecated and will be removed in a future release (2025.3.0). Users are encouraged to transition to the `splurge-safe-io` package for these functionalities:
+>   - `splurge_dsv.safe_text_file_reader`
+>   - `splurge_dsv.safe_text_file_writer`
+>   - `splurge_dsv.path_validator`
+>   - `splurge_dsv.text_file_helper`
+> - **New Exception**: Added `SplurgeDsvFileExistsError` to handle file existence errors.
+> - **Fixed Exception Mapping**: Many errors were incorrectly mapped to SplurgeDsvEncodingError; this has been corrected to use appropriate exception types. 
+>   - Some exceptions were not mapped to any SplurgeDsv* exception; these have also been corrected.
+> - **3rd-Party Dependency Additions**: Added `splurge-safe-io (v2025.0.4)`.
+>   - `splurge-safe-io` is a new dependency that provides robust and secure file I/O operations, including safe text file reading and writing with deterministic newline handling and path validation.
+>   - This change reduces code duplication and improves maintainability by leveraging the functionality of `splurge-safe-io`.
+>   - Users should refer to the `splurge-safe-io` documentation for details on its usage and features.
+> - **Code Refactoring**: Refactored `SafeTextFileReader`, `SafeTextFileWriter`, and `PathValidator` to utilize `splurge-safe-io` implementations internally, ensuring consistent behavior and reducing maintenance overhead.
+> - **This release maintains backward compatibility** for existing users, but users are encouraged to transition to `splurge-safe-io` for future-proofing their codebases.
+>   - **_This release is a commit-only release and will not be published to PyPI._**
 
 **⚠️ BREAKING CHANGES in v2025.2.0**
 >
@@ -45,6 +82,41 @@ python -m splurge_dsv data.csv --delimiter ,
 python -m splurge_dsv large_file.csv --delimiter , --stream --chunk-size 1000
 ```
 
+### YAML configuration file
+
+You can place CLI-equivalent options in a YAML file and pass it to the CLI
+using `--config` (or `-c`). CLI arguments override values found in the
+YAML file. Example `config.yaml`:
+
+```yaml
+delimiter: ","
+strip: true
+bookend: '"'
+encoding: utf-8
+skip_header_rows: 1
+skip_footer_rows: 0
+skip_empty_lines: false
+detect_columns: true
+chunk_size: 500
+max_detect_chunks: 5
+raise_on_missing_columns: false
+raise_on_extra_columns: false
+```
+
+Usage with CLI:
+
+```bash
+python -m splurge_dsv data.csv --config config.yaml --delimiter "|"
+# The CLI delimiter '|' overrides the YAML delimiter
+```
+
+Example using the shipped example config in the repository:
+
+```bash
+# Use the example file provided at examples/config.yaml
+python -m splurge_dsv data.csv --config examples/config.yaml
+```
+
 ### API Usage
 
 ```python

{splurge_dsv-2025.2.0 → splurge_dsv-2025.3.1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "splurge-dsv"
-version = "2025.2.0"
+version = "2025.3.1"
 description = "A utility library for working with DSV (Delimited String Values) files"
 readme = "README.md"
 requires-python = ">=3.10"
@@ -25,13 +25,15 @@ classifiers = [
     "Topic :: Text Processing :: Filters",
 ]
 
-dependencies = []
+dependencies = [
+    "splurge-safe-io>=2025.0.5",
+    "PyYAML>=6.0",
+]
 
 [project.optional-dependencies]
 dev = [
     "pytest>=7.0.0",
     "pytest-cov>=4.0.0",
-    "pytest-xdist>=3.0.0",
     "mypy>=1.0.0",
     "ruff>=0.0.241",
     "pytest-mock>=3.0.0",
@@ -53,7 +55,7 @@ include = ["splurge_dsv*"]
 
 [tool.pytest.ini_options]
 minversion = "7.0"
-addopts = "-x -v -n 4"
+addopts = "-x -v"
 testpaths = ["tests"]
 python_files = ["test_*.py"]
 python_classes = ["Test*"]
@@ -128,3 +130,5 @@ line-ending = "auto"
 files = ["splurge_dsv"]
 # show_error_codes helps with diagnostics
 show_error_codes = true
+# Allow missing imports for vendored/external helper package used at runtime
+ignore_missing_imports = true

{splurge_dsv-2025.2.0 → splurge_dsv-2025.3.1}/splurge_dsv/__init__.py

@@ -13,9 +13,20 @@ Copyright (c) 2025 Jim Schilling
 # test cases may remove the process working directory which causes calls to
 # os.getcwd() to raise FileNotFoundError later during test execution. Guard
 # against that here by switching to this package directory when cwd is missing.
+# Ensure the required external implementation is available on import so the
+# rest of the package can rely on its APIs. Fail fast with a helpful message
+# instructing the user to install the package if it's missing.
+import importlib as _importlib
 import os
 from pathlib import Path as _Path
 
+try:  # pragma: no cover - import-time guard
+    _importlib.import_module("splurge_safe_io")
+except Exception as e:
+    raise ImportError(
+        "Missing required dependency 'splurge-safe-io'. Please install it: `pip install splurge-safe-io`"
+    ) from e
+
 try:
     try:
         # os.getcwd() can raise FileNotFoundError in CI/runner environments
@@ -35,11 +46,13 @@ except Exception:
 from splurge_dsv.dsv import Dsv, DsvConfig
 from splurge_dsv.dsv_helper import DsvHelper
 from splurge_dsv.exceptions import (
+    SplurgeDsvColumnMismatchError,
     SplurgeDsvConfigurationError,
     SplurgeDsvDataProcessingError,
     # canonical SplurgeDsv* exception names
     SplurgeDsvError,
     SplurgeDsvFileEncodingError,
+    SplurgeDsvFileExistsError,
     SplurgeDsvFileNotFoundError,
     SplurgeDsvFileOperationError,
     SplurgeDsvFilePermissionError,
@@ -56,11 +69,9 @@ from splurge_dsv.exceptions import (
     SplurgeDsvTypeConversionError,
     SplurgeDsvValidationError,
 )
-from splurge_dsv.path_validator import PathValidator
 from splurge_dsv.string_tokenizer import StringTokenizer
-from splurge_dsv.text_file_helper import TextFileHelper
 
-__version__ = "2025.2.0"
+__version__ = "2025.3.1"
 __author__ = "Jim Schilling"
 __license__ = "MIT"
 
@@ -79,6 +90,7 @@ __all__ = [
     "SplurgeDsvPathValidationError",
     "SplurgeDsvDataProcessingError",
     "SplurgeDsvParsingError",
+    "SplurgeDsvColumnMismatchError",
     "SplurgeDsvTypeConversionError",
     "SplurgeDsvStreamingError",
     "SplurgeDsvConfigurationError",
@@ -89,8 +101,7 @@ __all__ = [
     "SplurgeDsvParameterError",
     "SplurgeDsvRangeError",
     "SplurgeDsvFormatError",
+    "SplurgeDsvFileExistsError",
     # Utility classes
     "StringTokenizer",
-    "TextFileHelper",
-    "PathValidator",
 ]

{splurge_dsv-2025.2.0 → splurge_dsv-2025.3.1}/splurge_dsv/cli.py

@@ -23,6 +23,7 @@ from pathlib import Path
 # Local imports
 from splurge_dsv import __version__
 from splurge_dsv.dsv import Dsv, DsvConfig
+from splurge_dsv.dsv_helper import DsvHelper
 from splurge_dsv.exceptions import SplurgeDsvError
 
 
@@ -39,14 +40,31 @@ def parse_arguments() -> argparse.Namespace:
         epilog="""
 Examples:
   python -m splurge_dsv data.csv --delimiter ,
-  python -m splurge_dsv data.tsv --delimiter "\\t"
+  python -m splurge_dsv data.tsv --delimiter "\t"
   python -m splurge_dsv data.txt --delimiter "|" --bookend '"'
-        """,
+  # Auto-detect the expected column count and normalize rows
+  python -m splurge_dsv data.csv --delimiter , --detect-columns --max-detect-chunks 5
+  # Stream a large file while attempting to detect the column count from the first non-blank logical row
+  python -m splurge_dsv large.csv --delimiter , --stream --detect-columns --max-detect-chunks 10
+    """,
     )
 
     parser.add_argument("file_path", type=str, help="Path to the DSV file to parse")
 
-    parser.add_argument("--delimiter", "-d", type=str, required=True, help="Delimiter character to use for parsing")
+    parser.add_argument(
+        "--config",
+        "-c",
+        dest="config",
+        type=str,
+        help="Path to a YAML config file that mirrors CLI options (values overridden by CLI args)",
+    )
+
+    parser.add_argument(
+        "--delimiter",
+        "-d",
+        type=str,
+        help="Delimiter character to use for parsing (may also be provided via --config)",
+    )
 
     parser.add_argument("--bookend", "-b", type=str, help="Bookend character for text fields (e.g., '\"')")
 
@@ -64,7 +82,53 @@ Examples:
         "--stream", "-s", action="store_true", help="Stream the file in chunks instead of loading entirely into memory"
     )
 
-    parser.add_argument("--chunk-size", type=int, default=500, help="Chunk size for streaming (default: 500)")
+    parser.add_argument(
+        "--detect-columns",
+        action="store_true",
+        help=(
+            "Auto-detect the expected column count from the first non-blank logical row "
+            "and normalize subsequent rows to that count. For streamed parsing, the "
+            "detector may scan up to --max-detect-chunks chunks from the start of the file."
+        ),
+    )
+
+    parser.add_argument(
+        "--raise-on-missing-columns",
+        action="store_true",
+        help="Raise an error if a row has fewer columns than the detected/expected count",
+    )
+
+    parser.add_argument(
+        "--raise-on-extra-columns",
+        action="store_true",
+        help="Raise an error if a row has more columns than the detected/expected count",
+    )
+
+    parser.add_argument(
+        "--chunk-size",
+        type=int,
+        default=DsvHelper.DEFAULT_CHUNK_SIZE,
+        help=(
+            f"Chunk size for streaming (minimum: {DsvHelper.DEFAULT_MIN_CHUNK_SIZE}, "
+            f"default: {DsvHelper.DEFAULT_CHUNK_SIZE})"
+        ),
+    )
+
+    parser.add_argument(
+        "--max-detect-chunks",
+        type=int,
+        default=DsvHelper.MAX_DETECT_CHUNKS,
+        help=(
+            "When detecting columns while streaming (use --detect-normalize-columns), "
+            f"scan up to N chunks from the start of the stream before giving up (default: {DsvHelper.MAX_DETECT_CHUNKS})."
+        ),
+    )
+
+    parser.add_argument(
+        "--skip-empty-lines",
+        action="store_true",
+        help="Have the underlying reader skip raw empty logical lines (line.strip() == '') before parsing",
+    )
 
     parser.add_argument(
         "--output-format",
@@ -141,17 +205,56 @@ def run_cli() -> int:
             print(f"Error: '{args.file_path}' is not a file.", file=sys.stderr)
             return 1
 
+        # Build base config either from YAML file (if provided) or from CLI args
+        base_params = {}
+        if args.config:
+            try:
+                import yaml  # type: ignore
+
+                cfg_path = Path(args.config)
+                if not cfg_path.exists():
+                    print(f"Error: Config file '{args.config}' not found.", file=sys.stderr)
+                    return 1
+
+                with cfg_path.open("r", encoding="utf-8") as fh:
+                    file_cfg = yaml.safe_load(fh) or {}
+
+                if not isinstance(file_cfg, dict):
+                    print(f"Error: Config file '{args.config}' must contain a mapping/dictionary.", file=sys.stderr)
+                    return 1
+
+                base_params.update(file_cfg)
+            except Exception as e:
+                print(f"Error reading config file '{args.config}': {e}", file=sys.stderr)
+                return 1
+
+        # CLI args override YAML values when provided. Build the parameter map
+        cli_params = {
+            "delimiter": args.delimiter,
+            "strip": not args.no_strip,
+            "bookend": args.bookend,
+            "bookend_strip": not args.no_bookend_strip,
+            "encoding": args.encoding,
+            "skip_header_rows": args.skip_header,
+            "skip_footer_rows": args.skip_footer,
+            "chunk_size": args.chunk_size,
+            "detect_columns": args.detect_columns,
+            "raise_on_missing_columns": args.raise_on_missing_columns,
+            "raise_on_extra_columns": args.raise_on_extra_columns,
+            "max_detect_chunks": args.max_detect_chunks,
+            "skip_empty_lines": args.skip_empty_lines,
+        }
+
+        # Merge: start from file (if any), then overlay CLI-provided values
+        merged = {**base_params, **{k: v for k, v in cli_params.items() if v is not None}}
+
         # Create configuration and Dsv instance for parsing
-        config = DsvConfig(
-            delimiter=args.delimiter,
-            strip=not args.no_strip,
-            bookend=args.bookend,
-            bookend_strip=not args.no_bookend_strip,
-            encoding=args.encoding,
-            skip_header_rows=args.skip_header,
-            skip_footer_rows=args.skip_footer,
-            chunk_size=args.chunk_size,
-        )
+        try:
+            config = DsvConfig.from_params(**merged)
+        except Exception as e:
+            print(f"Error building configuration: {e}", file=sys.stderr)
+            return 1
+        dsv = Dsv(config)
         dsv = Dsv(config)
 
         # Parse the file
@@ -161,18 +264,26 @@ def run_cli() -> int:
             chunk_count = 0
             total_rows = 0
 
-            for chunk in dsv.parse_stream(file_path):
-                chunk_count += 1
-                total_rows += len(chunk)
-                if args.output_format == "json":
-                    print(json.dumps(chunk, ensure_ascii=False))
-                elif args.output_format == "ndjson":
-                    for row in chunk:
-                        print(json.dumps(row, ensure_ascii=False))
-                else:
-                    print(f"Chunk {chunk_count}: {len(chunk)} rows")
-                    print_results(chunk, args.delimiter)
-                    print()
+            try:
+                for chunk in dsv.parse_file_stream(file_path):
+                    chunk_count += 1
+                    total_rows += len(chunk)
+
+                    if args.output_format == "json":
+                        print(json.dumps(chunk, ensure_ascii=False))
+                    elif args.output_format == "ndjson":
+                        for row in chunk:
+                            print(json.dumps(row, ensure_ascii=False))
+                    else:
+                        print(f"Chunk {chunk_count}: {len(chunk)} rows")
+                        print_results(chunk, args.delimiter)
+                        print()
+            except Exception as e:
+                print(f"Error during streaming: {e}", file=sys.stderr)
+                import traceback
+
+                traceback.print_exc(file=sys.stderr)
+                return 1
 
             if args.output_format not in ["json", "ndjson"]:
                 print(f"Total: {total_rows} rows in {chunk_count} chunks")