phrasplit 0.2.0__tar.gz → 0.2.2__tar.gz

{phrasplit-0.2.0 → phrasplit-0.2.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: phrasplit
-Version: 0.2.0
+Version: 0.2.2
 Summary: A simple tool to split text.
 Author-email: Holger Nahrstaedt <nahrstaedt@gmail.com>
 License: MIT License
@@ -41,10 +41,12 @@ Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: click>=8.0.0
 Requires-Dist: rich>=13.0.0
-Requires-Dist: spacy>=3.5.0
+Provides-Extra: nlp
+Requires-Dist: spacy>=3.5.0; extra == "nlp"
 Provides-Extra: dev
 Requires-Dist: pytest>=7.0.0; extra == "dev"
 Requires-Dist: ruff>=0.1.0; extra == "dev"
+Requires-Dist: spacy>=3.5.0; extra == "dev"
 Dynamic: license-file
 
 [![PyPI - Version](https://img.shields.io/pypi/v/phrasplit)](https://pypi.org/project/phrasplit/)
@@ -54,33 +56,75 @@ Dynamic: license-file
 
 # phrasplit
 
-A Python library for splitting text into sentences, clauses, or paragraphs using spaCy
-NLP. Designed for audiobook creation and text-to-speech processing.
+A Python library for splitting text into sentences, clauses, or paragraphs. Choose
+between spaCy NLP for best accuracy or fast regex-based splitting for simple use cases.
 
 ## Features
 
-- **Sentence splitting**: Intelligent sentence boundary detection using spaCy
+- **Two modes**: spaCy (accurate) or simple regex (fast, no ML dependencies)
+- **Sentence splitting**: Intelligent sentence boundary detection
 - **Clause splitting**: Split sentences at commas for natural pause points
-- **Paragraph splitting**: Split text at double newlines
+- **Paragraph splitting**: Split text at double newlines (no spaCy needed)
 - **Hierarchical splitting**: Split text with paragraph/sentence position tracking
 - **Long line splitting**: Break long lines at sentence/clause boundaries
 - **Abbreviation handling**: Correctly handles Mr., Dr., U.S.A., etc.
 - **Ellipsis support**: Preserves ellipses without incorrect splitting
+- **25+ languages**: Multi-language abbreviation support
 
 ## Installation
 
+### Basic Installation (Simple Mode)
+
+For fast, regex-based splitting without ML dependencies:
+
 ```bash
 pip install phrasplit
 ```
 
-You'll also need to download a spaCy language model:
+### Full Installation (spaCy Mode)
+
+For best accuracy with complex text, install with spaCy:
 
 ```bash
+pip install phrasplit[nlp]
 python -m spacy download en_core_web_sm
 ```
 
+## Performance Comparison
+
+| Mode       | Speed       | Accuracy | Dependencies            | When to Use                      |
+| ---------- | ----------- | -------- | ----------------------- | -------------------------------- |
+| **Simple** | ~60x faster | ~85-90%  | None (regex only)       | Simple text, speed-critical apps |
+| **spaCy**  | Baseline    | ~95%+    | spaCy + models (~500MB) | Complex text, best accuracy      |
+
+Benchmark results (1000 sentences):
+
+- spaCy: 1091ms
+- Simple: 17ms (63x faster)
+
+Both modes produce nearly identical results for well-formatted text.
+
 ## Quick Start
 
+### Auto-Detection (Recommended)
+
+Phrasplit automatically uses spaCy if installed, otherwise falls back to simple mode:
+
+```python
+from phrasplit import split_sentences, split_clauses, split_paragraphs
+
+# Uses spaCy if installed, otherwise simple mode
+text = "Dr. Smith is here. She has a Ph.D. in Chemistry."
+sentences = split_sentences(text)
+# ['Dr. Smith is here.', 'She has a Ph.D. in Chemistry.']
+
+# Force simple mode (even if spaCy is installed)
+sentences = split_sentences(text, use_spacy=False)
+
+# Force spaCy mode (error if not installed)
+sentences = split_sentences(text, use_spacy=True)
+```
+
 ### Python API
 
 ```python
@@ -96,7 +140,7 @@ text = "I like coffee, and I like tea."
 clauses = split_clauses(text)
 # ['I like coffee,', 'and I like tea.']
 
-# Split text into paragraphs
+# Split text into paragraphs (no spaCy needed)
 text = "First paragraph.\n\nSecond paragraph."
 paragraphs = split_paragraphs(text)
 # ['First paragraph.', 'Second paragraph.']
@@ -140,24 +184,33 @@ Available modes:
 ### Command Line Interface
 
 ```bash
-# Split into sentences
+# Split into sentences (auto-detects spaCy or uses simple mode)
 phrasplit sentences input.txt -o output.txt
 
+# Force simple mode (60x faster, no spaCy required)
+phrasplit sentences input.txt --simple
+
 # Split into clauses
 phrasplit clauses input.txt -o output.txt
 
-# Split into paragraphs
+# Use simple mode for clauses (faster)
+phrasplit clauses input.txt --simple -o output.txt
+
+# Split into paragraphs (no spaCy needed)
 phrasplit paragraphs input.txt -o output.txt
 
 # Split long lines (default max 80 characters)
 phrasplit longlines input.txt -o output.txt --max-length 60
 
-# Use a different spaCy model
+# Long lines with simple mode
+phrasplit longlines input.txt --simple --max-length 60
+
+# Use a different spaCy model (only for spaCy mode)
 phrasplit sentences input.txt --model en_core_web_lg
 
 # Read from stdin (pipe or redirect)
 echo "Hello world. This is a test." | phrasplit sentences
-cat input.txt | phrasplit clauses -o output.txt
+cat input.txt | phrasplit clauses --simple -o output.txt
 
 # Explicit stdin with dash
 phrasplit sentences - < input.txt
@@ -165,21 +218,28 @@ phrasplit sentences - < input.txt
 
 ## API Reference
 
-### `split_sentences(text, language_model="en_core_web_sm", apply_corrections=True, split_on_colon=True)`
+### `split_sentences(text, language_model="en_core_web_sm", apply_corrections=True, use_spacy=None)`
 
-Split text into sentences using spaCy's sentence boundary detection.
+Split text into sentences.
 
 **Parameters:**
 
 - `text`: Input text string
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (e.g., "en_core_web_sm", "de_core_news_sm")
+  - For spaCy mode: Name of the spaCy model to use
+  - For simple mode: Used to determine language for abbreviation handling
 - `apply_corrections`: Apply post-processing corrections for URLs and abbreviations
-  (default: True)
-- `split_on_colon`: Treat colons as sentence terminators (default: True)
+  (default: True, only applies to spaCy mode)
+- `use_spacy`: Choose implementation:
+  - `None` (default): Auto-detect (use spaCy if available)
+  - `True`: Force spaCy mode (raises ImportError if not installed)
+  - `False`: Force simple regex mode
 
 **Returns:** List of sentences
 
-### `split_clauses(text, language_model="en_core_web_sm")`
+**Raises:** `ImportError` if `use_spacy=True` but spaCy is not installed
+
+### `split_clauses(text, language_model="en_core_web_sm", use_spacy=None)`
 
 Split text into comma-separated parts. Useful for creating natural pause points in
 audiobook/TTS applications.
@@ -187,13 +247,14 @@ audiobook/TTS applications.
 **Parameters:**
 
 - `text`: Input text string
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of clauses (comma stays at end of each part)
 
 ### `split_paragraphs(text)`
 
-Split text into paragraphs at double newlines.
+Split text into paragraphs at double newlines. Works without spaCy.
 
 **Parameters:**
 
@@ -201,7 +262,7 @@ Split text into paragraphs at double newlines.
 
 **Returns:** List of paragraphs
 
-### `split_text(text, mode="sentence", language_model="en_core_web_sm", apply_corrections=True, split_on_colon=True)`
+### `split_text(text, mode="sentence", language_model="en_core_web_sm", apply_corrections=True, use_spacy=None)`
 
 Split text into segments with hierarchical position information.
 
@@ -209,9 +270,9 @@ Split text into segments with hierarchical position information.
 
 - `text`: Input text string
 - `mode`: Splitting mode - "paragraph", "sentence", or "clause"
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
 - `apply_corrections`: Apply post-processing corrections (default: True)
-- `split_on_colon`: Treat colons as sentence terminators (default: True)
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of `Segment` namedtuples with fields:
 
@@ -219,7 +280,7 @@ Split text into segments with hierarchical position information.
 - `paragraph`: Paragraph index (0-based)
 - `sentence`: Sentence index within paragraph (0-based), None for paragraph mode
 
-### `split_long_lines(text, max_length, language_model="en_core_web_sm")`
+### `split_long_lines(text, max_length, language_model="en_core_web_sm", use_spacy=None)`
 
 Split lines exceeding max_length at sentence/clause boundaries.
 
@@ -227,7 +288,8 @@ Split lines exceeding max_length at sentence/clause boundaries.
 
 - `text`: Input text string
 - `max_length`: Maximum line length in characters (must be >= 1)
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of lines, each within max_length (except single words exceeding limit)
 
@@ -286,10 +348,44 @@ for paragraph in split_paragraphs(text):
 
 ## Requirements
 
-- Python 3.9+
-- spaCy 3.5+
+- Python 3.10+
 - click 8.0+
 - rich 13.0+
+- spaCy 3.5+ (optional, for best accuracy)
+
+## Choosing Between Modes
+
+### Use Simple Mode When:
+
+- Processing simple, well-formatted text
+- Speed is critical (60-100x faster)
+- Deploying in constrained environments (no ML dependencies)
+- Installing spaCy models is not feasible (~500MB per language)
+
+### Use spaCy Mode When:
+
+- Processing complex, informal, or poorly formatted text
+- Accuracy is paramount (5-10% better)
+- Already using spaCy in your pipeline
+- Working with academic or literary texts
+
+## Migration Guide
+
+### Upgrading from Previous Versions
+
+Version 1.x made spaCy optional. Your existing code continues to work:
+
+```python
+# Old code (still works, auto-uses spaCy if installed)
+from phrasplit import split_sentences
+sentences = split_sentences(text)
+
+# New: Explicit control
+sentences = split_sentences(text, use_spacy=False)  # Force simple
+sentences = split_sentences(text, use_spacy=True)   # Force spaCy
+```
+
+The `split_on_colon` parameter is deprecated and will be removed in a future version.
 
 ## License
 

{phrasplit-0.2.0 → phrasplit-0.2.2}/README.md

@@ -5,33 +5,75 @@
 
 # phrasplit
 
-A Python library for splitting text into sentences, clauses, or paragraphs using spaCy
-NLP. Designed for audiobook creation and text-to-speech processing.
+A Python library for splitting text into sentences, clauses, or paragraphs. Choose
+between spaCy NLP for best accuracy or fast regex-based splitting for simple use cases.
 
 ## Features
 
-- **Sentence splitting**: Intelligent sentence boundary detection using spaCy
+- **Two modes**: spaCy (accurate) or simple regex (fast, no ML dependencies)
+- **Sentence splitting**: Intelligent sentence boundary detection
 - **Clause splitting**: Split sentences at commas for natural pause points
-- **Paragraph splitting**: Split text at double newlines
+- **Paragraph splitting**: Split text at double newlines (no spaCy needed)
 - **Hierarchical splitting**: Split text with paragraph/sentence position tracking
 - **Long line splitting**: Break long lines at sentence/clause boundaries
 - **Abbreviation handling**: Correctly handles Mr., Dr., U.S.A., etc.
 - **Ellipsis support**: Preserves ellipses without incorrect splitting
+- **25+ languages**: Multi-language abbreviation support
 
 ## Installation
 
+### Basic Installation (Simple Mode)
+
+For fast, regex-based splitting without ML dependencies:
+
 ```bash
 pip install phrasplit
 ```
 
-You'll also need to download a spaCy language model:
+### Full Installation (spaCy Mode)
+
+For best accuracy with complex text, install with spaCy:
 
 ```bash
+pip install phrasplit[nlp]
 python -m spacy download en_core_web_sm
 ```
 
+## Performance Comparison
+
+| Mode       | Speed       | Accuracy | Dependencies            | When to Use                      |
+| ---------- | ----------- | -------- | ----------------------- | -------------------------------- |
+| **Simple** | ~60x faster | ~85-90%  | None (regex only)       | Simple text, speed-critical apps |
+| **spaCy**  | Baseline    | ~95%+    | spaCy + models (~500MB) | Complex text, best accuracy      |
+
+Benchmark results (1000 sentences):
+
+- spaCy: 1091ms
+- Simple: 17ms (63x faster)
+
+Both modes produce nearly identical results for well-formatted text.
+
 ## Quick Start
 
+### Auto-Detection (Recommended)
+
+Phrasplit automatically uses spaCy if installed, otherwise falls back to simple mode:
+
+```python
+from phrasplit import split_sentences, split_clauses, split_paragraphs
+
+# Uses spaCy if installed, otherwise simple mode
+text = "Dr. Smith is here. She has a Ph.D. in Chemistry."
+sentences = split_sentences(text)
+# ['Dr. Smith is here.', 'She has a Ph.D. in Chemistry.']
+
+# Force simple mode (even if spaCy is installed)
+sentences = split_sentences(text, use_spacy=False)
+
+# Force spaCy mode (error if not installed)
+sentences = split_sentences(text, use_spacy=True)
+```
+
 ### Python API
 
 ```python
@@ -47,7 +89,7 @@ text = "I like coffee, and I like tea."
 clauses = split_clauses(text)
 # ['I like coffee,', 'and I like tea.']
 
-# Split text into paragraphs
+# Split text into paragraphs (no spaCy needed)
 text = "First paragraph.\n\nSecond paragraph."
 paragraphs = split_paragraphs(text)
 # ['First paragraph.', 'Second paragraph.']
@@ -91,24 +133,33 @@ Available modes:
 ### Command Line Interface
 
 ```bash
-# Split into sentences
+# Split into sentences (auto-detects spaCy or uses simple mode)
 phrasplit sentences input.txt -o output.txt
 
+# Force simple mode (60x faster, no spaCy required)
+phrasplit sentences input.txt --simple
+
 # Split into clauses
 phrasplit clauses input.txt -o output.txt
 
-# Split into paragraphs
+# Use simple mode for clauses (faster)
+phrasplit clauses input.txt --simple -o output.txt
+
+# Split into paragraphs (no spaCy needed)
 phrasplit paragraphs input.txt -o output.txt
 
 # Split long lines (default max 80 characters)
 phrasplit longlines input.txt -o output.txt --max-length 60
 
-# Use a different spaCy model
+# Long lines with simple mode
+phrasplit longlines input.txt --simple --max-length 60
+
+# Use a different spaCy model (only for spaCy mode)
 phrasplit sentences input.txt --model en_core_web_lg
 
 # Read from stdin (pipe or redirect)
 echo "Hello world. This is a test." | phrasplit sentences
-cat input.txt | phrasplit clauses -o output.txt
+cat input.txt | phrasplit clauses --simple -o output.txt
 
 # Explicit stdin with dash
 phrasplit sentences - < input.txt
@@ -116,21 +167,28 @@ phrasplit sentences - < input.txt
 
 ## API Reference
 
-### `split_sentences(text, language_model="en_core_web_sm", apply_corrections=True, split_on_colon=True)`
+### `split_sentences(text, language_model="en_core_web_sm", apply_corrections=True, use_spacy=None)`
 
-Split text into sentences using spaCy's sentence boundary detection.
+Split text into sentences.
 
 **Parameters:**
 
 - `text`: Input text string
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (e.g., "en_core_web_sm", "de_core_news_sm")
+  - For spaCy mode: Name of the spaCy model to use
+  - For simple mode: Used to determine language for abbreviation handling
 - `apply_corrections`: Apply post-processing corrections for URLs and abbreviations
-  (default: True)
-- `split_on_colon`: Treat colons as sentence terminators (default: True)
+  (default: True, only applies to spaCy mode)
+- `use_spacy`: Choose implementation:
+  - `None` (default): Auto-detect (use spaCy if available)
+  - `True`: Force spaCy mode (raises ImportError if not installed)
+  - `False`: Force simple regex mode
 
 **Returns:** List of sentences
 
-### `split_clauses(text, language_model="en_core_web_sm")`
+**Raises:** `ImportError` if `use_spacy=True` but spaCy is not installed
+
+### `split_clauses(text, language_model="en_core_web_sm", use_spacy=None)`
 
 Split text into comma-separated parts. Useful for creating natural pause points in
 audiobook/TTS applications.
@@ -138,13 +196,14 @@ audiobook/TTS applications.
 **Parameters:**
 
 - `text`: Input text string
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of clauses (comma stays at end of each part)
 
 ### `split_paragraphs(text)`
 
-Split text into paragraphs at double newlines.
+Split text into paragraphs at double newlines. Works without spaCy.
 
 **Parameters:**
 
@@ -152,7 +211,7 @@ Split text into paragraphs at double newlines.
 
 **Returns:** List of paragraphs
 
-### `split_text(text, mode="sentence", language_model="en_core_web_sm", apply_corrections=True, split_on_colon=True)`
+### `split_text(text, mode="sentence", language_model="en_core_web_sm", apply_corrections=True, use_spacy=None)`
 
 Split text into segments with hierarchical position information.
 
@@ -160,9 +219,9 @@ Split text into segments with hierarchical position information.
 
 - `text`: Input text string
 - `mode`: Splitting mode - "paragraph", "sentence", or "clause"
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
 - `apply_corrections`: Apply post-processing corrections (default: True)
-- `split_on_colon`: Treat colons as sentence terminators (default: True)
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of `Segment` namedtuples with fields:
 
@@ -170,7 +229,7 @@ Split text into segments with hierarchical position information.
 - `paragraph`: Paragraph index (0-based)
 - `sentence`: Sentence index within paragraph (0-based), None for paragraph mode
 
-### `split_long_lines(text, max_length, language_model="en_core_web_sm")`
+### `split_long_lines(text, max_length, language_model="en_core_web_sm", use_spacy=None)`
 
 Split lines exceeding max_length at sentence/clause boundaries.
 
@@ -178,7 +237,8 @@ Split lines exceeding max_length at sentence/clause boundaries.
 
 - `text`: Input text string
 - `max_length`: Maximum line length in characters (must be >= 1)
-- `language_model`: spaCy model to use (default: "en_core_web_sm")
+- `language_model`: Language model name (default: "en_core_web_sm")
+- `use_spacy`: Choose implementation (default: None for auto-detect)
 
 **Returns:** List of lines, each within max_length (except single words exceeding limit)
 
@@ -237,10 +297,44 @@ for paragraph in split_paragraphs(text):
 
 ## Requirements
 
-- Python 3.9+
-- spaCy 3.5+
+- Python 3.10+
 - click 8.0+
 - rich 13.0+
+- spaCy 3.5+ (optional, for best accuracy)
+
+## Choosing Between Modes
+
+### Use Simple Mode When:
+
+- Processing simple, well-formatted text
+- Speed is critical (60-100x faster)
+- Deploying in constrained environments (no ML dependencies)
+- Installing spaCy models is not feasible (~500MB per language)
+
+### Use spaCy Mode When:
+
+- Processing complex, informal, or poorly formatted text
+- Accuracy is paramount (5-10% better)
+- Already using spaCy in your pipeline
+- Working with academic or literary texts
+
+## Migration Guide
+
+### Upgrading from Previous Versions
+
+Version 1.x made spaCy optional. Your existing code continues to work:
+
+```python
+# Old code (still works, auto-uses spaCy if installed)
+from phrasplit import split_sentences
+sentences = split_sentences(text)
+
+# New: Explicit control
+sentences = split_sentences(text, use_spacy=False)  # Force simple
+sentences = split_sentences(text, use_spacy=True)   # Force spaCy
+```
+
+The `split_on_colon` parameter is deprecated and will be removed in a future version.
 
 ## License
 

phrasplit-0.2.2/benchmarks/benchmark_simple_vs_spacy.py

@@ -0,0 +1,116 @@
+"""Performance benchmark comparing spaCy vs simple splitters.
+
+Run this script to benchmark both implementations.
+"""
+
+import time
+
+from phrasplit import split_sentences
+
+
+def benchmark_split_sentences(
+    text: str, runs: int = 5
+) -> tuple[float, float, int, int]:
+    """Benchmark sentence splitting with both implementations."""
+    # Warm up
+    split_sentences(text, use_spacy=True)
+    split_sentences(text, use_spacy=False)
+
+    # Benchmark spaCy
+    spacy_times = []
+    spacy_count = 0
+    for _ in range(runs):
+        start = time.time()
+        result = split_sentences(text, use_spacy=True)
+        spacy_times.append(time.time() - start)
+        spacy_count = len(result)
+
+    # Benchmark simple
+    simple_times = []
+    simple_count = 0
+    for _ in range(runs):
+        start = time.time()
+        result = split_sentences(text, use_spacy=False)
+        simple_times.append(time.time() - start)
+        simple_count = len(result)
+
+    spacy_avg = sum(spacy_times) / len(spacy_times)
+    simple_avg = sum(simple_times) / len(simple_times)
+
+    return spacy_avg, simple_avg, spacy_count, simple_count
+
+
+def main() -> None:
+    """Run benchmarks and print results."""
+    print("=" * 70)
+    print("Phrasplit Performance Benchmark: spaCy vs Simple Mode")
+    print("=" * 70)
+
+    # Test 1: Short text (a few sentences)
+    print("\n1. Short text (3 sentences, ~50 words)")
+    print("-" * 70)
+    short_text = (
+        "Dr. Smith has a Ph.D. in Chemistry. "
+        'She said, "It\'s working!" The results were published.'
+    )
+    spacy_time, simple_time, spacy_count, simple_count = benchmark_split_sentences(
+        short_text
+    )
+    print(f"  spaCy:  {spacy_time * 1000:.2f}ms  ({spacy_count} sentences)")
+    print(f"  Simple: {simple_time * 1000:.2f}ms  ({simple_count} sentences)")
+    print(f"  Speedup: {spacy_time / simple_time:.1f}x")
+
+    # Test 2: Medium text (many sentences)
+    print("\n2. Medium text (100 sentences)")
+    print("-" * 70)
+    medium_text = ". ".join([f"This is sentence number {i}" for i in range(100)])
+    spacy_time, simple_time, spacy_count, simple_count = benchmark_split_sentences(
+        medium_text
+    )
+    print(f"  spaCy:  {spacy_time * 1000:.2f}ms  ({spacy_count} sentences)")
+    print(f"  Simple: {simple_time * 1000:.2f}ms  ({simple_count} sentences)")
+    print(f"  Speedup: {spacy_time / simple_time:.1f}x")
+
+    # Test 3: Complex text with abbreviations
+    print("\n3. Complex text (abbreviations, acronyms, URLs)")
+    print("-" * 70)
+    complex_text = (
+        "Mr. J.R.R. Tolkien wrote many books. "
+        "Visit www.example.com for more info. "
+        "The U.S.A. is a big country. "
+        "Prof. Green met Dr. Stone at Inc. headquarters."
+    )
+    spacy_time, simple_time, spacy_count, simple_count = benchmark_split_sentences(
+        complex_text
+    )
+    print(f"  spaCy:  {spacy_time * 1000:.2f}ms  ({spacy_count} sentences)")
+    print(f"  Simple: {simple_time * 1000:.2f}ms  ({simple_count} sentences)")
+    print(f"  Speedup: {spacy_time / simple_time:.1f}x")
+
+    # Test 4: Very long text
+    print("\n4. Long text (1000 sentences)")
+    print("-" * 70)
+    long_text = ". ".join(
+        [f"Sentence {i} with some more words to make it realistic" for i in range(1000)]
+    )
+    spacy_time, simple_time, spacy_count, simple_count = benchmark_split_sentences(
+        long_text, runs=3
+    )
+    print(f"  spaCy:  {spacy_time * 1000:.2f}ms  ({spacy_count} sentences)")
+    print(f"  Simple: {simple_time * 1000:.2f}ms  ({simple_count} sentences)")
+    print(f"  Speedup: {spacy_time / simple_time:.1f}x")
+
+    # Summary
+    print("\n" + "=" * 70)
+    print("SUMMARY")
+    print("=" * 70)
+    print("Simple mode is typically 20-100x faster than spaCy for common text.")
+    print("Both implementations produce similar results for well-formatted text.")
+    print("\nWhen to use:")
+    print("  • Simple mode: Speed-critical applications, simple text, no ML models")
+    print("  • spaCy mode: Complex text, best accuracy, NLP pipelines")
+    print("=" * 70)
+
+
+if __name__ == "__main__":
+    main()

{phrasplit-0.2.0 → phrasplit-0.2.2}/benchmarks/phrasplit_segmenter.py

@@ -143,6 +143,12 @@ def main() -> None:
         default=False,
         help="Disable splitting on colons",
     )
+    parser.add_argument(
+        "--simple",
+        action="store_true",
+        default=False,
+        help="Use simple regex-based splitting (no spaCy required)",
+    )
 
     args = parser.parse_args()
 
@@ -162,10 +168,12 @@ def main() -> None:
                 # Use the actual phrasplit.split_sentences() function
                 # Long text handling is built-in (automatic chunking)
                 split_on_colon = not args.no_split_on_colon
+                use_spacy = None if not args.simple else False
                 sentences = split_sentences(
                     line,
                     language_model=model_name,
                     split_on_colon=split_on_colon,
+                    use_spacy=use_spacy,
                 )
 
                 # Write each sentence on its own line