patchtroy 0.5.0__tar.gz → 0.5.2__tar.gz

{patchtroy-0.5.0 → patchtroy-0.5.2}/Dockerfile

@@ -5,10 +5,10 @@
 
 FROM python:3.11-slim
 
-LABEL maintainer="Marcus Zou <marcus.zou@icloud.com>"
+LABEL maintainer="marcuz-apl <support@alfazen.org>"
 LABEL org.opencontainers.image.title="Patchtroy"
 LABEL org.opencontainers.image.description="Undetected stealth web scraper & markdown extractor microservice"
-LABEL org.opencontainers.image.version="0.5.0"
+LABEL org.opencontainers.image.version="0.5.2"
 
 # Python and environment settings
 ENV PYTHONUNBUFFERED=1 \

{patchtroy-0.5.0 → patchtroy-0.5.2}/PKG-INFO

@@ -1,12 +1,12 @@
 Metadata-Version: 2.5
 Name: patchtroy
-Version: 0.5.0
-Summary: Undetected stealth web scraper & markdown extractor for LLMs, pairing Patchright with Trafilatura.
+Version: 0.5.2
+Summary: Stealth web scraper & markdown extractor for LLMs, pairing Patchright with Trafilatura.
 Project-URL: Homepage, https://github.com/marcuz-apl/patchtroy
 Project-URL: Repository, https://github.com/marcuz-apl/patchtroy
 Project-URL: Issues, https://github.com/marcuz-apl/patchtroy/issues
-Author-email: Marcus Zou <marcus.zou@icloud.com>
-Maintainer-email: "Alfazen Inc." <support@alfazen.io>
+Author-email: marcuz-apl <support@alfazen.org>
+Maintainer-email: "Alfazen Inc." <support@alfazen.org>
 License-Expression: Apache-2.0
 License-File: LICENSE
 Keywords: crawler,llm,markdown,patchright,playwright,rag,scraper,stealth,trafilatura,web-scraping
@@ -117,8 +117,10 @@ print(result.markdown[:300])
 # Scrape clean Markdown directly to stdout
 patchtroy https://news.ycombinator.com
 
-# Save to output file
+# Save to Markdown, CSV, or JSON (auto-detected from file extension)
 patchtroy https://example.com -o output.md
+patchtroy https://example.com -o output.csv
+patchtroy https://example.com -f json -o output.json
 ```
 
 ---
@@ -150,4 +152,4 @@ Full documentation, API references, architecture guides, and benchmarks are avai
 
 ## 📄 License
 
-Patchtroy is open-source software created by **Marcus Zou** and maintained by **Alfazen Inc.**, released under the **[Apache 2.0 License](LICENSE)**.
+Patchtroy is open-source software created by [@marcuz-apl](https://github.com/marcuz-apl) and maintained by **Alfazen Inc.**, released under the **[Apache 2.0 License](LICENSE)**.

{patchtroy-0.5.0 → patchtroy-0.5.2}/PRD.md

@@ -2,7 +2,7 @@
 
 **Document Version**: 1.0.0  
 **Status**: Active / Approved  
-**Author**: Marcus Zou / Patchtroy Project  
+**Author**: marcuz-apl / Patchtroy Project  
 **Target Category**: Developer Tools / AI & LLM Data Engineering  
 
 ---
@@ -152,7 +152,7 @@ Patchtroy occupies the unoccupied **"Lightweight Stealth Sweet Spot"**:
 - [x] Token counter & LLM chunking utility (`result.chunk(max_tokens=2048)`).
 - [x] Full test suite (32 tests passing).
 
-### Phase 4 (v0.5.0 — Current)
+### Phase 4 (v0.5.2 — Current)
 - [x] PyPI public release workflows & multi-OS matrix CI (`.github/workflows/`).
 - [x] Comprehensive benchmark publication vs Crawl4AI and Firecrawl (`benchmarks/BENCHMARKS.md`).
 - [x] Official documentation portal (Material for MkDocs).

{patchtroy-0.5.0 → patchtroy-0.5.2}/README.md

@@ -72,8 +72,10 @@ print(result.markdown[:300])
 # Scrape clean Markdown directly to stdout
 patchtroy https://news.ycombinator.com
 
-# Save to output file
+# Save to Markdown, CSV, or JSON (auto-detected from file extension)
 patchtroy https://example.com -o output.md
+patchtroy https://example.com -o output.csv
+patchtroy https://example.com -f json -o output.json
 ```
 
 ---
@@ -105,4 +107,4 @@ Full documentation, API references, architecture guides, and benchmarks are avai
 
 ## 📄 License
 
-Patchtroy is open-source software created by **Marcus Zou** and maintained by **Alfazen Inc.**, released under the **[Apache 2.0 License](LICENSE)**.
+Patchtroy is open-source software created by [@marcuz-apl](https://github.com/marcuz-apl) and maintained by **Alfazen Inc.**, released under the **[Apache 2.0 License](LICENSE)**.

patchtroy-0.5.2/VERSION

@@ -0,0 +1 @@
+v0.5.2-2609033

{patchtroy-0.5.0 → patchtroy-0.5.2}/benchmarks/BENCHMARKS.md

@@ -19,7 +19,7 @@ Existing open-source solutions force developers to choose between:
 
 ## 2. Feature & Architecture Matrix
 
-| Dimension | **Patchtroy** (v0.5.0) | **Crawl4AI** (v0.9.3) | **Firecrawl** (Self-Hosted) |
+| Dimension | **Patchtroy** (v0.5.2) | **Crawl4AI** (v0.9.3) | **Firecrawl** (Self-Hosted) |
 | :--- | :---: | :---: | :---: |
 | **Stealth Engine** | **✅ Native Patchright (C++ CDP masked)** | ❌ Standard Playwright (CDP leaked) | ⚠️ Standard Playwright / Puppeteer |
 | **Dynamic Challenge Resilience** | **✅ Native driver protection** | ❌ Frequently flagged on automated checks | ❌ Blocked unless using paid SaaS proxy |

{patchtroy-0.5.0 → patchtroy-0.5.2}/docs/benchmarks.md

@@ -1,6 +1,6 @@
 # 📊 Benchmarks vs Crawl4AI and Firecrawl
 
-A quantitative, reproducible benchmark comparing **Patchtroy (v0.5.0)** against **Crawl4AI (v0.9.3)** and **Firecrawl (Self-Hosted)**.
+A quantitative, reproducible benchmark comparing **Patchtroy (v0.5.2)** against **Crawl4AI (v0.9.3)** and **Firecrawl (Self-Hosted)**.
 
 ---
 

{patchtroy-0.5.0 → patchtroy-0.5.2}/docs/getting-started.md

@@ -186,6 +186,12 @@ patchtroy https://example.com -o output.md
 # Save complete JSON payload (markdown, metadata, structured items, links)
 patchtroy https://example.com -f json -o output.json
 
+# Export to standard CSV (auto-detected from file extension)
+patchtroy https://example.com -o output.csv
+
+# Batch crawl multiple URLs directly to CSV for data pipelines
+patchtroy https://site1.com https://site2.com -f csv -o dataset.csv
+
 # Capture screenshot and PDF
 patchtroy https://example.com --screenshot page.png --pdf document.pdf
 

{patchtroy-0.5.0 → patchtroy-0.5.2}/docs/rest-api.md

@@ -53,7 +53,7 @@ curl http://localhost:4013/health
 ```json
 {
   "status": "healthy",
-  "version": "0.5.0",
+  "version": "0.5.2",
   "engine": "patchright",
   "active": true
 }

{patchtroy-0.5.0 → patchtroy-0.5.2}/pyproject.toml

@@ -4,16 +4,16 @@ build-backend = "hatchling.build"
 
 [project]
 name = "patchtroy"
-version = "0.5.0"
-description = "Undetected stealth web scraper & markdown extractor for LLMs, pairing Patchright with Trafilatura."
+version = "0.5.2"
+description = "Stealth web scraper & markdown extractor for LLMs, pairing Patchright with Trafilatura."
 readme = "README.md"
 license = "Apache-2.0"
 requires-python = ">=3.10"
 authors = [
-    { name = "Marcus Zou", email = "marcus.zou@icloud.com" }
+    { name = "marcuz-apl", email = "support@alfazen.org" }
 ]
 maintainers = [
-    { name = "Alfazen Inc.", email = "support@alfazen.io" }
+    { name = "Alfazen Inc.", email = "support@alfazen.org" }
 ]
 keywords = [
     "crawler",

{patchtroy-0.5.0 → patchtroy-0.5.2}/src/patchtroy/__init__.py

@@ -6,8 +6,8 @@ from patchtroy.models import LinkItem, PatchtroyConfig, ScrapeResult
 from patchtroy.pool import BrowserContextPool
 from patchtroy.proxy import ProxyItem, ProxyManager
 
-__version__ = "0.5.0"
-__author__ = "Marcus Zou"
+__version__ = "0.5.2"
+__author__ = "marcuz-apl"
 __license__ = "Apache-2.0"
 __copyright__ = "Copyright 2026 Alfazen Inc."
 

{patchtroy-0.5.0 → patchtroy-0.5.2}/src/patchtroy/cli.py

@@ -11,7 +11,7 @@ from patchtroy.crawler import Patchtroy
 from patchtroy.models import PatchtroyConfig
 from patchtroy.utils import silence_windows_proactor_bug
 
-__version__ = "0.5.0"
+__version__ = "0.5.2"
 
 
 def main(argv: list[str] | None = None) -> int:
@@ -42,9 +42,9 @@ def main(argv: list[str] | None = None) -> int:
     parser.add_argument(
         "-f",
         "--format",
-        choices=["markdown", "json", "html"],
+        choices=["markdown", "json", "html", "csv"],
         default="markdown",
-        help="Output format (default: markdown)",
+        help="Output format (default: markdown, or inferred from -o extension)",
     )
     parser.add_argument(
         "--wait-for",
@@ -101,6 +101,16 @@ def main(argv: list[str] | None = None) -> int:
 
     args = parser.parse_args(argv)
 
+    # Auto-detect format from output file extension if left at default markdown
+    if args.output and args.format == "markdown":
+        ext = Path(args.output).suffix.lower()
+        if ext == ".csv":
+            args.format = "csv"
+        elif ext == ".json":
+            args.format = "json"
+        elif ext in (".html", ".htm"):
+            args.format = "html"
+
     # Launch REST microservice if requested
     if args.serve or (args.urls and args.urls[0] == "serve"):
         from patchtroy.server import run_server
@@ -149,6 +159,9 @@ def main(argv: list[str] | None = None) -> int:
                 content = json.dumps(dump_data, indent=2, ensure_ascii=False)
             elif args.format == "html":
                 content = result.html
+            elif args.format == "csv":
+                from patchtroy.utils import results_to_csv
+                content = results_to_csv(result)
             else:
                 header = f"# {result.title}\n\nSource: {result.url}\n\n" if result.title else ""
                 content = header + result.markdown
@@ -176,6 +189,11 @@ def main(argv: list[str] | None = None) -> int:
                 for r in results
             ]
             content = json.dumps(dump_data, indent=2, ensure_ascii=False)
+        elif args.format == "csv":
+            from patchtroy.utils import results_to_csv
+            content = results_to_csv(results)
+        elif args.format == "html":
+            content = "\n\n<hr/>\n\n".join(r.html for r in results if r.html)
         else:
             combined = []
             for r in results:

{patchtroy-0.5.0 → patchtroy-0.5.2}/src/patchtroy/models.py

@@ -152,3 +152,9 @@ class ScrapeResult(BaseModel):
             overlap_tokens=overlap_tokens,
             metadata={"url": self.url, "title": self.title},
         )
+
+    def to_csv(self) -> str:
+        """Export this ScrapeResult as an RFC 4180 CSV string."""
+        from patchtroy.utils import results_to_csv
+        return results_to_csv(self)
+

{patchtroy-0.5.0 → patchtroy-0.5.2}/src/patchtroy/server.py

@@ -90,7 +90,7 @@ def create_app() -> FastAPI:
     app = FastAPI(
         title="Patchtroy REST Microservice",
         description="Undetected stealth web scraper & clean Markdown extractor for LLMs.",
-        version="0.5.0",
+        version="0.5.2",
         lifespan=lifespan,
     )
 
@@ -99,7 +99,7 @@ def create_app() -> FastAPI:
         """Microservice health and status check."""
         return {
             "status": "healthy",
-            "version": "0.5.0",
+            "version": "0.5.2",
             "engine": "patchright",
             "active": crawler_instance is not None and crawler_instance._pool.is_running,
         }

{patchtroy-0.5.0 → patchtroy-0.5.2}/src/patchtroy/utils.py

@@ -103,3 +103,74 @@ def silence_subprocess_transport_bug() -> None:
 
 # Backwards-compatible alias
 silence_windows_proactor_bug = silence_subprocess_transport_bug
+
+
+def results_to_csv(results: Any) -> str:
+    """Convert one or multiple ScrapeResult instances into standard RFC 4180 CSV text.
+
+    Args:
+        results: A single ScrapeResult or an iterable/list of ScrapeResult instances.
+
+    Returns:
+        A valid CSV string containing header and data rows.
+    """
+    import csv
+    import io
+
+    if not isinstance(results, (list, tuple)):
+        items = [results]
+    else:
+        items = list(results)
+
+    fieldnames = [
+        "url",
+        "success",
+        "status_code",
+        "title",
+        "author",
+        "date",
+        "token_count",
+        "elapsed_s",
+        "engine_used",
+        "markdown",
+        "error",
+    ]
+
+    output = io.StringIO()
+    writer = csv.DictWriter(
+        output,
+        fieldnames=fieldnames,
+        quoting=csv.QUOTE_MINIMAL,
+        lineterminator="\n",
+    )
+    writer.writeheader()
+
+    for r in items:
+        meta = getattr(r, "metadata", {}) or {}
+        author = meta.get("author") or meta.get("byline") or ""
+        date = meta.get("date") or meta.get("published_time") or ""
+        token_count = meta.get("token_count", 0)
+        markdown_str = getattr(r, "markdown", "") or ""
+        if not token_count and markdown_str:
+            try:
+                from patchtroy.chunker import count_tokens
+                token_count = count_tokens(markdown_str)
+            except Exception:
+                token_count = len(markdown_str) // 4
+
+        writer.writerow({
+            "url": getattr(r, "url", ""),
+            "success": getattr(r, "success", True),
+            "status_code": getattr(r, "status_code", 200),
+            "title": getattr(r, "title", "") or "",
+            "author": author,
+            "date": date,
+            "token_count": token_count,
+            "elapsed_s": round(float(getattr(r, "elapsed_s", 0.0) or 0.0), 3),
+            "engine_used": getattr(r, "engine_used", "patchright"),
+            "markdown": markdown_str,
+            "error": getattr(r, "error", "") or "",
+        })
+
+    return output.getvalue()
+

patchtroy-0.5.2/tests/test_cli.py

@@ -0,0 +1,137 @@
+"""Tests for Patchtroy CLI."""
+
+from unittest.mock import MagicMock, patch
+
+from patchtroy.cli import main
+from patchtroy.models import ScrapeResult
+
+
+def test_cli_help(capsys):
+    ret = main([])
+    assert ret == 1
+
+
+def test_cli_single_url():
+    fake_result = ScrapeResult(
+        url="https://example.com",
+        title="Test Page",
+        markdown="This is test markdown.",
+        success=True,
+    )
+    with patch("patchtroy.cli.Patchtroy") as mock_cls:
+        mock_instance = MagicMock()
+        mock_instance.scrape.return_value = fake_result
+        mock_cls.return_value = mock_instance
+
+        ret = main(["https://example.com", "--screenshot", "out.png", "--pdf", "out.pdf"])
+        assert ret == 0
+        mock_cls.assert_called_once()
+        # Verify config created had screenshot and pdf enabled
+        config_arg = mock_cls.call_args[0][0]
+        assert config_arg.screenshot is True
+        assert config_arg.pdf is True
+        assert config_arg.screenshot_path == "out.png"
+        assert config_arg.pdf_path == "out.pdf"
+
+
+def test_cli_batch_urls():
+    fake_result = ScrapeResult(
+        url="https://example.com",
+        title="Test Page",
+        markdown="Markdown content",
+        success=True,
+    )
+    with patch("patchtroy.cli.Patchtroy") as mock_cls:
+        mock_instance = MagicMock()
+        mock_instance.scrape_many.return_value = [fake_result, fake_result]
+        mock_cls.return_value = mock_instance
+
+        ret = main(["https://example.com/1", "https://example.com/2", "-c", "4"])
+        assert ret == 0
+        config_arg = mock_cls.call_args[0][0]
+        assert config_arg.max_concurrency == 4
+        mock_instance.scrape_many.assert_called_once_with(["https://example.com/1", "https://example.com/2"])
+
+
+def test_cli_serve():
+    with patch("patchtroy.server.run_server") as mock_run:
+        ret = main(["serve", "--port", "9000", "--host", "127.0.0.1"])
+        assert ret == 0
+        mock_run.assert_called_once_with(host="127.0.0.1", port=9000)
+
+
+def test_cli_single_url_csv(tmp_path):
+    csv_file = tmp_path / "result.csv"
+    fake_result = ScrapeResult(
+        url="https://example.com",
+        title="Test Page",
+        markdown="This is test markdown.",
+        success=True,
+    )
+    with patch("patchtroy.cli.Patchtroy") as mock_cls:
+        mock_instance = MagicMock()
+        mock_instance.scrape.return_value = fake_result
+        mock_cls.return_value = mock_instance
+
+        ret = main(["https://example.com", "-f", "csv", "-o", str(csv_file)])
+        assert ret == 0
+        assert csv_file.exists()
+        content = csv_file.read_text(encoding="utf-8")
+        assert "url,success,status_code,title" in content
+        assert "https://example.com,True,200,Test Page" in content
+
+
+def test_cli_csv_auto_detect(tmp_path):
+    csv_file = tmp_path / "autodetect.csv"
+    fake_result = ScrapeResult(
+        url="https://example.com/auto",
+        title="Auto CSV",
+        markdown="Auto CSV Content",
+        success=True,
+    )
+    with patch("patchtroy.cli.Patchtroy") as mock_cls:
+        mock_instance = MagicMock()
+        mock_instance.scrape.return_value = fake_result
+        mock_cls.return_value = mock_instance
+
+        ret = main(["https://example.com/auto", "-o", str(csv_file)])
+        assert ret == 0
+        assert csv_file.exists()
+        content = csv_file.read_text(encoding="utf-8")
+        assert "https://example.com/auto,True,200,Auto CSV" in content
+
+
+def test_cli_batch_csv(tmp_path):
+    csv_file = tmp_path / "batch.csv"
+    r1 = ScrapeResult(url="https://a.com", title="A", markdown="Doc A", success=True)
+    r2 = ScrapeResult(url="https://b.com", title="B", markdown="Doc B", success=False, error="Timeout")
+
+    with patch("patchtroy.cli.Patchtroy") as mock_cls:
+        mock_instance = MagicMock()
+        mock_instance.scrape_many.return_value = [r1, r2]
+        mock_cls.return_value = mock_instance
+
+        ret = main(["https://a.com", "https://b.com", "-f", "csv", "-o", str(csv_file)])
+        assert ret == 0
+        assert csv_file.exists()
+        lines = csv_file.read_text(encoding="utf-8").strip().splitlines()
+        assert len(lines) == 3  # Header + 2 data rows
+        assert "https://a.com" in lines[1]
+        assert "https://b.com" in lines[2]
+        assert "Timeout" in lines[2]
+
+
+def test_scrape_result_to_csv():
+    res = ScrapeResult(
+        url="https://example.com/test",
+        title="Sample",
+        markdown="# Heading\nParagraph",
+        metadata={"author": "Marcus", "date": "2026-09-03"},
+        success=True,
+    )
+    csv_text = res.to_csv()
+    assert "url,success,status_code,title,author,date" in csv_text
+    assert "https://example.com/test" in csv_text
+    assert "Marcus" in csv_text
+    assert "2026-09-03" in csv_text
+

{patchtroy-0.5.0 → patchtroy-0.5.2}/tests/test_server.py

@@ -17,7 +17,7 @@ async def test_health_check_endpoint():
         assert resp.status_code == 200
         data = resp.json()
         assert data["status"] == "healthy"
-        assert data["version"] == "0.5.0"
+        assert data["version"] == "0.5.2"
         assert data["engine"] == "patchright"
 
 

{patchtroy-0.5.0 → patchtroy-0.5.2}/uv.lock

@@ -900,7 +900,7 @@ wheels = [
 
 [[package]]
 name = "patchtroy"
-version = "0.5.0"
+version = "0.5.2"
 source = { editable = "." }
 dependencies = [
     { name = "beautifulsoup4" },

patchtroy-0.5.0/VERSION

@@ -1 +0,0 @@
-v0.5.0-2609031

patchtroy-0.5.0/tests/test_cli.py

@@ -1,60 +0,0 @@
-"""Tests for Patchtroy CLI."""
-
-from unittest.mock import MagicMock, patch
-
-from patchtroy.cli import main
-from patchtroy.models import ScrapeResult
-
-
-def test_cli_help(capsys):
-    ret = main([])
-    assert ret == 1
-
-
-def test_cli_single_url():
-    fake_result = ScrapeResult(
-        url="https://example.com",
-        title="Test Page",
-        markdown="This is test markdown.",
-        success=True,
-    )
-    with patch("patchtroy.cli.Patchtroy") as mock_cls:
-        mock_instance = MagicMock()
-        mock_instance.scrape.return_value = fake_result
-        mock_cls.return_value = mock_instance
-
-        ret = main(["https://example.com", "--screenshot", "out.png", "--pdf", "out.pdf"])
-        assert ret == 0
-        mock_cls.assert_called_once()
-        # Verify config created had screenshot and pdf enabled
-        config_arg = mock_cls.call_args[0][0]
-        assert config_arg.screenshot is True
-        assert config_arg.pdf is True
-        assert config_arg.screenshot_path == "out.png"
-        assert config_arg.pdf_path == "out.pdf"
-
-
-def test_cli_batch_urls():
-    fake_result = ScrapeResult(
-        url="https://example.com",
-        title="Test Page",
-        markdown="Markdown content",
-        success=True,
-    )
-    with patch("patchtroy.cli.Patchtroy") as mock_cls:
-        mock_instance = MagicMock()
-        mock_instance.scrape_many.return_value = [fake_result, fake_result]
-        mock_cls.return_value = mock_instance
-
-        ret = main(["https://example.com/1", "https://example.com/2", "-c", "4"])
-        assert ret == 0
-        config_arg = mock_cls.call_args[0][0]
-        assert config_arg.max_concurrency == 4
-        mock_instance.scrape_many.assert_called_once_with(["https://example.com/1", "https://example.com/2"])
-
-
-def test_cli_serve():
-    with patch("patchtroy.server.run_server") as mock_run:
-        ret = main(["serve", "--port", "9000", "--host", "127.0.0.1"])
-        assert ret == 0
-        mock_run.assert_called_once_with(host="127.0.0.1", port=9000)