docling-pipelines 1.0.0.dev2__tar.gz → 1.0.1.dev0__tar.gz

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/.github/mergify.yml

@@ -20,3 +20,5 @@ merge_protections:
       - "#approved-reviews-by >= 1"
 merge_protections_settings:
   reporting_method: check-runs
+queue_rules:
+  - name: label queue

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/CODEOWNERS

@@ -3,4 +3,4 @@
 
 # By default the below mentioned users are the codeowners for API repo
 # and will be assigned as reviewers when someone opens a pull request.
-* @jo-in @adityars-ibm @nsbayas
+* @jo-in @adityars-ibm @nsbayas @paulbaby

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/PKG-INFO

@@ -1,12 +1,16 @@
-Metadata-Version: 2.4
+Metadata-Version: 2.5
 Name: docling-pipelines
-Version: 1.0.0.dev2
+Version: 1.0.1.dev0
 Summary: This repository contains the docpipe operators.
+Project-URL: Homepage, https://github.com/IBM/docling-pipelines
+Project-URL: Documentation, https://github.com/IBM/docling-pipelines/blob/main/docs/README.md
+Project-URL: Source, https://github.com/IBM/docling-pipelines
+Project-URL: Bug Tracker, https://github.com/IBM/docling-pipelines/issues
 Maintainer-email: Jojo Joseph <jjojo@in.ibm.com>, Aditya Rohan Singh <adityars@ibm.com>, Anudeep Dunaboyina <anudeep.dunaboyina@ibm.com>, Ashok Kumar Angadi <asangadi@in.ibm.com>, Harshad Nehate <Harshad.Nehate@ibm.com>, Kurian Kevin <Kurian.Kevin@ibm.com>, Nipun Bayas <nipun.bayas@ibm.com>, Paul Baby <Paul.Baby1@ibm.com>, Prasad Madugundu <smadugun@in.ibm.com>, Remya P <remya.p@ibm.com>, Sahil Berwal <Sahil.Berwal@ibm.com>, Sanchit Rote <Sanchit.Rote@ibm.com>, Yash Bopardikar <ybopard@us.ibm.com>, Benson Fernandes <benferna@in.ibm.com>, Manish Soni <Manish.Soni3@ibm.com>, Docling Pipeline Team <docling_pipeline_team-dg@ibm.com>
 License-File: LICENSE
 Requires-Python: <3.13,>=3.12
 Requires-Dist: accelerate==1.13.0
-Requires-Dist: aiohttp==3.14.1
+Requires-Dist: aiohttp==3.14.3
 Requires-Dist: alembic==1.18.4
 Requires-Dist: azure-storage-blob==12.28.0
 Requires-Dist: babel==2.18.0
@@ -58,7 +62,7 @@ Requires-Dist: polars==1.32.3
 Requires-Dist: prefect==3.7.1
 Requires-Dist: psycopg2-binary==2.9.12
 Requires-Dist: pyarrow==24.0.0
-Requires-Dist: pyasn1==0.6.3
+Requires-Dist: pyasn1==0.6.4
 Requires-Dist: pydantic-settings==2.14.0
 Requires-Dist: pydantic==2.12.5
 Requires-Dist: pygments==2.20.0
@@ -90,7 +94,7 @@ Requires-Dist: unicodedataplus==16.0.0.post1
 Requires-Dist: urllib3==2.7.0
 Requires-Dist: uvicorn[standard]==0.40.0
 Provides-Extra: dev
-Requires-Dist: black==26.1.0; extra == 'dev'
+Requires-Dist: black==26.3.1; extra == 'dev'
 Requires-Dist: detect-secrets==1.5.0; extra == 'dev'
 Requires-Dist: faker==40.8.0; extra == 'dev'
 Requires-Dist: flake8==7.3.0; extra == 'dev'
@@ -181,38 +185,38 @@ Log verbosity is controlled via `DS_LOG_LEVEL` (`DEBUG`, `INFO`, `WARNING`).
 
 ## Documentation
 
-Check out the full [documentation](docs/README.md) for installation, flow authoring, operator reference, and more:
+Check out the full [documentation](https://github.com/IBM/docling-pipelines/blob/main/docs/README.md) for installation, flow authoring, operator reference, and more:
 
-- [Quick Start Guide](QUICKSTART.md) — first pipeline in under 5 minutes
-- [Pipeline Setup Guide](USER_GUIDE_PIPELINE_SETUP.md) — complete setup with Ollama, OpenSearch, and flow examples
-- [Flow Authoring Format](docs/guides/FLOW_AUTHORING_FORMAT.md) — declarative flow authoring
-- [Operator Reference](docs/reference/OPERATORS.md) — full parameter specs for all operators
-- [Architecture](ARCHITECTURE.md) — system design and distributed execution patterns
-- [Troubleshooting](TROUBLESHOOTING.md) — common issues and solutions
+- [Quick Start Guide](https://github.com/IBM/docling-pipelines/blob/main/QUICKSTART.md) — first pipeline in under 5 minutes
+- [Pipeline Setup Guide](https://github.com/IBM/docling-pipelines/blob/main/USER_GUIDE_PIPELINE_SETUP.md) — complete setup with Ollama, OpenSearch, and flow examples
+- [Flow Authoring Format](https://github.com/IBM/docling-pipelines/blob/main/docs/guides/FLOW_AUTHORING_FORMAT.md) — declarative flow authoring
+- [Operator Reference](https://github.com/IBM/docling-pipelines/blob/main/docs/reference/OPERATORS.md) — full parameter specs for all operators
+- [Architecture](https://github.com/IBM/docling-pipelines/blob/main/ARCHITECTURE.md) — system design and distributed execution patterns
+- [Troubleshooting](https://github.com/IBM/docling-pipelines/blob/main/TROUBLESHOOTING.md) — common issues and solutions
 
 ## Available Operators
 
 | Category | Operators |
 |---|---|
-| **Ingest** | Local File Ingest (`ingest_local`), Remote Source Ingest (`ingest_source`) — [S3, IBM COS, SharePoint, OneDrive, Google Drive, Box, CSV, web](docs/operators/ingest_source/README.md) |
+| **Ingest** | Local File Ingest (`ingest_local`), Remote Source Ingest (`ingest_source`) — [S3, IBM COS, SharePoint, OneDrive, Google Drive, Box, CSV, web](https://github.com/IBM/docling-pipelines/blob/main/docs/operators/ingest_source/README.md) |
 | **Extract** | Document Extractor (`extract_operator`), ACL Extraction (`acl_operator`) |
 | **Functional** | Chunking (`chunker`), Embeddings (`embeddings`), Branching Operator (`branching`), Merge Operator (`merge`), Document ID Hash (`doc_id_hash`), Entity Curation (`entity_curation`), No-op (`noop`) |
 | **Quality** | Language Annotator (`lang_detect`), Readability Operator (`readability`), PII and HAP Annotator (`pii_and_hap`), Document Classifier (`document_classifier`), Annotation Filter (`sql_filter`), Redaction (`redaction`), De-duplicator (`ededup`), ML Text Enrichment (`ml_enrichment`), Document Quality (`doc_quality`) |
 | **VectorDB** | Vector Database (`vectordb`) — OpenSearch, Milvus |
 | **Storage** | Document Set (`document_set`) — DuckDB-backed document collections |
 
-For per-operator configuration guides, see [Operator Configuration Guides](docs/reference/OPERATORS.md).
+For per-operator configuration guides, see [Operator Configuration Guides](https://github.com/IBM/docling-pipelines/blob/main/docs/reference/OPERATORS.md).
 
 ## Examples
 
-Explore [sample flows](examples/) and [DocpipeFlowManager examples](examples/docpipe_flow_manager/) for common pipeline patterns.
+Explore [sample flows](https://github.com/IBM/docling-pipelines/tree/main/examples/) and [DocpipeFlowManager examples](https://github.com/IBM/docling-pipelines/tree/main/examples/docpipe_flow_manager/) for common pipeline patterns.
 
-For interactive, hands-on tutorials, see the [Jupyter notebook examples](examples/notebooks/README.md).
+For interactive, hands-on tutorials, see the [Jupyter notebook examples](https://github.com/IBM/docling-pipelines/blob/main/examples/notebooks/README.md).
 
 ## Contributing
 
-Please read [Contributing to Docling pipelines](CONTRIBUTING.md) for development setup, code standards, testing requirements, and the pull request process.
+Please read [Contributing to Docling pipelines](https://github.com/IBM/docling-pipelines/blob/main/CONTRIBUTING.md) for development setup, code standards, testing requirements, and the pull request process.
 
 ## License
 
-The Docling pipelines codebase is under the [MIT License](LICENSE).
+The Docling pipelines codebase is under the [MIT License](https://github.com/IBM/docling-pipelines/blob/main/LICENSE).

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/README.md

@@ -66,38 +66,38 @@ Log verbosity is controlled via `DS_LOG_LEVEL` (`DEBUG`, `INFO`, `WARNING`).
 
 ## Documentation
 
-Check out the full [documentation](docs/README.md) for installation, flow authoring, operator reference, and more:
+Check out the full [documentation](https://github.com/IBM/docling-pipelines/blob/main/docs/README.md) for installation, flow authoring, operator reference, and more:
 
-- [Quick Start Guide](QUICKSTART.md) — first pipeline in under 5 minutes
-- [Pipeline Setup Guide](USER_GUIDE_PIPELINE_SETUP.md) — complete setup with Ollama, OpenSearch, and flow examples
-- [Flow Authoring Format](docs/guides/FLOW_AUTHORING_FORMAT.md) — declarative flow authoring
-- [Operator Reference](docs/reference/OPERATORS.md) — full parameter specs for all operators
-- [Architecture](ARCHITECTURE.md) — system design and distributed execution patterns
-- [Troubleshooting](TROUBLESHOOTING.md) — common issues and solutions
+- [Quick Start Guide](https://github.com/IBM/docling-pipelines/blob/main/QUICKSTART.md) — first pipeline in under 5 minutes
+- [Pipeline Setup Guide](https://github.com/IBM/docling-pipelines/blob/main/USER_GUIDE_PIPELINE_SETUP.md) — complete setup with Ollama, OpenSearch, and flow examples
+- [Flow Authoring Format](https://github.com/IBM/docling-pipelines/blob/main/docs/guides/FLOW_AUTHORING_FORMAT.md) — declarative flow authoring
+- [Operator Reference](https://github.com/IBM/docling-pipelines/blob/main/docs/reference/OPERATORS.md) — full parameter specs for all operators
+- [Architecture](https://github.com/IBM/docling-pipelines/blob/main/ARCHITECTURE.md) — system design and distributed execution patterns
+- [Troubleshooting](https://github.com/IBM/docling-pipelines/blob/main/TROUBLESHOOTING.md) — common issues and solutions
 
 ## Available Operators
 
 | Category | Operators |
 |---|---|
-| **Ingest** | Local File Ingest (`ingest_local`), Remote Source Ingest (`ingest_source`) — [S3, IBM COS, SharePoint, OneDrive, Google Drive, Box, CSV, web](docs/operators/ingest_source/README.md) |
+| **Ingest** | Local File Ingest (`ingest_local`), Remote Source Ingest (`ingest_source`) — [S3, IBM COS, SharePoint, OneDrive, Google Drive, Box, CSV, web](https://github.com/IBM/docling-pipelines/blob/main/docs/operators/ingest_source/README.md) |
 | **Extract** | Document Extractor (`extract_operator`), ACL Extraction (`acl_operator`) |
 | **Functional** | Chunking (`chunker`), Embeddings (`embeddings`), Branching Operator (`branching`), Merge Operator (`merge`), Document ID Hash (`doc_id_hash`), Entity Curation (`entity_curation`), No-op (`noop`) |
 | **Quality** | Language Annotator (`lang_detect`), Readability Operator (`readability`), PII and HAP Annotator (`pii_and_hap`), Document Classifier (`document_classifier`), Annotation Filter (`sql_filter`), Redaction (`redaction`), De-duplicator (`ededup`), ML Text Enrichment (`ml_enrichment`), Document Quality (`doc_quality`) |
 | **VectorDB** | Vector Database (`vectordb`) — OpenSearch, Milvus |
 | **Storage** | Document Set (`document_set`) — DuckDB-backed document collections |
 
-For per-operator configuration guides, see [Operator Configuration Guides](docs/reference/OPERATORS.md).
+For per-operator configuration guides, see [Operator Configuration Guides](https://github.com/IBM/docling-pipelines/blob/main/docs/reference/OPERATORS.md).
 
 ## Examples
 
-Explore [sample flows](examples/) and [DocpipeFlowManager examples](examples/docpipe_flow_manager/) for common pipeline patterns.
+Explore [sample flows](https://github.com/IBM/docling-pipelines/tree/main/examples/) and [DocpipeFlowManager examples](https://github.com/IBM/docling-pipelines/tree/main/examples/docpipe_flow_manager/) for common pipeline patterns.
 
-For interactive, hands-on tutorials, see the [Jupyter notebook examples](examples/notebooks/README.md).
+For interactive, hands-on tutorials, see the [Jupyter notebook examples](https://github.com/IBM/docling-pipelines/blob/main/examples/notebooks/README.md).
 
 ## Contributing
 
-Please read [Contributing to Docling pipelines](CONTRIBUTING.md) for development setup, code standards, testing requirements, and the pull request process.
+Please read [Contributing to Docling pipelines](https://github.com/IBM/docling-pipelines/blob/main/CONTRIBUTING.md) for development setup, code standards, testing requirements, and the pull request process.
 
 ## License
 
-The Docling pipelines codebase is under the [MIT License](LICENSE).
+The Docling pipelines codebase is under the [MIT License](https://github.com/IBM/docling-pipelines/blob/main/LICENSE).

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/TROUBLESHOOTING.md

@@ -182,6 +182,59 @@ uv sync --extra dev
 
 ---
 
+#### Issue: `fasttext-wheel` Build Failure on macOS 15+ (Sequoia / Tahoe)
+
+**Symptoms:**
+
+```
+× Failed to build `fasttext-wheel==0.9.2`
+...
+fatal error: 'istream' file not found
+error: command '/usr/bin/c++' failed with exit code 1
+```
+
+**Cause:**
+
+`fasttext-wheel` 0.9.2 compiles a C++ extension from source. On macOS 15+ with clang 17, the
+compiler no longer resolves the C++ standard library headers at the deployment target hardcoded
+by `fasttext-wheel` (`-mmacosx-version-min=11.0`). No pre-built binary is available for arm64.
+
+**Solution:**
+
+Set these environment variables before running `uv sync`:
+
+```bash
+CPLUS_INCLUDE_PATH=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/c++/v1:/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include \
+CXXFLAGS="-isysroot $(xcrun --show-sdk-path) -mmacosx-version-min=14.0" \
+uv sync --extra dev
+```
+
+To avoid setting these every time, add them to a `.envrc` in the project root (if you use
+[direnv](https://direnv.net/)) or to your `~/.zshrc`:
+
+```bash
+export CPLUS_INCLUDE_PATH=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/c++/v1:/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include
+export CXXFLAGS="-isysroot $(xcrun --show-sdk-path) -mmacosx-version-min=14.0"
+```
+
+**Verify Xcode CLT is installed:**
+
+```bash
+xcode-select --print-path
+# Expected: /Library/Developer/CommandLineTools
+
+xcrun --show-sdk-path
+# Expected: /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk
+```
+
+If `xcode-select` prints nothing, install the tools first:
+
+```bash
+xcode-select --install
+```
+
+---
+
 #### Issue: Permission Denied During Setup
 
 **Symptoms:**

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/pyproject.toml

@@ -22,9 +22,10 @@ maintainers = [
     { name = "Manish Soni", email = "Manish.Soni3@ibm.com" },
     { name = "Docling Pipeline Team", email = "docling_pipeline_team-dg@ibm.com" },
 ]
+
 dependencies = [
     "accelerate==1.13.0",
-    "aiohttp==3.14.1",
+    "aiohttp==3.14.3",
     "alembic==1.18.4",
     "azure-storage-blob==12.28.0",
     "babel==2.18.0",
@@ -75,7 +76,7 @@ dependencies = [
     "prefect==3.7.1",
     "psycopg2-binary==2.9.12",
     "pyarrow==24.0.0",
-    "pyasn1==0.6.3",
+    "pyasn1==0.6.4",  # CVE-2026-59884: Security fix for pyasn1 BER/CER/DER decoder DoS
     "pydantic==2.12.5",
     "pydantic-settings==2.14.0",
     "pygments==2.20.0",
@@ -112,7 +113,7 @@ dependencies = [
 
 [project.optional-dependencies]
 dev = [
-    "black==26.1.0",
+    "black==26.3.1",
     "detect-secrets==1.5.0",
     "faker==40.8.0",
     "flake8==7.3.0",
@@ -143,6 +144,12 @@ vlm_asr = [
 docling-pipelines-api = "docpipe.api.main:app"
 docling-pipelines = "docpipe.cli.docpipe_cli:main"
 
+[project.urls]
+Homepage = "https://github.com/IBM/docling-pipelines"
+Documentation = "https://github.com/IBM/docling-pipelines/blob/main/docs/README.md"
+Source = "https://github.com/IBM/docling-pipelines"
+"Bug Tracker" = "https://github.com/IBM/docling-pipelines/issues"
+
 [tool.hatch.build.targets.wheel]
 packages = ["src/docpipe"]
 

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/requirements.txt

@@ -3,7 +3,7 @@
 -e .
 accelerate==1.13.0
 aiohappyeyeballs==2.6.1
-aiohttp==3.14.1
+aiohttp==3.14.3
 aiosignal==1.4.0
 aiosqlite==0.22.1
 alembic==1.18.4
@@ -208,7 +208,7 @@ psutil==7.2.2
 psycopg2-binary==2.9.12
 py-key-value-aio==0.4.4
 pyarrow==24.0.0
-pyasn1==0.6.3
+pyasn1==0.6.4
 pyasn1-modules==0.4.2
 pybind11==3.0.4
 pyclipper==1.4.0

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/src/docpipe/core/constants/operator_constants.py

@@ -520,6 +520,16 @@ class OperatorConstants:
         OUTPUT_FORMAT_DOCTAGS: Final[str] = "doctags"
         OUTPUT_FORMAT_DOCLANG: Final[str] = "doclang"
 
+        # Docling Serve API response keys
+        DOCLING_SERVE_DOCUMENT: Final[str] = "document"
+        DOCLING_SERVE_PROCESSING_TIME: Final[str] = "processing_time"
+        DOCLING_SERVE_PAGES: Final[str] = "pages"
+        DOCLING_SERVE_HTML_CONTENT: Final[str] = "html_content"
+        DOCLING_SERVE_JSON_CONTENT: Final[str] = "json_content"
+        DOCLING_SERVE_TEXT_CONTENT: Final[str] = "text_content"
+        DOCLING_SERVE_DOCTAGS_CONTENT: Final[str] = "doctags_content"
+        DOCLING_SERVE_DOCLANG_CONTENT: Final[str] = "doclang_content"
+
         # Valid output formats list (markdown is always generated, so not in this list)
         VALID_OUTPUT_FORMATS: Final[list[str]] = [
             OUTPUT_FORMAT_HTML,

{docling_pipelines-1.0.0.dev2 → docling_pipelines-1.0.1.dev0}/src/docpipe/core/operators/extract/adapters/outbound/factories/text_extraction_adapter_factory.py

@@ -142,7 +142,6 @@ class TextExtractionAdapterFactory:
             )
 
         elif mode == TextExtractionMode.DOCLING_SERVE:
-            # Build docling_serve_config dictionary from provider_config
             docling_serve_config = {
                 OperatorConstants.Config.BASE_URL: provider_config.get(
                     OperatorConstants.Config.BASE_URL, "http://localhost:5001"
@@ -158,13 +157,9 @@ class TextExtractionAdapterFactory:
                     OperatorConstants.Processing.VERIFY_SSL, True
                 ),
                 OperatorConstants.Config.DO_OCR: provider_config.get(OperatorConstants.Config.DO_OCR, True),
-                OperatorConstants.Config.OCR_ENGINE: provider_config.get(
-                    OperatorConstants.Config.OCR_ENGINE, "easyocr"
-                ),
                 OperatorConstants.Config.PDF_BACKEND: provider_config.get(
                     OperatorConstants.Config.PDF_BACKEND, "dlparse_v2"
                 ),
-                OperatorConstants.Config.TABLE_MODE: provider_config.get(OperatorConstants.Config.TABLE_MODE, "fast"),
                 OperatorConstants.Config.IMAGE_EXPORT_MODE: provider_config.get(
                     OperatorConstants.Config.IMAGE_EXPORT_MODE, "placeholder"
                 ),
@@ -176,6 +171,18 @@ class TextExtractionAdapterFactory:
                     OperatorConstants.Config.API_KEY
                 ]
 
+            # ocr_engine and table_mode are optional — only forward if explicitly set
+            # (different docling-serve versions/deployments support different values)
+            if provider_config.get(OperatorConstants.Config.OCR_ENGINE):
+                docling_serve_config[OperatorConstants.Config.OCR_ENGINE] = provider_config[
+                    OperatorConstants.Config.OCR_ENGINE
+                ]
+
+            if provider_config.get(OperatorConstants.Config.TABLE_MODE):
+                docling_serve_config[OperatorConstants.Config.TABLE_MODE] = provider_config[
+                    OperatorConstants.Config.TABLE_MODE
+                ]
+
             if provider_config.get(OperatorConstants.Config.OCR_LANGUAGES):
                 docling_serve_config[OperatorConstants.Config.OCR_LANGUAGES] = provider_config[
                     OperatorConstants.Config.OCR_LANGUAGES