docling 1.19.1__py3-none-any.whl → 2.0.0__py3-none-any.whl

docling-1.19.1.dist-info/METADATA

@@ -1,380 +0,0 @@
-Metadata-Version: 2.1
-Name: docling
-Version: 1.19.1
-Summary: Docling PDF conversion package
-Home-page: https://github.com/DS4SD/docling
-License: MIT
-Keywords: docling,convert,document,pdf,layout model,segmentation,table structure,table former
-Author: Christoph Auer
-Author-email: cau@zurich.ibm.com
-Requires-Python: >=3.10,<4.0
-Classifier: Development Status :: 5 - Production/Stable
-Classifier: Intended Audience :: Developers
-Classifier: Intended Audience :: Science/Research
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Operating System :: MacOS :: MacOS X
-Classifier: Operating System :: POSIX :: Linux
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
-Provides-Extra: tesserocr
-Requires-Dist: certifi (>=2024.7.4)
-Requires-Dist: deepsearch-glm (>=0.22.0,<0.23.0)
-Requires-Dist: docling-core (>=1.7.1,<2.0.0)
-Requires-Dist: docling-ibm-models (>=2.0.0,<3.0.0)
-Requires-Dist: docling-parse (>=1.4.1,<2.0.0)
-Requires-Dist: easyocr (>=1.7,<2.0)
-Requires-Dist: filetype (>=1.2.0,<2.0.0)
-Requires-Dist: huggingface_hub (>=0.23,<1)
-Requires-Dist: pandas (>=2.1.4,<3.0.0)
-Requires-Dist: pyarrow (>=16.1.0,<17.0.0)
-Requires-Dist: pydantic (>=2.0.0,<3.0.0)
-Requires-Dist: pydantic-settings (>=2.3.0,<3.0.0)
-Requires-Dist: pypdfium2 (>=4.30.0,<5.0.0)
-Requires-Dist: requests (>=2.32.3,<3.0.0)
-Requires-Dist: rtree (>=1.3.0,<2.0.0)
-Requires-Dist: scipy (>=1.14.1,<2.0.0)
-Requires-Dist: tesserocr (>=2.7.1,<3.0.0) ; extra == "tesserocr"
-Requires-Dist: torch (>=2.2.2,<2.3.0) ; sys_platform == "darwin" and platform_machine == "x86_64"
-Requires-Dist: torch (>=2.2.2,<3.0.0) ; sys_platform != "darwin" or platform_machine != "x86_64"
-Requires-Dist: torchvision (>=0,<1) ; sys_platform != "darwin" or platform_machine != "x86_64"
-Requires-Dist: torchvision (>=0.17.2,<0.18.0) ; sys_platform == "darwin" and platform_machine == "x86_64"
-Requires-Dist: typer (>=0.12.5,<0.13.0)
-Project-URL: Repository, https://github.com/DS4SD/docling
-Description-Content-Type: text/markdown
-
-<p align="center">
-  <a href="https://github.com/ds4sd/docling">
-    <img loading="lazy" alt="Docling" src="https://github.com/DS4SD/docling/raw/main/logo.png" width="150" />
-  </a>
-</p>
-
-# Docling
-
-[![arXiv](https://img.shields.io/badge/arXiv-2408.09869-b31b1b.svg)](https://arxiv.org/abs/2408.09869)
-[![PyPI version](https://img.shields.io/pypi/v/docling)](https://pypi.org/project/docling/)
-![Python](https://img.shields.io/badge/python-3.10%20%7C%203.11%20%7C%203.12-blue)
-[![Poetry](https://img.shields.io/endpoint?url=https://python-poetry.org/badge/v0.json)](https://python-poetry.org/)
-[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
-[![Imports: isort](https://img.shields.io/badge/%20imports-isort-%231674b1?style=flat&labelColor=ef8336)](https://pycqa.github.io/isort/)
-[![Pydantic v2](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/pydantic/pydantic/main/docs/badge/v2.json)](https://pydantic.dev)
-[![pre-commit](https://img.shields.io/badge/pre--commit-enabled-brightgreen?logo=pre-commit&logoColor=white)](https://github.com/pre-commit/pre-commit)
-[![License MIT](https://img.shields.io/github/license/DS4SD/docling)](https://opensource.org/licenses/MIT)
-
-Docling bundles PDF document conversion to JSON and Markdown in an easy, self-contained package.
-
-## Features
-* ⚡ Converts any PDF document to JSON or Markdown format, stable and lightning fast
-* 📑 Understands detailed page layout, reading order and recovers table structures
-* 📝 Extracts metadata from the document, such as title, authors, references and language
-* 🔍 Includes OCR support for scanned PDFs
-* 🤖 Integrates easily with LLM app / RAG frameworks like 🦙 LlamaIndex and 🦜🔗 LangChain
-* 💻 Provides a simple and convenient CLI
-
-## Installation
-
-To use Docling, simply install `docling` from your package manager, e.g. pip:
-```bash
-pip install docling
-```
-
-Works on macOS, Linux and Windows environments. Both x86_64 and arm64 architectures.
-
-<details>
-  <summary><b>Alternative PyTorch distributions</b></summary>
-
-  The Docling models depend on the [PyTorch](https://pytorch.org/) library.
-  Depending on your architecture, you might want to use a different distribution of `torch`.
-  For example, you might want support for different accelerator or for a cpu-only version.
-  All the different ways for installing `torch` are listed on their website <https://pytorch.org/>.
-
-  One common situation is the installation on Linux systems with cpu-only support.
-  In this case, we suggest the installation of Docling with the following options
-
-  ```bash
-  # Example for installing on the Linux cpu-only version
-  pip install docling --extra-index-url https://download.pytorch.org/whl/cpu
-  ```
-</details>
-
-<details>
-  <summary><b>Alternative OCR engines</b></summary>
-
-  Docling supports multiple OCR engines for processing scanned documents. The current version provides
-  the following engines.
-
-  | Engine | Installation | Usage |
-  | ------ | ------------ | ----- |
-  | [EasyOCR](https://github.com/JaidedAI/EasyOCR) | Default in Docling or via `pip install easyocr`. | `EasyOcrOptions` |
-  | Tesseract | System dependency. See description for Tesseract and Tesserocr below.  | `TesseractOcrOptions` |
-  | Tesseract CLI | System dependency. See description below. | `TesseractCliOcrOptions` |
-
-  The Docling `DocumentConverter` allows to choose the OCR engine with the `ocr_options` settings. For example
-
-  ```python
-    from docling.datamodel.base_models import ConversionStatus, PipelineOptions
-    from docling.datamodel.pipeline_options import PipelineOptions, EasyOcrOptions, TesseractOcrOptions
-    from docling.document_converter import DocumentConverter
-
-    pipeline_options = PipelineOptions()
-    pipeline_options.do_ocr = True
-    pipeline_options.ocr_options = TesseractOcrOptions()  # Use Tesseract
-
-    doc_converter = DocumentConverter(
-        pipeline_options=pipeline_options,
-    )
-  ```
-
-  #### Tesseract installation
-
-  [Tesseract](https://github.com/tesseract-ocr/tesseract) is a popular OCR engine which is available
-  on most operating systems. For using this engine with Docling, Tesseract must be installed on your
-  system, using the packaging tool of your choice. Below we provide example commands.
-  After installing Tesseract you are expected to provide the path to its language files using the
-  `TESSDATA_PREFIX` environment variable (note that it must terminate with a slash `/`).
-
-  For macOS, we reccomend using [Homebrew](https://brew.sh/).
-
-  ```console
-  brew install tesseract leptonica pkg-config
-  TESSDATA_PREFIX=/opt/homebrew/share/tessdata/
-  echo "Set TESSDATA_PREFIX=${TESSDATA_PREFIX}"
-  ```
-
-  For Debian-based systems.
-
-  ```console
-  apt-get install tesseract-ocr tesseract-ocr-eng libtesseract-dev libleptonica-dev pkg-config
-  TESSDATA_PREFIX=$(dpkg -L tesseract-ocr-eng | grep tessdata$)
-  echo "Set TESSDATA_PREFIX=${TESSDATA_PREFIX}"
-  ```
-
-  For RHEL systems.
-
-  ```console
-  dnf install tesseract tesseract-devel tesseract-langpack-eng leptonica-devel
-  TESSDATA_PREFIX=/usr/share/tesseract/tessdata/
-  echo "Set TESSDATA_PREFIX=${TESSDATA_PREFIX}"
-  ```
-
-  #### Linking to Tesseract
-  The most efficient usage of the Tesseract library is via linking. Docling is using
-  the [Tesserocr](https://github.com/sirfz/tesserocr) package for this.
-
-  If you get into installation issues of Tesserocr, we suggest using the following
-  installation options:
-
-  ```console
-  pip uninstall tesserocr
-  pip install --no-binary :all: tesserocr
-  ```
-</details>
-
-<details>
-  <summary><b>Docling development setup</b></summary>
-
-  To develop for Docling (features, bugfixes etc.), install as follows from your local clone's root dir:
-  ```bash
-  poetry install --all-extras
-  ```
-</details>
-
-## Getting started
-
-### Convert a single document
-
-To convert invidual PDF documents, use `convert_single()`, for example:
-```python
-from docling.document_converter import DocumentConverter
-
-source = "https://arxiv.org/pdf/2408.09869"  # PDF path or URL
-converter = DocumentConverter()
-result = converter.convert_single(source)
-print(result.render_as_markdown())  # output: "## Docling Technical Report[...]"
-print(result.render_as_doctags())  # output: "<document><title><page_1><loc_20>..."
-```
-
-### Convert a batch of documents
-
-For an example of batch-converting documents, see [batch_convert.py](https://github.com/DS4SD/docling/blob/main/examples/batch_convert.py).
-
-From a local repo clone, you can run it with:
-
-```
-python examples/batch_convert.py
-```
-The output of the above command will be written to `./scratch`.
-
-### CLI
-
-You can also use Docling directly from your command line to convert individual files —be it local or by URL— or whole directories.
-
-A simple example would look like this:
-```console
-docling https://arxiv.org/pdf/2206.01062
-```
-
-To see all available options (export formats etc.) run `docling --help`.
-
-<details>
-  <summary><b>CLI reference</b></summary>
-
-  Here are the available options as of this writing (for an up-to-date listing, run `docling --help`):
-
-  ```console
-  $ docling --help
-
-  Usage: docling [OPTIONS] source
-
-  ╭─ Arguments ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
-  │ *    input_sources      source  PDF files to convert. Can be local file / directory paths or URL. [default: None] [required] │
-  ╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
-  ╭─ Options ────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
-  │ --json       --no-json                            If enabled the document is exported as JSON. [default: no-json]            │
-  │ --md         --no-md                              If enabled the document is exported as Markdown. [default: md]             │
-  │ --txt        --no-txt                             If enabled the document is exported as Text. [default: no-txt]             │
-  │ --doctags    --no-doctags                         If enabled the document is exported as Doc Tags. [default: no-doctags]     │
-  │ --ocr        --no-ocr                             If enabled, the bitmap content will be processed using OCR. [default: ocr] │
-  │ --backend                    [pypdfium2|docling]  The PDF backend to use. [default: docling]                                 │
-  │ --output                     PATH                 Output directory where results are saved. [default: .]                     │
-  │ --version                                         Show version information.                                                  │
-  │ --help                                            Show this message and exit.                                                │
-  ╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
-  ```
-</details>
-
-### RAG
-Check out the following examples showcasing RAG using Docling with standard LLM application frameworks:
-- [Basic RAG pipeline with 🦙 LlamaIndex](https://github.com/DS4SD/docling/tree/main/examples/rag_llamaindex.ipynb)
-- [Basic RAG pipeline with 🦜🔗 LangChain](https://github.com/DS4SD/docling/tree/main/examples/rag_langchain.ipynb)
-
-## Advanced features
-
-### Adjust pipeline features
-
-The example file [custom_convert.py](https://github.com/DS4SD/docling/blob/main/examples/custom_convert.py) contains multiple ways
-one can adjust the conversion pipeline and features.
-
-
-#### Control pipeline options
-
-You can control if table structure recognition or OCR should be performed by arguments passed to `DocumentConverter`:
-```python
-doc_converter = DocumentConverter(
-    artifacts_path=artifacts_path,
-    pipeline_options=PipelineOptions(
-        do_table_structure=False,  # controls if table structure is recovered
-        do_ocr=True,  # controls if OCR is applied (ignores programmatic content)
-    ),
-)
-```
-
-#### Control table extraction options
-
-You can control if table structure recognition should map the recognized structure back to PDF cells (default) or use text cells from the structure prediction itself.
-This can improve output quality if you find that multiple columns in extracted tables are erroneously merged into one.
-
-
-```python
-from docling.datamodel.pipeline_options import PipelineOptions
-
-pipeline_options = PipelineOptions(do_table_structure=True)
-pipeline_options.table_structure_options.do_cell_matching = False  # uses text cells predicted from table structure model
-
-doc_converter = DocumentConverter(
-    artifacts_path=artifacts_path,
-    pipeline_options=pipeline_options,
-)
-```
-
-Since docling 1.16.0: You can control which TableFormer mode you want to use. Choose between `TableFormerMode.FAST` (default) and `TableFormerMode.ACCURATE` (better, but slower) to receive better quality with difficult table structures.
-
-```python
-from docling.datamodel.pipeline_options import PipelineOptions, TableFormerMode
-
-pipeline_options = PipelineOptions(do_table_structure=True)
-pipeline_options.table_structure_options.mode = TableFormerMode.ACCURATE  # use more accurate TableFormer model
-
-doc_converter = DocumentConverter(
-    artifacts_path=artifacts_path,
-    pipeline_options=pipeline_options,
-)
-```
-
-### Impose limits on the document size
-
-You can limit the file size and number of pages which should be allowed to process per document:
-```python
-conv_input = DocumentConversionInput.from_paths(
-    paths=[Path("./test/data/2206.01062.pdf")],
-    limits=DocumentLimits(max_num_pages=100, max_file_size=20971520)
-)
-```
-
-### Convert from binary PDF streams
-
-You can convert PDFs from a binary stream instead of from the filesystem as follows:
-```python
-buf = BytesIO(your_binary_stream)
-docs = [DocumentStream(filename="my_doc.pdf", stream=buf)]
-conv_input = DocumentConversionInput.from_streams(docs)
-results = doc_converter.convert(conv_input)
-```
-### Limit resource usage
-
-You can limit the CPU threads used by Docling by setting the environment variable `OMP_NUM_THREADS` accordingly. The default setting is using 4 CPU threads.
-
-### Chunking
-
-You can perform a hierarchy-aware chunking of a Docling document as follows:
-
-```python
-from docling.document_converter import DocumentConverter
-from docling_core.transforms.chunker import HierarchicalChunker
-
-doc = DocumentConverter().convert_single("https://arxiv.org/pdf/2206.01062").output
-chunks = list(HierarchicalChunker().chunk(doc))
-print(chunks[0])
-# ChunkWithMetadata(
-#     path='#/main-text/1',
-#     text='DocLayNet: A Large Human-Annotated Dataset [...]',
-#     page=1,
-#     bbox=[107.30, 672.38, 505.19, 709.08],
-#     [...]
-# )
-```
-
-
-## Technical report
-
-For more details on Docling's inner workings, check out the [Docling Technical Report](https://arxiv.org/abs/2408.09869).
-
-## Contributing
-
-Please read [Contributing to Docling](https://github.com/DS4SD/docling/blob/main/CONTRIBUTING.md) for details.
-
-
-## References
-
-If you use Docling in your projects, please consider citing the following:
-
-```bib
-@techreport{Docling,
-  author = {Deep Search Team},
-  month = {8},
-  title = {Docling Technical Report},
-  url = {https://arxiv.org/abs/2408.09869},
-  eprint = {2408.09869},
-  doi = {10.48550/arXiv.2408.09869},
-  version = {1.0.0},
-  year = {2024}
-}
-```
-
-## License
-
-The Docling codebase is under MIT license.
-For individual model usage, please refer to the model licenses found in the original packages.
-

docling-1.19.1.dist-info/RECORD

@@ -1,34 +0,0 @@
-docling/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/backend/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/backend/abstract_backend.py,sha256=clJtGxLedpLriEhpx7oyxjmlwMLPorkv-1tdfZm9GdA,1546
-docling/backend/docling_parse_backend.py,sha256=RUWWZbx2cUotZeeTkc-Lbg2k8MVFXFxaDjM4sPfaFZE,7475
-docling/backend/pypdfium2_backend.py,sha256=bIIImVM73wmcVcKMqjl4JF8CD-Qj2W5rZbI4G7clU4s,8877
-docling/cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/cli/main.py,sha256=Q_5HTL2O20bMlF-U8Ac8ev4iqgLPyrwlHEyLAq6rezg,7913
-docling/datamodel/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/datamodel/base_models.py,sha256=ihBfPvVhxnEGmrzBMma_2RlOyObpaBAb7O5oBFBlIks,8833
-docling/datamodel/document.py,sha256=8iHylLaty-ZVYGzYmP61dZPtduzEyiRM79Tx3gS9UEU,16195
-docling/datamodel/pipeline_options.py,sha256=KTjos_AheIUDlMm4xsV9V1cvM5cI3ZG43z-WXAP_FXU,1931
-docling/datamodel/settings.py,sha256=t5g6wrEJnPa9gBzMMl8ppgBRUYz-8xgopEtfMS0ZH28,733
-docling/document_converter.py,sha256=V0Q5hCRyTbmavhQBN48biBttxpvPyoAPmFRhSePv2vE,11149
-docling/models/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/models/base_ocr_model.py,sha256=a89dLaT2vV5lTSNeetlCY9OnUd4LP4My_ZRky_fpVgo,4530
-docling/models/ds_glm_model.py,sha256=VXGmj8cW0WKMz1He4tp1lZhXHkS8Z39U1G-ujkc7deU,3368
-docling/models/easyocr_model.py,sha256=fmfTvOfqo97n_xYQDPRMKlvMOs9QqgLgSTqwBDrjK_8,3010
-docling/models/layout_model.py,sha256=5wCohyzGK1p5F5cTRY5QWbW2AI4eevXobJDJdSLhX7k,11272
-docling/models/page_assemble_model.py,sha256=8eoG2WiFxPxq9TPvM-wkngb2gkr0tdtCRVXg1JcTETo,5550
-docling/models/table_structure_model.py,sha256=iHJjWdKCpTcH3l_ElMWnC5pt6tkUpIuByed304Fdq9w,6009
-docling/models/tesseract_ocr_cli_model.py,sha256=B7zPkpKgpfTTUWXm-_zvw7x0yvzVd85WguawFVDwdqI,5529
-docling/models/tesseract_ocr_model.py,sha256=PqQv1Hv3GC1FByjegWvjNFw15Jcw-mT25_MvFr3hAHQ,4575
-docling/pipeline/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/pipeline/base_model_pipeline.py,sha256=rrMog3EuiR5Gx9OWtfMj24rQvHCrWkxZ3g9OIr7LPSQ,607
-docling/pipeline/standard_model_pipeline.py,sha256=SVyMYmP1YLzYqDqagjn-pWugnjS7bp9YbmlV-VcenpI,2589
-docling/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-docling/utils/export.py,sha256=bKLdbeUcR-rQsGPV1IqJkCHKMCv7X2QOHyxmjNuH3HE,4655
-docling/utils/layout_utils.py,sha256=FOFbL0hKzUoWXdZaeUvEtFqKv0IkPifIr4sdGW4suKs,31804
-docling/utils/utils.py,sha256=llhXSbIDNZ1MHOwBEfLHBAoJIAYI7QlPIonlI1jLUJ0,1208
-docling-1.19.1.dist-info/LICENSE,sha256=mBb7ErEcM8VS9OhiGHnQ2kk75HwPhr54W1Oiz3965MY,1088
-docling-1.19.1.dist-info/METADATA,sha256=hCQeq3JVB16CfTwtjjwnX5u9bWYjD0CsSbn9h1tZZTM,16800
-docling-1.19.1.dist-info/WHEEL,sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg,88
-docling-1.19.1.dist-info/entry_points.txt,sha256=VOSzV77znM52dz5ysaDuJ0ijl1cnfrh1ZPg8od5OcTs,48
-docling-1.19.1.dist-info/RECORD,,