magic-pdf 0.6.0__py3-none-any.whl → 0.6.2b1__py3-none-any.whl

magic_pdf-0.6.0.dist-info/METADATA

@@ -1,241 +0,0 @@
-Metadata-Version: 2.1
-Name: magic-pdf
-Version: 0.6.0
-Summary: A practical tool for converting PDF to Markdown
-Home-page: https://github.com/opendatalab/MinerU
-Requires-Python: >=3.9
-Description-Content-Type: text/markdown
-License-File: LICENSE.md
-Requires-Dist: boto3 >=1.28.43
-Requires-Dist: Brotli >=1.1.0
-Requires-Dist: click >=8.1.7
-Requires-Dist: PyMuPDF >=1.24.7
-Requires-Dist: loguru >=0.6.0
-Requires-Dist: numpy >=1.21.6
-Requires-Dist: fast-langdetect >=0.2.1
-Requires-Dist: wordninja >=2.0.0
-Requires-Dist: scikit-learn >=1.0.2
-Requires-Dist: pdfminer.six >=20231228
-Provides-Extra: cpu
-Requires-Dist: paddleocr ==2.7.3 ; extra == 'cpu'
-Requires-Dist: paddlepaddle ; extra == 'cpu'
-Provides-Extra: full-cpu
-Requires-Dist: unimernet ; extra == 'full-cpu'
-Requires-Dist: matplotlib ; extra == 'full-cpu'
-Requires-Dist: ultralytics ; extra == 'full-cpu'
-Requires-Dist: paddleocr ==2.7.3 ; extra == 'full-cpu'
-Requires-Dist: paddlepaddle ; extra == 'full-cpu'
-Provides-Extra: gpu
-Requires-Dist: paddleocr ==2.7.3 ; extra == 'gpu'
-Requires-Dist: paddlepaddle-gpu ; extra == 'gpu'
-
-<div id="top"></div>
-<div align="center">
-
-[![stars](https://img.shields.io/github/stars/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
-[![forks](https://img.shields.io/github/forks/opendatalab/MinerU.svg)](https://github.com/opendatalab/MinerU)
-[![open issues](https://img.shields.io/github/issues-raw/opendatalab/MinerU)](https://github.com/opendatalab/MinerU/issues)
-[![issue resolution](https://img.shields.io/github/issues-closed-raw/opendatalab/MinerU)](https://github.com/opendatalab/MinerU/issues)
-[![PyPI version](https://badge.fury.io/py/magic-pdf.svg)](https://badge.fury.io/py/magic-pdf)
-[![Downloads](https://static.pepy.tech/badge/magic-pdf)](https://pepy.tech/project/magic-pdf)
-[![Downloads](https://static.pepy.tech/badge/magic-pdf/month)](https://pepy.tech/project/magic-pdf)
-
-
-
-
-[English](README.md) | [简体中文](README_zh-CN.md)
-
-</div>
-
-<div align="center">
-
-</div>
-
-# MinerU 
-
-
-## Introduction
-
-MinerU is a one-stop, open-source, high-quality data extraction tool, includes the following primary features:
-
-- [Magic-PDF](#Magic-PDF)  PDF Document Extraction  
-- [Magic-Doc](#Magic-Doc)  Webpage & E-book Extraction
-
-
-# Magic-PDF
-
-
-## Introduction
-
-Magic-PDF is a tool designed to convert PDF documents into Markdown format, capable of processing files stored locally or on object storage supporting S3 protocol.
-
-Key features include:
-
-- Support for multiple front-end model inputs
-- Removal of headers, footers, footnotes, and page numbers
-- Human-readable layout formatting
-- Retains the original document's structure and formatting, including headings, paragraphs, lists, and more
-- Extraction and display of images and tables within markdown
-- Conversion of equations into LaTeX format
-- Automatic detection and conversion of garbled PDFs
-- Compatibility with CPU and GPU environments
-- Available for Windows, Linux, and macOS platforms
-
-
-https://github.com/opendatalab/MinerU/assets/11393164/618937cb-dc6a-4646-b433-e3131a5f4070
-
-
-
-## Project Panorama
-
-![Project Panorama](docs/images/project_panorama_en.png)
-
-
-## Flowchart
-
-![Flowchart](docs/images/flowchart_en.png)
-
-### Submodule Repositories
-
-- [PDF-Extract-Kit](https://github.com/opendatalab/PDF-Extract-Kit)
-  - A Comprehensive Toolkit for High-Quality PDF Content Extraction
-
-## Getting Started
-
-### Requirements
-
-- Python >= 3.9
-
-### Usage Instructions
-
-#### 1. Install Magic-PDF
-
-```bash
-pip install magic-pdf
-```
-
-#### 2. Usage via Command Line
-
-###### simple
-
-```bash
-cp magic-pdf.template.json ~/magic-pdf.json
-magic-pdf pdf-command --pdf "pdf_path" --model "model_json_path"
-```
-After the program has finished, you can find the generated markdown files under the directory "/tmp/magic-pdf".
-
-###### more 
-
-```bash
-magic-pdf --help
-```
-
-#### 3. Usage via Api
-
-###### Local
-```python
-image_writer = DiskReaderWriter(local_image_dir)
-image_dir = str(os.path.basename(local_image_dir))
-jso_useful_key = {"_pdf_type": "", "model_list": model_json}
-pipe = UNIPipe(pdf_bytes, jso_useful_key, image_writer)
-pipe.pipe_classify()
-pipe.pipe_parse()
-md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
-```
-
-###### Object Storage
-```python
-s3pdf_cli = S3ReaderWriter(pdf_ak, pdf_sk, pdf_endpoint)
-image_dir = "s3://img_bucket/"
-s3image_cli = S3ReaderWriter(img_ak, img_sk, img_endpoint, parent_path=image_dir)
-pdf_bytes = s3pdf_cli.read(s3_pdf_path, mode=s3pdf_cli.MODE_BIN)
-jso_useful_key = {"_pdf_type": "", "model_list": model_json}
-pipe = UNIPipe(pdf_bytes, jso_useful_key, s3image_cli)
-pipe.pipe_classify()
-pipe.pipe_parse()
-md_content = pipe.pipe_mk_markdown(image_dir, drop_mode="none")
-```
-
-Demo can be referred to [demo.py](demo/demo.py)
-
-
-# Magic-Doc
-
-
-## Introduction
-
-Magic-Doc is a tool designed to convert web pages or multi-format e-books into markdown format.
-
-Key Features Include:
-
-- Web Page Extraction
-  - Cross-modal precise parsing of text, images, tables, and formula information.
-
-- E-Book Document Extraction
-  - Supports various document formats including epub, mobi, with full adaptation for text and images.
-
-- Language Type Identification
-  - Accurate recognition of 176 languages.
-
-https://github.com/opendatalab/MinerU/assets/11393164/a5a650e9-f4c0-463e-acc3-960967f1a1ca
-
-
-
-https://github.com/opendatalab/MinerU/assets/11393164/0f4a6fe9-6cca-4113-9fdc-a537749d764d
-
-
-
-https://github.com/opendatalab/MinerU/assets/11393164/20438a02-ce6c-4af8-9dde-d722a4e825b2
-
-
-
-
-## Project Repository
-
-- [Magic-Doc](https://github.com/InternLM/magic-doc)
-  Outstanding Webpage and E-book Extraction Tool
-
-
-# All Thanks To Our Contributors
-
-<a href="https://github.com/magicpdf/Magic-PDF/graphs/contributors">
-  <img src="https://contrib.rocks/image?repo=opendatalab/MinerU" />
-</a>
-
-
-# License Information
-
-[LICENSE.md](LICENSE.md)
-
-The project currently leverages PyMuPDF to deliver advanced functionalities; however, its adherence to the AGPL license may impose limitations on certain use cases. In upcoming iterations, we intend to explore and transition to a more permissively licensed PDF processing library to enhance user-friendliness and flexibility.
-
-
-# Acknowledgments
-
-- [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)
-- [PyMuPDF](https://github.com/pymupdf/PyMuPDF)
-- [fast-langdetect](https://github.com/LlmKira/fast-langdetect)
-- [pdfminer.six](https://github.com/pdfminer/pdfminer.six)
-
-
-# Citation
-
-```bibtex
-@misc{2024mineru,
-    title={MinerU: A One-stop, Open-source, High-quality Data Extraction Tool},
-    author={MinerU Contributors},
-    howpublished = {\url{https://github.com/opendatalab/MinerU}},
-    year={2024}
-}
-```
-
-
-# Star History
-
-<a>
- <picture>
-   <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=opendatalab/MinerU&type=Date&theme=dark" />
-   <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=opendatalab/MinerU&type=Date" />
-   <img alt="Star History Chart" src="https://api.star-history.com/svg?repos=opendatalab/MinerU&type=Date" />
- </picture>
-</a>