infinity-parser2 0.2.0__tar.gz → 0.3.0__tar.gz

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: infinity_parser2
-Version: 0.2.0
+Version: 0.3.0
 Summary: Document parsing Python package supporting PDF and image parsing using Infinity-Parser2-Pro model.
 Home-page: https://github.com/infly-ai/INF-MLLM
 Author: INF Tech
@@ -83,7 +83,101 @@ We are excited to release Infinity-Parser2-Pro, our latest flagship document und
 
 ## Quick Start
 
-### Installation
+### 1. Minimal "Hello World" (Native Transformers)
+
+If you are looking for a minimal script to parse a single image to Markdown using the native `transformers` library, here is a simple snippet:
+
+```python
+from PIL import Image
+import torch
+from transformers import AutoModelForImageTextToText, AutoProcessor
+from qwen_vl_utils import process_vision_info
+
+# Load the model and processor
+model = AutoModelForImageTextToText.from_pretrained(
+    "infly/Infinity-Parser2-Pro",
+    torch_dtype="float16",
+    device_map="auto",
+)
+processor = AutoProcessor.from_pretrained("infly/Infinity-Parser2-Pro")
+
+# Build the messages for the model
+pil_image = Image.open("demo_data/demo.png").convert("RGB")
+min_pixels = 2048  # 32 * 64
+max_pixels = 16777216  # 4096 * 4096
+prompt = """
+Please output the layout information from the PDF image, including each layout element's bbox, its category, and the corresponding text content within the bbox.
+1. Bbox format: [x1, y1, x2, y2]
+2. Layout Categories: The possible categories are ['header', 'title', 'text', 'figure', 'table', 'formula', 'figure_caption', 'table_caption', 'formula_caption', 'figure_footnote', 'table_footnote', 'page_footnote', 'footer'].
+3. Text Extraction & Formatting Rules:
+    - Figure: For the 'figure' category, the text field should be empty string.
+    - Formula: Format its text as LaTeX.
+    - Table: Format its text as HTML.
+    - All Others (Text, Title, etc.): Format their text as Markdown.
+4. Constraints:
+    - The output text must be the original text from the image, with no translation.
+    - All layout elements must be sorted according to human reading order.
+5. Final Output: The entire output must be a single JSON object.
+"""
+
+messages = [
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "image",
+                "image": pil_image,
+                "min_pixels": min_pixels,
+                "max_pixels": max_pixels,
+            },
+            {"type": "text", "text": prompt},
+        ],
+    }
+]
+
+chat_template_kwargs = {"enable_thinking": False}
+
+text = processor.apply_chat_template(
+    messages, tokenize=False, add_generation_prompt=True, **chat_template_kwargs
+)
+image_inputs, _ = process_vision_info(messages, image_patch_size=16)
+
+inputs = processor(
+    text=text,
+    images=image_inputs,
+    do_resize=False,
+    padding=True,
+    return_tensors="pt",
+)
+
+# Move all tensors to the same device as the model
+inputs = {
+    k: v.to(model.device) if isinstance(v, torch.Tensor) else v
+    for k, v in inputs.items()
+}
+
+# Generate the response
+generated_ids = model.generate(
+    **inputs,
+    max_new_tokens=32768,
+    temperature=0.0,
+    top_p=1.0,
+)
+
+# Strip input tokens, keeping only the newly generated response
+generated_ids_trimmed = [
+    out_ids[len(in_ids) :]
+    for in_ids, out_ids in zip(inputs["input_ids"], generated_ids)
+]
+output_text = processor.batch_decode(
+    generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
+)
+print(output_text)
+```
+
+### 2. Advanced Pipeline (infinity_parser2)
+
+For bulk processing, advanced features, or an end-to-end PDF parsing pipeline, we recommend using our infinity_parser2 wrapper.
 
 #### Pre-requisites
 
@@ -95,10 +189,12 @@ conda activate infinity_parser2
 # Install PyTorch (CUDA). Find the proper version at https://pytorch.org/get-started/previous-versions based on your CUDA version.
 pip install torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 --index-url https://download.pytorch.org/whl/cu128
 
-# Install FlashAttention (required for NVIDIA GPUs).
-# This command builds flash-attn from source, which can take 10 to 30 minutes.
+# Install FlashAttention (FlashAttention-2 is recommended by default)
+# Standard install (compiles from source, ~10-30 min):
 pip install flash-attn==2.8.3 --no-build-isolation
-# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See the official guide at https://github.com/Dao-AILab/flash-attention.
+# Faster install: download wheel from https://github.com/Dao-AILab/flash-attention/releases. Then run: pip install /path/to/<wheel_filename>.whl
+# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See: https://github.com/Dao-AILab/flash-attention
+# NOTE: The code will prioritize detecting FlashAttention-3. If not found, it falls back to FlashAttention-2.
 
 # Install vLLM
 # NOTE: you may need to run the command below to resolve triton and numpy conflicts before installing vllm.
@@ -108,19 +204,23 @@ pip install vllm==0.17.1
 
 #### Install infinity_parser2
 
+Install from PyPI
+
 ```bash
-# From PyPI
 pip install infinity_parser2
+```
 
-# From source
+Install from source code
+
+```bash
 git clone https://github.com/infly-ai/INF-MLLM.git
 cd INF-MLLM/Infinity-Parser2
 pip install -e .
 ```
 
-### Usage
+#### Usage
 
-#### Command Line
+##### Command Line
 
 The `parser` command is the fastest way to get started.
 
@@ -151,7 +251,7 @@ parser demo_data/demo.png --task doc2md
 parser --help
 ```
 
-#### Python API
+##### Python API
 
 ```python
 # NOTE: The Infinity-Parser2 model will be automatically downloaded on the first run.

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/README.md

@@ -30,7 +30,101 @@ We are excited to release Infinity-Parser2-Pro, our latest flagship document und
 
 ## Quick Start
 
-### Installation
+### 1. Minimal "Hello World" (Native Transformers)
+
+If you are looking for a minimal script to parse a single image to Markdown using the native `transformers` library, here is a simple snippet:
+
+```python
+from PIL import Image
+import torch
+from transformers import AutoModelForImageTextToText, AutoProcessor
+from qwen_vl_utils import process_vision_info
+
+# Load the model and processor
+model = AutoModelForImageTextToText.from_pretrained(
+    "infly/Infinity-Parser2-Pro",
+    torch_dtype="float16",
+    device_map="auto",
+)
+processor = AutoProcessor.from_pretrained("infly/Infinity-Parser2-Pro")
+
+# Build the messages for the model
+pil_image = Image.open("demo_data/demo.png").convert("RGB")
+min_pixels = 2048  # 32 * 64
+max_pixels = 16777216  # 4096 * 4096
+prompt = """
+Please output the layout information from the PDF image, including each layout element's bbox, its category, and the corresponding text content within the bbox.
+1. Bbox format: [x1, y1, x2, y2]
+2. Layout Categories: The possible categories are ['header', 'title', 'text', 'figure', 'table', 'formula', 'figure_caption', 'table_caption', 'formula_caption', 'figure_footnote', 'table_footnote', 'page_footnote', 'footer'].
+3. Text Extraction & Formatting Rules:
+    - Figure: For the 'figure' category, the text field should be empty string.
+    - Formula: Format its text as LaTeX.
+    - Table: Format its text as HTML.
+    - All Others (Text, Title, etc.): Format their text as Markdown.
+4. Constraints:
+    - The output text must be the original text from the image, with no translation.
+    - All layout elements must be sorted according to human reading order.
+5. Final Output: The entire output must be a single JSON object.
+"""
+
+messages = [
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "image",
+                "image": pil_image,
+                "min_pixels": min_pixels,
+                "max_pixels": max_pixels,
+            },
+            {"type": "text", "text": prompt},
+        ],
+    }
+]
+
+chat_template_kwargs = {"enable_thinking": False}
+
+text = processor.apply_chat_template(
+    messages, tokenize=False, add_generation_prompt=True, **chat_template_kwargs
+)
+image_inputs, _ = process_vision_info(messages, image_patch_size=16)
+
+inputs = processor(
+    text=text,
+    images=image_inputs,
+    do_resize=False,
+    padding=True,
+    return_tensors="pt",
+)
+
+# Move all tensors to the same device as the model
+inputs = {
+    k: v.to(model.device) if isinstance(v, torch.Tensor) else v
+    for k, v in inputs.items()
+}
+
+# Generate the response
+generated_ids = model.generate(
+    **inputs,
+    max_new_tokens=32768,
+    temperature=0.0,
+    top_p=1.0,
+)
+
+# Strip input tokens, keeping only the newly generated response
+generated_ids_trimmed = [
+    out_ids[len(in_ids) :]
+    for in_ids, out_ids in zip(inputs["input_ids"], generated_ids)
+]
+output_text = processor.batch_decode(
+    generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
+)
+print(output_text)
+```
+
+### 2. Advanced Pipeline (infinity_parser2)
+
+For bulk processing, advanced features, or an end-to-end PDF parsing pipeline, we recommend using our infinity_parser2 wrapper.
 
 #### Pre-requisites
 
@@ -42,10 +136,12 @@ conda activate infinity_parser2
 # Install PyTorch (CUDA). Find the proper version at https://pytorch.org/get-started/previous-versions based on your CUDA version.
 pip install torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 --index-url https://download.pytorch.org/whl/cu128
 
-# Install FlashAttention (required for NVIDIA GPUs).
-# This command builds flash-attn from source, which can take 10 to 30 minutes.
+# Install FlashAttention (FlashAttention-2 is recommended by default)
+# Standard install (compiles from source, ~10-30 min):
 pip install flash-attn==2.8.3 --no-build-isolation
-# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See the official guide at https://github.com/Dao-AILab/flash-attention.
+# Faster install: download wheel from https://github.com/Dao-AILab/flash-attention/releases. Then run: pip install /path/to/<wheel_filename>.whl
+# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See: https://github.com/Dao-AILab/flash-attention
+# NOTE: The code will prioritize detecting FlashAttention-3. If not found, it falls back to FlashAttention-2.
 
 # Install vLLM
 # NOTE: you may need to run the command below to resolve triton and numpy conflicts before installing vllm.
@@ -55,19 +151,23 @@ pip install vllm==0.17.1
 
 #### Install infinity_parser2
 
+Install from PyPI
+
 ```bash
-# From PyPI
 pip install infinity_parser2
+```
 
-# From source
+Install from source code
+
+```bash
 git clone https://github.com/infly-ai/INF-MLLM.git
 cd INF-MLLM/Infinity-Parser2
 pip install -e .
 ```
 
-### Usage
+#### Usage
 
-#### Command Line
+##### Command Line
 
 The `parser` command is the fastest way to get started.
 
@@ -98,7 +198,7 @@ parser demo_data/demo.png --task doc2md
 parser --help
 ```
 
-#### Python API
+##### Python API
 
 ```python
 # NOTE: The Infinity-Parser2 model will be automatically downloaded on the first run.

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/infinity_parser2/__init__.py

@@ -1,6 +1,6 @@
 """Infinity-Parser2: Document parsing Python package."""
 
-__version__ = "0.2.0"
+__version__ = "0.3.0"
 
 from .parser import InfinityParser2
 from .backends import (

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/infinity_parser2/cli.py

@@ -136,7 +136,7 @@ Examples:
     parser.add_argument(
         "--version",
         action="version",
-        version="Infinity-Parser2 0.2.0",
+        version="Infinity-Parser2 0.3.0",
     )
 
     return parser

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/infinity_parser2/parser.py

@@ -86,8 +86,11 @@ class InfinityParser2:
         self.kwargs = kwargs
 
         # Initialize model cache and resolve model path (stored separately)
-        cache = get_model_cache(model_cache_dir)
-        self._model_path = cache.resolve_model_path(self.model_name)
+        if self.backend_name == "vllm-server":
+            self._model_path = self.model_name
+        else:
+            cache = get_model_cache(model_cache_dir)
+            self._model_path = cache.resolve_model_path(self.model_name)
 
         self._backend: BaseBackend = self._init_backend()
 

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/infinity_parser2.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: infinity_parser2
-Version: 0.2.0
+Version: 0.3.0
 Summary: Document parsing Python package supporting PDF and image parsing using Infinity-Parser2-Pro model.
 Home-page: https://github.com/infly-ai/INF-MLLM
 Author: INF Tech
@@ -83,7 +83,101 @@ We are excited to release Infinity-Parser2-Pro, our latest flagship document und
 
 ## Quick Start
 
-### Installation
+### 1. Minimal "Hello World" (Native Transformers)
+
+If you are looking for a minimal script to parse a single image to Markdown using the native `transformers` library, here is a simple snippet:
+
+```python
+from PIL import Image
+import torch
+from transformers import AutoModelForImageTextToText, AutoProcessor
+from qwen_vl_utils import process_vision_info
+
+# Load the model and processor
+model = AutoModelForImageTextToText.from_pretrained(
+    "infly/Infinity-Parser2-Pro",
+    torch_dtype="float16",
+    device_map="auto",
+)
+processor = AutoProcessor.from_pretrained("infly/Infinity-Parser2-Pro")
+
+# Build the messages for the model
+pil_image = Image.open("demo_data/demo.png").convert("RGB")
+min_pixels = 2048  # 32 * 64
+max_pixels = 16777216  # 4096 * 4096
+prompt = """
+Please output the layout information from the PDF image, including each layout element's bbox, its category, and the corresponding text content within the bbox.
+1. Bbox format: [x1, y1, x2, y2]
+2. Layout Categories: The possible categories are ['header', 'title', 'text', 'figure', 'table', 'formula', 'figure_caption', 'table_caption', 'formula_caption', 'figure_footnote', 'table_footnote', 'page_footnote', 'footer'].
+3. Text Extraction & Formatting Rules:
+    - Figure: For the 'figure' category, the text field should be empty string.
+    - Formula: Format its text as LaTeX.
+    - Table: Format its text as HTML.
+    - All Others (Text, Title, etc.): Format their text as Markdown.
+4. Constraints:
+    - The output text must be the original text from the image, with no translation.
+    - All layout elements must be sorted according to human reading order.
+5. Final Output: The entire output must be a single JSON object.
+"""
+
+messages = [
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "image",
+                "image": pil_image,
+                "min_pixels": min_pixels,
+                "max_pixels": max_pixels,
+            },
+            {"type": "text", "text": prompt},
+        ],
+    }
+]
+
+chat_template_kwargs = {"enable_thinking": False}
+
+text = processor.apply_chat_template(
+    messages, tokenize=False, add_generation_prompt=True, **chat_template_kwargs
+)
+image_inputs, _ = process_vision_info(messages, image_patch_size=16)
+
+inputs = processor(
+    text=text,
+    images=image_inputs,
+    do_resize=False,
+    padding=True,
+    return_tensors="pt",
+)
+
+# Move all tensors to the same device as the model
+inputs = {
+    k: v.to(model.device) if isinstance(v, torch.Tensor) else v
+    for k, v in inputs.items()
+}
+
+# Generate the response
+generated_ids = model.generate(
+    **inputs,
+    max_new_tokens=32768,
+    temperature=0.0,
+    top_p=1.0,
+)
+
+# Strip input tokens, keeping only the newly generated response
+generated_ids_trimmed = [
+    out_ids[len(in_ids) :]
+    for in_ids, out_ids in zip(inputs["input_ids"], generated_ids)
+]
+output_text = processor.batch_decode(
+    generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
+)
+print(output_text)
+```
+
+### 2. Advanced Pipeline (infinity_parser2)
+
+For bulk processing, advanced features, or an end-to-end PDF parsing pipeline, we recommend using our infinity_parser2 wrapper.
 
 #### Pre-requisites
 
@@ -95,10 +189,12 @@ conda activate infinity_parser2
 # Install PyTorch (CUDA). Find the proper version at https://pytorch.org/get-started/previous-versions based on your CUDA version.
 pip install torch==2.10.0 torchvision==0.25.0 torchaudio==2.10.0 --index-url https://download.pytorch.org/whl/cu128
 
-# Install FlashAttention (required for NVIDIA GPUs).
-# This command builds flash-attn from source, which can take 10 to 30 minutes.
+# Install FlashAttention (FlashAttention-2 is recommended by default)
+# Standard install (compiles from source, ~10-30 min):
 pip install flash-attn==2.8.3 --no-build-isolation
-# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See the official guide at https://github.com/Dao-AILab/flash-attention.
+# Faster install: download wheel from https://github.com/Dao-AILab/flash-attention/releases. Then run: pip install /path/to/<wheel_filename>.whl
+# For Hopper GPUs (e.g. H100, H800), we recommend FlashAttention-3 instead. See: https://github.com/Dao-AILab/flash-attention
+# NOTE: The code will prioritize detecting FlashAttention-3. If not found, it falls back to FlashAttention-2.
 
 # Install vLLM
 # NOTE: you may need to run the command below to resolve triton and numpy conflicts before installing vllm.
@@ -108,19 +204,23 @@ pip install vllm==0.17.1
 
 #### Install infinity_parser2
 
+Install from PyPI
+
 ```bash
-# From PyPI
 pip install infinity_parser2
+```
 
-# From source
+Install from source code
+
+```bash
 git clone https://github.com/infly-ai/INF-MLLM.git
 cd INF-MLLM/Infinity-Parser2
 pip install -e .
 ```
 
-### Usage
+#### Usage
 
-#### Command Line
+##### Command Line
 
 The `parser` command is the fastest way to get started.
 
@@ -151,7 +251,7 @@ parser demo_data/demo.png --task doc2md
 parser --help
 ```
 
-#### Python API
+##### Python API
 
 ```python
 # NOTE: The Infinity-Parser2 model will be automatically downloaded on the first run.

{infinity_parser2-0.2.0 → infinity_parser2-0.3.0}/setup.py

@@ -32,7 +32,7 @@ install_requires = [
 
 setup(
     name="infinity_parser2",
-    version="0.2.0",
+    version="0.3.0",
     description="Document parsing Python package supporting PDF and image parsing using Infinity-Parser2-Pro model.",
     long_description=open("README.md", "r", encoding="utf-8").read(),
     long_description_content_type="text/markdown",