BabelDOC 0.6.0__tar.gz → 0.6.1__tar.gz

{babeldoc-0.6.0 → babeldoc-0.6.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: BabelDOC
-Version: 0.6.0
+Version: 0.6.1
 Summary: Yet Another Document Translator
 Project-URL: Homepage, https://github.com/funstory-ai/BabelDOC
 Project-URL: Issues, https://github.com/funstory-ai/BabelDOC/issues
@@ -53,10 +53,7 @@ Provides-Extra: memray
 Requires-Dist: memray>=1.17.1; extra == 'memray'
 Description-Content-Type: text/markdown
 
-<!-- # Yet Another Document Translator -->
-
 <div align="center">
-<!-- <img src="https://s.immersivetranslate.com/assets/r2-uploads/images/babeldoc-banner.png" width="320px"  alt="YADT"/> -->
 
 <br/>
 
@@ -119,11 +116,11 @@ See details: [EN](https://github.com/funstory-ai/jobs) | [ZH](https://github.com
 
 ### Install from PyPI
 
-We recommend using the Tool feature of [uv](https://github.com/astral-sh/uv) to install yadt.
+We recommend using the Tool feature of [uv](https://github.com/astral-sh/uv) to install BabelDOC.
 
 1. First, you need to refer to [uv installation](https://github.com/astral-sh/uv#installation) to install uv and set up the `PATH` environment variable as prompted.
 
-2. Use the following command to install yadt:
+2. Use the following command to install BabelDOC:
 
 ```bash
 uv tool install --python 3.12 BabelDOC
@@ -146,7 +143,7 @@ We still recommend using [uv](https://github.com/astral-sh/uv) to manage virtual
 
 1. First, you need to refer to [uv installation](https://github.com/astral-sh/uv#installation) to install uv and set up the `PATH` environment variable as prompted.
 
-2. Use the following command to install yadt:
+2. Use the following command to install BabelDOC:
 
 ```bash
 # clone the project
@@ -290,7 +287,7 @@ uv run babeldoc --files example.pdf --files example2.pdf --openai --openai-model
 ### Output Control
 
 - `--output`, `-o`: Output directory for translated files. If not set, use current working directory.
-- `--debug`: Enable debug logging level and export detailed intermediate results in `~/.cache/yadt/working`.
+- `--debug`: Enable debug logging level and export detailed intermediate results in `~/.cache/babeldoc/working`.
 - `--report-interval`: Progress report interval in seconds (default: 0.1).
 
 ### General Options
@@ -393,7 +390,7 @@ There are a lot projects and teams working on to make document editing and trans
 - [mathpix](https://mathpix.com/)
 - [Doc2X](https://doc2x.noedgeai.com/)
 - [minerU](https://github.com/opendatalab/MinerU)
-- [PDFMathTranslate](https://github.com/funstory-ai/yadt)
+- [PDFMathTranslate](https://github.com/PDFMathTranslate/PDFMathTranslate)
 
 There are also some solutions to solve specific parts of the problem like:
 
@@ -457,15 +454,25 @@ This project uses a combination of [Semantic Versioning](https://semver.org/) an
 
 ## How to Contribute
 
-We encourage you to contribute to YADT! Please check out the [CONTRIBUTING](https://github.com/funstory-ai/yadt/blob/main/docs/CONTRIBUTING.md) guide.
+BabelDOC is currently developed in a maintainer-led mode. Bug reports,
+reproducible PDFs, documentation fixes, and small compatibility fixes are
+welcome. For changes to parsing, rendering, translation, or service integration
+behavior, please open an issue for discussion before submitting a pull request.
 
-Everyone interacting in YADT and its sub-projects' codebases, issue trackers, chat rooms, and mailing lists is expected to follow the YADT [Code of Conduct](https://github.com/funstory-ai/yadt/blob/main/docs/CODE_OF_CONDUCT.md).
+Everyone interacting in BabelDOC and its sub-projects' codebases, issue trackers, chat rooms, and mailing lists is expected to follow the BabelDOC [Code of Conduct](https://github.com/funstory-ai/BabelDOC/blob/main/docs/CODE_OF_CONDUCT.md).
 
 [Immersive Translation](https://immersivetranslate.com) sponsors monthly Pro membership redemption codes for active contributors to this project, see details at: [CONTRIBUTOR_REWARD.md](https://github.com/funstory-ai/BabelDOC/blob/main/docs/CONTRIBUTOR_REWARD.md)
 
 ## Acknowledgements
 
-- [PDFMathTranslate](https://github.com/Byaidu/PDFMathTranslate)
+BabelDOC is still at an early stage of development, and many parts are not as
+polished as we would like yet. We sincerely appreciate every bug report,
+criticism, suggestion, reproducible PDF, downstream integration experience, and
+contribution from people working on BabelDOC and related upstream/downstream
+projects. We will keep iterating on BabelDOC, fixing bugs, and making it better
+step by step.
+
+- [PDFMathTranslate](https://github.com/PDFMathTranslate/PDFMathTranslate)
 - [DocLayout-YOLO](https://github.com/opendatalab/DocLayout-YOLO)
 - [pdfminer](https://github.com/pdfminer/pdfminer.six)
 - [PyMuPDF](https://github.com/pymupdf/PyMuPDF)

{babeldoc-0.6.0 → babeldoc-0.6.1}/README.md

@@ -1,7 +1,4 @@
-<!-- # Yet Another Document Translator -->
-
 <div align="center">
-<!-- <img src="https://s.immersivetranslate.com/assets/r2-uploads/images/babeldoc-banner.png" width="320px"  alt="YADT"/> -->
 
 <br/>
 
@@ -64,11 +61,11 @@ See details: [EN](https://github.com/funstory-ai/jobs) | [ZH](https://github.com
 
 ### Install from PyPI
 
-We recommend using the Tool feature of [uv](https://github.com/astral-sh/uv) to install yadt.
+We recommend using the Tool feature of [uv](https://github.com/astral-sh/uv) to install BabelDOC.
 
 1. First, you need to refer to [uv installation](https://github.com/astral-sh/uv#installation) to install uv and set up the `PATH` environment variable as prompted.
 
-2. Use the following command to install yadt:
+2. Use the following command to install BabelDOC:
 
 ```bash
 uv tool install --python 3.12 BabelDOC
@@ -91,7 +88,7 @@ We still recommend using [uv](https://github.com/astral-sh/uv) to manage virtual
 
 1. First, you need to refer to [uv installation](https://github.com/astral-sh/uv#installation) to install uv and set up the `PATH` environment variable as prompted.
 
-2. Use the following command to install yadt:
+2. Use the following command to install BabelDOC:
 
 ```bash
 # clone the project
@@ -235,7 +232,7 @@ uv run babeldoc --files example.pdf --files example2.pdf --openai --openai-model
 ### Output Control
 
 - `--output`, `-o`: Output directory for translated files. If not set, use current working directory.
-- `--debug`: Enable debug logging level and export detailed intermediate results in `~/.cache/yadt/working`.
+- `--debug`: Enable debug logging level and export detailed intermediate results in `~/.cache/babeldoc/working`.
 - `--report-interval`: Progress report interval in seconds (default: 0.1).
 
 ### General Options
@@ -338,7 +335,7 @@ There are a lot projects and teams working on to make document editing and trans
 - [mathpix](https://mathpix.com/)
 - [Doc2X](https://doc2x.noedgeai.com/)
 - [minerU](https://github.com/opendatalab/MinerU)
-- [PDFMathTranslate](https://github.com/funstory-ai/yadt)
+- [PDFMathTranslate](https://github.com/PDFMathTranslate/PDFMathTranslate)
 
 There are also some solutions to solve specific parts of the problem like:
 
@@ -402,15 +399,25 @@ This project uses a combination of [Semantic Versioning](https://semver.org/) an
 
 ## How to Contribute
 
-We encourage you to contribute to YADT! Please check out the [CONTRIBUTING](https://github.com/funstory-ai/yadt/blob/main/docs/CONTRIBUTING.md) guide.
+BabelDOC is currently developed in a maintainer-led mode. Bug reports,
+reproducible PDFs, documentation fixes, and small compatibility fixes are
+welcome. For changes to parsing, rendering, translation, or service integration
+behavior, please open an issue for discussion before submitting a pull request.
 
-Everyone interacting in YADT and its sub-projects' codebases, issue trackers, chat rooms, and mailing lists is expected to follow the YADT [Code of Conduct](https://github.com/funstory-ai/yadt/blob/main/docs/CODE_OF_CONDUCT.md).
+Everyone interacting in BabelDOC and its sub-projects' codebases, issue trackers, chat rooms, and mailing lists is expected to follow the BabelDOC [Code of Conduct](https://github.com/funstory-ai/BabelDOC/blob/main/docs/CODE_OF_CONDUCT.md).
 
 [Immersive Translation](https://immersivetranslate.com) sponsors monthly Pro membership redemption codes for active contributors to this project, see details at: [CONTRIBUTOR_REWARD.md](https://github.com/funstory-ai/BabelDOC/blob/main/docs/CONTRIBUTOR_REWARD.md)
 
 ## Acknowledgements
 
-- [PDFMathTranslate](https://github.com/Byaidu/PDFMathTranslate)
+BabelDOC is still at an early stage of development, and many parts are not as
+polished as we would like yet. We sincerely appreciate every bug report,
+criticism, suggestion, reproducible PDF, downstream integration experience, and
+contribution from people working on BabelDOC and related upstream/downstream
+projects. We will keep iterating on BabelDOC, fixing bugs, and making it better
+step by step.
+
+- [PDFMathTranslate](https://github.com/PDFMathTranslate/PDFMathTranslate)
 - [DocLayout-YOLO](https://github.com/opendatalab/DocLayout-YOLO)
 - [pdfminer](https://github.com/pdfminer/pdfminer.six)
 - [PyMuPDF](https://github.com/pymupdf/PyMuPDF)

babeldoc-0.6.1/babeldoc/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.6.1"

{babeldoc-0.6.0 → babeldoc-0.6.1}/babeldoc/const.py

@@ -6,7 +6,7 @@ import subprocess
 import threading
 from pathlib import Path
 
-__version__ = "0.6.0"
+__version__ = "0.6.1"
 
 CACHE_FOLDER = Path.home() / ".cache" / "babeldoc"
 

{babeldoc-0.6.0 → babeldoc-0.6.1}/babeldoc/format/pdf/document_il/midend/il_translator.py

@@ -1,6 +1,5 @@
 from __future__ import annotations
 
-import copy
 import json
 import logging
 import re
@@ -40,6 +39,7 @@ from babeldoc.format.pdf.document_il.utils.paragraph_helper import (
     is_pure_numeric_paragraph,
 )
 from babeldoc.format.pdf.document_il.utils.style_helper import GRAY80
+from babeldoc.format.pdf.translation_config import TitleContextSnapshot
 from babeldoc.format.pdf.translation_config import TranslationConfig
 from babeldoc.translator.translator import BaseTranslator
 from babeldoc.utils.priority_thread_pool_executor import PriorityThreadPoolExecutor
@@ -393,9 +393,11 @@ class ILTranslator:
             # Try to find the first title paragraph
             title_paragraph = self.find_title_paragraph(docs)
             self.translation_config.shared_context_cross_split_part.first_paragraph = (
-                copy.deepcopy(title_paragraph)
+                self.shared_context_cross_split_part.snapshot_title_paragraph(
+                    title_paragraph
+                )
             )
-            self.translation_config.shared_context_cross_split_part.recent_title_paragraph = copy.deepcopy(
+            self.translation_config.shared_context_cross_split_part.recent_title_paragraph = self.shared_context_cross_split_part.snapshot_title_paragraph(
                 title_paragraph
             )
             if title_paragraph:
@@ -460,7 +462,9 @@ class ILTranslator:
             paragraph_token_count = self.calc_token_count(paragraph.unicode)
             if paragraph.layout_label == "title":
                 self.shared_context_cross_split_part.recent_title_paragraph = (
-                    copy.deepcopy(paragraph)
+                    self.shared_context_cross_split_part.snapshot_title_paragraph(
+                        paragraph
+                    )
                 )
             executor.submit(
                 self.translate_paragraph,
@@ -1037,8 +1041,8 @@ class ILTranslator:
 
     def _build_context_block(
         self,
-        title_paragraph: PdfParagraph | None = None,
-        local_title_paragraph: PdfParagraph | None = None,
+        title_paragraph: TitleContextSnapshot | None = None,
+        local_title_paragraph: TitleContextSnapshot | None = None,
         translate_input: TranslateInput | None = None,
     ) -> str:
         """Build the context/hints block for LLM prompt.
@@ -1130,8 +1134,8 @@ class ILTranslator:
     def generate_prompt_for_llm(
         self,
         text: str,
-        title_paragraph: PdfParagraph | None = None,
-        local_title_paragraph: PdfParagraph | None = None,
+        title_paragraph: TitleContextSnapshot | None = None,
+        local_title_paragraph: TitleContextSnapshot | None = None,
         translate_input: TranslateInput | None = None,
     ):
         """Generate LLM prompt using template-based approach.
@@ -1216,8 +1220,8 @@ class ILTranslator:
         page_font_map: dict[str, PdfFont] = None,
         xobj_font_map: dict[int, dict[str, PdfFont]] = None,
         paragraph_token_count: int = 0,
-        title_paragraph: PdfParagraph | None = None,
-        local_title_paragraph: PdfParagraph | None = None,
+        title_paragraph: TitleContextSnapshot | None = None,
+        local_title_paragraph: TitleContextSnapshot | None = None,
     ):
         """Translate a paragraph using pre and post processing functions."""
         self.translation_config.raise_if_cancelled()

{babeldoc-0.6.0 → babeldoc-0.6.1}/babeldoc/format/pdf/document_il/midend/il_translator_llm_only.py

@@ -1,4 +1,3 @@
-import copy
 import json
 import logging
 import re
@@ -30,6 +29,7 @@ from babeldoc.format.pdf.document_il.utils.paragraph_helper import (
 from babeldoc.format.pdf.document_il.utils.paragraph_helper import (
     is_pure_numeric_paragraph,
 )
+from babeldoc.format.pdf.translation_config import TitleContextSnapshot
 from babeldoc.format.pdf.translation_config import TranslationConfig
 from babeldoc.translator.translator import BaseTranslator
 from babeldoc.utils.priority_thread_pool_executor import PriorityThreadPoolExecutor
@@ -181,9 +181,11 @@ class ILTranslatorLLMOnly:
             # Try to find the first title paragraph
             title_paragraph = self.find_title_paragraph(docs)
             self.translation_config.shared_context_cross_split_part.first_paragraph = (
-                copy.deepcopy(title_paragraph)
+                self.shared_context_cross_split_part.snapshot_title_paragraph(
+                    title_paragraph
+                )
             )
-            self.translation_config.shared_context_cross_split_part.recent_title_paragraph = copy.deepcopy(
+            self.translation_config.shared_context_cross_split_part.recent_title_paragraph = self.shared_context_cross_split_part.snapshot_title_paragraph(
                 title_paragraph
             )
             if title_paragraph:
@@ -582,7 +584,9 @@ class ILTranslatorLLMOnly:
             translated_ids.add(id(paragraph))
             if paragraph.layout_label == "title":
                 self.shared_context_cross_split_part.recent_title_paragraph = (
-                    copy.deepcopy(paragraph)
+                    self.shared_context_cross_split_part.snapshot_title_paragraph(
+                        paragraph
+                    )
                 )
 
             if total_token_count > 200 or len(paragraphs) > 5:
@@ -625,8 +629,8 @@ class ILTranslatorLLMOnly:
         pbar: tqdm | None = None,
         page_font_map: dict[str, PdfFont] = None,
         xobj_font_map: dict[int, dict[str, PdfFont]] = None,
-        title_paragraph: PdfParagraph | None = None,
-        local_title_paragraph: PdfParagraph | None = None,
+        title_paragraph: TitleContextSnapshot | None = None,
+        local_title_paragraph: TitleContextSnapshot | None = None,
         executor: PriorityThreadPoolExecutor | None = None,
         paragraph_token_count: int = 0,
         mp_id: int = 0,
@@ -882,8 +886,8 @@ class ILTranslatorLLMOnly:
     def _build_llm_prompt(
         self,
         json_input_str: str,
-        title_paragraph: PdfParagraph | None,
-        local_title_paragraph: PdfParagraph | None,
+        title_paragraph: TitleContextSnapshot | None,
+        local_title_paragraph: TitleContextSnapshot | None,
         batch_text_for_glossary_matching: str,
     ) -> str:
         """Build LLM prompt using a single template for easier maintenance."""

{babeldoc-0.6.0 → babeldoc-0.6.1}/babeldoc/format/pdf/document_il/midend/typesetting.py

@@ -664,9 +664,22 @@ class TypesettingUnit:
         scale: float,
     ):
         """Transform a curve for formula relocation."""
-        import copy
-
-        new_curve = copy.deepcopy(curve)
+        new_curve = PdfCurve(
+            box=curve.box,
+            graphic_state=curve.graphic_state,
+            pdf_path=list(curve.pdf_path),
+            pdf_original_path=list(curve.pdf_original_path),
+            pdf_original_path_primitive=curve.pdf_original_path_primitive,
+            debug_info=curve.debug_info,
+            fill_background=curve.fill_background,
+            stroke_path=curve.stroke_path,
+            evenodd=curve.evenodd,
+            passthrough_paint=curve.passthrough_paint,
+            xobj_id=curve.xobj_id,
+            render_order=curve.render_order,
+            ctm=list(curve.ctm),
+            relocation_transform=list(curve.relocation_transform),
+        )
 
         if new_curve.box:
             # Calculate relative position to formula's original position (same as chars)
@@ -723,9 +736,18 @@ class TypesettingUnit:
         scale: float,
     ):
         """Transform a form for formula relocation."""
-        import copy
-
-        new_form = copy.deepcopy(form)
+        new_form = PdfForm(
+            box=form.box,
+            graphic_state=form.graphic_state,
+            pdf_matrix=form.pdf_matrix,
+            pdf_affine_transform=form.pdf_affine_transform,
+            pdf_form_subtype=form.pdf_form_subtype,
+            xobj_id=form.xobj_id,
+            ctm=list(form.ctm),
+            relocation_transform=list(form.relocation_transform),
+            render_order=form.render_order,
+            form_type=form.form_type,
+        )
 
         if new_form.box:
             # Calculate relative position to formula's original position (same as chars)
@@ -1203,7 +1225,7 @@ class Typesetting:
             font_size=6,
             graphic_state=il_version_1.GraphicState(),
         )
-        text = f"本文档由 funstory.ai 的开源 PDF 翻译库 BabelDOC {WATERMARK_VERSION} (http://yadt.io) 翻译，本仓库正在积极的建设当中，欢迎 star 和关注。"
+        text = f"本文档由 funstory.ai 的开源 PDF 翻译库 BabelDOC {WATERMARK_VERSION} (https://github.com/funstory-ai/BabelDOC) 翻译，本仓库正在积极的建设当中，欢迎 star 和关注。"
         if self.translation_config.debug:
             text += "\n 当前为 DEBUG 模式，将显示更多辅助信息。请注意，部分框的位置对应原文，但在译文中可能不正确。"
         page.pdf_paragraph.append(

babeldoc-0.6.1/babeldoc/format/pdf/new_parser/active_object_projection.py

@@ -0,0 +1,191 @@
+from __future__ import annotations
+
+from collections.abc import Callable
+
+from babeldoc.format.pdf.new_parser.active_object_backend import create_active_literal
+from babeldoc.format.pdf.new_parser.active_object_backend import create_active_stream
+from babeldoc.format.pdf.new_parser.active_value_access import obj_ref_id
+from babeldoc.format.pdf.new_parser.object_model import PdfObjectStream
+
+MAX_FONT_SPEC_PROJECTION_DEPTH = 128
+
+
+class FontSpecProjectionError(ValueError):
+    pass
+
+
+def project_font_spec(
+    spec: dict[object, object],
+    *,
+    resolve_indirect: Callable[[object], object] | None = None,
+    max_depth: int = MAX_FONT_SPEC_PROJECTION_DEPTH,
+) -> dict[object, object]:
+    resolved = _resolve_all(
+        spec,
+        resolve_indirect or (lambda value: value),
+        max_depth=max_depth,
+    )
+    projected = _project_value(resolved, max_depth=max_depth)
+    if not isinstance(projected, dict):
+        raise TypeError(f"Projected font spec must be dict, got {type(projected)}")
+    return projected
+
+
+def _check_depth(depth: int, max_depth: int) -> None:
+    if depth > max_depth:
+        msg = f"Font spec projection exceeded max depth {max_depth}"
+        raise FontSpecProjectionError(msg)
+
+
+def _resolve_all(
+    value: object,
+    resolve_indirect: Callable[[object], object],
+    *,
+    max_depth: int,
+    depth: int = 0,
+    active_refs: frozenset[int] = frozenset(),
+    active_containers: frozenset[int] = frozenset(),
+) -> object:
+    _check_depth(depth, max_depth)
+    ref_id = obj_ref_id(value)
+    if ref_id is not None:
+        if ref_id in active_refs:
+            msg = f"Recursive font spec indirect reference {ref_id}"
+            raise FontSpecProjectionError(msg)
+        resolved = resolve_indirect(value)
+        if resolved is value:
+            return value
+        return _resolve_all(
+            resolved,
+            resolve_indirect,
+            max_depth=max_depth,
+            depth=depth + 1,
+            active_refs=active_refs | {ref_id},
+            active_containers=active_containers,
+        )
+    if isinstance(value, list):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive font spec list container"
+            raise FontSpecProjectionError(msg)
+        return [
+            _resolve_all(
+                item,
+                resolve_indirect,
+                max_depth=max_depth,
+                depth=depth + 1,
+                active_refs=active_refs,
+                active_containers=active_containers | {container_id},
+            )
+            for item in value
+        ]
+    if isinstance(value, dict):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive font spec dict container"
+            raise FontSpecProjectionError(msg)
+        return {
+            key: _resolve_all(
+                item,
+                resolve_indirect,
+                max_depth=max_depth,
+                depth=depth + 1,
+                active_refs=active_refs,
+                active_containers=active_containers | {container_id},
+            )
+            for key, item in value.items()
+        }
+    if isinstance(value, PdfObjectStream):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive font spec stream container"
+            raise FontSpecProjectionError(msg)
+        return PdfObjectStream(
+            attrs={
+                key: _resolve_all(
+                    item,
+                    resolve_indirect,
+                    max_depth=max_depth,
+                    depth=depth + 1,
+                    active_refs=active_refs,
+                    active_containers=active_containers | {container_id},
+                )
+                for key, item in value.attrs.items()
+            },
+            rawdata=value.rawdata,
+            objid=value.objid,
+            decoded=value.decoded,
+        )
+    return value
+
+
+def _project_value(
+    value: object,
+    *,
+    max_depth: int,
+    depth: int = 0,
+    active_containers: frozenset[int] = frozenset(),
+) -> object:
+    _check_depth(depth, max_depth)
+    if isinstance(value, str):
+        if value.isascii():
+            return create_active_literal(value)
+        return create_active_literal(value.encode("latin-1"))
+    if isinstance(value, list):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive projected font spec list container"
+            raise FontSpecProjectionError(msg)
+        return [
+            _project_value(
+                item,
+                max_depth=max_depth,
+                depth=depth + 1,
+                active_containers=active_containers | {container_id},
+            )
+            for item in value
+        ]
+    if isinstance(value, dict):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive projected font spec dict container"
+            raise FontSpecProjectionError(msg)
+        return {
+            key: _project_value(
+                item,
+                max_depth=max_depth,
+                depth=depth + 1,
+                active_containers=active_containers | {container_id},
+            )
+            for key, item in value.items()
+        }
+    if isinstance(value, PdfObjectStream):
+        container_id = id(value)
+        if container_id in active_containers:
+            msg = "Recursive projected font spec stream container"
+            raise FontSpecProjectionError(msg)
+        attrs = {
+            key: _project_value(
+                item,
+                max_depth=max_depth,
+                depth=depth + 1,
+                active_containers=active_containers | {container_id},
+            )
+            for key, item in _project_stream_attrs(value).items()
+        }
+        stream = create_active_stream(attrs, value.rawdata)
+        if value.objid is not None:
+            stream.set_objid(value.objid, 0)
+        return stream
+    return value
+
+
+def _project_stream_attrs(value: PdfObjectStream) -> dict[object, object]:
+    if not value.decoded:
+        return value.attrs
+
+    return {
+        key: item
+        for key, item in value.attrs.items()
+        if key not in {"Filter", "DecodeParms", "F", "FDecodeParms", "DL", "Length"}
+    }

{babeldoc-0.6.0 → babeldoc-0.6.1}/babeldoc/format/pdf/new_parser/object_parser.py

@@ -10,6 +10,8 @@ from babeldoc.format.pdf.new_parser.tokenizer import PdfString
 from babeldoc.format.pdf.new_parser.tokenizer import TokenizerError
 from babeldoc.format.pdf.new_parser.tokenizer import decode_pdf_name
 
+MAX_OBJECT_NESTING_DEPTH = 128
+
 
 class ObjectParserError(ValueError):
     pass
@@ -18,6 +20,7 @@ class ObjectParserError(ValueError):
 @dataclass(slots=True)
 class _Parser:
     lexer: ContentStreamTokenizer
+    max_nesting_depth: int = MAX_OBJECT_NESTING_DEPTH
 
     def parse(self) -> object:
         value = self._parse_value()
@@ -27,16 +30,22 @@ class _Parser:
             raise ObjectParserError(f"Trailing data after object: {tail!r}")
         return value
 
-    def _parse_value(self) -> object:
+    def _check_nesting_depth(self, depth: int) -> None:
+        if depth > self.max_nesting_depth:
+            msg = f"PDF object nesting exceeded max depth {self.max_nesting_depth}"
+            raise ObjectParserError(msg)
+
+    def _parse_value(self, *, depth: int = 0) -> object:
+        self._check_nesting_depth(depth)
         self.lexer._skip_space_and_comments()  # noqa: SLF001
         if self.lexer.pos >= len(self.lexer.data):
             raise ObjectParserError("Unexpected EOF while parsing object.")
 
         token = self.lexer.data[self.lexer.pos : self.lexer.pos + 1]
         if token == b"<" and self.lexer._peek(2) == b"<<":  # noqa: SLF001
-            return self._parse_dict()
+            return self._parse_dict(depth=depth + 1)
         if token == b"[":
-            return self._parse_array()
+            return self._parse_array(depth=depth + 1)
         if token == b"/":
             return decode_pdf_name(self.lexer._read_name().value)  # noqa: SLF001
         if token == b"(":
@@ -47,7 +56,8 @@ class _Parser:
         raw = self.lexer._read_number_or_keyword()  # noqa: SLF001
         return self._maybe_indirect_ref(raw)
 
-    def _parse_array(self) -> list[object]:
+    def _parse_array(self, *, depth: int = 0) -> list[object]:
+        self._check_nesting_depth(depth)
         if self.lexer.data[self.lexer.pos : self.lexer.pos + 1] != b"[":
             raise ObjectParserError("Array must start with '['.")
         self.lexer.pos += 1
@@ -59,9 +69,10 @@ class _Parser:
             if self.lexer.data[self.lexer.pos : self.lexer.pos + 1] == b"]":
                 self.lexer.pos += 1
                 return items
-            items.append(self._parse_value())
+            items.append(self._parse_value(depth=depth))
 
-    def _parse_dict(self) -> dict[str, object]:
+    def _parse_dict(self, *, depth: int = 0) -> dict[str, object]:
+        self._check_nesting_depth(depth)
         if self.lexer._peek(2) != b"<<":  # noqa: SLF001
             raise ObjectParserError("Dictionary must start with '<<'.")
         self.lexer.pos += 2
@@ -77,7 +88,7 @@ class _Parser:
             key = self.lexer._read_name()  # noqa: SLF001
             if not isinstance(key, PdfName):
                 raise ObjectParserError(f"Dictionary key must be PdfName, got {key!r}")
-            items[key.value] = self._parse_value()
+            items[key.value] = self._parse_value(depth=depth)
 
     def _maybe_indirect_ref(self, first: object) -> object:
         if not isinstance(first, int):
@@ -106,8 +117,15 @@ class _Parser:
         return value
 
 
-def parse_object_bytes(data: bytes) -> object:
-    parser = _Parser(ContentStreamTokenizer(data))
+def parse_object_bytes(
+    data: bytes,
+    *,
+    max_nesting_depth: int = MAX_OBJECT_NESTING_DEPTH,
+) -> object:
+    parser = _Parser(
+        ContentStreamTokenizer(data, max_nesting_depth=max_nesting_depth),
+        max_nesting_depth=max_nesting_depth,
+    )
     try:
         return parser.parse()
     except TokenizerError as exc: