renderers 0.1.11.dev3__tar.gz → 0.1.11.dev5__tar.gz

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: renderers
-Version: 0.1.11.dev3
+Version: 0.1.11.dev5
 Summary: Chat template renderers — deterministic message-to-token conversion for LLM training
 License-Expression: Apache-2.0
 License-File: LICENSE
@@ -77,7 +77,7 @@ next_prompt_ids = r.bridge_to_next_turn(
 )
 ```
 
-Hand-coded renderers ship for `qwen3`, `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `glm-5`, `glm-5.1`, `glm-4.5`, `minimax-m2`, `deepseek-v3`, `deepseek-r1`, `kimi-k2`, `kimi-k2.5` / `kimi-k2.6`, `laguna-xs.2`, `laguna-xs-2.1`, `laguna-s-2.1`, `laguna-m.1`, `nemotron-3`, `nemotron-3-ultra`, `nemotron-3.5`, `llama-3`, `gpt-oss`, `hy3`, `inkling` / `inkling-small`, and `prime-qwen3`. Anything else falls back to `DefaultRenderer`, a generic `apply_chat_template` wrapper. `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `kimi-k2.5` / `kimi-k2.6`, and the Inkling checkpoints are multimodal (Inkling handles both image **and** audio).
+Hand-coded renderers ship for `qwen3`, `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `glm-5`, `glm-5.1`, `glm-4.5`, `minimax-m2`, `deepseek-v3`, `deepseek-r1`, `deepseek-v4` (V4 Flash 0731), `kimi-k2`, `kimi-k2.5` / `kimi-k2.6`, `laguna-xs.2`, `laguna-xs-2.1`, `laguna-s-2.1`, `laguna-m.1`, `nemotron-3`, `nemotron-3-ultra`, `nemotron-3.5`, `llama-3`, `gpt-oss`, `hy3`, `inkling` / `inkling-small`, and `prime-qwen3`. Anything else falls back to `DefaultRenderer`, a generic `apply_chat_template` wrapper. `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `kimi-k2.5` / `kimi-k2.6`, and the Inkling checkpoints are multimodal (Inkling handles both image **and** audio).
 
 ## API
 
@@ -199,7 +199,7 @@ uv sync --group dev
 uv run pytest
 ```
 
-Round-trip parity (render → parse → original) and token-level parity against `apply_chat_template` are tested per renderer. End-to-end validation runs against Reverse-Text, Wordle, OpenCode-Math, and RLM-SWE environments.
+Round-trip parity (render → parse → original) and token-level parity against each model's independent reference encoder are tested per renderer. Most references use `apply_chat_template`; DeepSeek V4 uses its shipped Python encoder, and GPT-OSS uses Harmony.
 
 ## License
 

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/README.md

@@ -57,7 +57,7 @@ next_prompt_ids = r.bridge_to_next_turn(
 )
 ```
 
-Hand-coded renderers ship for `qwen3`, `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `glm-5`, `glm-5.1`, `glm-4.5`, `minimax-m2`, `deepseek-v3`, `deepseek-r1`, `kimi-k2`, `kimi-k2.5` / `kimi-k2.6`, `laguna-xs.2`, `laguna-xs-2.1`, `laguna-s-2.1`, `laguna-m.1`, `nemotron-3`, `nemotron-3-ultra`, `nemotron-3.5`, `llama-3`, `gpt-oss`, `hy3`, `inkling` / `inkling-small`, and `prime-qwen3`. Anything else falls back to `DefaultRenderer`, a generic `apply_chat_template` wrapper. `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `kimi-k2.5` / `kimi-k2.6`, and the Inkling checkpoints are multimodal (Inkling handles both image **and** audio).
+Hand-coded renderers ship for `qwen3`, `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `glm-5`, `glm-5.1`, `glm-4.5`, `minimax-m2`, `deepseek-v3`, `deepseek-r1`, `deepseek-v4` (V4 Flash 0731), `kimi-k2`, `kimi-k2.5` / `kimi-k2.6`, `laguna-xs.2`, `laguna-xs-2.1`, `laguna-s-2.1`, `laguna-m.1`, `nemotron-3`, `nemotron-3-ultra`, `nemotron-3.5`, `llama-3`, `gpt-oss`, `hy3`, `inkling` / `inkling-small`, and `prime-qwen3`. Anything else falls back to `DefaultRenderer`, a generic `apply_chat_template` wrapper. `qwen3-vl`, `qwen3.5`, `qwen3.6`, `qwen3.8`, `gemma4`, `kimi-k2.5` / `kimi-k2.6`, and the Inkling checkpoints are multimodal (Inkling handles both image **and** audio).
 
 ## API
 
@@ -179,7 +179,7 @@ uv sync --group dev
 uv run pytest
 ```
 
-Round-trip parity (render → parse → original) and token-level parity against `apply_chat_template` are tested per renderer. End-to-end validation runs against Reverse-Text, Wordle, OpenCode-Math, and RLM-SWE environments.
+Round-trip parity (render → parse → original) and token-level parity against each model's independent reference encoder are tested per renderer. Most references use `apply_chat_template`; DeepSeek V4 uses its shipped Python encoder, and GPT-OSS uses Harmony.
 
 ## License
 

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/docs/renderer-config.md

@@ -21,8 +21,8 @@ construction.
 Use `type(config).template_field_names()` to inspect the explicit allowlist of
 fields accepted through `chat_template_kwargs`. Every renderer-specific field
 is classified as either a template field or a renderer-only field at class
-definition time. Template fields are covered by parity tests against
-`apply_chat_template` in `tests/test_renderer_config_parity.py`.
+definition time. Template fields are covered by the model/scenario/kwarg
+product in `tests/test_parity.py`.
 
 | Renderer | Config class | Template fields | Renderer-only fields |
 | --- | --- | --- | --- |
@@ -51,6 +51,7 @@ definition time. Template fields are covered by parity tests against
 | Nemotron-3.5 Lightning | `Nemotron35RendererConfig` | `enable_thinking`, `truncate_history_thinking` | - |
 | DeepSeek V3 | `DeepSeekV3RendererConfig` | - | - |
 | DeepSeek R1 | `DeepSeekR1RendererConfig` | - | - |
+| DeepSeek V4 Flash 0731 | `DeepSeekV4RendererConfig` | `enable_thinking`, `drop_thinking`, `reasoning_effort` | - |
 
 Configs are frozen value objects. To override a field, construct a new instance
 or call `config.model_copy(update={...})`.
@@ -145,6 +146,7 @@ the knobs its template actually exposes:
 | Kimi K2.5 / 2.6 | `thinking=False -> all`, else `tool_cycle` |
 | Nemotron-3 / 3.5 | `truncate_history_thinking=False -> all`; else `enable_thinking=False -> all`; else `tool_cycle` |
 | DeepSeek R1 | `template` |
+| DeepSeek V4 Flash 0731 | `enable_thinking=False` or `drop_thinking=False -> all`, else `tool_cycle` |
 | MiniMax M2 | `tool_cycle` |
 | DeepSeek V3, Qwen3-VL, Kimi K2, Laguna XS.2 / M.1 / XS-2.1 / S-2.1, Llama 3, Inkling | `all` |
 | PrimeIntellect Qwen3 | `all` |

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/pyproject.toml

@@ -27,7 +27,7 @@ dependencies = [
     # release through 0.5.12.post1 hard-pins ``openai-harmony==0.0.4``, so a
     # higher floor makes ``renderers`` uninstallable alongside SGLang. The
     # GptOssRenderer renders byte-identically on 0.0.4 (verified token-for-token
-    # against 0.0.8) and ``tests/test_gpt_oss_harmony_parity.py`` passes on it,
+    # against 0.0.8) and the Harmony cells in ``tests/test_parity.py`` pass,
     # so the older harmony is safe.
     "openai-harmony>=0.0.4",
     # ``BaseRendererConfig`` inherits from ``pydantic_config.BaseConfig`` so

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/renderers/__init__.py

@@ -48,6 +48,7 @@ from renderers.configs import (
     DefaultRendererConfig,
     DeepSeekR1RendererConfig,
     DeepSeekV3RendererConfig,
+    DeepSeekV4RendererConfig,
     GLM45RendererConfig,
     GLM51RendererConfig,
     GLM5RendererConfig,
@@ -85,6 +86,7 @@ from renderers.configs import (
 _LAZY_RENDERERS: dict[str, str] = {
     "DeepSeekR1Renderer": "renderers.deepseek_r1",
     "DeepSeekV3Renderer": "renderers.deepseek_v3",
+    "DeepSeekV4Renderer": "renderers.deepseek_v4",
     "DefaultRenderer": "renderers.default",
     "GLM45Renderer": "renderers.glm45",
     "GLM51Renderer": "renderers.glm5",
@@ -138,6 +140,8 @@ __all__ = [
     "DeepSeekR1RendererConfig",
     "DeepSeekV3Renderer",
     "DeepSeekV3RendererConfig",
+    "DeepSeekV4Renderer",
+    "DeepSeekV4RendererConfig",
     "DefaultRenderer",
     "DefaultRendererConfig",
     "GLM45Renderer",

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/renderers/_version.py

@@ -18,7 +18,7 @@ version_tuple: tuple[int | str, ...]
 commit_id: str | None
 __commit_id__: str | None
 
-__version__ = version = '0.1.11.dev3'
-__version_tuple__ = version_tuple = (0, 1, 11, 'dev3')
+__version__ = version = '0.1.11.dev5'
+__version_tuple__ = version_tuple = (0, 1, 11, 'dev5')
 
 __commit_id__ = commit_id = None

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/renderers/base.py

@@ -982,6 +982,9 @@ MODEL_RENDERER_MAP: dict[str, str] = {
     # DeepSeek R1 (reasoning).
     "deepseek-ai/DeepSeek-R1": "deepseek-r1",
     "deepseek-ai/DeepSeek-R1-0528": "deepseek-r1",
+    # DeepSeek V4 Flash 0731 uses the repository's Python DSML encoder (the
+    # tokenizer intentionally ships no Jinja chat_template).
+    "deepseek-ai/DeepSeek-V4-Flash-0731": "deepseek-v4",
     # Kimi K2 (K2.5 and K2.6 share the K2.5 template, distinct from K2).
     "moonshotai/Kimi-K2-Instruct": "kimi-k2",
     "moonshotai/Kimi-K2.5": "kimi-k2.5",
@@ -1299,6 +1302,7 @@ def _populate_registry():
         return
     from renderers.deepseek_r1 import DeepSeekR1Renderer
     from renderers.deepseek_v3 import DeepSeekV3Renderer
+    from renderers.deepseek_v4 import DeepSeekV4Renderer
     from renderers.default import DefaultRenderer
     from renderers.glm5 import GLM5Renderer, GLM51Renderer
     from renderers.glm45 import GLM45Renderer
@@ -1344,6 +1348,7 @@ def _populate_registry():
             "minimax-m2": MiniMaxM2Renderer,
             "deepseek-v3": DeepSeekV3Renderer,
             "deepseek-r1": DeepSeekR1Renderer,
+            "deepseek-v4": DeepSeekV4Renderer,
             "hy3": Hy3Renderer,
             "inkling": InklingRenderer,
             "kimi-k2": KimiK2Renderer,

{renderers-0.1.11.dev3 → renderers-0.1.11.dev5}/renderers/configs.py

@@ -930,6 +930,47 @@ class DeepSeekR1RendererConfig(BaseRendererConfig):
     _template_fields = frozenset()
 
 
+class DeepSeekV4RendererConfig(BaseRendererConfig):
+    """DeepSeek-V4-Flash-0731 reference-encoder configuration.
+
+    The checkpoint ships a Python encoder rather than a Jinja template.  These
+    fields mirror its public controls: chat vs thinking mode, historical
+    reasoning dropping, and the opt-in thinking-effort prefix.
+    """
+
+    name: Literal["deepseek-v4"] = "deepseek-v4"
+    _template_fields = frozenset(
+        {"enable_thinking", "drop_thinking", "reasoning_effort"}
+    )
+
+    enable_thinking: bool = False
+    """Select thinking mode.  ``False`` matches the official inference script."""
+
+    drop_thinking: bool = True
+    """Drop reasoning before the latest user query when no tools are present.
+
+    The reference encoder automatically preserves all reasoning whenever tools
+    are supplied, regardless of this value.
+    """
+
+    reasoning_effort: Literal["low", "high", "max"] = "low"
+    """Thinking-only effort prefix; ``low`` adds no text.
+
+    ``low`` is the checkpoint Python encoder's default. DeepSeek's hosted API
+    independently defaults its thinking effort to ``high``.
+    """
+
+    @model_validator(mode="after")
+    def _check_thinking_retention(self):
+        _reject_thinking_retention_conflict(
+            self,
+            "drop_thinking",
+            true_implies="tool_cycle",
+            false_implies="all",
+        )
+        return self
+
+
 RendererConfig = Annotated[
     Union[
         AutoRendererConfig,
@@ -960,6 +1001,7 @@ RendererConfig = Annotated[
         Nemotron35RendererConfig,
         DeepSeekV3RendererConfig,
         DeepSeekR1RendererConfig,
+        DeepSeekV4RendererConfig,
     ],
     Field(discriminator="name"),
 ]
@@ -1006,6 +1048,7 @@ _CONFIG_BY_NAME: dict[str, type[BaseRendererConfig]] = {
     "nemotron-3.5": Nemotron35RendererConfig,
     "deepseek-v3": DeepSeekV3RendererConfig,
     "deepseek-r1": DeepSeekR1RendererConfig,
+    "deepseek-v4": DeepSeekV4RendererConfig,
 }
 
 
@@ -1039,6 +1082,7 @@ __all__ = [
     "DefaultRendererConfig",
     "DeepSeekR1RendererConfig",
     "DeepSeekV3RendererConfig",
+    "DeepSeekV4RendererConfig",
     "GLM45RendererConfig",
     "GLM51RendererConfig",
     "GLM5RendererConfig",