cache-dit 0.2.26__py3-none-any.whl → 0.2.27__py3-none-any.whl

{cache_dit-0.2.26.dist-info → cache_dit-0.2.27.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: cache_dit
-Version: 0.2.26
+Version: 0.2.27
 Summary: 🤗 CacheDiT: An Unified and Training-free Cache Acceleration Toolbox for Diffusion Transformers
 Author: DefTruth, vipshop.com, etc.
 Maintainer: DefTruth, vipshop.com, etc
@@ -66,20 +66,25 @@ Dynamic: requires-python
 
 ## 🔥News  
 
+- [2025-09-01] 📚[**Hybird Forward Pattern**](#unified) is supported! Please check [FLUX.1-dev](./examples/run_flux_adapter.py) as an example.
 - [2025-08-29] 🔥</b>Covers <b>All</b> Diffusers' <b>DiT-based</b> Pipelines via **[BlockAdapter](#unified) + [Pattern Matching](#unified).**
 - [2025-08-26] 🎉[**Wan2.2**](https://github.com/Wan-Video) **1.8x⚡️** speedup with `cache-dit + compile`! Please check the [example](./examples/run_wan_2.2.py).
 - [2025-08-19] 🔥[**Qwen-Image-Edit**](https://github.com/QwenLM/Qwen-Image) **2x⚡️** speedup! Check the example at [run_qwen_image_edit.py](./examples/run_qwen_image_edit.py).
 - [2025-08-12] 🎉First caching mechanism in [QwenLM/Qwen-Image](https://github.com/QwenLM/Qwen-Image) with **[cache-dit](https://github.com/vipshop/cache-dit)**, check this [PR](https://github.com/QwenLM/Qwen-Image/pull/61). 
 - [2025-08-11] 🔥[**Qwen-Image**](https://github.com/QwenLM/Qwen-Image) **1.8x⚡️** speedup! Please refer [run_qwen_image.py](./examples/run_qwen_image.py) as an example.
+- [2025-08-10] 🔥[**FLUX.1-Kontext-dev**](https://huggingface.co/black-forest-labs/FLUX.1-Kontext-dev) is supported! Please refer [run_flux_kontext.py](./examples/run_flux_kontext.py) as an example.
+- [2025-07-18] 🎉First caching mechanism in [🤗huggingface/flux-fast](https://github.com/huggingface/flux-fast) with **[cache-dit](https://github.com/vipshop/cache-dit)**, check the [PR](https://github.com/huggingface/flux-fast/pull/13). 
+- [2025-07-13] **[🤗flux-faster](https://github.com/xlite-dev/flux-faster)** is released! **3.3x** speedup for FLUX.1 on NVIDIA L20 with **[cache-dit](https://github.com/vipshop/cache-dit)**.
 
+<!--
 <details>
 <summary> Previous News </summary>  
-  
-- [2025-08-10] 🔥[**FLUX.1-Kontext-dev**](https://huggingface.co/black-forest-labs/FLUX.1-Kontext-dev) is supported! Please refer [run_flux_kontext.py](./examples/run_flux_kontext.py) as an example.
+
 - [2025-07-18] 🎉First caching mechanism in [🤗huggingface/flux-fast](https://github.com/huggingface/flux-fast) with **[cache-dit](https://github.com/vipshop/cache-dit)**, check the [PR](https://github.com/huggingface/flux-fast/pull/13). 
 - [2025-07-13] **[🤗flux-faster](https://github.com/xlite-dev/flux-faster)** is released! **3.3x** speedup for FLUX.1 on NVIDIA L20 with **[cache-dit](https://github.com/vipshop/cache-dit)**.
 
 </details>
+-->
 
 ## 📖Contents 
 
@@ -176,7 +181,7 @@ Currently, **cache-dit** library supports almost **Any** Diffusion Transformers
 
 Currently, for any **Diffusion** models with **Transformer Blocks** that match the specific **Input/Output patterns**, we can use the **Unified Cache APIs** from **cache-dit**, namely, the `cache_dit.enable_cache(...)` API. The **Unified Cache APIs** are currently in the experimental phase; please stay tuned for updates. The supported patterns are listed as follows:
 
-![](https://github.com/vipshop/cache-dit/raw/main/assets/patterns.png)
+![](https://github.com/vipshop/cache-dit/raw/main/assets/patterns-v1.png)
 
 ### ♥️Cache Acceleration with One-line Code
 
@@ -196,19 +201,22 @@ cache_dit.enable_cache(pipe)
 output = pipe(...)
 ```
 
-### 🔥Automatic Block Adapter
+### 🔥Automatic Block Adapter + 📚Hybird Forward Pattern
 
-But in some cases, you may have a **modified** Diffusion Pipeline or Transformer that is not located in the diffusers library or not officially supported by **cache-dit** at this time. The **BlockAdapter** can help you solve this problems. Please refer to [Qwen-Image w/ BlockAdapter](./examples/run_qwen_image_adapter.py) as an example.
+But in some cases, you may have a **modified** Diffusion Pipeline or Transformer that is not located in the diffusers library or not officially supported by **cache-dit** at this time. The **BlockAdapter** can help you solve this problems. Please refer to [🔥Qwen-Image w/ BlockAdapter](./examples/run_qwen_image_adapter.py) and [📚FLUX.1 w/ Hybird Forward Pattern](./examples/run_flux_adapter.py) for more details.
 
 ```python
 from cache_dit import ForwardPattern, BlockAdapter
 
-# Use BlockAdapter with `auto` mode.
+# Use 🔥BlockAdapter with `auto` mode.
 cache_dit.enable_cache(
-    BlockAdapter(pipe=pipe, auto=True), # Qwen-Image, etc.  
-    # Check `📚Forward Pattern Matching` documentation and hack the code of
-    # of Qwen-Image, you will find that it has satisfied `FORWARD_PATTERN_1`.
-    forward_pattern=ForwardPattern.Pattern_1,  
+    BlockAdapter(
+        # Any DiffusionPipeline, Qwen-Image, etc.  
+        pipe=pipe, auto=True,
+        # Check `📚Forward Pattern Matching` documentation and hack the code of
+        # of Qwen-Image, you will find that it has satisfied `FORWARD_PATTERN_1`.
+        forward_pattern=ForwardPattern.Pattern_1,
+    ),   
 )
 
 # Or, manually setup transformer configurations.
@@ -218,8 +226,30 @@ cache_dit.enable_cache(
         transformer=pipe.transformer,
         blocks=pipe.transformer.transformer_blocks,
         blocks_name="transformer_blocks",
+        forward_pattern=ForwardPattern.Pattern_1,
     ), 
-    forward_pattern=ForwardPattern.Pattern_1,
+)
+
+# cache-dit supported 📚Hybird Forward Pattern, for example:
+# For diffusers <= 0.34.0, FLUX.1 transformer_blocks and 
+# single_transformer_blocks has different forward pattern.
+cache_dit.enable_cache(
+    BlockAdapter(
+        pipe=pipe, # FLUX.1, etc.
+        transformer=pipe.transformer,
+        blocks=[
+            pipe.transformer.transformer_blocks,
+            pipe.transformer.single_transformer_blocks,
+        ],
+        blocks_name=[
+            "transformer_blocks",
+            "single_transformer_blocks",
+        ],
+        forward_pattern=[
+            ForwardPattern.Pattern_1,
+            ForwardPattern.Pattern_3,
+        ],
+    ),
 )
 ```
 For such situations, **BlockAdapter** can help you quickly apply various cache acceleration features to your own Diffusion Pipelines and Transformers. Please check the [📚BlockAdapter.md](./docs/BlockAdapter.md) for more details.

cache_dit-0.2.27.dist-info/RECORD

@@ -0,0 +1,47 @@
+cache_dit/__init__.py,sha256=-ENQmZ9rQfIlyiyyL1M_i_7dmxdp7EIXk3Q0ijccweE,1140
+cache_dit/_version.py,sha256=sQt3vJQXfZVL852h4ZP8iWmYkhYM4zSob72-HinVTME,706
+cache_dit/logger.py,sha256=0zsu42hN-3-rgGC_C29ms1IvVpV4_b4_SwJCKSenxBE,4304
+cache_dit/utils.py,sha256=d3aE6dybxu8zVTskfPvZIDXqtA8f7WZQuvhVrE9iUq8,7336
+cache_dit/cache_factory/.gitignore,sha256=5Cb-qT9wsTUoMJ7vACDF7ZcLpAXhi5v-xdcWSRit988,23
+cache_dit/cache_factory/__init__.py,sha256=8IqCdKEzqJGGlAcmgn4ySXmpyZE0BzUA7xBrZHpYGb4,899
+cache_dit/cache_factory/cache_adapters.py,sha256=wTLgJAxAJLn7iF6ylWvfaxWT9dhQ977AF5t1cdYHFOg,9857
+cache_dit/cache_factory/cache_interface.py,sha256=-PI7Oph2TDUCE6sviudV75jQ36p8WymLSSlyhHazL4k,8369
+cache_dit/cache_factory/cache_types.py,sha256=FIFa6ZBfvvSMMHyBBhvarvgg2Y2wbRgITcG_uGylGe0,991
+cache_dit/cache_factory/forward_pattern.py,sha256=FumlCuZ-TSmSYH0hGBHctSJ-oGLCftdZjLygqhsmdR4,2258
+cache_dit/cache_factory/utils.py,sha256=XkVM9AXcB9zYq8-S8QKAsGz80r3tA6U3lBNGDGeHOe4,1871
+cache_dit/cache_factory/block_adapters/__init__.py,sha256=wtbQLqTCyegAzDjBn3qVmg80Q6SH7WE8IxSYh-a6Chw,16935
+cache_dit/cache_factory/block_adapters/block_adapters.py,sha256=Q1BCk96ibWOuyCI_JO_qkQ-SCoCs0J4UtSFupaZ8jeU,11560
+cache_dit/cache_factory/block_adapters/block_registers.py,sha256=99ouWioxldlZJYQWhcUkOu94f8vO9V9QGzVNhKWtyO4,2005
+cache_dit/cache_factory/cache_blocks/__init__.py,sha256=yqZZLNM9NN8SHv9bb1jPAaRAfb_jQ77Km8nMBJpfhpI,777
+cache_dit/cache_factory/cache_blocks/pattern_0_1_2.py,sha256=ElMps6_7uI74tSF9GDR_dEI0bZEhdzcepM29xFWnYo8,428
+cache_dit/cache_factory/cache_blocks/pattern_3_4_5.py,sha256=BD-bJdFleN7B2JLrNc90s9f-wQon9Ud5JUV7fBaaLmg,9902
+cache_dit/cache_factory/cache_blocks/pattern_base.py,sha256=2FPQBnX4yroH4i5-qb8yPyAN523hrGc-ozGsv7dENQU,19809
+cache_dit/cache_factory/cache_blocks/utils.py,sha256=DM4YEtbRVV-_NsbFWjI-WZPBbSDc4Gl366AgFz06L_s,770
+cache_dit/cache_factory/cache_contexts/__init__.py,sha256=KqD3XSAnUlaa2wzuOhG0q8A3Xf0m5rsOEihCNLjsdfU,153
+cache_dit/cache_factory/cache_contexts/cache_context.py,sha256=6rtLjAPX5zVrmBXYPHOGQuyIR0fuDxrqsRiWV9A1h8M,43135
+cache_dit/cache_factory/cache_contexts/cache_manager.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+cache_dit/cache_factory/cache_contexts/taylorseer.py,sha256=etSUIZzDvqW3ScKCbccTPcFaSmxV1T-xAXdk-p3e3wk,3802
+cache_dit/cache_factory/patch_functors/__init__.py,sha256=yK05iONMGILsTZ83ynrUUJtiJKJ_FDjxmVIzRLy416s,252
+cache_dit/cache_factory/patch_functors/functor_base.py,sha256=Ahk0fTfrHgNdEl-9JSkACvfyyv9G-Ei5OSz7XBIlX5o,357
+cache_dit/cache_factory/patch_functors/functor_chroma.py,sha256=IFCuFU8HCnohM9Qpij7oU_UG1T8Ok8uTI3B9Nw7BHfY,10029
+cache_dit/cache_factory/patch_functors/functor_flux.py,sha256=3Q8x-PEeDiUtuv-FnQ2qEzo4qbpsYOPB9uf7YridE88,9538
+cache_dit/compile/__init__.py,sha256=FcTVzCeyypl-mxlc59_ehHL3lBNiDAFsXuRoJ-5Cfi0,56
+cache_dit/compile/utils.py,sha256=nN2OIrSdwRR5zGxJinKDqb07pXpvTNTF3g_OgLkeeBU,3858
+cache_dit/custom_ops/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+cache_dit/custom_ops/triton_taylorseer.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+cache_dit/metrics/__init__.py,sha256=RaUhl5dieF40RqnizGzR30qoJJ9dyMUEADwgwMaMQrE,575
+cache_dit/metrics/config.py,sha256=ieOgD9ayz722RjVzk24bSIqS2D6o7TZjGk8KeXV-OLQ,551
+cache_dit/metrics/fid.py,sha256=9Ivtazl6mW0Bon2VXa-Ia5Xj2ewxRD3V1Qkd69zYM3Y,17066
+cache_dit/metrics/inception.py,sha256=pBVe2X6ylLPIXTG4-GWDM9DWnCviMJbJ45R3ulhktR0,12759
+cache_dit/metrics/lpips.py,sha256=I2qCNi6qJh5TRsaIsdxO0WoRX1DN7U_H3zS0oCSahYM,1032
+cache_dit/metrics/metrics.py,sha256=8jvM1sF-nDxUuwCRy44QEoo4dYVLCQVh1QyAMs4eaQY,27840
+cache_dit/quantize/__init__.py,sha256=kWYoMAyZgBXu9BJlZjTQ0dRffW9GqeeY9_iTkXrb70A,59
+cache_dit/quantize/quantize_ao.py,sha256=mGspqYgQtenl3QnKPtsSYsSD7LbVX93f1M940bhXKLU,6066
+cache_dit/quantize/quantize_interface.py,sha256=2s_R7xPSKuJeFpEGeLwRxnq_CqJcBG3a3lzyW5wh-UM,1241
+cache_dit/quantize/quantize_svdq.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+cache_dit-0.2.27.dist-info/licenses/LICENSE,sha256=Dqb07Ik2dV41s9nIdMUbiRWEfDqo7-dQeRiY7kPO8PE,3769
+cache_dit-0.2.27.dist-info/METADATA,sha256=DN_iaPFoqnieAUKirJp-A0eLdYiiABAO8TY1EyCh8ss,23150
+cache_dit-0.2.27.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
+cache_dit-0.2.27.dist-info/entry_points.txt,sha256=FX2gysXaZx6NeK1iCLMcIdP8Q4_qikkIHtEmi3oWn8o,65
+cache_dit-0.2.27.dist-info/top_level.txt,sha256=ZJDydonLEhujzz0FOkVbO-BqfzO9d_VqRHmZU-3MOZo,10
+cache_dit-0.2.27.dist-info/RECORD,,

cache_dit-0.2.26.dist-info/RECORD

@@ -1,42 +0,0 @@
-cache_dit/__init__.py,sha256=6_DrKjVU0N7BpQLz4A5-qLLmpc4plflHbBAss_4FmC8,1140
-cache_dit/_version.py,sha256=qaUIn8np9pb6UE7Q3omOIYbBHqbmKse_sogKIKw72sA,706
-cache_dit/logger.py,sha256=0zsu42hN-3-rgGC_C29ms1IvVpV4_b4_SwJCKSenxBE,4304
-cache_dit/utils.py,sha256=H4YqlkvenlBxh2-ilOflbVDFqhI1UtnFniDgQac-D6k,7303
-cache_dit/cache_factory/.gitignore,sha256=5Cb-qT9wsTUoMJ7vACDF7ZcLpAXhi5v-xdcWSRit988,23
-cache_dit/cache_factory/__init__.py,sha256=sHGxoYnUWy4CqWTTnrqF2JdleYGdtN7T3erz__zztzE,635
-cache_dit/cache_factory/cache_adapters.py,sha256=NAM7Zo7WrdSb7WOUG2WFRkFXmSx9sXm2oTMx4PhtlZk,39302
-cache_dit/cache_factory/cache_context.py,sha256=krIPLYExwRbwZBj4-eVLV-v5QSEQoVqoLFMZBFWIIT0,41874
-cache_dit/cache_factory/cache_interface.py,sha256=1lCoN1Co1J6lqRI3mDikgqbscWnZShmEw53uatTHJdc,8588
-cache_dit/cache_factory/cache_types.py,sha256=FIFa6ZBfvvSMMHyBBhvarvgg2Y2wbRgITcG_uGylGe0,991
-cache_dit/cache_factory/forward_pattern.py,sha256=FumlCuZ-TSmSYH0hGBHctSJ-oGLCftdZjLygqhsmdR4,2258
-cache_dit/cache_factory/taylorseer.py,sha256=etSUIZzDvqW3ScKCbccTPcFaSmxV1T-xAXdk-p3e3wk,3802
-cache_dit/cache_factory/utils.py,sha256=XkVM9AXcB9zYq8-S8QKAsGz80r3tA6U3lBNGDGeHOe4,1871
-cache_dit/cache_factory/cache_blocks/__init__.py,sha256=jxO8v6o-Ke30HGfnDfZNZ6XknP3sabA2tlHiBW2BZTo,815
-cache_dit/cache_factory/cache_blocks/pattern_0_1_2.py,sha256=dSVcjHPkjlAqLaXxCyvcx8jdFFq6UfIhZk0geziQCVE,434
-cache_dit/cache_factory/cache_blocks/pattern_3_4_5.py,sha256=IMfm3HPzCbQC_SHbn74pfri4zwmPKBgpnT_NhdLxRZs,9598
-cache_dit/cache_factory/cache_blocks/pattern_base.py,sha256=_B1PPICBkyLUoHYWo0XmtIDv944bGBWFSN9y3X9uKTM,18739
-cache_dit/cache_factory/cache_blocks/utils.py,sha256=3VeCcqsYhD719uakrKJNSIFUa0-Qqgw08uu0LCKFa_A,648
-cache_dit/cache_factory/patch_functors/__init__.py,sha256=yK05iONMGILsTZ83ynrUUJtiJKJ_FDjxmVIzRLy416s,252
-cache_dit/cache_factory/patch_functors/functor_base.py,sha256=Ahk0fTfrHgNdEl-9JSkACvfyyv9G-Ei5OSz7XBIlX5o,357
-cache_dit/cache_factory/patch_functors/functor_chroma.py,sha256=RcN6AmpDp19ILY37tjOANlwXHrcaNMHlbv9XWF8hBwA,9942
-cache_dit/cache_factory/patch_functors/functor_flux.py,sha256=ycAypjJ34Uh7hmvbRbHadswRQj_fpxU24YfX1vtBL6c,9450
-cache_dit/compile/__init__.py,sha256=FcTVzCeyypl-mxlc59_ehHL3lBNiDAFsXuRoJ-5Cfi0,56
-cache_dit/compile/utils.py,sha256=nN2OIrSdwRR5zGxJinKDqb07pXpvTNTF3g_OgLkeeBU,3858
-cache_dit/custom_ops/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-cache_dit/custom_ops/triton_taylorseer.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-cache_dit/metrics/__init__.py,sha256=RaUhl5dieF40RqnizGzR30qoJJ9dyMUEADwgwMaMQrE,575
-cache_dit/metrics/config.py,sha256=ieOgD9ayz722RjVzk24bSIqS2D6o7TZjGk8KeXV-OLQ,551
-cache_dit/metrics/fid.py,sha256=9Ivtazl6mW0Bon2VXa-Ia5Xj2ewxRD3V1Qkd69zYM3Y,17066
-cache_dit/metrics/inception.py,sha256=pBVe2X6ylLPIXTG4-GWDM9DWnCviMJbJ45R3ulhktR0,12759
-cache_dit/metrics/lpips.py,sha256=I2qCNi6qJh5TRsaIsdxO0WoRX1DN7U_H3zS0oCSahYM,1032
-cache_dit/metrics/metrics.py,sha256=8jvM1sF-nDxUuwCRy44QEoo4dYVLCQVh1QyAMs4eaQY,27840
-cache_dit/quantize/__init__.py,sha256=kWYoMAyZgBXu9BJlZjTQ0dRffW9GqeeY9_iTkXrb70A,59
-cache_dit/quantize/quantize_ao.py,sha256=x9zm7AX9JjNhh7mqMkjHDGz2rDl4PzBwwU-CP1e_AVA,6012
-cache_dit/quantize/quantize_interface.py,sha256=2s_R7xPSKuJeFpEGeLwRxnq_CqJcBG3a3lzyW5wh-UM,1241
-cache_dit/quantize/quantize_svdq.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-cache_dit-0.2.26.dist-info/licenses/LICENSE,sha256=Dqb07Ik2dV41s9nIdMUbiRWEfDqo7-dQeRiY7kPO8PE,3769
-cache_dit-0.2.26.dist-info/METADATA,sha256=xBljGjnEV9OxSWLRmKx-FLWKUw2DGIv3pNJHg106uOo,21722
-cache_dit-0.2.26.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
-cache_dit-0.2.26.dist-info/entry_points.txt,sha256=FX2gysXaZx6NeK1iCLMcIdP8Q4_qikkIHtEmi3oWn8o,65
-cache_dit-0.2.26.dist-info/top_level.txt,sha256=ZJDydonLEhujzz0FOkVbO-BqfzO9d_VqRHmZU-3MOZo,10
-cache_dit-0.2.26.dist-info/RECORD,,