diffusers-workflow 0.12.0__tar.gz → 0.13.0__tar.gz

{diffusers_workflow-0.12.0/diffusers_workflow.egg-info → diffusers_workflow-0.13.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: diffusers-workflow
-Version: 0.12.0
+Version: 0.13.0
 Summary: Declarative workflow engine and web UI for Hugging Face Diffusers
 Author: dkackman
 License: Apache-2.0
@@ -16,70 +16,70 @@ Classifier: Programming Language :: Python :: 3.14
 Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
-Requires-Dist: torch>=2.13.0
-Requires-Dist: torchvision>=0.28.0
+Requires-Dist: torch>=2.14.1
+Requires-Dist: torchvision>=0.29.1
 Requires-Dist: diffusers>=0.40.0
-Requires-Dist: transformers!=5.17.0,>=5.16.1
-Requires-Dist: accelerate>=1.14.0
-Requires-Dist: peft>=0.20.0
+Requires-Dist: transformers>=5.19.0
+Requires-Dist: accelerate>=1.15.0
+Requires-Dist: peft>=0.21.2
 Requires-Dist: safetensors>=0.8.0
-Requires-Dist: huggingface-hub>=1.29.0
+Requires-Dist: huggingface-hub>=1.33.0
 Requires-Dist: sentencepiece>=0.2.2
-Requires-Dist: protobuf>=7.36.0
+Requires-Dist: protobuf>=7.36.2
 Requires-Dist: ftfy>=6.3.1
 Requires-Dist: torchsde>=0.2.6
 Requires-Dist: torchao>=0.18.0
 Requires-Dist: optimum-quanto>=0.2.7
-Requires-Dist: sdnq>=0.2.5
+Requires-Dist: sdnq>=0.2.8
 Requires-Dist: gguf>=0.19.0
 Requires-Dist: bitsandbytes>=0.50.2; sys_platform == "linux"
 Requires-Dist: controlnet-aux>=0.0.10
 Requires-Dist: opencv-python-headless>=5.0.0.93
 Requires-Dist: kornia>=0.8.3
-Requires-Dist: kernels>=0.17.0
+Requires-Dist: kernels>=0.17.2
 Requires-Dist: spandrel>=0.4.2
 Requires-Dist: facexlib>=0.3.0
-Requires-Dist: numpy>=2.5.2
+Requires-Dist: numpy>=2.5.4
 Requires-Dist: Pillow>=12.3.0
 Requires-Dist: piexif>=1.1.3
-Requires-Dist: imageio>=2.37.4
+Requires-Dist: imageio>=2.38.1
 Requires-Dist: imageio-ffmpeg>=0.6.0
-Requires-Dist: av>=18.1.0
+Requires-Dist: av>=19.0.1
 Requires-Dist: soundfile>=0.14.0
-Requires-Dist: matplotlib>=3.11.1
+Requires-Dist: matplotlib>=3.11.2
 Requires-Dist: pyloudnorm>=0.2.0
 Requires-Dist: scipy>=1.18.1
-Requires-Dist: speechbrain>=1.0.3
+Requires-Dist: speechbrain>=1.1.1
 Requires-Dist: demucs>=4.1.0
 Requires-Dist: qrcode>=8.2
 Requires-Dist: requests>=2.34.2
-Requires-Dist: aiohttp>=3.14.3
+Requires-Dist: aiohttp>=3.14.5
 Requires-Dist: beautifulsoup4>=4.15.0
 Requires-Dist: jsonschema>=4.26.0
-Requires-Dist: concurrent-log-handler>=0.9.29
-Requires-Dist: python-dotenv>=1.2.3
+Requires-Dist: concurrent-log-handler>=0.9.30
+Requires-Dist: python-dotenv>=1.2.4
 Requires-Dist: packaging>=26.3
-Requires-Dist: filelock>=3.12
+Requires-Dist: filelock>=4.1.1
 Requires-Dist: httpx>=0.28.1
 Provides-Extra: server
-Requires-Dist: fastapi>=0.141.1; extra == "server"
-Requires-Dist: uvicorn[standard]>=0.52.4; extra == "server"
+Requires-Dist: fastapi>=0.143.0; extra == "server"
+Requires-Dist: uvicorn[standard]>=0.54.0; extra == "server"
 Provides-Extra: mcp
-Requires-Dist: mcp>=2.1.1; extra == "mcp"
+Requires-Dist: mcp>=2.3.0; extra == "mcp"
 Provides-Extra: dev
 Requires-Dist: pytest>=9.1.1; extra == "dev"
 Requires-Dist: pytest-cov>=7.1.0; extra == "dev"
 Requires-Dist: pytest-xdist>=3.8.0; extra == "dev"
 Requires-Dist: pytest-timeout>=2.4.0; extra == "dev"
-Requires-Dist: pytest-mock>=3.15.1; extra == "dev"
+Requires-Dist: pytest-mock>=3.16.0; extra == "dev"
 Requires-Dist: pytest-asyncio>=1.4.0; extra == "dev"
 Requires-Dist: httpx>=0.28.1; extra == "dev"
-Requires-Dist: ruff>=0.15.0; extra == "dev"
+Requires-Dist: ruff>=0.17.0; extra == "dev"
 Requires-Dist: build; extra == "dev"
-Requires-Dist: mcp>=2.1.1; extra == "dev"
-Requires-Dist: pylint>=3.3; extra == "dev"
+Requires-Dist: mcp>=2.3.0; extra == "dev"
+Requires-Dist: pylint>=4.1.3; extra == "dev"
 Requires-Dist: import-linter>=2.15; extra == "dev"
-Requires-Dist: networkx>=3.0; extra == "dev"
+Requires-Dist: networkx>=3.7; extra == "dev"
 Requires-Dist: pygount>=3.2; extra == "dev"
 Dynamic: license-file
 
@@ -148,7 +148,7 @@ family that knows which workflow fits a request and the rules that bite:
 ```
 
 Most of the shipped workflows (Flux, LTX-2, MiniMax...) use **gated** models.
-Request access on the model's Hugging Face page, then `huggingface-cli login`
+Request access on the model's Hugging Face page, then `hf auth login`
 once; without it the run fails partway through with a 401/403 from the Hub.
 
 > **GPU on another machine?** Start the engine there with `--mcp` and connect

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/README.md

@@ -63,7 +63,7 @@ family that knows which workflow fits a request and the rules that bite:
 ```
 
 Most of the shipped workflows (Flux, LTX-2, MiniMax...) use **gated** models.
-Request access on the model's Hugging Face page, then `huggingface-cli login`
+Request access on the model's Hugging Face page, then `hf auth login`
 once; without it the run fails partway through with a 401/403 from the Hub.
 
 > **GPU on another machine?** Start the engine there with `--mcp` and connect

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0/diffusers_workflow.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: diffusers-workflow
-Version: 0.12.0
+Version: 0.13.0
 Summary: Declarative workflow engine and web UI for Hugging Face Diffusers
 Author: dkackman
 License: Apache-2.0
@@ -16,70 +16,70 @@ Classifier: Programming Language :: Python :: 3.14
 Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
-Requires-Dist: torch>=2.13.0
-Requires-Dist: torchvision>=0.28.0
+Requires-Dist: torch>=2.14.1
+Requires-Dist: torchvision>=0.29.1
 Requires-Dist: diffusers>=0.40.0
-Requires-Dist: transformers!=5.17.0,>=5.16.1
-Requires-Dist: accelerate>=1.14.0
-Requires-Dist: peft>=0.20.0
+Requires-Dist: transformers>=5.19.0
+Requires-Dist: accelerate>=1.15.0
+Requires-Dist: peft>=0.21.2
 Requires-Dist: safetensors>=0.8.0
-Requires-Dist: huggingface-hub>=1.29.0
+Requires-Dist: huggingface-hub>=1.33.0
 Requires-Dist: sentencepiece>=0.2.2
-Requires-Dist: protobuf>=7.36.0
+Requires-Dist: protobuf>=7.36.2
 Requires-Dist: ftfy>=6.3.1
 Requires-Dist: torchsde>=0.2.6
 Requires-Dist: torchao>=0.18.0
 Requires-Dist: optimum-quanto>=0.2.7
-Requires-Dist: sdnq>=0.2.5
+Requires-Dist: sdnq>=0.2.8
 Requires-Dist: gguf>=0.19.0
 Requires-Dist: bitsandbytes>=0.50.2; sys_platform == "linux"
 Requires-Dist: controlnet-aux>=0.0.10
 Requires-Dist: opencv-python-headless>=5.0.0.93
 Requires-Dist: kornia>=0.8.3
-Requires-Dist: kernels>=0.17.0
+Requires-Dist: kernels>=0.17.2
 Requires-Dist: spandrel>=0.4.2
 Requires-Dist: facexlib>=0.3.0
-Requires-Dist: numpy>=2.5.2
+Requires-Dist: numpy>=2.5.4
 Requires-Dist: Pillow>=12.3.0
 Requires-Dist: piexif>=1.1.3
-Requires-Dist: imageio>=2.37.4
+Requires-Dist: imageio>=2.38.1
 Requires-Dist: imageio-ffmpeg>=0.6.0
-Requires-Dist: av>=18.1.0
+Requires-Dist: av>=19.0.1
 Requires-Dist: soundfile>=0.14.0
-Requires-Dist: matplotlib>=3.11.1
+Requires-Dist: matplotlib>=3.11.2
 Requires-Dist: pyloudnorm>=0.2.0
 Requires-Dist: scipy>=1.18.1
-Requires-Dist: speechbrain>=1.0.3
+Requires-Dist: speechbrain>=1.1.1
 Requires-Dist: demucs>=4.1.0
 Requires-Dist: qrcode>=8.2
 Requires-Dist: requests>=2.34.2
-Requires-Dist: aiohttp>=3.14.3
+Requires-Dist: aiohttp>=3.14.5
 Requires-Dist: beautifulsoup4>=4.15.0
 Requires-Dist: jsonschema>=4.26.0
-Requires-Dist: concurrent-log-handler>=0.9.29
-Requires-Dist: python-dotenv>=1.2.3
+Requires-Dist: concurrent-log-handler>=0.9.30
+Requires-Dist: python-dotenv>=1.2.4
 Requires-Dist: packaging>=26.3
-Requires-Dist: filelock>=3.12
+Requires-Dist: filelock>=4.1.1
 Requires-Dist: httpx>=0.28.1
 Provides-Extra: server
-Requires-Dist: fastapi>=0.141.1; extra == "server"
-Requires-Dist: uvicorn[standard]>=0.52.4; extra == "server"
+Requires-Dist: fastapi>=0.143.0; extra == "server"
+Requires-Dist: uvicorn[standard]>=0.54.0; extra == "server"
 Provides-Extra: mcp
-Requires-Dist: mcp>=2.1.1; extra == "mcp"
+Requires-Dist: mcp>=2.3.0; extra == "mcp"
 Provides-Extra: dev
 Requires-Dist: pytest>=9.1.1; extra == "dev"
 Requires-Dist: pytest-cov>=7.1.0; extra == "dev"
 Requires-Dist: pytest-xdist>=3.8.0; extra == "dev"
 Requires-Dist: pytest-timeout>=2.4.0; extra == "dev"
-Requires-Dist: pytest-mock>=3.15.1; extra == "dev"
+Requires-Dist: pytest-mock>=3.16.0; extra == "dev"
 Requires-Dist: pytest-asyncio>=1.4.0; extra == "dev"
 Requires-Dist: httpx>=0.28.1; extra == "dev"
-Requires-Dist: ruff>=0.15.0; extra == "dev"
+Requires-Dist: ruff>=0.17.0; extra == "dev"
 Requires-Dist: build; extra == "dev"
-Requires-Dist: mcp>=2.1.1; extra == "dev"
-Requires-Dist: pylint>=3.3; extra == "dev"
+Requires-Dist: mcp>=2.3.0; extra == "dev"
+Requires-Dist: pylint>=4.1.3; extra == "dev"
 Requires-Dist: import-linter>=2.15; extra == "dev"
-Requires-Dist: networkx>=3.0; extra == "dev"
+Requires-Dist: networkx>=3.7; extra == "dev"
 Requires-Dist: pygount>=3.2; extra == "dev"
 Dynamic: license-file
 
@@ -148,7 +148,7 @@ family that knows which workflow fits a request and the rules that bite:
 ```
 
 Most of the shipped workflows (Flux, LTX-2, MiniMax...) use **gated** models.
-Request access on the model's Hugging Face page, then `huggingface-cli login`
+Request access on the model's Hugging Face page, then `hf auth login`
 once; without it the run fails partway through with a 401/403 from the Hub.
 
 > **GPU on another machine?** Start the engine there with `--mcp` and connect

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/diffusers_workflow.egg-info/SOURCES.txt

@@ -181,44 +181,44 @@ dw/server/ui/assets/csharp-BKxtCVv1.js
 dw/server/ui/assets/csp-bTuwJoIa.js
 dw/server/ui/assets/css-DIMkf-bt.js
 dw/server/ui/assets/css.worker-C6lDtRpF.js
-dw/server/ui/assets/cssMode-n9saDHXf.js
+dw/server/ui/assets/cssMode-QzCkHHkC.js
 dw/server/ui/assets/cypher-CVaqCwHa.js
 dw/server/ui/assets/dart-onAF5SnQ.js
 dw/server/ui/assets/dockerfile-DZFCIeNp.js
 dw/server/ui/assets/ecl-D05T4iGw.js
 dw/server/ui/assets/editor-DjpsE8to.css
-dw/server/ui/assets/editor.api-DBE2zlnf.js
+dw/server/ui/assets/editor.api-LvRbw1iL.js
 dw/server/ui/assets/editor.worker-BmdWdrHZ.js
 dw/server/ui/assets/elixir-6RTg0lbw.js
 dw/server/ui/assets/flow9-C5_-GSwl.js
-dw/server/ui/assets/freemarker2-BomqYelz.js
+dw/server/ui/assets/freemarker2-BFEReHqW.js
 dw/server/ui/assets/fsharp-C8Ef5oNN.js
 dw/server/ui/assets/go-C-y9NEjX.js
 dw/server/ui/assets/graphql-fmXr3nnJ.js
-dw/server/ui/assets/handlebars-8Houv1UM.js
+dw/server/ui/assets/handlebars--qZ0WvL7.js
 dw/server/ui/assets/hcl-CpzslTdj.js
-dw/server/ui/assets/html-DaY0zzOJ.js
+dw/server/ui/assets/html-Bs0VSJAA.js
 dw/server/ui/assets/html.worker-C5yZDBHz.js
-dw/server/ui/assets/htmlMode-DP2rYJIT.js
-dw/server/ui/assets/index-CZtjWH1q.css
-dw/server/ui/assets/index-DGl2EK47.js
+dw/server/ui/assets/htmlMode-DrsyYX5n.js
+dw/server/ui/assets/index-BgBhcVj3.js
+dw/server/ui/assets/index-DSM5LA24.css
 dw/server/ui/assets/ini-sBoK_t0W.js
 dw/server/ui/assets/java-BEtHBSE6.js
-dw/server/ui/assets/javascript-B5R3UPTQ.js
+dw/server/ui/assets/javascript-C3KR7rul.js
 dw/server/ui/assets/json.worker-DdeUAmHa.js
-dw/server/ui/assets/jsonMode-DsuGIxoD.js
+dw/server/ui/assets/jsonMode-DEXt-mqp.js
 dw/server/ui/assets/julia-Bri6UV-V.js
 dw/server/ui/assets/kotlin-BOotOW0E.js
 dw/server/ui/assets/less-B9JPFI3C.js
 dw/server/ui/assets/lexon-CfSJPG6W.js
-dw/server/ui/assets/liquid-B2d5ZvOn.js
-dw/server/ui/assets/lspLanguageFeatures-ChdmQify.js
+dw/server/ui/assets/liquid-ByBJuq1e.js
+dw/server/ui/assets/lspLanguageFeatures-6nDoG86-.js
 dw/server/ui/assets/lua-CsQS60Ue.js
 dw/server/ui/assets/m3-D-oSqn_W.js
 dw/server/ui/assets/markdown-Cimd5fb3.js
-dw/server/ui/assets/mdx-DIXDAORJ.js
+dw/server/ui/assets/mdx-BH2GyjV6.js
 dw/server/ui/assets/mips-CIPQ_RoX.js
-dw/server/ui/assets/monaco-BgG3yDUh.js
+dw/server/ui/assets/monaco-B6Bmfo5o.js
 dw/server/ui/assets/monaco-n7clI0si.css
 dw/server/ui/assets/msdax-DauUninz.js
 dw/server/ui/assets/mysql-SOo6toE5.js
@@ -234,10 +234,10 @@ dw/server/ui/assets/powerquery-D3hlyOfw.js
 dw/server/ui/assets/powershell-DmHpPYUd.js
 dw/server/ui/assets/protobuf-C531GsRP.js
 dw/server/ui/assets/pug-Z5eAx3Zn.js
-dw/server/ui/assets/python-CXHtns6L.js
+dw/server/ui/assets/python-C1sJMrAm.js
 dw/server/ui/assets/qsharp-DkqhCAOL.js
 dw/server/ui/assets/r-BwWrilGY.js
-dw/server/ui/assets/razor-BSKKsa7H.js
+dw/server/ui/assets/razor-BdPZ4bvZ.js
 dw/server/ui/assets/redis-ClamHrr6.js
 dw/server/ui/assets/redshift-DT7zqm-g.js
 dw/server/ui/assets/restructuredtext-BYgofb2h.js
@@ -257,15 +257,15 @@ dw/server/ui/assets/swift-Bxkupp3x.js
 dw/server/ui/assets/systemverilog-Bz4Y3fRF.js
 dw/server/ui/assets/tcl-DISqw1ZD.js
 dw/server/ui/assets/ts.worker-DGGa2mF8.js
-dw/server/ui/assets/tsMode-DRjPuZ2P.js
+dw/server/ui/assets/tsMode-DW5i-ukN.js
 dw/server/ui/assets/twig-De2hgUGE.js
-dw/server/ui/assets/typescript-CBpoJtqE.js
+dw/server/ui/assets/typescript-C_QzKQY3.js
 dw/server/ui/assets/typespec-B8J7ngcE.js
 dw/server/ui/assets/vb-DV3o63ZY.js
 dw/server/ui/assets/wgsl-DpFanUEy.js
-dw/server/ui/assets/workers-DUo4Mox_.js
-dw/server/ui/assets/xml-B2gZoNmP.js
-dw/server/ui/assets/yaml-CSvo_Woe.js
+dw/server/ui/assets/workers-DHqaOvh8.js
+dw/server/ui/assets/xml-D3UEcM_2.js
+dw/server/ui/assets/yaml-C0TnGcnd.js
 dw/tasks/assess.py
 dw/tasks/audio_dynamics.py
 dw/tasks/audio_handlers.py
@@ -392,6 +392,7 @@ tests/test_elision.py
 tests/test_events.py
 tests/test_examples.py
 tests/test_face_track.py
+tests/test_faststart.py
 tests/test_find_loop_bed.py
 tests/test_finish.py
 tests/test_fit_templates.py

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/diffusers_workflow.egg-info/requires.txt

@@ -1,46 +1,46 @@
-torch>=2.13.0
-torchvision>=0.28.0
+torch>=2.14.1
+torchvision>=0.29.1
 diffusers>=0.40.0
-transformers!=5.17.0,>=5.16.1
-accelerate>=1.14.0
-peft>=0.20.0
+transformers>=5.19.0
+accelerate>=1.15.0
+peft>=0.21.2
 safetensors>=0.8.0
-huggingface-hub>=1.29.0
+huggingface-hub>=1.33.0
 sentencepiece>=0.2.2
-protobuf>=7.36.0
+protobuf>=7.36.2
 ftfy>=6.3.1
 torchsde>=0.2.6
 torchao>=0.18.0
 optimum-quanto>=0.2.7
-sdnq>=0.2.5
+sdnq>=0.2.8
 gguf>=0.19.0
 controlnet-aux>=0.0.10
 opencv-python-headless>=5.0.0.93
 kornia>=0.8.3
-kernels>=0.17.0
+kernels>=0.17.2
 spandrel>=0.4.2
 facexlib>=0.3.0
-numpy>=2.5.2
+numpy>=2.5.4
 Pillow>=12.3.0
 piexif>=1.1.3
-imageio>=2.37.4
+imageio>=2.38.1
 imageio-ffmpeg>=0.6.0
-av>=18.1.0
+av>=19.0.1
 soundfile>=0.14.0
-matplotlib>=3.11.1
+matplotlib>=3.11.2
 pyloudnorm>=0.2.0
 scipy>=1.18.1
-speechbrain>=1.0.3
+speechbrain>=1.1.1
 demucs>=4.1.0
 qrcode>=8.2
 requests>=2.34.2
-aiohttp>=3.14.3
+aiohttp>=3.14.5
 beautifulsoup4>=4.15.0
 jsonschema>=4.26.0
-concurrent-log-handler>=0.9.29
-python-dotenv>=1.2.3
+concurrent-log-handler>=0.9.30
+python-dotenv>=1.2.4
 packaging>=26.3
-filelock>=3.12
+filelock>=4.1.1
 httpx>=0.28.1
 
 [:sys_platform == "linux"]
@@ -51,20 +51,20 @@ pytest>=9.1.1
 pytest-cov>=7.1.0
 pytest-xdist>=3.8.0
 pytest-timeout>=2.4.0
-pytest-mock>=3.15.1
+pytest-mock>=3.16.0
 pytest-asyncio>=1.4.0
 httpx>=0.28.1
-ruff>=0.15.0
+ruff>=0.17.0
 build
-mcp>=2.1.1
-pylint>=3.3
+mcp>=2.3.0
+pylint>=4.1.3
 import-linter>=2.15
-networkx>=3.0
+networkx>=3.7
 pygount>=3.2
 
 [mcp]
-mcp>=2.1.1
+mcp>=2.3.0
 
 [server]
-fastapi>=0.141.1
-uvicorn[standard]>=0.52.4
+fastapi>=0.143.0
+uvicorn[standard]>=0.54.0

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/dw/disk_caches.py

@@ -33,7 +33,11 @@ refused, until someone marks it by hand.
 is renamed into one `<root>/.clearing-<pid>-<rand>/` directory, which is then
 deleted. A writer racing the clear finds an empty cache and rebuilds; it never
 reads a half-deleted tree. An entry delete moves the one entry the same way. The
-routes refuse while a job is running or queued.
+routes refuse while a job is running or queued, and hold the job queue still
+(`JobManager.hold_dispatch`) while they work, so a job submitted meanwhile waits
+instead of starting into a root being emptied. A staging directory a killed
+server left behind is removed at `mark_roots()` and at the next clear, and is
+never counted by a scan. `scan_all()` reuses its answer for a few seconds.
 
 **An entry id must have a cache key's shape** (`quantized_cache.is_key`, 64
 lowercase hex) before any path is built from it.
@@ -45,6 +49,7 @@ import os
 import secrets
 import shutil
 import threading
+import time
 from dataclasses import dataclass
 from typing import Callable
 
@@ -65,6 +70,12 @@ _MARKER_TEXT = (
 _clear_lock = threading.Lock()
 
 
+# How long scan_all's answer is reused. A scan stat()s every file of every
+# cache, and get_server_info asks on each call (#840)
+_SCAN_TTL = 5.0
+_scan_memo = None  # (monotonic time, scan_all's result)
+
+
 class UnknownCache(ValueError):
     pass
 
@@ -210,9 +221,28 @@ def _write_marker(root):
         f.write(_MARKER_TEXT)
 
 
-def mark_root(cache):
+def _sweep_staging(root):
+    """Delete the `.clearing-*` directories a clear that died mid-delete left
+    in `root`. Only called where no clear can be running: server start, or
+    inside `_clear_lock`."""
+    try:
+        leftovers = [
+            entry.path
+            for entry in _children(root)
+            if entry.name.startswith(_CLEARING_PREFIX)
+            and entry.is_dir(follow_symlinks=False)
+        ]
+    except OSError:
+        return
+    for path in leftovers:
+        shutil.rmtree(path, ignore_errors=True)
+        logger.info(f"Removed the leftover {path} from an interrupted clear")
+
+
+def mark_root(cache, quiet=False):
     """Mark one cache's root as dw's to clear, if the rule allows it.
-    Returns whether the root carries the marker afterwards."""
+    Returns whether the root carries the marker afterwards. `quiet` logs the
+    refusal at DEBUG: only the startup pass says it at INFO (#841)."""
     root = cache.root()
     if os.path.islink(root) or (os.path.exists(root) and not os.path.isdir(root)):
         return False
@@ -223,9 +253,10 @@ def mark_root(cache):
     if _has_marker(root):
         return True
     if _children(root) and root != cache.default_root():
-        logger.info(
+        logger.log(
+            logging.DEBUG if quiet else logging.INFO,
             f"The {cache.name} cache at {root} was not created by dw and "
-            f"has no {MARKER} marker, so it can't be cleared from the server"
+            f"has no {MARKER} marker, so it can't be cleared from the server",
         )
         return False
     _write_marker(root)
@@ -237,7 +268,8 @@ def mark_roots():
     once at server start; a root it can't write is left unclearable."""
     for cache in CACHES.values():
         try:
-            mark_root(cache)
+            if mark_root(cache):
+                _sweep_staging(cache.root())
         except (OSError, SecurityError) as e:
             logger.warning(f"Could not mark the {cache.name} cache: {e}")
 
@@ -255,6 +287,9 @@ def _walk(top):
             continue
         with entries:
             for entry in entries:
+                if directory == top and entry.name.startswith(_CLEARING_PREFIX):
+                    # A clear's staging directory is on its way out
+                    continue
                 try:
                     if entry.is_dir(follow_symlinks=False):
                         stack.append(entry.path)
@@ -295,7 +330,7 @@ def _reason(cache):
     root = cache.root()
     if os.path.isdir(root) and not _has_marker(root):
         try:
-            mark_root(cache)
+            mark_root(cache, quiet=True)
         except (OSError, SecurityError) as e:
             logger.warning(f"Could not mark the {cache.name} cache: {e}")
     return _not_clearable_reason(root)
@@ -340,7 +375,7 @@ def scan(cache):
 def _entry_fields(path):
     """What an entry's `entry.json` says of it, or None when it can't be
     read. `component` falls back to the subfolder - the component's name in
-    a diffusers repo - since entry.json doesn't record it."""
+    a diffusers repo - for entries written before entry.json recorded it."""
     try:
         entry = quantized_cache.read_entry(path)
     except (OSError, ValueError):
@@ -385,7 +420,20 @@ def scan_entries(root):
 
 
 def scan_all():
-    return [scan(cache) for cache in CACHES.values()]
+    """Every cache as plain data, reused for `_SCAN_TTL` seconds; a clear or
+    entry delete drops the reused answer."""
+    global _scan_memo
+    memo = _scan_memo
+    if memo is not None and time.monotonic() - memo[0] < _SCAN_TTL:
+        return memo[1]
+    result = [scan(cache) for cache in CACHES.values()]
+    _scan_memo = (time.monotonic(), result)
+    return result
+
+
+def _forget_scans():
+    global _scan_memo
+    _scan_memo = None
 
 
 def entry_cache(name, entry):
@@ -441,10 +489,12 @@ def delete_entry(name, entry):
         if reason:
             raise NotClearable(f"The {name} cache at {root} can't be changed: {reason}")
         root = validate_path(root)
+        _sweep_staging(root)
         path = quantized_cache.entry_path(root, entry)
         if os.path.islink(path) or not os.path.isdir(path):
             raise UnknownEntry(f"The {name} cache has no entry {entry}")
         freed, files = _stage_out(root, [path])
+        _forget_scans()
     logger.info(f"Deleted {name} cache entry {entry} ({freed} bytes, {files} files)")
     return {"freed": freed, "files": files}
 
@@ -462,10 +512,12 @@ def clear(name):
         if reason:
             raise NotClearable(f"The {name} cache at {root} can't be cleared: {reason}")
         root = validate_path(root)
+        _sweep_staging(root)
         # A link is left alone: validate_path resolves it, so the rename
         # would move its target, not the link
         freed, files = _stage_out(
             root, [entry.path for entry in _children(root) if not entry.is_symlink()]
         )
+        _forget_scans()
     logger.info(f"Cleared the {name} cache at {root} ({freed} bytes, {files} files)")
     return {"freed": freed, "files": files}

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/dw/docs/ARCHITECTURE.md

@@ -150,10 +150,10 @@ one to open.
 | App factory | `dw/server/app.py`: `create_app` | `create_app` builds the JobManager and `app.state`, installs the middleware and registers the routes, and all state lives in the JobManager. | — |
 | Routers | `dw/server/routes/*.py`, `dw/server/routes/__init__.py`: `ROUTERS`, `include_routers`, `include_file_routes` | Routers register in `ROUTERS` order, because a greedy `{name:path}` route must come after its specific siblings. The files router comes later, after `/mcp`. | `tests/test_server_downloads.py::test_download_workflow_sets_content_disposition_attachment` |
 | Job queue | `dw/server/jobs.py`: `JobManager`; `dw/server/job_results.py`: `consume_results` | A dispatcher thread hands queued jobs, in queue order, to the pool's workers (`Worker pool dispatch`); each worker runs one job at a time, and `consume_results` folds that worker's replies into the job, naming files relative to the job's own `output_dir`. A job carries its own `output_dir`, `asset_dir` and `workflow_dir`, so it stays in its workspace. | `tests/test_server_workspaces.py::TestRunning::test_rerun_stays_in_the_workspace_it_ran_in` (FIFO: —) |
-| Worker pool dispatch | `dw/server/jobs.py`: `JobManager._next_dispatch`; `dw/server/pool.py`: `WorkerSlot`, `check_fits`, `largest_ceiling_gb`; `dw/vram_estimate.py`: `required_vram_gb`; `dw/server/admission.py`: `pool_capacity` | `--devices` runs one worker per card; a queued job goes to a free card that fits what it needs, a job that fits no free card keeps its place while a smaller one behind it takes the card, a job bigger than every card is refused at submit, and cancel or a crash touches only the worker running that job. On a backend no `cost` entry describes, a declared `vram_estimate` is held at admission to the pool's largest card, so a job the first card cannot hold is not refused when a larger card can hold it. | `tests/test_worker_pool.py::TestConcurrency::test_two_workers_run_two_jobs_at_once`, `tests/test_worker_pool.py::TestBackfill::test_a_job_too_big_for_the_free_card_waits_while_a_smaller_one_takes_it`, `tests/test_worker_pool.py::TestFitAtSubmit::test_a_job_too_big_for_every_card_is_refused_naming_the_largest`, `tests/test_worker_pool.py::TestCancel::test_cancel_reaches_the_worker_running_the_job`, `tests/test_worker_pool.py::TestCrashIsolation::test_a_crashed_worker_fails_only_its_own_job`, `tests/test_worker_pool.py::TestOomRanking::test_the_later_started_worker_is_ranked_first`, `tests/test_worker_pool.py::TestFitAtSubmit::test_a_job_only_the_larger_card_holds_is_admitted` |
+| Worker pool dispatch | `dw/server/jobs.py`: `JobManager._next_dispatch`; `dw/server/pool.py`: `WorkerSlot`, `check_fits`, `largest_ceiling_gb`; `dw/vram_estimate.py`: `required_vram_gb`; `dw/server/admission.py`: `pool_capacity` | `--devices` runs one worker per card; a queued job goes to a free card that fits what it needs (none starts while a cache clear holds dispatch, `dw disk caches`), a job that fits no free card keeps its place while a smaller one behind it takes the card, a job bigger than every card is refused at submit, and cancel or a crash touches only the worker running that job. On a backend no `cost` entry describes, a declared `vram_estimate` is held at admission to the pool's largest card, so a job the first card cannot hold is not refused when a larger card can hold it. | `tests/test_worker_pool.py::TestConcurrency::test_two_workers_run_two_jobs_at_once`, `tests/test_worker_pool.py::TestBackfill::test_a_job_too_big_for_the_free_card_waits_while_a_smaller_one_takes_it`, `tests/test_worker_pool.py::TestFitAtSubmit::test_a_job_too_big_for_every_card_is_refused_naming_the_largest`, `tests/test_worker_pool.py::TestCancel::test_cancel_reaches_the_worker_running_the_job`, `tests/test_worker_pool.py::TestCrashIsolation::test_a_crashed_worker_fails_only_its_own_job`, `tests/test_worker_pool.py::TestOomRanking::test_the_later_started_worker_is_ranked_first`, `tests/test_worker_pool.py::TestFitAtSubmit::test_a_job_only_the_larger_card_holds_is_admitted` |
 | Card affinity | `dw/server/pool.py`: `choose_slot`; `dw/server/jobs.py`: `JobManager.route`; `dw/worker_protocol.py`: `workflow_identity` | Among the free cards a job fits it goes to the rerun's original card, else the card whose worker last ran its workflow identity (`workflow_identity`, the one rule the worker caches by too), else one with no worker running, else the first in `--devices` order; a cache probe and `plan.estimate` (`priced_for`) ask about the card `route` names, and memory is read and cleared per card. | `tests/test_worker_pool.py::TestIdentityAffinity::test_a_second_run_lands_on_the_card_that_ran_the_workflow_first`, `tests/test_worker_pool.py::TestRerunAffinity::test_a_rerun_lands_on_the_original_card_when_it_is_free`, `tests/test_worker_pool.py::TestProbeRouting::test_the_probe_goes_to_the_worker_the_job_would_be_routed_to`, `tests/test_worker_pool.py::TestMemoryPerCard::test_a_named_card_running_a_job_is_refused_though_the_other_is_idle` |
 | Per-card memory and cache | `dw/server/worker_memory.py`: `memory_status`, `clear_memory`, `probe_cache` | Each card keeps its own last memory reading; an idle card's worker is asked live, a busy one answers with the run's last report and says why it is not live, and a clear leaves a card running a job alone. Every request takes the card's lock with a bounded wait, and a card's lock is never taken while the JobManager's lock is held. | `tests/test_worker_pool.py::TestMemoryPerCard::test_a_named_card_running_a_job_is_refused_though_the_other_is_idle`, `tests/test_worker_pool.py::TestProbeRouting::test_the_probe_goes_to_the_worker_the_job_would_be_routed_to`, `tests/test_server.py::test_memory_says_why_a_reading_is_not_the_worker_s` |
-| dw disk caches | `dw/disk_caches.py` | Members `inductor`, `triton`, `quantized`. Clear only a root carrying the `.dw-cache` marker, never while a job is running or queued (`quantized` also not during a model download); an entry delete takes only a 64-hex id, checked before any path is built; clear renames into `.clearing-*` then deletes. | `tests/test_disk_caches.py` |
+| dw disk caches | `dw/disk_caches.py`; `dw/server/jobs.py`: `JobManager.hold_dispatch`; `dw/server/routes/system.py`: `clear_cache`, `delete_cache_entry` | Members `inductor`, `triton`, `quantized`. Clear only a root carrying the `.dw-cache` marker, never while a job is running or queued (`quantized` also not during a model download); an entry delete takes only a 64-hex id, checked before any path is built; clear renames into `.clearing-*` then deletes. The busy check and the dispatch hold are one step in `JobManager.hold_dispatch`, kept for the whole clear or entry delete: a job submitted meanwhile is accepted but stays queued until it ends. | `tests/test_disk_caches.py`, `tests/test_disk_caches.py::test_job_submitted_during_a_clear_waits_for_it` |
 | Job-to-run link | `dw/server/job_record.py`, `dw/server/jobs.py`: `JobManager.realized` | A job records `run_id`, `run_dir` and `run_version`, and `JobManager.realized` reads that run's `workflow.json`, confined to the output root. | `tests/test_server_jobs.py::test_realized_reads_the_file_the_run_wrote`, `tests/test_server_jobs.py::test_realized_refuses_a_run_dir_that_escapes_the_output_root` |
 | Job history | `dw/server/job_history.py`: `JobHistory` | Finished jobs persist in `jobs.sqlite`, in WAL mode, so the Jobs view survives a restart. | `tests/test_server.py::test_job_history_survives_restart_and_reruns`, `tests/test_job_history_wal.py::test_the_jobs_database_uses_wal_mode` |
 | HTTP security | `dw/server/http_security.py`: `install_middleware`, `query_token_ok` | Every API route needs the token, and only a route marked `query_token_ok` takes it as `?token=`. | `tests/test_security_auth.py::TestTheTokenGate::test_every_api_spelling_needs_the_token`, `tests/test_security_auth.py::TestTheTokenGate::test_the_query_token_is_refused_where_it_is_not_allowed` |

{diffusers_workflow-0.12.0 → diffusers_workflow-0.13.0}/dw/docs/DEPENDENCIES.md

@@ -76,10 +76,10 @@ bash ./install.sh
 
 ## Troubleshooting
 
-**Hugging Face authentication (401/403 downloading a model):** Most workflows under `workflows/` (Flux, LTX-2, MiniMax...) point at **gated** models on the Hub — repos that require the owner to approve your account before you can download them. A run against one of these fails with an actionable error naming the repo and `huggingface-cli login` (mapped from the Hub's 401/403 in `load_component()`, `dw/pipeline_processors/components.py`) — request access on the model's page (e.g. [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)) and then log in once, locally:
+**Hugging Face authentication (401/403 downloading a model):** Most workflows under `workflows/` (Flux, LTX-2, MiniMax...) point at **gated** models on the Hub — repos that require the owner to approve your account before you can download them. A run against one of these fails with an actionable error naming the repo and `hf auth login` (mapped from the Hub's 401/403 in `load_component()`, `dw/pipeline_processors/components.py`) — request access on the model's page (e.g. [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)) and then log in once, locally:
 
 ```bash
-huggingface-cli login
+hf auth login
 ```
 
 `workflows/templates/text-to-image.json` uses an ungated model and needs no login - start there if you just want to confirm the install works.