hcpdiff 0.9.1__py3-none-any.whl → 2.1__py3-none-any.whl

hcpdiff-2.1.dist-info/METADATA

@@ -0,0 +1,285 @@
+Metadata-Version: 2.4
+Name: hcpdiff
+Version: 2.1
+Summary: A universal Diffusion toolbox
+Home-page: https://github.com/IrisRainbowNeko/HCP-Diffusion
+Author: Ziyi Dong
+Author-email: rainbow-neko@outlook.com
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: rainbowneko
+Requires-Dist: diffusers
+Requires-Dist: matplotlib
+Requires-Dist: pyarrow
+Requires-Dist: transformers>=4.25.1
+Requires-Dist: pytorch-msssim
+Requires-Dist: lmdb
+Dynamic: author
+Dynamic: author-email
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: home-page
+Dynamic: license-file
+Dynamic: requires-dist
+Dynamic: requires-python
+Dynamic: summary
+
+# HCP-Diffusion V2
+
+[![PyPI](https://img.shields.io/pypi/v/hcpdiff)](https://pypi.org/project/hcpdiff/)
+[![GitHub stars](https://img.shields.io/github/stars/7eu7d7/HCP-Diffusion)](https://github.com/7eu7d7/HCP-Diffusion/stargazers)
+[![GitHub license](https://img.shields.io/github/license/7eu7d7/HCP-Diffusion)](https://github.com/7eu7d7/HCP-Diffusion/blob/master/LICENSE)
+[![codecov](https://codecov.io/gh/7eu7d7/HCP-Diffusion/branch/main/graph/badge.svg)](https://codecov.io/gh/7eu7d7/HCP-Diffusion)
+[![open issues](https://isitmaintained.com/badge/open/7eu7d7/HCP-Diffusion.svg)](https://github.com/7eu7d7/HCP-Diffusion/issues)
+
+[📘中文说明](./README_cn.md)
+
+[📘English document](https://hcpdiff.readthedocs.io/en/latest/)
+[📘中文文档](https://hcpdiff.readthedocs.io/zh_CN/latest/)
+
+Old HCP-Diffusion V1 at [main branch](https://github.com/IrisRainbowNeko/HCP-Diffusion/tree/main)
+
+## Introduction
+
+**HCP-Diffusion** is a Diffusion model toolbox built on top of the [🐱 RainbowNeko Engine](https://github.com/IrisRainbowNeko/RainbowNekoEngine).  
+It features a clean code structure and a flexible **Python-based configuration file**, making it easier to conduct and manage complex experiments. It includes a wide variety of training components, and compared to existing frameworks, it's more extensible, flexible, and user-friendly.
+
+HCP-Diffusion allows you to use a single `.py` config file to unify training workflows across popular methods and model architectures, including Prompt-tuning (Textual Inversion), DreamArtist, Fine-tuning, DreamBooth, LoRA, ControlNet, ....  
+Different techniques can also be freely combined.
+
+This framework also implements **DreamArtist++**, an upgraded version of DreamArtist based on LoRA. It enables high generalization and controllability with just a single image for training.  
+Compared to the original DreamArtist, it offers better stability, image quality, controllability, and faster training.
+
+---
+
+## Installation
+
+Install via pip:
+
+```bash
+pip install hcpdiff
+# Initialize configuration
+hcpinit
+```
+
+Install from source:
+
+```bash
+git clone https://github.com/7eu7d7/HCP-Diffusion.git
+cd HCP-Diffusion
+pip install -e .
+# Initialize configuration
+hcpinit
+```
+
+Use xFormers to reduce memory usage and accelerate training:
+
+```bash
+# Choose the appropriate xformers version for your PyTorch version
+pip install xformers==?
+```
+
+## 🚀 Python Configuration Files
+RainbowNeko Engine supports configuration files written in a Python-like syntax. This allows users to call functions and classes directly within the configuration file, with function parameters inheritable from parent configuration files. The framework automatically handles the formatting of these configuration files.
+
+For example, consider the following configuration file:
+```python
+dict(
+    layer=Linear(in_features=4, out_features=4)
+)
+```
+During parsing, this will be automatically compiled into:
+```python
+dict(
+    layer=dict(_target_=Linear, in_features=4, out_features=4)
+)
+```
+After parsing, the framework will instantiate the components accordingly. This means users can write configuration files using familiar Python syntax.
+
+---
+
+## ✨ Features
+
+<details>
+<summary>Features</summary>
+
+### 📦 Model Support
+
+| Model Name                | Status      |
+|--------------------------|-------------|
+| Stable Diffusion 1.5     | ✅ Supported |
+| Stable Diffusion XL (SDXL)| ✅ Supported |
+| PixArt                   | ✅ Supported |
+| FLUX                     | 🚧 In Development |
+| Stable Diffusion 3 (SD3) | 🚧 In Development |
+
+---
+
+### 🧠 Fine-Tuning Capabilities
+
+| Feature                         | Description/Support |
+|----------------------------------|---------------------|
+| LoRA Layer-wise Configuration   | ✅ Supported (including Conv2d) |
+| Layer-wise Fine-Tuning          | ✅ Supported |
+| Multi-token Prompt-Tuning       | ✅ Supported |
+| Layer-wise Model Merging        | ✅ Supported |
+| Custom Optimizers               | ✅ Supported (Lion, DAdaptation, pytorch-optimizer, etc.) |
+| Custom LR Schedulers            | ✅ Supported |
+
+---
+
+### 🧩 Extension Method Support
+
+| Method                         | Status      |
+|--------------------------------|-------------|
+| ControlNet (including training)| ✅ Supported |
+| DreamArtist / DreamArtist++    | ✅ Supported |
+| Token Attention Adjustment     | ✅ Supported |
+| Max Sentence Length Extension  | ✅ Supported |
+| Textual Inversion (Custom Tokens)| ✅ Supported |
+| CLIP Skip                      | ✅ Supported |
+
+---
+
+### 🚀 Training Acceleration
+
+| Tool/Library                                       | Supported Modules        |
+|---------------------------------------------------|---------------------------|
+| [🤗 Accelerate](https://github.com/huggingface/accelerate)    | ✅ Supported |
+| [Colossal-AI](https://github.com/hpcaitech/ColossalAI)       | ✅ Supported |
+| [xFormers](https://github.com/facebookresearch/xformers)     | ✅ Supported (UNet and text encoder) |
+
+---
+
+### 🗂 Dataset Support
+
+| Feature                         | Description |
+|----------------------------------|-------------|
+| Aspect Ratio Bucket (ARB)       | ✅ Auto-clustering supported |
+| Multi-source / Multi-dataset    | ✅ Supported |
+| LMDB                            | ✅ Supported |
+| webdataset                      | 🚧 In Development |
+| Local Attention Enhancement     | ✅ Supported |
+| Tag Shuffling & Dropout         | ✅ Multiple tag editing strategies |
+
+---
+
+### 📉 Supported Loss Functions
+
+| Loss Type  | Description |
+|------------|-------------|
+| Min-SNR    | ✅ Supported |
+| SSIM       | ✅ Supported |
+| GWLoss     | ✅ Supported |
+
+---
+
+### 🌫 Supported Diffusion Strategies
+
+| Strategy Type   | Status       |
+|------------------|--------------|
+| DDPM             | ✅ Supported |
+| EDM              | ✅ Supported |
+| Flow Matching    | ✅ Supported |
+
+---
+
+### 🧠 Automatic Evaluation (Step Selection Assistant)
+
+| Feature         | Description/Status                       |
+|------------------|------------------------------------------|
+| Image Preview    | ✅ Supported (workflow preview)           |
+| FID              | 🚧 In Development                        |
+| CLIP Score       | 🚧 In Development                        |
+| CCIP Score       | 🚧 In Development                        |
+| Corrupt Score    | 🚧 In Development                        |
+
+</details>
+
+---
+
+## Getting Started
+
+### Training
+
+HCP-Diffusion provides training scripts based on 🤗 Accelerate.
+
+```bash
+# Multi-GPU training, configure GPUs in cfgs/launcher/multi.yaml
+hcp_train --cfg cfgs/train/py/your_config.py
+
+# Single-GPU training, configure GPU in cfgs/launcher/single.yaml
+hcp_train_1gpu --cfg cfgs/train/py/your_config.py
+```
+
+You can also override config items via command line:
+
+```bash
+# Override base model path
+hcp_train --cfg cfgs/train/py/your_config.py model.wrapper.models.ckpt_path=pretrained_model_path
+```
+
+### Image Generation
+
+Use the workflow defined in the Python config to generate images:
+
+```bash
+hcp_run --cfg cfgs/workflow/text2img.py
+```
+
+Or override parameters via command line:
+
+```bash
+hcp_run --cfg cfgs/workflow/text2img_cli.py \
+    pretrained_model=pretrained_model_path \
+    prompt='positive_prompt' \
+    negative_prompt='negative_prompt' \
+    seed=42
+```
+
+### Tutorials
+
+🚧 In Development
+
+---
+
+## Contributing
+
+We welcome contributions to support more models and features.
+
+---
+
+## Team
+
+Maintained by [HCP-Lab at Sun Yat-sen University](https://www.sysu-hcp.net/).
+
+---
+
+## Citation
+
+```bibtex
+@article{DBLP:journals/corr/abs-2211-11337,
+  author    = {Ziyi Dong and
+               Pengxu Wei and
+               Liang Lin},
+  title     = {DreamArtist: Towards Controllable One-Shot Text-to-Image Generation
+               via Positive-Negative Prompt-Tuning},
+  journal   = {CoRR},
+  volume    = {abs/2211.11337},
+  year      = {2022},
+  doi       = {10.48550/arXiv.2211.11337},
+  eprinttype = {arXiv},
+  eprint    = {2211.11337},
+}
+```

hcpdiff-2.1.dist-info/RECORD

@@ -0,0 +1,114 @@
+hcpdiff/__init__.py,sha256=dwNwrEgvG4g60fGMG6b50K3q3AWD1XCfzlIgbxkSUpE,177
+hcpdiff/train_colo.py,sha256=EsuNSzLBvGTZWU_LEk0JpP-F5eNW0lwkawIRAX38jmE,9250
+hcpdiff/train_deepspeed.py,sha256=PwyNukWi0of6TXy_VRDgBQSMLCZBhipO5g3Lq0nCYNk,2988
+hcpdiff/trainer_ac.py,sha256=6KAzo54in7ZRHud_rHjJdwRRZ4uWtc0B4SxVCxgcrmM,2990
+hcpdiff/trainer_ac_single.py,sha256=0PIC5EScqcxp49EaeIWq4KS5K_09OZfKajqbFu-hUb8,1108
+hcpdiff/ckpt_manager/__init__.py,sha256=LfMwz9R4jV4xpiSFt5vhpwaF7-8UHEZ_iDoW-3QGvt0,239
+hcpdiff/ckpt_manager/ckpt.py,sha256=Pa3uXQbCi2T99mpV5fYddQ-OGHcpk8r1ll-0lmP_WXk,965
+hcpdiff/ckpt_manager/loader.py,sha256=Ch1xsZmseq4nyPhpox9-nebN-dZB4k0rqBEHos-ZLso,3245
+hcpdiff/ckpt_manager/format/__init__.py,sha256=a3cdKkOTDgdVbDQwSC4mlxOigjX2hBvRb5_X7E3TQWs,237
+hcpdiff/ckpt_manager/format/diffusers.py,sha256=T81WN95Nj1il9DfQp9iioVn0uqFEWOlmdIYs2beNOFU,3769
+hcpdiff/ckpt_manager/format/emb.py,sha256=FrqfTfJ8H7f0Zw17NTWCP2AJtpsJI5oXR5IAd4NekhU,680
+hcpdiff/ckpt_manager/format/lora_webui.py,sha256=j7SpXnSx_Ys8tnWBgojuB1HEJIm46lhCBuNNYLhaF9w,9824
+hcpdiff/ckpt_manager/format/sd_single.py,sha256=LpCAL_7nAVooCHTFznVVsNMku1G3C77NBORxxr8GDtQ,2328
+hcpdiff/data/__init__.py,sha256=-z47HsEQSubc-AfriVComMACbQXlXTWAKMOPBkATHxA,258
+hcpdiff/data/dataset.py,sha256=1k4GldW13eVyqK_9hrQniqr3_XYAapnWF7iXl_1GXGg,877
+hcpdiff/data/cache/__init__.py,sha256=ToCmokYH6DghlSwm7HJFirPRIWJ0LkgzqVOYlgoAkQw,25
+hcpdiff/data/cache/vae.py,sha256=gB89zs4CdNlvukDXhVYU9QZrY6VTFUWfzjeF2psNQ50,4070
+hcpdiff/data/handler/__init__.py,sha256=D1HyqY0qfrUHgf25itpYj57JUvgn06G6EQ9d2vRRtys,236
+hcpdiff/data/handler/controlnet.py,sha256=bRDMD9BP8-VaG5VrxzvcFKfkqeTbChNfrJSZ3vXbQgY,658
+hcpdiff/data/handler/diffusion.py,sha256=8n60UYdGNR08xw45HoI4EB5AaIui03tSGNDfjazO-5w,3516
+hcpdiff/data/handler/text.py,sha256=gOzqB2oEkEUbiuy0kZWduo0c-w4Buu60KI6q6Nyl3aM,4208
+hcpdiff/data/source/__init__.py,sha256=AB1VicA272KjTm-Q5L6XvDM8CLQhVPylAPuPMtpfw4g,158
+hcpdiff/data/source/folder_class.py,sha256=bs4qPMTzwcnT6ZFlT3tpi9sclsRF9a2MBA1pQD-9EYs,961
+hcpdiff/data/source/text2img.py,sha256=MWXqAEbzmK6pkBY40t9u37ngY25mgdKQ2idwNld8-bo,1826
+hcpdiff/data/source/text2img_cond.py,sha256=yj1KpARA2rkjENutnnzC4uDkcU2Rye21FL2VdC25Hac,585
+hcpdiff/diffusion/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+hcpdiff/diffusion/noise/__init__.py,sha256=seBpOtd0YsU53PqMn7Nyl_RtwoC-ONEIOX7v2XLGpZQ,93
+hcpdiff/diffusion/noise/pyramid_noise.py,sha256=KbpyMT1BHNIaAa7g5eECDkTttOMoMWVFmbP-ekBsuEY,1693
+hcpdiff/diffusion/noise/zero_terminal.py,sha256=EfVOaqrTCfw11AolDBl0LIOey3uQT1bDw2XKr2Bm434,1532
+hcpdiff/diffusion/sampler/__init__.py,sha256=pSHsKpLjscY5yLbdzHeBUeK9nFDuVeMIIeA_k6FQFdY,158
+hcpdiff/diffusion/sampler/base.py,sha256=2AuPVT2ZSXYt2etZmHMyNKuGlT5zn6KIkoMz4m5PGcs,2577
+hcpdiff/diffusion/sampler/ddpm.py,sha256=raqSuKsEPN1AEqRVCuBdMAOnKDoeJTRO17wtLBNJCf4,523
+hcpdiff/diffusion/sampler/diffusers.py,sha256=XIu-oIlT4LnAYI2-yyIoNeIMeSQe5YpeEvn-FkGVFnE,2684
+hcpdiff/diffusion/sampler/edm.py,sha256=5W4pv8hxQsPpJGiFBgElZxR3C9S8kWAhzGKejEVwq3I,753
+hcpdiff/diffusion/sampler/sigma_scheduler/__init__.py,sha256=kmIoWgsWqij6b7KYon3UOCSC07sRJCo-DPR6qkJwUd0,184
+hcpdiff/diffusion/sampler/sigma_scheduler/base.py,sha256=9-JI-jwf7xZoQUtrU0qfbjkhNZT8a_tmapLtwVbFUx0,381
+hcpdiff/diffusion/sampler/sigma_scheduler/ddpm.py,sha256=2PMIpg2K6CVoxew1y1pIqvCHbdggC-m3amrOYk15OdQ,8107
+hcpdiff/diffusion/sampler/sigma_scheduler/edm.py,sha256=fOPB3lgnS9uVo4oW26Fur_nc8X_wQ6mmUcbkKhnoQjs,1900
+hcpdiff/easy/__init__.py,sha256=-emoyCOZlLCu3KNMI8L4qapUEtEYFSoiGU6-rKv1at4,149
+hcpdiff/easy/sampler.py,sha256=dQSBkeGh71O0DAmZLhTHTbk1bY7XzyUCeW1oJO14A4I,1250
+hcpdiff/easy/cfg/__init__.py,sha256=aVDEDPxHdX5n-aFkP_4ic8ZhQfSeKu8lZOkgW_4m398,221
+hcpdiff/easy/cfg/sd15_train.py,sha256=LRCJLHNU0JEd1m3MC_NFWUCw5LmwztiLiJlV7u_DeKM,6493
+hcpdiff/easy/cfg/sdxl_train.py,sha256=R0wolSVOrRlI9A-vAfz592SzSnwuDd4ku1oc5yRKrfU,4038
+hcpdiff/easy/cfg/t2i.py,sha256=6Pyy4werXNalwoBBHVMBLBg67kMS85Heb7R3t26GJqQ,6871
+hcpdiff/easy/model/__init__.py,sha256=CA-7r3R2Jgweekk1XNByFYttLolbWyUV2bCnXygcD8w,133
+hcpdiff/easy/model/cnet.py,sha256=m0NTH9V1kLzb5GybwBrSNT0KvTcRpPfGkzUeMz9jZZQ,1084
+hcpdiff/easy/model/loader.py,sha256=Tdx-lhQEYf2NYjVM1A5B8x6ZZpJKcXUkFIPIbr7h7XM,3456
+hcpdiff/evaluate/__init__.py,sha256=CtNzi8xdUWZBDBcP5TZTDMcRyykaOJhBIxTJgVuMabo,35
+hcpdiff/evaluate/previewer.py,sha256=QiYYiEJBKP06uL3wKLhnpIGUZuAkr9BuHxTE29obpXI,2432
+hcpdiff/loss/__init__.py,sha256=2dwPczSiv3rB5fzOeYbl5ZHpMU-qXOQlXeOiXdxcxwM,173
+hcpdiff/loss/base.py,sha256=3bvgMbwyPOEA9iSkv0hRHw4VnKjkUCZAENNnDMFilYM,1780
+hcpdiff/loss/gw.py,sha256=0yi1kozuII3xZA6FnjOhINtvScWt1MyBZLBtMKmgojM,1224
+hcpdiff/loss/ssim.py,sha256=YofadvBkc6sklxBUx1p3ADw5OHOZPK3kaHz8FH5a6m4,1281
+hcpdiff/loss/vlb.py,sha256=s78iBnXUiDWfGf7mYmhUnHqxqea5gSByKOoqBrX6bzU,3222
+hcpdiff/loss/weighting.py,sha256=UR2PyZ1JTNOydXMw4e1Fh52XmtwKaviPvddcmVKCTlI,2242
+hcpdiff/models/__init__.py,sha256=eQS7DPiGLiE1MFRkZj_17IY3IsfDUVcYpcOmhHb5B9o,472
+hcpdiff/models/cfg_context.py,sha256=e2B3K1KwJhzbD6xdJUOyNtl_XgQ0296XI3FHw3gvZF4,1502
+hcpdiff/models/container.py,sha256=z3p5TmQhxdzXSIfofz55_bmEhSsgUJsy1o9EcDs8Oeo,696
+hcpdiff/models/controlnet.py,sha256=VIkUzJCVpCqqQOtRSLQPfbcDy9CsXutxLeZB6PdZfA0,7809
+hcpdiff/models/lora_base.py,sha256=LGwBD9KP6qf4pgTx24i5-JLo4rDBQ6jFfterQKBjTbE,6758
+hcpdiff/models/lora_base_patch.py,sha256=WW3CULnROTxKXyynJiqirhHYCKN5JtxLhVpT5b7AUQg,6532
+hcpdiff/models/lora_layers.py,sha256=O9W_Ue71lHj7Y_GbpioF4Hc3h2-z_zOqck93VYUra6s,7777
+hcpdiff/models/lora_layers_patch.py,sha256=GYFYsJD2VSLZfdnLma9CmQEHz09HROFJcc4wc_gs9f0,8198
+hcpdiff/models/text_emb_ex.py,sha256=a5QImxzvj0zWR12qXOPP9kmpESl8J9VLabA0W9D_i_c,7867
+hcpdiff/models/textencoder_ex.py,sha256=JrTQ30Avx8tPbdr-Q6K5BvEWCEdsu8Z7eSOzMqpUuzg,8270
+hcpdiff/models/tokenizer_ex.py,sha256=zKUn4BY7b3yXwK9PWkZtQKJPyKYwUc07E-hwB9NQybs,2446
+hcpdiff/models/compose/__init__.py,sha256=lTNFTGg5csqvUuys22RqgjmWlk_7Okw6ZTsnTi1pqCg,217
+hcpdiff/models/compose/compose_hook.py,sha256=FfDSfn5FuLFGM80HMUwiUopy1P4xDbvKSBDuA6QK2So,6112
+hcpdiff/models/compose/compose_textencoder.py,sha256=tiFoStKOIEH9YzsZQrLki4gra18kMy3wSzSUrVQG1sk,6607
+hcpdiff/models/compose/compose_tokenizer.py,sha256=g3l0pOFv6p7Iigxm6Pqt_iTUXBlO1_SWAQOt0m54IoE,3033
+hcpdiff/models/compose/sdxl_composer.py,sha256=NtMGaFGZTfKsPJSVi2yT-UM6K1WKWtk99XxVmTcKlk8,2164
+hcpdiff/models/wrapper/__init__.py,sha256=HbGQmFnfccr-dtvZKjEv-pmR4cCnF4fwGLKS3tuG_OY,135
+hcpdiff/models/wrapper/pixart.py,sha256=nRUvHSHn4TYg_smC0xpeW-GtUgXss-MuaVPTHpMozDE,1147
+hcpdiff/models/wrapper/sd.py,sha256=D7VDI4OmbLTk9mzYta-C4LJjWfZmuBiDub4t8v1-M9o,11711
+hcpdiff/models/wrapper/utils.py,sha256=NyebMoAPnrgcTHbiIocSD-eGdGdD-V1G_TQuWsRWufw,665
+hcpdiff/parser/__init__.py,sha256=-2dDZ2Ii4zoGQqDTme94q4PpJbBiV6HS5BsDASz4Xbo,33
+hcpdiff/parser/embpt.py,sha256=LgwZ0f0tLn3DrTo5ZpSCsZcA5330UpiW_sK96yEPmOM,1307
+hcpdiff/tools/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+hcpdiff/tools/convert_caption_txt2json.py,sha256=tbBgIphJWvXUoXjtwsnLX2w9IZEY3jTgxbTvUMgukbM,945
+hcpdiff/tools/convert_old_lora.py,sha256=yIP9RGcyQbwT2NNAZtTLgBXs6XJOHRvoHQep0SdqDho,453
+hcpdiff/tools/create_embedding.py,sha256=qbBx3mFPeVcVSeMWn5_-3Dq7EqWn0UTOQg6OurIwDeo,4577
+hcpdiff/tools/dataset_generator.py,sha256=CG28IP1w0XAlEG1xPB0jQi40hVaFGxLe76tnV6hya-E,4639
+hcpdiff/tools/diffusers2sd.py,sha256=MdZirlyztaaO4UAYU_AJa25eTFKfJa08nbHbdcqOdhs,13300
+hcpdiff/tools/download_hf_model.py,sha256=3XZE-GYotE0W5ZQNk78ljZgolYhjbNKxfU-tB9I0yDY,947
+hcpdiff/tools/embedding_convert.py,sha256=JN56dVFcMng8kq9YGS02_Umco71UjDYvwQGeqbhsJXU,1498
+hcpdiff/tools/gen_from_ptlist.py,sha256=j4_wNd9JmsWUOcgkP4q4P1gB1SVnzy0VxY4pJqXM07Q,3105
+hcpdiff/tools/init_proj.py,sha256=XrXxxhIaItywG7HsrloJo-x8w9suZiY35daelzZvjrg,194
+hcpdiff/tools/lora_convert.py,sha256=So14WvSVIm6rU4m1XCajFXDnhq7abpZS95SLbaoyBFU,10058
+hcpdiff/tools/save_model.py,sha256=gbfYi_EfEBZEUcDjle6MDHA19sQWY0zA8_y_LMzHQ7M,428
+hcpdiff/tools/sd2diffusers.py,sha256=vB6OnBLw60sJkdpVZcYEPtKAZW1h8ErbSGSRq0uAiIk,16855
+hcpdiff/utils/__init__.py,sha256=VOLhdNq2mRyqmWxrssIWSZtR_PQ8rFwo2u0uq6GbLHA,45
+hcpdiff/utils/colo_utils.py,sha256=JyLUvVnISa48CnryNLrgVxMo-jxu2UhBq70eYPrkjuI,837
+hcpdiff/utils/inpaint_pipe.py,sha256=CRy1MUlPmHifCAbZnKOP0qbLp2grn7ZbVeaB2qIA4ig,42862
+hcpdiff/utils/net_utils.py,sha256=gdwLYDNKV2t3SP0jBIO3d0HtY6E7jRaf_rmPT8gKZZE,9762
+hcpdiff/utils/pipe_hook.py,sha256=-UDX3FtZGl-bxSk13gdbPXc1OvtbCcpk_fvKxLQo3Ag,31987
+hcpdiff/utils/utils.py,sha256=hZnZP1IETgVpScxES0yIuRfc34TnzvAqmgOTK_56ssw,4976
+hcpdiff/workflow/__init__.py,sha256=t7Zyc0XFORdNvcwHp9AsCtEkhJ3l7Hm41ugngIL0Sag,867
+hcpdiff/workflow/diffusion.py,sha256=yrl2cXE2d2FNeVzYZDRQNLjy5-QnVgOWioIHSmszk2Y,8662
+hcpdiff/workflow/fast.py,sha256=kZt7bKrvpFInSn7GzbkTkpoCSM0Z6IbDjgaDvcbFYf8,1024
+hcpdiff/workflow/flow.py,sha256=FFbFFOAXT4c31L5bHBEB_qeVGuBQDLYhq8kTD1chGNo,2548
+hcpdiff/workflow/io.py,sha256=aTrMR3s44apVJpnSyvZIabW2Op0tslk_Z9JFJl5svm0,2635
+hcpdiff/workflow/model.py,sha256=1gj5yOTefYTnGXVR6JPAfxIwuB69YwN6E-BontRcuyQ,2913
+hcpdiff/workflow/text.py,sha256=FSFUm_zEeZjMeg0qRXZAPplnJkg2pR_2FA3XljpoN2w,5110
+hcpdiff/workflow/utils.py,sha256=xojaMG4lHsymslc8df5uiVXmmBVWpn_Phqka8qzJEWw,2226
+hcpdiff/workflow/vae.py,sha256=cingDPkIOc4qGpOwwhXJK4EQbGoIxO583pm6gGov5t8,3118
+hcpdiff/workflow/daam/__init__.py,sha256=ySIDaxloN-D3qM7OuVaG1BR3D-CibDoXYpoTgw0zUhU,59
+hcpdiff/workflow/daam/act.py,sha256=tHbsFWTYYU4bvcZOo1Bpi_z6ofpJatRYccl4vvf8wIA,2756
+hcpdiff/workflow/daam/hook.py,sha256=z9f9mBjKW21xuUZ-iQxQ0HbWOBXtZrisFB0VNMq6d0U,4383
+hcpdiff-2.1.dist-info/licenses/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
+hcpdiff-2.1.dist-info/METADATA,sha256=NpBZuj23d1gTKPQhJ0TBRV8QsfICa4LCGSk6PJNniSw,9248
+hcpdiff-2.1.dist-info/WHEEL,sha256=CmyFI0kx5cdEMTLiONQRbGQwjIoR1aIYB7eCAQ4KPJ0,91
+hcpdiff-2.1.dist-info/entry_points.txt,sha256=86wPOMzsfWWflTJ-sQPLc7WG5Vtu0kGYBH9C_vR3ur8,207
+hcpdiff-2.1.dist-info/top_level.txt,sha256=shyf78x-HVgykYpsmY22mKG0xIc7Qk30fDMdavdYWQ8,8
+hcpdiff-2.1.dist-info/RECORD,,

{hcpdiff-0.9.1.dist-info → hcpdiff-2.1.dist-info}/WHEEL

@@ -1,5 +1,5 @@
 Wheel-Version: 1.0
-Generator: bdist_wheel (0.42.0)
+Generator: setuptools (78.1.0)
 Root-Is-Purelib: true
 Tag: py3-none-any
 

hcpdiff-2.1.dist-info/entry_points.txt

@@ -0,0 +1,5 @@
+[console_scripts]
+hcp_run = rainbowneko.infer.infer_workflow:run_workflow
+hcp_train = hcpdiff.trainer_ac:hcp_train
+hcp_train_1gpu = hcpdiff.trainer_ac_single:hcp_train
+hcpinit = hcpdiff.tools.init_proj:main

hcpdiff/ckpt_manager/base.py

@@ -1,16 +0,0 @@
-from diffusers import StableDiffusionPipeline
-from diffusers.models.lora import LoRACompatibleLinear
-
-class CkptManagerBase:
-    def __init__(self, **kwargs):
-        pass
-
-    def set_save_dir(self, save_dir, emb_dir=None):
-        raise NotImplementedError()
-
-    def save(self, step, unet, TE, lora_unet, lora_TE, all_plugin_unet, all_plugin_TE, embs, pipe: StableDiffusionPipeline, **kwargs):
-        raise NotImplementedError()
-
-    @classmethod
-    def load(cls, pretrained_model, **kwargs) -> StableDiffusionPipeline:
-        raise NotImplementedError

hcpdiff/ckpt_manager/ckpt_diffusers.py

@@ -1,45 +0,0 @@
-from .base import CkptManagerBase
-import os
-from diffusers import StableDiffusionPipeline, UNet2DConditionModel
-from hcpdiff.models.plugin import BasePluginBlock
-
-
-class CkptManagerDiffusers(CkptManagerBase):
-
-    def set_save_dir(self, save_dir, emb_dir=None):
-        os.makedirs(save_dir, exist_ok=True)
-        self.save_dir = save_dir
-        self.emb_dir = emb_dir
-
-    def save(self, step, unet, TE, lora_unet, lora_TE, all_plugin_unet, all_plugin_TE, embs, pipe: StableDiffusionPipeline, **kwargs):
-        def state_dict_unet(*args, model=unet, **kwargs):
-            plugin_names = {k for k, v in model.named_modules() if isinstance(v, BasePluginBlock)}
-            model_sd = {}
-            for k, v in model.state_dict_().items():
-                for name in plugin_names:
-                    if k.startswith(name):
-                        break
-                else:
-                    model_sd[k] = v
-            return model_sd
-        unet.state_dict_ = unet.state_dict
-        unet.state_dict = state_dict_unet
-
-        def state_dict_TE(*args, model=TE, **kwargs):
-            plugin_names = {k for k, v in model.named_modules() if isinstance(v, BasePluginBlock)}
-            model_sd = {}
-            for k, v in model.state_dict_().items():
-                for name in plugin_names:
-                    if k.startswith(name):
-                        break
-                else:
-                    model_sd[k] = v
-            return model_sd
-        TE.state_dict_ = TE.state_dict
-        TE.state_dict = state_dict_TE
-
-        pipe.save_pretrained(os.path.join(self.save_dir, f"model-{step}"), **kwargs)
-
-    @classmethod
-    def load(cls, pretrained_model, **kwargs) -> StableDiffusionPipeline:
-        return StableDiffusionPipeline.from_pretrained(pretrained_model, **kwargs)

hcpdiff/ckpt_manager/ckpt_pkl.py

@@ -1,138 +0,0 @@
-"""
-ckpt_pkl.py
-====================
-    :Name:        save model with torch
-    :Author:      Dong Ziyi
-    :Affiliation: HCP Lab, SYSU
-    :Created:     8/04/2023
-    :Licence:     MIT
-"""
-
-from typing import Dict
-import os
-
-import torch
-from torch import nn
-
-from hcpdiff.models.lora_base import LoraBlock, LoraGroup, split_state
-from hcpdiff.models.plugin import PluginGroup, BasePluginBlock
-from hcpdiff.utils.net_utils import save_emb
-from .base import CkptManagerBase
-
-class CkptManagerPKL(CkptManagerBase):
-    def __init__(self, plugin_from_raw=False, **kwargs):
-        self.plugin_from_raw = plugin_from_raw
-
-    def set_save_dir(self, save_dir, emb_dir=None):
-        os.makedirs(save_dir, exist_ok=True)
-        self.save_dir = save_dir
-        self.emb_dir = emb_dir
-
-    def exclude_state(self, state, key):
-        if key is None:
-            return state
-        else:
-            return {k: v for k, v in state.items() if key not in k}
-
-    def save_model(self, model: nn.Module, name, step, model_ema=None, exclude_key=None):
-        sd_model = {
-            'base': self.exclude_state(LoraBlock.extract_trainable_state_without_lora(model), exclude_key),
-        }
-        if model_ema is not None:
-            sd_ema, sd_ema_lora = split_state(model_ema.state_dict())
-            sd_model['base_ema'] = self.exclude_state(sd_ema, exclude_key)
-        self._save_ckpt(sd_model, name, step)
-
-    def save_plugins(self, host_model: nn.Module, plugins: Dict[str, PluginGroup], name:str, step:int, model_ema=None):
-        if len(plugins)>0:
-            sd_plugin={}
-            for plugin_name, plugin in plugins.items():
-                sd_plugin['plugin'] = plugin.state_dict(host_model if self.plugin_from_raw else None)
-                if model_ema is not None:
-                    sd_plugin['plugin_ema'] = plugin.state_dict(model_ema)
-                self._save_ckpt(sd_plugin, f'{name}-{plugin_name}', step)
-
-    def save_model_with_lora(self, model: nn.Module, lora_blocks: LoraGroup, name:str, step:int, model_ema=None,
-                             exclude_key=None):
-        sd_model = {
-            'base': self.exclude_state(BasePluginBlock.extract_state_without_plugin(model, trainable=True), exclude_key),
-        } if model is not None else {}
-        if (lora_blocks is not None) and (not lora_blocks.empty()):
-            sd_model['lora'] = lora_blocks.state_dict(model if self.plugin_from_raw else None)
-
-        if model_ema is not None:
-            ema_state = model_ema.state_dict()
-            if model is not None:
-                sd_ema = {k:ema_state[k] for k in sd_model['base'].keys()}
-                sd_model['base_ema'] = self.exclude_state(sd_ema, exclude_key)
-            if (lora_blocks is not None) and (not lora_blocks.empty()):
-                sd_model['lora_ema'] = lora_blocks.state_dict(model_ema)
-
-        self._save_ckpt(sd_model, name, step)
-
-    def _save_ckpt(self, sd_model, name=None, step=None, save_path=None):
-        if save_path is None:
-            save_path = os.path.join(self.save_dir, f"{name}-{step}.ckpt")
-        torch.save(sd_model, save_path)
-
-    def load_ckpt(self, ckpt_path, map_location='cpu'):
-        return torch.load(ckpt_path, map_location=map_location)
-
-    def load_ckpt_to_model(self, model: nn.Module, ckpt_path, model_ema=None):
-        sd = self.load_ckpt(ckpt_path)
-        if 'base' in sd:
-            model.load_state_dict(sd['base'], strict=False)
-        if 'lora' in sd:
-            model.load_state_dict(sd['lora'], strict=False)
-        if 'plugin' in sd:
-            model.load_state_dict(sd['plugin'], strict=False)
-
-        if model_ema is not None:
-            if 'base' in sd:
-                model_ema.load_state_dict(sd['base_ema'])
-            if 'lora' in sd:
-                model_ema.load_state_dict(sd['lora_ema'])
-            if 'plugin' in sd:
-                model_ema.load_state_dict(sd['plugin_ema'])
-
-    def save_embedding(self, train_pts, step, replace):
-        for k, v in train_pts.items():
-            save_path = os.path.join(self.save_dir, f"{k}-{step}.pt")
-            save_emb(save_path, v.data, replace=True)
-            if replace:
-                save_emb(f'{k}.pt', v.data, replace=True)
-
-    def save(self, step, unet, TE, lora_unet, lora_TE, all_plugin_unet, all_plugin_TE, embs, pipe):
-        '''
-
-        :param step:
-        :param unet:
-        :param TE:
-        :param lora_unet: [pos, neg]
-        :param lora_TE: [pos, neg]
-        :param all_plugin_unet:
-        :param all_plugin_TE:
-        :param emb:
-        :param pipe:
-        :return:
-        '''
-        self.save_model_with_lora(unet, lora_unet[0], model_ema=getattr(self, 'ema_unet', None), name='unet', step=step)
-        self.save_plugins(unet, all_plugin_unet, name='unet', step=step, model_ema=getattr(self, 'ema_unet', None))
-
-        if TE is not None:
-            # exclude_key: embeddings should not save with text-encoder
-            self.save_model_with_lora(TE, lora_TE[0], model_ema=getattr(self, 'ema_text_encoder', None),
-                                                   name='text_encoder', step=step, exclude_key='emb_ex.')
-            self.save_plugins(TE, all_plugin_TE, name='text_encoder', step=step,
-                                           model_ema=getattr(self, 'ema_text_encoder', None))
-
-        if lora_unet[1] is not None:
-            self.save_model_with_lora(None, lora_unet[1], name='unet-neg', step=step)
-            if lora_TE[1] is not None:
-                self.save_model_with_lora(None, lora_TE[1], name='text_encoder-neg', step=step)
-
-        self.save_embedding(embs, step, False)
-
-    @classmethod
-    def load(cls, pretrained_model):
-        raise NotImplementedError(f'{cls} dose not support load()')

hcpdiff/ckpt_manager/ckpt_safetensor.py

@@ -1,64 +0,0 @@
-"""
-ckpt_safetensors.py
-====================
-    :Name:        save model with safetensors
-    :Author:      Dong Ziyi
-    :Affiliation: HCP Lab, SYSU
-    :Created:     8/04/2023
-    :Licence:     MIT
-"""
-
-import os
-import torch
-from safetensors import safe_open
-from safetensors.torch import save_file
-
-from .ckpt_pkl import CkptManagerPKL
-
-class CkptManagerSafe(CkptManagerPKL):
-
-    def _save_ckpt(self, sd_model, name=None, step=None, save_path=None):
-        if save_path is None:
-            save_path = os.path.join(self.save_dir, f"{name}-{step}.safetensors")
-        sd_unfold = self.unfold_dict(sd_model)
-        for k, v in sd_unfold.items():
-            if not v.is_contiguous():
-                sd_unfold[k] = v.contiguous()
-        save_file(sd_unfold, save_path)
-
-    def load_ckpt(self, ckpt_path, map_location='cpu'):
-        with safe_open(ckpt_path, framework="pt", device=map_location) as f:
-            sd_fold = self.fold_dict(f)
-        return sd_fold
-
-    @staticmethod
-    def unfold_dict(data, split_key=':'):
-        dict_unfold={}
-
-        def unfold(prefix, dict_fold):
-            for k,v in dict_fold.items():
-                k_new = k if prefix=='' else f'{prefix}{split_key}{k}'
-                if isinstance(v, dict):
-                    unfold(k_new, v)
-                elif isinstance(v, list) or isinstance(v, tuple):
-                    unfold(k_new, {i:d for i,d in enumerate(v)})
-                else:
-                    dict_unfold[k_new]=v
-
-        unfold('', data)
-        return dict_unfold
-
-    @staticmethod
-    def fold_dict(safe_f, split_key=':'):
-        dict_fold = {}
-
-        for k in safe_f.keys():
-            k_list = k.split(split_key)
-            dict_last = dict_fold
-            for item in k_list[:-1]:
-                if item not in dict_last:
-                    dict_last[item] = {}
-                dict_last = dict_last[item]
-            dict_last[k_list[-1]]=safe_f.get_tensor(k)
-
-        return dict_fold