mingyi456's picture
Update README.md
13146ea
|
Raw
History Blame
2.25 kB
---
license: apache-2.0
language:
- en
pipeline_tag: text-to-image
tags:
- comfyui
- diffusion-single-file
base_model:
- lodestones/Chroma1-Flash
base_model_relation: quantized
---
## Update: I have uploaded an updated version of this model, that should further reduce disk size and VRAM usage by ~82 MB. This is because I missed out on compressing a small portion of the model (the `distilled_guidance_layers`) in my original upload. There is <u>no need to download again</u> if you are not having any issues with the older version, but please either update to the latest version of my DF11 custom node fork, or update the patched `pattern_dict` as shown below if you are still using the official node. I apologize for my earlier oversight.
For more information (including how to compress models yourself), check out https://huggingface.co/DFloat11 and https://github.com/LeanModels/DFloat11
Feel free to request for other models for compression as well, although compressing models that do not use the Flux architecture might be slightly tricky for me.
### How to Use
#### ComfyUI
Install my own fork of the DF11 ComfyUI custom node: https://github.com/mingyi456/ComfyUI-DFloat11-Extended. After installing the DF11 custom node, use the provided workflow [json](Chroma1-Flash-DF11-workflow.json), or simply replace the "Load Diffusion Model" node of an existing Chroma workflow with the "DFloat11 Model Loader" node. If you run into any issues, feel free to leave a comment. The workflow is also embedded in the below [png](Chroma1-Flash-DF11-workflow.png) image.
![](Chroma1-Flash-DF11-workflow.png)
#### `diffusers`
Refer to this [model](https://huggingface.co/mingyi456/Chroma1-Flash-DF11) instead.
### Compression Details
This is the `pattern_dict` for compressing Chroma-based models in ComfyUI:
```python
pattern_dict_comfyui = {
r"distilled_guidance_layer\.layers\.\d+": (
"in_layer",
"out_layer"
),
r"double_blocks\.\d+": (
"img_attn.qkv",
"img_attn.proj",
"img_mlp.0",
"img_mlp.2",
"txt_attn.qkv",
"txt_attn.proj",
"txt_mlp.0",
"txt_mlp.2",
),
r"single_blocks\.\d+": (
"linear1",
"linear2",
),
}
```