Instructions to use mingyi456/Chroma1-Flash-DF11-ComfyUI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusion Single File
How to use mingyi456/Chroma1-Flash-DF11-ComfyUI with Diffusion Single File:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
| license: apache-2.0 | |
| language: | |
| - en | |
| pipeline_tag: text-to-image | |
| tags: | |
| - comfyui | |
| - diffusion-single-file | |
| base_model: | |
| - lodestones/Chroma1-Flash | |
| base_model_relation: quantized | |
| ## Update: I have uploaded an updated version of this model, that should further reduce disk size and VRAM usage by ~82 MB. This is because I missed out on compressing a small portion of the model (the `distilled_guidance_layers`) in my original upload. There is <u>no need to download again</u> if you are not having any issues with the older version, but please either update to the latest version of my DF11 custom node fork, or update the patched `pattern_dict` as shown below if you are still using the official node. I apologize for my earlier oversight. | |
| For more information (including how to compress models yourself), check out https://huggingface.co/DFloat11 and https://github.com/LeanModels/DFloat11 | |
| Feel free to request for other models for compression as well, although compressing models that do not use the Flux architecture might be slightly tricky for me. | |
| ### How to Use | |
| #### ComfyUI | |
| Install my own fork of the DF11 ComfyUI custom node: https://github.com/mingyi456/ComfyUI-DFloat11-Extended. After installing the DF11 custom node, use the provided workflow [json](Chroma1-Flash-DF11-workflow.json), or simply replace the "Load Diffusion Model" node of an existing Chroma workflow with the "DFloat11 Model Loader" node. If you run into any issues, feel free to leave a comment. The workflow is also embedded in the below [png](Chroma1-Flash-DF11-workflow.png) image. | |
|  | |
| #### `diffusers` | |
| Refer to this [model](https://huggingface.co/mingyi456/Chroma1-Flash-DF11) instead. | |
| ### Compression Details | |
| This is the `pattern_dict` for compressing Chroma-based models in ComfyUI: | |
| ```python | |
| pattern_dict_comfyui = { | |
| r"distilled_guidance_layer\.layers\.\d+": ( | |
| "in_layer", | |
| "out_layer" | |
| ), | |
| r"double_blocks\.\d+": ( | |
| "img_attn.qkv", | |
| "img_attn.proj", | |
| "img_mlp.0", | |
| "img_mlp.2", | |
| "txt_attn.qkv", | |
| "txt_attn.proj", | |
| "txt_mlp.0", | |
| "txt_mlp.2", | |
| ), | |
| r"single_blocks\.\d+": ( | |
| "linear1", | |
| "linear2", | |
| ), | |
| } | |
| ``` |