---
tags:
- comfyui
- int4
- convrot
- w4a4
- krea2
- qwenimage
- fireredimageedit
- qwen2_5_vl
- qwen3
- qwen3_vl
- Quantizations
---
For non-INT4 models, go to https://huggingface.co/ariaotp/int8-ComfyUI instead.

These models are quantized INT4 Convrot W4A4 for ComfyUI 0.28.0 or later. It has somewhat inferior image quality than BF16/GGUF Q8/INT8 Convrot but fast in Ampere(RTX30x0)/Ada Lovelace(RTX40x0)

Original models that I used:

 * Krea2 Turbo: https://huggingface.co/LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed
 * Krea2 Raw: https://huggingface.co/LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed
 * Qwen-Image-2512: https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI
 * Qwen-Image-Edit-2511: https://huggingface.co/LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed
 * FireRed-Image-Edit 1.1: https://huggingface.co/cocorang/FireRed-Image-Edit-1.1-FP8_And_BF16
 * FLUX.2 Klein 9B: https://huggingface.co/black-forest-labs/FLUX.2-klein-9B
 * Qwen2.5-VL 7B (Qwen2.5-VL-7B-Instruct-abliterated): https://huggingface.co/huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated (Needed for Qwen-Image and FireRed-Image-Edit)
 * Qwen3 4B (Huihui-Qwen3-4B-abliterated-v2): https://huggingface.co/chinmankokumin/Qwen3-4B-abliterated-v2 (Needed for Z-Image and FLUX.2 Klein 4B)
 * Qwen3 8B (Huihui-Qwen3-8B-abliterated-v2): https://huggingface.co/huihui-ai/Huihui-Qwen3-8B-abliterated-v2 (Needed for FLUX.2 Klein 9B)
 * Qwen3-VL 4B (Huihui-Qwen3-VL-4B-Instruct-abliterated): https://huggingface.co/ahmed22xa/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy (Needed for Krea2)
 * Qwen3-VL 8B (Huihui-Qwen3-VL-8B-Instruct-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated (Needed for Boogu-Image and Ideogram4)

For Krea2 models and Qwen-Image-Edit 2511, Since they are already quantized INT4 ConvRot W4A4 by LAXMAYDAY, I fixed keys of those models to convrot_w4a4 for working on official ComfyUI.

That python script I created used ChatGPT 5.6 Sol is convert_int4_tensorwise_to_convrot_w4a4.py.

The rest of them are used Starnodes Model Converter, made by Starnodes2024, quantized from BF16 models https://github.com/Starnodes2024/comfyui-starnodes-modelconverter
Or quant_int8_convrot.py of ComfyUI's official ComfyUI model tools https://github.com/Comfy-Org/comfy-model-tools

convert_int4_tensorwise_to_convrot_w4a4.py Script usage (not so useful because I already converted and uploaded)

Not actual convert, but test run

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors --dry-run

Save to new model(convrot_w4a4 model for ComfyUI)

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors model_convrot_w4a4.safetensors
 *default output name: 'model.convrot_w4a4.safetensors'

Overwrite original model

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors --in-place

Overwrite existing file

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors model_convrot_w4a4.safetensors --force

Keep original scale scape [N,1]

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors --keep-scale-shape

If that model doesn't have "convrot: true", but it's convrot_w4a4 model:

 * python convert_int4_tensorwise_to_convrot_w4a4.py model.safetensors --assume-convrot

*WARNING: If you convert non-ConvRot int4_tensorwise model, it should be MALFUCTIONS!

Can convert these models for official ComfyUI:

 * https://huggingface.co/LAXMAYDAY/Krea-2-Turbo-int4-tensorwise-mixed
 * https://huggingface.co/LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed
 * https://huggingface.co/LAXMAYDAY/Qwen-Image-Edit-2511-int4-tensorwise-mixed

License

Qwen-Image, Qwen-Image-Edit, FireRed-Image-Edit, Qwen2.5-VL, Qwen3, Qwen3-VL: Apache 2.0
 * https://www.apache.org/licenses/LICENSE-2.0.txt

Krea2: Krea 2 Community License
 * https://www.krea.ai/krea-2-licensing

FLUX.2 Klein 9B: FLUX Non-Commercial License
 * https://github.com/black-forest-labs/flux2/blob/main/model_licenses/LICENSE-FLUX-NON-COMMERICAL

convert_int4_tensorwise_to_convrot_w4a4.py: MIT
 * https://opensource.org/license/mit