--- license: mit pipeline_tag: image-text-to-image library_name: diffusers tags: - comfyui - text-to-image - image-editing - fp16 - distilled language: - en - zh --- # HiDream-O1-Image-Dev — FP16 (ComfyUI) This is the **FP16** conversion of [HiDream-ai/HiDream-O1-Image-Dev](https://huggingface.co/HiDream-ai/HiDream-O1-Image-Dev) — the **distilled** variant of HiDream-O1-Image — for use with **ComfyUI**. The Dev model runs in just **28 steps** (half the steps of the full model) making it significantly faster while retaining strong output quality. ![image](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/Mvay8HZHbtT-iyAflNy1I.png) > **Custom ComfyUI Node:** [Saganaki22/HiDream_O1-ComfyUI](https://github.com/Saganaki22/HiDream_O1-ComfyUI) ![Screenshot 2026-05-10 005045](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/svXL5KJJ9VCUhUoEJHukD.png) --- ## Dev vs Full — Key Differences | | Full Model | Dev Model (this repo) | | :--- | :---: | :---: | | Inference Steps | 50 | **28** | | Guidance Scale (CFG) | 5.0 | **0.0 (disabled)** | | Shift | 3.0 | 1.0 | | Scheduler | FlowUniPCMultistepScheduler | FlashFlowMatchEulerDiscreteScheduler | | Speed | Slower, more detail | **~2× faster** | The Dev model uses a custom Euler scheduler with built-in noise scaling tuned for fewer steps. CFG is disabled — negative prompts have no effect in Dev mode. > **BF16 vs FP16:** Both use 16 bits per weight and have identical VRAM usage. BF16 has a wider dynamic range; FP16 has higher mantissa precision. Differences at inference are typically negligible. If you encounter NaN/Inf errors with FP16, switch to the BF16 variant. --- ## VRAM Requirements | Precision | Approximate VRAM | | :--- | :---: | | BF16 | 17 – 20 GB | | FP16 (this repo) | **17 – 20 GB** | | FP8 Mixed | ~10 GB | --- ## Quick Start — ComfyUI ### 1. Install the Custom Node ```bash cd ComfyUI/custom_nodes git clone https://github.com/Saganaki22/HiDream_O1-ComfyUI.git cd HiDream_O1-ComfyUI python -m pip install -r requirements.txt ``` Or search for `HiDream O1` in **ComfyUI Manager**. Suggested transformers version: **4.57.1 – 5.3** (newer versions may break compatibility). ### 2. Download the Weights Download the **entire model folder** (all files, not just the safetensors) and place it in `ComfyUI/models/diffusion_models/`: ```bash huggingface-cli download drbaph/HiDream-O1-Image-Dev-FP16 \ --local-dir ComfyUI/models/diffusion_models/HiDream-O1-Image-Dev-fp16 ``` The folder must contain the full Hugging Face support files alongside the weights: `config.json`, `chat_template.json`, `generation_config.json`, `preprocessor_config.json`, `tokenizer.json`, `tokenizer_config.json`, `vocab.json`, `merges.txt`, `model.safetensors` ### 3. Load in ComfyUI Use the workflow provided in the custom node repository. The loader will detect `dev` in the folder name and automatically apply Dev settings (28 steps, no CFG, Euler scheduler). Point the model loader to `HiDream-O1-Image-Dev-fp16`. --- ## About HiDream-O1-Image HiDream-O1-Image is a natively unified image generative foundation model built on a **Pixel-level Unified Transformer (UiT)** — no external VAEs, no disjoint text encoders. It encodes raw pixels, text, and task-specific conditions in a single shared token space, supporting: - **Text-to-image generation** up to 2,048 × 2,048 - **Instruction-based image editing** - **Subject-driven personalization** (multi-reference IP) - **Long-text and multilingual text rendering** At only 9B parameters it matches or exceeds much larger open-source DiTs and leading closed-source models. It debuted at **#8 in the Artificial Analysis Text to Image Arena** (2026-05-05). --- ## Key Features - 🧬 **Pixel-Level Unified Transformer** — end-to-end on raw pixels, no VAE, no disjoint text encoder - 🎨 **One Model, Many Tasks** — T2I, editing, personalization, storyboard generation - ⚡ **28-Step Distilled Dev** — ~2× faster than the full model with minimal quality trade-off - 🖼️ **Native High Resolution** — direct synthesis up to 2,048 × 2,048 --- ## All Model Variants ### Full Model | Repo | Precision | VRAM | Steps | | :--- | :---: | :---: | :---: | | [drbaph/HiDream-O1-Image-BF16](https://huggingface.co/drbaph/HiDream-O1-Image-BF16) | BF16 | 17–20 GB | 50 | | [drbaph/HiDream-O1-Image-FP16](https://huggingface.co/drbaph/HiDream-O1-Image-FP16) | FP16 | 17–20 GB | 50 | | [drbaph/HiDream-O1-Image-FP8](https://huggingface.co/drbaph/HiDream-O1-Image-FP8) | FP8 Mixed | ~10 GB | 50 | ### Dev Model (distilled, faster) | Repo | Precision | VRAM | Steps | | :--- | :---: | :---: | :---: | | [drbaph/HiDream-O1-Image-Dev-BF16](https://huggingface.co/drbaph/HiDream-O1-Image-Dev-BF16) | BF16 | 17–20 GB | **28** | | [drbaph/HiDream-O1-Image-Dev-FP16](https://huggingface.co/drbaph/HiDream-O1-Image-Dev-FP16) *(this repo)* | FP16 | 17–20 GB | **28** | | [drbaph/HiDream-O1-Image-Dev-FP8](https://huggingface.co/drbaph/HiDream-O1-Image-Dev-FP8) | FP8 Mixed | ~10 GB | **28** | --- ## License The original HiDream-O1-Image model and code are released under the **MIT License**. This FP16 conversion inherits the same license. --- ## Links - 🔗 Original Dev model: [HiDream-ai/HiDream-O1-Image-Dev](https://huggingface.co/HiDream-ai/HiDream-O1-Image-Dev) - 🔗 Original Full model: [HiDream-ai/HiDream-O1-Image](https://huggingface.co/HiDream-ai/HiDream-O1-Image) - 🔧 ComfyUI node: [Saganaki22/HiDream_O1-ComfyUI](https://github.com/Saganaki22/HiDream_O1-ComfyUI) - 📑 Technical report: [HiDream-O1-Image.pdf](https://github.com/HiDream-ai/HiDream-O1-Image/blob/main/assets/HiDream-O1-Image.pdf) - 🤗 Online demo: [HiDream-O1-Image-Dev Space](https://huggingface.co/spaces/HiDream-ai/HiDream-O1-Image-Dev)