Image-to-Image
Diffusers
StableDiffusionXLControlNetInpaintPipeline
stable-diffusion-xl
lora
template:sd-lora
inpainting
light-estimation
relighting
Instructions to use DiffusionLight/TurboLoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use DiffusionLight/TurboLoRA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("DiffusionLight/TurboLoRA") prompt = "a perfect mirrored reflective chrome ball sphere, a perfect black dark mirrored reflective chrome ball sphere" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
| license: mit | |
| base_model: | |
| - stabilityai/stable-diffusion-xl-base-1.0 | |
| pipeline_tag: image-to-image | |
| tags: | |
| - image-to-image | |
| - StableDiffusionXLControlNetInpaintPipeline | |
| - stable-diffusion-xl | |
| - lora | |
| - diffusers | |
| - template:sd-lora | |
| - inpainting | |
| - light-estimation | |
| - relighting | |
| instance_prompt: >- | |
| a perfect mirrored reflective chrome ball sphere, a perfect black dark | |
| mirrored reflective chrome ball sphere | |
| inference: false | |
| # DiffusionLight's TurboLoRA | |
| [Project Page](https://diffusionlight.github.io/turbo) | [Code](https://github.com/DiffusionLight/DiffusionLight-Turbo-diffusers) | |
| [ | |
| <table> | |
| <thead> | |
| <tr> | |
| <th colspan="3"> | |
| <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/backpacker_seed400.jpg" /> | |
| </th> | |
| <th colspan="3"> | |
| <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/brick_apartment_seed400.jpg" /> | |
| </th> | |
| <th colspan="3"> | |
| <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/yuurakuchou_seed600.jpg" /> | |
| </th> | |
| <th colspan="3"> | |
| <img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild/hill_seed800.jpg" /> | |
| </th> | |
| </tr> | |
| </thead> | |
| <tbody> | |
| <tr> | |
| <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_backpacker_seed400.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_backpacker_seed400.png" /></td> | |
| <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_brick_apartment_seed400.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_brick_apartment_seed400.png" /></td> | |
| <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_yuurakuchou_seed600.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_yuurakuchou_seed600.png" /></td> | |
| <td><p align="center"><b>DiffusionLight-Turbo</b> <br> <code style="color : greenyellow">30 seconds</code></p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_turbo_hill_seed800.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_turbo_hill_seed800.png" /></td> | |
| </tr> | |
| <tr> | |
| <td><p align="center">DiffusionLight <br> 30 Minutes</p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_backpacker_seed400.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_backpacker_seed400.png" /></td> | |
| <td><p align="center">DiffusionLight <br> 30 Minutes</p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_brick_apartment_seed400.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_brick_apartment_seed400.png" /></td> | |
| <td><p align="center">DiffusionLight <br> 30 Minutes</p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_yuurakuchou_seed600.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_yuurakuchou_seed600.png" /></td> | |
| <td><p align="center">DiffusionLight <br> 30 Minutes</p></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-normal_diffusionlight_hill_seed800.png" /></td> | |
| <td><img src="https://diffusionlight.github.io/turbo/assets/images/in-the-wild-ball/ball-dark_diffusionlight_hill_seed800.png" /></td> | |
| </tr> | |
| <tr> | |
| <td></td> | |
| <td><p align="center">Normally exposed</p></td> | |
| <td><p align="center">Underexposed</p></td> | |
| <td></td> | |
| <td><p align="center">Normally exposed</p></td> | |
| <td><p align="center">Underexposed</p></td> | |
| <td></td> | |
| <td><p align="center">Normally exposed</p></td> | |
| <td><p align="center">Underexposed</p></td> | |
| <td></td> | |
| <td><p align="center">Normally exposed</p></td> | |
| <td><p align="center">Underexposed</p></td> | |
| </tr> | |
| </tbody> | |
| </table> | |
| ## Usage | |
| This repository is the weight for an example code that shows how to implement DiffusionLight-Turbo `inpaint.py` in Diffusers `0.33.0` | |
| We recommend checking out Github Repository: [Github](https://github.com/DiffusionLight/DiffusionLight-Turbo-diffusers) | |
| Note that the Weight is the same as 'DiffusionLight/Flicker2k', but due to diffusers 0.33.0 breaking the compatibility, we have to store it in a separate model. | |
| ## Download model | |
| Weights for this model are available in Safetensors format. | |
| [Download](/DiffusionLight/TurboLoRA/tree/main) them in the Files & versions tab. | |
| ## Trigger words | |
| | Chromeball | Prompt | | |
| | ----------- | ----------- | | |
| | Normally exposed | a perfect mirrored reflective chrome ball sphere | | |
| | Underexposed | a perfect **black dark** mirrored reflective chrome ball sphere | | |
| ## Citation | |
| ``` | |
| @inproceedings{Chinchuthakun2025DiffusionLightTurbo, | |
| author = {Chinchuthakun, Worameth and Phongthawee, Pakkapon and Raj, Amit and Jampani, Varun and Khungurn, Pramook and Suwajanakorn, Supasorn}, | |
| title = {DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting}, | |
| booktitle = {ArXiv}, | |
| year = {2025}, | |
| } | |
| ``` | |
| ## Visit us 🦉 | |
| [](https://vistec.ist/vision) [](https://vistec.ist/) | |