Instructions to use alvarobartt/ghibli-characters-flux-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use alvarobartt/ghibli-characters-flux-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("alvarobartt/ghibli-characters-flux-lora") prompt = "Ghibli style futuristic stormtrooper with glossy white armor and a sleek helmet, standing heroically on a lush alien planet, vibrant flowers blooming around, soft sunlight illuminating the scene, a gentle breeze rustling the leaves" image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -72,13 +72,11 @@ pipeline_tag: text-to-image
|
|
| 72 |
This repository contains the LoRA adapter for [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), fine-tuned using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training)
|
| 73 |
with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).
|
| 74 |
|
| 75 |
-
The captions were written down manually by a single annotator, and following the exact same promp template as explained below.
|
| 76 |
-
|
| 77 |
## Prompt Template
|
| 78 |
|
| 79 |
-
You should use the following template:
|
| 80 |
|
| 81 |
-
"Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]
|
| 82 |
|
| 83 |
## Inference with `diffusers`
|
| 84 |
|
|
@@ -113,4 +111,7 @@ image.save("ghibli.png", format="PNG")
|
|
| 113 |
|
| 114 |
## Disclaimer
|
| 115 |
|
| 116 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
This repository contains the LoRA adapter for [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev), fine-tuned using [fal.ai/models/fal-ai/flux-lora-general-training](https://fal.ai/models/fal-ai/flux-lora-general-training)
|
| 73 |
with Studio Ghibli images free-to-use downloaded manually from https://ghibli.jp and hosted at [alvarobartt/ghibli-characters](https://huggingface.co/datasets/alvarobartt/ghibli-characters).
|
| 74 |
|
|
|
|
|
|
|
| 75 |
## Prompt Template
|
| 76 |
|
| 77 |
+
You should use the following template (defined when annotating the images with the captions) to trigger the image generation:
|
| 78 |
|
| 79 |
+
"Ghibli style [character description] with [distinctive features], [action or pose], [environment or background], [lighting or atmosphere], [additional details]"
|
| 80 |
|
| 81 |
## Inference with `diffusers`
|
| 82 |
|
|
|
|
| 111 |
|
| 112 |
## Disclaimer
|
| 113 |
|
| 114 |
+
This fine-tune is for **personal-use only**, with **no-commercial purposes** as stated within the licensing.
|
| 115 |
+
|
| 116 |
+
The FLUX.1-dev fine-tunes fall under the same license as FLUX.1-dev i.e. https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md;
|
| 117 |
+
and the Studio Ghibli dataset is released with a custom non-commercial license based on the interpretation of the findings on their website.
|