Instructions to use furaidosu/flux-lora-rtmi with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use furaidosu/flux-lora-rtmi with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("furaidosu/flux-lora-rtmi") prompt = "RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a blue pirate coat with gold accents. He has a white shirt underneath, a belt with a gold buckle, and dark pants. His expression is thoughtful, and he has a slight stubble on his face, adding to his adventurous appearance. Guybrush is programming with many computers. Cyberpunk style." image = pipe(prompt).images[0] - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Lisandro commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,57 +9,214 @@ tags:
|
|
| 9 |
- diffusers
|
| 10 |
- lora
|
| 11 |
- replicate
|
| 12 |
-
base_model: black-forest-labs/FLUX.1-
|
| 13 |
pipeline_tag: text-to-image
|
| 14 |
instance_prompt: RTMI
|
| 15 |
library_name: diffusers
|
| 16 |
-
|
| 17 |
inference:
|
| 18 |
parameters:
|
| 19 |
width: 1024
|
| 20 |
height: 1024
|
| 21 |
widget:
|
| 22 |
-
- text:
|
| 23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
output:
|
| 25 |
-
url:
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
output:
|
| 30 |
-
url:
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
output:
|
| 35 |
-
url:
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
output:
|
| 40 |
-
url:
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
output:
|
| 45 |
-
url:
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
output:
|
| 50 |
-
url:
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
example_title: "Spiderman"
|
| 54 |
output:
|
| 55 |
-
url:
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
example_title:
|
| 60 |
output:
|
| 61 |
-
url:
|
| 62 |
-
|
| 63 |
---
|
| 64 |
|
| 65 |
# Flux Lora Rtmi
|
|
@@ -88,4 +245,4 @@ image = pipeline('your prompt').images[0]
|
|
| 88 |
<Gallery />
|
| 89 |
|
| 90 |
|
| 91 |
-
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
|
|
|
| 9 |
- diffusers
|
| 10 |
- lora
|
| 11 |
- replicate
|
| 12 |
+
base_model: black-forest-labs/FLUX.1-schnell
|
| 13 |
pipeline_tag: text-to-image
|
| 14 |
instance_prompt: RTMI
|
| 15 |
library_name: diffusers
|
|
|
|
| 16 |
inference:
|
| 17 |
parameters:
|
| 18 |
width: 1024
|
| 19 |
height: 1024
|
| 20 |
widget:
|
| 21 |
+
- text: >-
|
| 22 |
+
RTMI style. Guybrush threepwood, a tall man with blonde hair, wearing a
|
| 23 |
+
blue pirate coat with gold accents. He has a white shirt underneath, a belt
|
| 24 |
+
with a gold buckle, and dark pants. His expression is thoughtful, and he has
|
| 25 |
+
a slight stubble on his face, adding to his adventurous appearance. Guybrush
|
| 26 |
+
is programming with many computers. Cyberpunk style.
|
| 27 |
+
example_title: Guybrush programmer
|
| 28 |
output:
|
| 29 |
+
url: samples/guybrush-programmer.png
|
| 30 |
+
- text: >-
|
| 31 |
+
RTMI style. An empty interior scene just inside the entrance of a towering
|
| 32 |
+
building constructed and inhabited by cockroaches. The perspective is
|
| 33 |
+
distorted and cartoonish, with the camera positioned as if you're standing
|
| 34 |
+
just past the grand, slightly arched door that leads into the building. The
|
| 35 |
+
interior is a labyrinth of narrow, winding corridors that twist and turn
|
| 36 |
+
unpredictably, with passageways leading up, down, and in all directions,
|
| 37 |
+
creating a sense of disorientation. The ceiling, walls, and floors are all
|
| 38 |
+
pristine white, with the floor retroilluminated, casting a soft glow
|
| 39 |
+
upwards. The hallways have a sleek, futuristic appearance, but are still
|
| 40 |
+
dimly lit, with shadows that accentuate the strange angles of the walls. The
|
| 41 |
+
retro-style TVs embedded in the walls have bright orange plastic casings,
|
| 42 |
+
while the screens emit a soft, white light. The screens are tilted at odd
|
| 43 |
+
angles, flickering with static or displaying quirky, old-school TV shows,
|
| 44 |
+
adding a nostalgic glow to the cold environment. The staircases are modern
|
| 45 |
+
and minimalist, without handrails, their black steps creating a stark
|
| 46 |
+
contrast against the white surroundings. The stairs spiral upward in erratic
|
| 47 |
+
directions, some leading to higher floors, while others abruptly end in dead
|
| 48 |
+
ends. The stairways are crooked, with steps of varying heights and widths,
|
| 49 |
+
enhancing the building’s surreal, disjointed atmosphere. The white walls are
|
| 50 |
+
adorned with subtle, recessed cockroach logos, creating an embossed effect
|
| 51 |
+
that adds texture and detail to the otherwise smooth surfaces. Additional
|
| 52 |
+
doors are scattered throughout the corridor, some leading to hidden rooms,
|
| 53 |
+
while others open into completely dark tunnels. The hallways also bifurcate
|
| 54 |
+
in places, with some passages leading into these pitch-black tunnels,
|
| 55 |
+
creating a sense of mystery and unease. The entire scene is bathed in a mix
|
| 56 |
+
of dim lighting from the ceiling, the soft glow from the floor, and the
|
| 57 |
+
eerie light of the orange TVs, creating a mysterious and slightly unsettling
|
| 58 |
+
atmosphere.
|
| 59 |
+
example_title: Tv nest
|
| 60 |
output:
|
| 61 |
+
url: samples/tv-channel.png
|
| 62 |
+
- text: >-
|
| 63 |
+
RTMI style. textured paper collage The paper texture is very visible. There
|
| 64 |
+
are different textures. The papers are handmade painted with watercolor and
|
| 65 |
+
crayons. An empty stylized game background scene using muted colors, mainly
|
| 66 |
+
blue, yellow, orange, black and violet. A winding path crosses the screen,
|
| 67 |
+
curving from the top left to the bottom right. Below the path, whimsical
|
| 68 |
+
trees with irregular, bulbous shapes and playful, swirling bushes fill the
|
| 69 |
+
scene. To the right stands a cozy, old-fashioned restaurant with large glass
|
| 70 |
+
windows, through which warm, soft light spills onto the empty street.
|
| 71 |
+
Inside, simple wooden tables and chairs are arranged neatly, but the
|
| 72 |
+
restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's
|
| 73 |
+
exterior features a large, aged wooden sign, slightly crooked, with an
|
| 74 |
+
oversized fork carved into it and the text "Crespín Restorán" in quirky,
|
| 75 |
+
uneven letters. Outside, a few tufts of grass poke through the cracks of the
|
| 76 |
+
weathered sidewalk tiles, adding to the rustic charm. The night sky above is
|
| 77 |
+
dark, with a crescent moon shining softly, casting gentle shadows. The
|
| 78 |
+
street is empty and lonely, illuminated by a few antique-style street lamps
|
| 79 |
+
that emit a dim, warm light, contrasting with the cold, bluish light of the
|
| 80 |
+
street itself. The lamps are bent and irregular, with wavy lines, and their
|
| 81 |
+
light creates playful, wavy reflections on the pavement. The visual style in
|
| 82 |
+
these images can be characterized as highly exaggerated and car.
|
| 83 |
+
example_title: Restaurant outdoor
|
| 84 |
output:
|
| 85 |
+
url: samples/restaurant-outdoor.png
|
| 86 |
+
- text: >-
|
| 87 |
+
RTMI game background design. Fisheye lens panorama background for a
|
| 88 |
+
point-and-click game. The horizon is curvy, and the scene is viewed from a
|
| 89 |
+
low angle on a deserted beach with soft, golden sand. In the foreground,
|
| 90 |
+
gentle waves of the deep blue ocean lap against the shore. Far in the
|
| 91 |
+
distance, a steep cliff rises dramatically from the beach, and perched on
|
| 92 |
+
top is a very large wooden cabin with a rustic, adventurous design. The
|
| 93 |
+
cabin features a thatched roof and sturdy log walls in various shades of
|
| 94 |
+
brown. A winding dirt path carves its way up the cliffside, connecting the
|
| 95 |
+
beach with the cabin above. Below the cliff, a small wooden pier extends
|
| 96 |
+
into the water, where a boat is gently swaying in the breeze. On the distant
|
| 97 |
+
horizon, a small picturesque village resembling Capri is nestled on a hill,
|
| 98 |
+
its buildings barely visible against the bright, sunny sky. The entire scene
|
| 99 |
+
is peaceful and tranquil, with the sun casting a warm light over the
|
| 100 |
+
landscape, while the sense of adventure lingers in the air from the towering
|
| 101 |
+
cliff and the solitary wooden cabin above. . This visual style is defined by
|
| 102 |
+
a strong emphasis on exaggerated forms and dynamic compositions. The shapes
|
| 103 |
+
throughout are distorted and twisted, moving away from realistic
|
| 104 |
+
representations and instead creating a world that feels fluid and constantly
|
| 105 |
+
in motion. Buildings and objects often appear bent, curved, or skewed,
|
| 106 |
+
giving the environment a surreal quality that emphasizes a playful and
|
| 107 |
+
imaginative tone. The architecture seems to defy gravity, with structures
|
| 108 |
+
leaning at odd angles, contributing to the overall whimsical feel.
|
| 109 |
+
Perspective is another key aspect of this style, where traditional rules are
|
| 110 |
+
intentionally bent or broken. Instead of using a realistic vanishing point,
|
| 111 |
+
the perspective often resembles a wide-angle or fisheye lens, with objects
|
| 112 |
+
stretching and warping as they recede into the distance. This creates a
|
| 113 |
+
sense of depth that is exaggerated and immersive, drawing the viewer into
|
| 114 |
+
the scene while maintaining a distinctly stylized and cartoonish appearance.
|
| 115 |
+
Lighting is used to define the shapes and enhance the sense of depth and
|
| 116 |
+
dimension. Highlights and shadows are applied in a bold, almost graphic
|
| 117 |
+
manner, bringing out the contours of the objects and creating a strong
|
| 118 |
+
contrast between different elements. This approach adds to the overall
|
| 119 |
+
dynamism of the composition, making the scenes feel energetic and full of
|
| 120 |
+
life. The compositions themselves are carefully structured to guide the
|
| 121 |
+
viewer’s eye across the scene. The use of exaggerated perspective and
|
| 122 |
+
distorted shapes creates a visual flow that leads from one area to another,
|
| 123 |
+
encouraging exploration and engagement with the environment. This sense of
|
| 124 |
+
movement within the static image helps to reinforce the idea of a world that
|
| 125 |
+
is in constant flux, where nothing is quite as it seems. Overall, the style
|
| 126 |
+
focuses on distortion, dynamic perspective, and strong lighting to create an
|
| 127 |
+
engaging and surreal visual experience. The world feels lively and
|
| 128 |
+
imaginative, with every element contributing to a cohesive and playful
|
| 129 |
+
aesthetic that invites the viewer into its unique and fantastical universe.
|
| 130 |
+
example_title: Beach
|
| 131 |
output:
|
| 132 |
+
url: samples/beach-01.png
|
| 133 |
+
- text: >-
|
| 134 |
+
RTMI illustration style. View from a cliffside lookout, looking down towards
|
| 135 |
+
large rocks and the ocean below. The edge of the cliff is covered in rough,
|
| 136 |
+
gray rocks with small cracks and patches of resilient vegetation growing
|
| 137 |
+
between them. The deep blue ocean below gently crashes against the rocks at
|
| 138 |
+
the base of the cliff, creating swirls of white foam. Some of the rocks are
|
| 139 |
+
partially submerged in water, while others jut out, weathered by the waves.
|
| 140 |
+
On the right, the ocean extends toward the horizon, with the sunlight
|
| 141 |
+
reflecting off the water, creating bright glimmers. The sky above is clear,
|
| 142 |
+
with soft sunlight bathing the scene. The atmosphere is peaceful, with soft
|
| 143 |
+
shadows cast on the rocks and water. The base of the cliff is composed of
|
| 144 |
+
dark, rugged rocks with patches of algae that catch the light, while gentle
|
| 145 |
+
waves leave traces of foam as they break against the rocks. . The visual
|
| 146 |
+
style in these images can be characterized as highly exaggerated and
|
| 147 |
+
cartoonish, with a playful use of perspective and distortion. The style
|
| 148 |
+
features bold and vibrant color schemes, where each area of the scene uses a
|
| 149 |
+
limited but intense palette, allowing the shapes and forms to stand out
|
| 150 |
+
sharply. These colors are often applied in large, flat planes, giving the
|
| 151 |
+
visuals a somewhat graphic novel-like quality, even though they are rendered
|
| 152 |
+
with a painterly texture. The perspective is notably warped, creating an
|
| 153 |
+
almost fisheye lens effect in some cases. This warping is especially evident
|
| 154 |
+
in how walls and floors curve unnaturally, as if the viewer is seeing the
|
| 155 |
+
scene through a distorted lens. This creates a surreal and exaggerated space
|
| 156 |
+
that enhances the whimsical and absurd nature of the scenes. Shapes are
|
| 157 |
+
angular, with a mix of sharp and flowing lines. There’s a clear emphasis on
|
| 158 |
+
abstraction, where objects and architectural elements are simplified to
|
| 159 |
+
their most recognizable forms but are bent and twisted to fit the playful
|
| 160 |
+
tone of the scene. The use of negative space is also significant, where
|
| 161 |
+
shadows and silhouettes create dynamic contrasts, further adding to the
|
| 162 |
+
overall exaggerated aesthetic. The perspective does not follow strict rules
|
| 163 |
+
of realism. Instead, it is dynamically altered to guide the viewer’s eye
|
| 164 |
+
across the scene, often leading to a sense of depth through exaggerated
|
| 165 |
+
angles. The lens-like distortion pulls the edges of the scene outward,
|
| 166 |
+
creating a sense of expansion, as if the environment is stretching away from
|
| 167 |
+
the viewer. This helps to create a visually engaging and immersive
|
| 168 |
+
experience, despite the flatness of the color application. Overall, the
|
| 169 |
+
style combines vibrant, exaggerated color with distorted shapes and a
|
| 170 |
+
playful approach to perspective, resulting in a visually unique and
|
| 171 |
+
whimsical world that feels both surreal and immersive. The style is a
|
| 172 |
+
collage that emphasizes texture and a handmade feel. Use simple geometric
|
| 173 |
+
shapes cut from textured paper, incorporating a mix of rough, uneven edges
|
| 174 |
+
to mimic the look of hand-torn paper. Incorporate crayon or pastel-like
|
| 175 |
+
effects on some of the elements, adding a slightly uneven, grainy texture.
|
| 176 |
+
The colors should be soft and muted, with subtle variations in hue, as if
|
| 177 |
+
lightly shaded or colored by hand. The background should have a textured,
|
| 178 |
+
almost sponge-like appearance, with visible brush strokes or speckled
|
| 179 |
+
effects. Overall, the piece should have a playful, handcrafted look,
|
| 180 |
+
combining the rough, tactile qualities of traditional collage with the
|
| 181 |
+
expressive, childlike feel of crayon or pastel artwork.
|
| 182 |
+
example_title: Cliff
|
| 183 |
output:
|
| 184 |
+
url: samples/punta-01.png
|
| 185 |
+
- text: >-
|
| 186 |
+
RTMI cartoon character design. The image shows two singers passionately
|
| 187 |
+
performing on stage, both holding microphones and singing with great
|
| 188 |
+
emotion. The man on the left is bald, with a neatly trimmed beard and
|
| 189 |
+
wearing a dark blue suit jacket over a white shirt. His head is tilted
|
| 190 |
+
slightly upward as he sings, with his mouth wide open, conveying intensity
|
| 191 |
+
and energy. His right hand grips the microphone tightly, and his left hand
|
| 192 |
+
is extended outwards, as if emphasizing the power of his performance. To
|
| 193 |
+
his right is a woman with long, curly blonde hair cascading over her
|
| 194 |
+
shoulders. She is wearing a black, sparkling dress with a deep neckline, and
|
| 195 |
+
she too is singing with enthusiasm. Her expression is powerful, with her
|
| 196 |
+
mouth open wide as she belts out a note. She holds her microphone in her
|
| 197 |
+
right hand, while her left hand is extended in a dramatic gesture, as if
|
| 198 |
+
reaching out to the audience. She wears a watch on her left wrist and a ring
|
| 199 |
+
on her right hand, adding to her glamorous appearance. The background
|
| 200 |
+
features a stage with a decorative backdrop that includes a large circular
|
| 201 |
+
design in shades of yellow and orange, resembling an abstract sun. Overhead,
|
| 202 |
+
green stage lights illuminate the scene, casting a vibrant glow on the
|
| 203 |
+
performers. Behind them, a dark curtain provides contrast, making the
|
| 204 |
+
singers stand out even more. The atmosphere is lively, with the lighting
|
| 205 |
+
and their dynamic expressions capturing the essence of a passionate
|
| 206 |
+
performance.
|
| 207 |
+
example_title: Singers
|
| 208 |
output:
|
| 209 |
+
url: samples/singers-01.png
|
| 210 |
+
- text: RTMI style. illustration of spiderman at the comic con
|
| 211 |
+
example_title: Spiderman
|
|
|
|
| 212 |
output:
|
| 213 |
+
url: samples/spiderman.png
|
| 214 |
+
- text: >-
|
| 215 |
+
RTMI style. character design. The image depicts Monna Lisa by leonardo da
|
| 216 |
+
vinci in cartoon RTMI style.
|
| 217 |
+
example_title: Monna Lisa
|
| 218 |
output:
|
| 219 |
+
url: samples/monna-lisa-03.png
|
|
|
|
| 220 |
---
|
| 221 |
|
| 222 |
# Flux Lora Rtmi
|
|
|
|
| 245 |
<Gallery />
|
| 246 |
|
| 247 |
|
| 248 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|