Wild-Heart/Disney-VideoGeneration-Dataset
Viewer • Updated • 69 • 488 • 28
How to use a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003 with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
from diffusers.utils import export_to_video
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("THUDM/CogVideoX-5b", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003")
prompt = "A man with short gray hair plays a red electric guitar."
output = pipe(prompt=prompt).frames[0]
export_to_video(output, "output.mp4")These are a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003 LoRA weights for THUDM/CogVideoX-5b.
The weights were trained using the CogVideoX Diffusers trainer.
Was LoRA for the text encoder enabled? No.
Download the *.safetensors LoRA in the Files & versions tab.
from diffusers import CogVideoXPipeline
import torch
pipe = CogVideoXPipeline.from_pretrained("THUDM/CogVideoX-5b", torch_dtype=torch.bfloat16).to("cuda")
pipe.load_lora_weights("a-r-r-o-w/cogvideox-disney-adamw-3000-0.0003", weight_name="pytorch_lora_weights.safetensors", adapter_name="cogvideox-lora")
pipe.set_adapters(["cogvideox-lora"], [1.0])
video = pipe("BW_STYLE A black and white animated scene unfolds with an anthropomorphic goat surrounded by musical notes and symbols, suggesting a playful environment. Mickey Mouse appears, leaning forward in curiosity as the goat remains still. The goat then engages with Mickey, who bends down to converse or react. The dynamics shift as Mickey grabs the goat, potentially in surprise or playfulness, amidst a minimalistic background. The scene captures the evolving relationship between the two characters in a whimsical, animated setting, emphasizing their interactions and emotions", guidance_scale=6, use_dynamic_cfg=True).frames[0]
For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers
Please adhere to the licensing terms as described here and here.
Base model
zai-org/CogVideoX-5b