Ref Lora Compatible Diffusion Model Question

#19
by boricuapab - opened

Which diffusion model is the ref lora meant to be compatible with.

Tried it using the fl2va int 8 conv rot, but it seems a lot of blocks aren't recognizing the lora.

h3_ref_lora_compat_question

Lora seems to be having an effect though, here's an example using both the ref and turbo loras with the fl2va int 8 conv rot model

Those are the pruned model only keys, I don't know if it matters, rest should apply the same.

Ok, thanks, I'll try using the prunned int8 models then. It's funny though that I can still use the ref to video conditioning node with the fl2va int 8 model and it still seems to be using the images as references, with or without the ref lora.

h3_ref_lora_off_fl2va_still_uses_refs

Ok, with lora strength at 2 with the pruned model I'm getting some nice results

https://www.youtube.com/watch?v=D8dc0hacoxU

Sign up or log in to comment