4 bit
#1
by flflow - opened
Model looks interesting. No 4 bit version in plans?
didn't think it'd be necessary, sure I'll queue it up later
Mistral models are great and 4 bit only one solution for low vram gpus.
3, 4 and 5bpw uploaded, here's 4bpw: https://huggingface.co/lucyknada/crestf411_MN-Slush-exl2/tree/4.0bpw?not-for-all-audiences=true
lucyknada changed discussion status to closed