EXL3 models
Collection
65 items • Updated • 63
EXL3 quants of LFM2.5-8B-A1B
mul1 quants
2.10 bits per weight
3.10 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight
8.00 bits per weight
Legacy (mcg) quants:
2.10 bits per weight
2.53 bits per weight
3.10 bits per weight
3.53 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight
8.00 bits per weight / H8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support