exllamav3 quantizations of sophosympatheia's Mero-Artemis-31B-v0.3.1
6.00bpw_h6 (25.175 GiB)
4.00bpw_h6 (18.356 GiB)
3.50bpw_h6 (16.647 GiB)
3.00bpw_h6 (14.947 GiB)
2.25bpw_h6 (12.389 GiB)
Model tree for MikeRoz/Mero-Artemis-31B-v0.3.1-exl3
Base model
sophosympatheia/Mero-Artemis-31B-v0.3.1