Quantised from Jackrong/Qwopus3.6-27B-v2

Has been converted using OMLX Version 0.4.0rc2 (1395) MTP Headers have been retained

This is the FP16 version which is optimal for Apple Silicon M1 and M2 Mac devices. I have also incorporated the "Fixed" Chat Template from froggeric/Qwen-Fixed-Chat-Templates

All thanks goes to the creators of all of the above, I merely just converted the model for those that cannot

Downloads last month: 277

Safetensors

Model size

7B params

Tensor type

F16

U32

MLX

Hardware compatibility

6-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for wezzel98765/Qwopus3.6-27B-v2-oQ6-fp16-mtp

Base model

Jackrong/Qwopus3.6-27B-v2

Quantized

(52)

this model