Qwen2.5 0.5B Instruct parity MLX (8bit)
This repo contains a same-origin MLX parity artifact derived from Qwen/Qwen2.5-0.5B-Instruct for backend parity testing with mesh-llm.
Validated exact pair:
- GGUF:
meshllm/qwen2.5-0.5b-instruct-parity-q8_0-gguf - MLX:
meshllm/qwen2.5-0.5b-instruct-parity-8bit-mlx
Exact validation result:
- GGUF exact: PASS
- MLX exact: PASS
- prompt-by-prompt outputs matched on the checked-in exact suite used by
mesh-llm
Files in this repo are the converted MLX 8bit artifact directory used in validation.
- Downloads last month
- 14
Model size
0.1B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support