How to use GreenBitAI/Qwen-2.5-3B-Instruct-layer-mix-bpw-4.0-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen-2.5-3B-Instruct-layer-mix-bpw-4.0-mlx GreenBitAI/Qwen-2.5-3B-Instruct-layer-mix-bpw-4.0-mlx
NicoNico commited on 
