Granite 4.0 MLX-LM 4-bit
Collection
Granite 4.0 Language Models for macOS (MLX-LM) - 4-bit Quantization • 16 items • Updated
ethicalabs/granite-4.0-h-tiny-base-MLX
This model ethicalabs/granite-4.0-h-tiny-base-MLX was converted to MLX format from ibm-granite/granite-4.0-h-tiny-base using mlx-lm version 0.28.2.
- Downloads last month
- 13
Model size
1B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for ethicalabs/granite-4.0-h-tiny-base-MLX
Base model
ibm-granite/granite-4.0-h-tiny-base
# Install MLX LM uv tool install mlx-lm# Generate some text mlx_lm.generate --model "ethicalabs/granite-4.0-h-tiny-base-MLX" --prompt "Once upon a time"