Edit Models filters

Model Tree

ibm-granite/granite-4.0-h-tiny

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: ibm-granite/granite-4.0-h-tiny

ibm-granite/granite-4.0-h-tiny-GGUF

7B • Updated Apr 23 • 2.91k • 22

lmstudio-community/granite-4.0-h-tiny-GGUF

7B • Updated Oct 2, 2025 • 7.09k • 3

lmstudio-community/granite-4.0-h-tiny-MLX-4bit

Text Generation • 1B • Updated Sep 29, 2025 • 150

lmstudio-community/granite-4.0-h-tiny-MLX-5bit

Text Generation • 1B • Updated Sep 29, 2025 • 65

lmstudio-community/granite-4.0-h-tiny-MLX-6bit

Text Generation • 7B • Updated Sep 29, 2025 • 146

lmstudio-community/granite-4.0-h-tiny-MLX-8bit

Text Generation • 7B • Updated Sep 29, 2025 • 662 • 1

unsloth/granite-4.0-h-tiny-GGUF

7B • Updated Oct 7, 2025 • 3.13k • 33

unsloth/granite-4.0-h-tiny-FP8-Dynamic

Text Generation • 7B • Updated Nov 25, 2025 • 31 • 1

bartowski/ibm-granite_granite-4.0-h-tiny-GGUF

Text Generation • 7B • Updated Oct 2, 2025 • 2.29k • 4

mlx-community/granite-4.0-h-tiny-8bit

Text Generation • Updated Oct 2, 2025 • 25

mlx-community/Granite-4.0-H-Tiny-4bit-DWQ

Text Generation • 1B • Updated Oct 3, 2025 • 213 • 5

DevQuasar/ibm-granite.granite-4.0-h-tiny-GGUF

Text Generation • 7B • Updated Oct 3, 2025 • 67

mlx-community/granite-4.0-h-tiny-3bit-MLX

Text Generation • 0.9B • Updated Oct 3, 2025 • 64 • 2

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • Updated Oct 3, 2025 • 18 • 1

mlx-community/granite-4.0-h-tiny-5bit-MLX

Text Generation • Updated Oct 3, 2025 • 16 • 2

tatsuyaaaaaaa/granite-4.0-h-tiny-gguf

7B • Updated Oct 4, 2025 • 79

ethicalabs/granite-4.0-h-tiny-MLX

Text Generation • 1B • Updated Oct 4, 2025 • 1

sizzlebop/granite-4.0-h-tiny-IQ4_NL-GGUF

7B • Updated Oct 5, 2025 • 3

sizzlebop/granite-4.0-h-tiny-Q8_0-GGUF

7B • Updated Oct 5, 2025 • 1

mradermacher/granite-4.0-h-tiny-GGUF

7B • Updated Oct 7, 2025 • 90

mradermacher/granite-4.0-h-tiny-i1-GGUF

7B • Updated Dec 9, 2025 • 247

KavinduHansaka/granite-4.0-h-tiny-gguf

Text Generation • 7B • Updated Jan 14 • 1

cyankiwi/granite-4.0-h-tiny-AWQ-4bit

Text Generation • 2B • Updated Oct 13, 2025 • 110 • 3

cyankiwi/granite-4.0-h-tiny-AWQ-8bit

Text Generation • 3B • Updated Oct 13, 2025 • 62

noctrex/Granite-4.0-H-Tiny-MXFP4_MOE-GGUF

Text Generation • 7B • Updated Oct 27, 2025 • 19

RepublicOfKorokke/granite-4.0-h-tiny-mlx-mxfp4

Text Generation • 1B • Updated Oct 23, 2025 • 12

introvoyz041/granite-4.0-h-tiny-mlx-4Bit

Text Generation • 1B • Updated Nov 29, 2025 • 5

RedHatAI/granite-4.0-h-tiny-FP8-dynamic

Text Generation • 7B • Updated Apr 28 • 718 • 3

guignome/granite-4.0-h-tiny-FP8-Dynamic

7B • Updated Feb 13 • 1

keisuke-miyako/granite-4.0-h-tiny-gguf-q8_0

7B • Updated Jan 31 • 3