SmolVLM GGUF - a ggml-org Collection

ggml-org 's Collections

NVIDIA Nemotron 3 Nano

NVIDIA-Nemotron-3-Nano-Omni

NVIDIA Nemotron 3 Super

Gemma 1.1 GGUFs

EmbeddingGemma 300M

Multimodal GGUFs

InternVL 3 and InternVL 2.5

Qwen 2 VL and Qwen 2.5 VL

GGUF LoRA adapters

llama.cpp presets

SmolVLM GGUF

updated 3 days ago

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30, 2025 • 10.9k • 37
ggml-org/SmolVLM2-500M-Video-Instruct-GGUF

0.4B • Updated Apr 30, 2025 • 12.8k • 19
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

0.2B • Updated Apr 30, 2025 • 2.08k • 10

Note ^ Version 2 (better quality) For "Video" models, input a sequence of images
ggml-org/SmolVLM-Instruct-GGUF

2B • Updated Apr 30, 2025 • 3.1k • 9
ggml-org/SmolVLM-500M-Instruct-GGUF

0.4B • Updated Apr 30, 2025 • 74.1k • 52
ggml-org/SmolVLM-256M-Instruct-GGUF

0.2B • Updated Apr 30, 2025 • 10.8k • 17

Note ^ Version 1