One base model across many bit-widths - read the quality/footprint curve, not a single point.
Christian N PRO
xv0y5ncu
AI & ML interests
GLQ E8 Quantization, reasoning AI software. MLops. Huggingface Transformers, vLLM & SGLang. Langchain, RAG. Open source software. Kubernetes
Making LLMs run better on more limited devices such as gaming GPUs
Recent Activity
updated a model 3 days ago
xv0y5ncu/SmolLM3-3B-trellis-3inst-3bpw published a model 3 days ago
xv0y5ncu/SmolLM3-3B-trellis-3inst-3bpw updated a model 6 days ago
xv0y5ncu/gemma-4-E4B-it-GLQ-trellis-3inst-4bpwOrganizations
None yet
SmolLM2 135M/360M and SmolLM3-3B - the small end: CI, demos, and cheap codebook A/Bs.
-
xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel
Text Generation • 1.0B • Updated • 835 -
xv0y5ncu/SmolLM3-3B-GLQ-block-diagonal-3.5bpw
Text Generation • 0.9B • Updated • 7 -
xv0y5ncu/SmolLM3-3B-GLQ-3.5bpw
Text Generation • 1B • Updated • 154 -
xv0y5ncu/SmolLM3-3B-GLQ-6bpw
Text Generation • 1B • Updated • 10
One base model across many bit-widths - read the quality/footprint curve, not a single point.
SmolLM2 135M/360M and SmolLM3-3B - the small end: CI, demos, and cheap codebook A/Bs.
-
xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel
Text Generation • 1.0B • Updated • 835 -
xv0y5ncu/SmolLM3-3B-GLQ-block-diagonal-3.5bpw
Text Generation • 0.9B • Updated • 7 -
xv0y5ncu/SmolLM3-3B-GLQ-3.5bpw
Text Generation • 1B • Updated • 154 -
xv0y5ncu/SmolLM3-3B-GLQ-6bpw
Text Generation • 1B • Updated • 10
models 29
xv0y5ncu/SmolLM3-3B-trellis-3inst-3bpw
Text Generation • 0.8B • Updated • 137
xv0y5ncu/gemma-4-E4B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 3B • Updated • 46
xv0y5ncu/gemma-4-E2B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 2B • Updated • 17
xv0y5ncu/gemma-4-31B-it-GLQ-trellis-3inst-4bpw
Image-Text-to-Text • 9B • Updated • 13
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-6bpw
Image-Text-to-Text • 11B • Updated • 17
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-5bpw
Image-Text-to-Text • 11B • Updated • 13
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-4bpw
Image-Text-to-Text • 7B • Updated • 37
xv0y5ncu/gemma-4-26B-A4B-it-GLQ-3bpw
Image-Text-to-Text • 7B • Updated • 238
xv0y5ncu/gemma-4-12B-it-GLQ-trellis-3inst-4bpw
Any-to-Any • 4B • Updated • 13
xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd
Image-Text-to-Text • 2B • Updated • 20
datasets 0
None public yet