Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

396

Base only

Active filters: local-ai

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated Jun 7 • 18.2k • 59

veyra-ai/Veyra-30M-Instruct

Text Generation • 34.6M • Updated about 4 hours ago • 31 • 3

ddalcu/Qwen3.6-27B-4bit-MTP-MLX-Serve

Text Generation • 5B • Updated Jun 11 • 626 • 3

shafire/Zero-Qwen3-8B-OpenZero-GGUF

Text Generation • 8B • Updated about 19 hours ago • 117 • 1

shafire/Zero-Gemma4-E4B-OpenZero-GGUF

Text Generation • 8B • Updated about 19 hours ago • 73 • 1

Dev4285/Allegretto-Mini

Text-to-Audio • Updated about 6 hours ago • 1

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebula

Text Generation • Updated May 10

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebulal

Text Generation • Updated May 10 • 10

Agnuxo/Mistral-NeMo-Minitron-8B-Base-CODE-Python

Text Generation • Updated May 10 • 5

mradermacher/Mistral-NeMo-Minitron-8B-Base-Nebulal-GGUF

Text Generation • 8B • Updated Jun 13 • 104

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-8bit

Text Generation • 8B • Updated May 10 • 124

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-16bit

Text Generation • 8B • Updated May 10 • 130

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-4bit

Text Generation • Updated May 10

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-16bit

Text Generation • Updated May 10 • 2 • 1

Agnuxo/Meta-Llama-3.1-8B-CODE-Alpaca-Python-8bit-GGUF

Text Generation • 8B • Updated May 10 • 69

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-Alpaca-Lora

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-lora_model

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant_16bit

Text Generation • 4B • Updated May 10 • 8

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_8bit

Text Generation • 4B • Updated May 10 • 241

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_16bit

Text Generation • 4B • Updated May 10 • 766 • 3

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_4bit

Text Generation • 4B • Updated May 10 • 894

Agnuxo/Mamba-Codestral-7B-v0.1-python_coding_assistant_16bit

Text Generation • 7B • Updated May 10 • 17

Agnuxo/Mamba-Codestral-7B-v0.1-lora_model

Text Generation • Updated May 10

Agnuxo/Mamba-Codestral-7B-v0.1-python_coding_assistant-GGUF_8bit

Text Generation • 7B • Updated May 10 • 322 • 1

Agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_16bit

Text Generation • 7B • Updated May 10 • 252

Agnuxo/Mamba-Codestral-7B-v0.1-instruct-python_coding_assistant-GGUF_4bit

Text Generation • 7B • Updated May 10 • 1.73k • 5

Agnuxo/gemma-2-2b-lora_model

Text Generation • Updated May 10

Agnuxo/gemma-2-2b-Python_CODE_assistant_16bit

Text Generation • 3B • Updated May 10 • 4

Agnuxo/gemma-2-2b-Python_CODE_assistant-GGUF_8bit

Text Generation • 3B • Updated May 10 • 90

Agnuxo/gemma-2-2b-instruct-python_CODE_assistant-GGUF_16bit

Text Generation • 3B • Updated May 10 • 122