Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

72

Base only

Active filters: mistralai

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 24B • Updated 13 days ago • 3.71k • 11

Trelis/Mistral-7B-Instruct-v0.1-function-calling-adapters-v2

Text Generation • Updated Oct 11, 2023

Trelis/Mistral-7B-Instruct-v0.1-function-calling-v2

Text Generation • 7B • Updated Jan 27, 2024 • 33

MNCLLM/Mistral-7B-orca-platy-over1k

Text Generation • Updated Oct 30, 2023 • 10

MNCJ1hun/Mistral-7B-OP-u1k-ver0.4

Text Generation • Updated Oct 30, 2023 • 7

duyntnet/Mistral-7B-Instruct-v0.1-imatrix-GGUF

Text Generation • 7B • Updated Apr 26, 2024 • 719

duyntnet/Mistral-7B-Instruct-v0.2-imatrix-GGUF

Text Generation • 7B • Updated Apr 26, 2024 • 215

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • 22B • Updated Jun 1, 2024 • 251 • 3

fbaldassarri/mistralai_Mistral-7B-v0.3-autoround-int4-gs128-asym

Text Generation • 1B • Updated Jan 17, 2025 • 8

fbaldassarri/mistralai_Mistral-7B-v0.3-autoround-int4-gs128-sym

Text Generation • 1B • Updated Jan 17, 2025 • 9

fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int4-gs128-asym

Text Generation • 7B • Updated Jan 17, 2025 • 7

fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int4-gs128-sym

Text Generation • 7B • Updated Jan 17, 2025 • 7

fbaldassarri/mistralai_Mistral-7B-v0.3-autoawq-int4-gs128-asym

Text Generation • 7B • Updated Jan 17, 2025 • 7

fbaldassarri/mistralai_Mistral-7B-v0.3-autoawq-int4-gs128-sym

Text Generation • 7B • Updated Jan 17, 2025 • 10

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autoround-int4-gs128-asym

Text Generation • 1B • Updated Jan 19, 2025 • 8

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autoround-int4-gs128-sym

Text Generation • 1B • Updated Jan 19, 2025 • 9

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autogptq-int4-gs128-asym

Text Generation • 7B • Updated Jan 17, 2025 • 5

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autogptq-int4-gs128-sym

Text Generation • 7B • Updated Jan 17, 2025 • 4

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autoawq-int4-gs128-asym

Text Generation • 7B • Updated Jan 18, 2025 • 6

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autoawq-int4-gs128-sym

Text Generation • 7B • Updated Jan 18, 2025 • 7

roleplaiapp/Codestral-22B-v0.1-Q2_K-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 15

roleplaiapp/Codestral-22B-v0.1-Q3_K_S-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 6

roleplaiapp/Codestral-22B-v0.1-Q3_K_M-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 5

roleplaiapp/Codestral-22B-v0.1-Q3_K_L-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 1

roleplaiapp/Codestral-22B-v0.1-Q4_0-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 4

roleplaiapp/Codestral-22B-v0.1-Q4_K_S-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 3

roleplaiapp/Codestral-22B-v0.1-Q4_K_M-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 54 • 2

roleplaiapp/Codestral-22B-v0.1-Q5_0-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 3

roleplaiapp/Codestral-22B-v0.1-Q5_K_S-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 2

roleplaiapp/Codestral-22B-v0.1-Q5_K_M-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 4