Edit Models filters

Model Tree

MarsupialAI/Monstral-123B-v2

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Base only

Active filters: MarsupialAI/Monstral-123B-v2

bartowski/Monstral-123B-v2-GGUF

Text Generation • 123B • Updated Dec 4, 2024 • 1.32k • 7

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.0bpw_h6

Text Generation • Updated Dec 9, 2024 • 8 • 2

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.5bpw_h6

Text Generation • Updated Dec 9, 2024 • 8

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated Dec 9, 2024 • 7 • 2

mradermacher/Monstral-123B-v2-GGUF

123B • Updated Aug 1, 2025 • 12 • 2

mradermacher/Monstral-123B-v2-i1-GGUF

123B • Updated Dec 6, 2024 • 297 • 1

FluffyKaeloky/Monstral-123B-v2-exl2-4.0bpw

Text Generation • Updated Dec 10, 2024 • 12 • 1

denru/Monstral-123B-v2x2-4_0bpw-h6-exl2-pippa

Text Generation • Updated Jan 1, 2025 • 19

TNT3530/Monstral-123B-v2-q4f16_1-MLC

Updated Jan 1, 2025

denru/Monstral-123B-v2x2-5_0bpw-h8-exl2-pippa

Text Generation • Updated Jan 1, 2025 • 8

ainugget/Monstral-123B-v2-Q2-MLX

Text Generation • 11B • Updated Feb 9, 2025 • 10

serpro/Monstral-123B-v2-mlx-8Bit

Text Generation • 34B • Updated Apr 26, 2025 • 12

ArtusDev/MarsupialAI_Monstral-123B-v2_EXL3_1.4bpw_H4

Text Generation • 11B • Updated May 19, 2025 • 11

ArtusDev/MarsupialAI_Monstral-123B-v2_EXL3_1.8bpw_H5

Text Generation • 14B • Updated May 24, 2025 • 12

Wwayu/Monstral-123B-v2-mlx-3Bit

Text Generation • 123B • Updated Oct 6, 2025 • 8

mratsim/Monstral-123B-v2-NVFP4

Text Generation • 69B • Updated Nov 9, 2025 • 23 • 1

gecfdo/Monstral-123B-v2_EXL3_4.75bpw_H16

Text Generation • 37B • Updated Dec 17, 2025 • 18

ailexleon/Monstral-123B-v2-mlx-4Bit

Text Generation • 123B • Updated May 11 • 22