Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

132

Base only

Active filters: w8a8

JongYeop/Qwen2.5-VL-3B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 4B • Updated Feb 22 • 7

JongYeop/Qwen2.5-VL-7B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 8B • Updated Feb 22 • 8

lsm0729/Qwen2.5-VL-3B-Instruct-quantized.w8a8

Image-Text-to-Text • 4B • Updated Feb 25 • 11

fedora-copr/granite-4.0-h-tiny-quantized.w8a8

Text Generation • 7B • Updated Mar 4 • 13

fedora-copr/granite-4.0-h-small-quantized.w8a8

Text Generation • 32B • Updated Mar 5 • 13

groxaxo/Huihui-Qwen3.5-27B-W8A8-INT8

27B • Updated Mar 5 • 248 • 4

collin-park/Qwen3-VL-Embedding-8B-W8A8

Image-Text-to-Text • 9B • Updated Mar 18 • 830 • 1

nameistoken/MiniMax-M2.5-Quark-W8A8-INT8

Text Generation • 229B • Updated Mar 31 • 13

tacodevs/Behemoth-X-R1-123B-FP8

Text Generation • 123B • Updated Apr 6 • 5

tacodevs/Behemoth-T1-123B-FP8

Text Generation • 123B • Updated Apr 7 • 8

nameistoken/MiniMax-M2.7-Quark-W8A8-INT8

Text Generation • 229B • Updated Apr 13 • 20

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-FP8

Text Generation • 139B • Updated Apr 16 • 17

0ppxnhximxr/gemma-4-31B-it-heretic-FP8-Dynamic

Image-Text-to-Text • 33B • Updated Apr 19 • 1.34k • 1

kamyarkazemi1373/Qwen3-4B-W8A8-RK3588

Updated Apr 19 • 22 • 1

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 2.58k • 4

nameistoken/Qwen3.6-35B-A3B-Quark-W8A8-INT8

Image-Text-to-Text • 35B • Updated May 13 • 18.4k • 6

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated 18 days ago • 3.34k • 9

vrfai/Qwen3.6-27B-FP8

Image-Text-to-Text • 27B • Updated Jun 6 • 93.3k • 3

darkc0de/gemma-4-31B-it-heretic-FP8-Dynamic-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated May 2 • 561 • 3

nunusadmqk/gemma-4-E4B-it-W8A8-INT8-v10-datafree

Image-Text-to-Text • 8B • Updated May 7 • 196

vadery/qwen36-27b-ft-grm-w8a8

Image-Text-to-Text • 28B • Updated May 22 • 30

vadery/Qwen3.5-0.8B-W8A8

Image-Text-to-Text • 0.9B • Updated May 22 • 377

amd/gpt-oss-20b-BF16-w8a8-llmcompressor-v0.10.0.2

Text Generation • 21B • Updated Jun 3 • 2.17k

vadery/Qwen3.5-27B-W8A8

Image-Text-to-Text • 28B • Updated May 29 • 23

tgmerritt/gemma-4-26B-A4B-it-MXFP8W8A8

26B • Updated May 28 • 13

solphor/Flux2-Dev-INT8-W8A8-Convrot-Model

Text-to-Image • Updated Jun 5 • 11 • 1

valoomba/Gemma-4-31B-it-uncensored-heretic-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Jun 6 • 36

JongYeop/Qwen3-30B-A3B-FP8-W8A8

Text Generation • 31B • Updated Jun 6 • 45

soyrsoyr/Llama-3.2-1B-Instruct-W8A8-GPTQ

Text Generation • 1B • Updated Jun 7 • 12

Shashwat42/Qwen3.5-9B-FP8

Image-Text-to-Text • 9B • Updated Jun 8 • 65