Edit Models filters

Model Tree

meta-llama/Llama-3.3-70B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

158

Base only

Active filters: meta-llama/Llama-3.3-70B-Instruct

lumolabs-ai/Lumo-70B-Instruct

72B • Updated Feb 7, 2025 • 99 • 10

amd/Llama-3.3-70B-Instruct-w4a16-llmcompressor-v0.11.0

Text Generation • 11B • Updated Jun 17 • 602 • 1

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • 9B • Updated Dec 6, 2024 • 525 • 8

mlx-community/Llama-3.3-70B-Instruct-4bit

Text Generation • 11B • Updated Dec 6, 2024 • 10.8k • 35

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • 15B • Updated Dec 6, 2024 • 404 • 5

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • 20B • Updated Dec 6, 2024 • 4.52k • 14

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 22k • 75

lmstudio-community/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 6, 2024 • 20.8k • 55

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 83.6k • 21

kosbu/Llama-3.3-70B-Instruct-AWQ

Text Generation • 71B • Updated Dec 7, 2024 • 16k • 12

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • 71B • Updated Nov 25, 2025 • 7.72k • 52

etemiz/Llama-3.3-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 70

unsloth/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 10, 2025 • 23.9k • 123

amd/Llama-3.3-70B-Instruct-FP8-KV

71B • Updated Jul 1, 2025 • 17.6k • 4

DevQuasar-2/meta-llama.Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Feb 1, 2025 • 304 • 4

mradermacher/Llama-3.3-70B-Instruct-GGUF

71B • Updated Aug 1, 2025 • 194 • 4

second-state/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 28, 2025 • 390

gaianet/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 28, 2025 • 118

mradermacher/Llama-3.3-70B-Instruct-i1-GGUF

71B • Updated Dec 8, 2024 • 681 • 4

tensorblock/Llama-3.3-70B-Instruct-GGUF

71B • Updated Jan 27 • 105 • 9

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Dec 7, 2024 • 89.7k • 30

kishizaki-sci/Llama-3.3-70B-Instruct-AWQ-4bit-JP-EN

Text Generation • 71B • Updated Dec 21, 2024 • 12

Dracones/Llama-3.3-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 7, 2024 • 9

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 13

Dracones/Llama-3.3-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 7, 2024 • 9

Dracones/Llama-3.3-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 7, 2024 • 5 • 1

Dracones/Llama-3.3-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 7, 2024 • 4 • 3

Dracones/Llama-3.3-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 7, 2024 • 2

Dracones/Llama-3.3-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 7, 2024 • 4

Jacoby746/Llama-3.3-70B-Instruct-exl2-5.0bpw

Text Generation • Updated Dec 7, 2024 • 8