Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

203

Base only

Active filters: ollama, meta-llama/Llama-3.1-8B

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Aug 23, 2024 • 41.8k • 154

dphn/dolphin-2.9.4-llama3.1-8b-gguf

8B • Updated Aug 8, 2024 • 1.89k • 74

dphn/Dolphin3.0-Llama3.1-8B-GGUF

8B • Updated Jan 5, 2025 • 39.5k • 179

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-old

Text Generation • 8B • Updated Jul 23, 2024 • 59 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_0-GGUF-old

Text Generation • 8B • Updated Jul 23, 2024 • 16

xyottax/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 50

shisahni/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 5

skoppisetti/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 10

mradermacher/Meta-Llama-3.1-8B-GGUF

8B • Updated Dec 16, 2024 • 271 • 1

mradermacher/Meta-Llama-3.1-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 1.04k

chrypnotoad/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 43

vaibhavsatpathy/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 5

vaibhavsatpathy/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 12

kaetemi/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 31, 2024 • 7

polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 6

mariagrandury/Meta-Llama-3.1-8B-ft-LoRA-elgrancorpus-it-gguf-q4_k_m

Text Generation • 8B • Updated Aug 2, 2024 • 26

swilde42/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 3

reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 3

reach-vb/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 8 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12

Text Generation • 8B • Updated Aug 1, 2024 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14

Text Generation • 8B • Updated Aug 1, 2024 • 4

sgerhart/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 2, 2024 • 17 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc

Text Generation • 8B • Updated Aug 3, 2024 • 6

polyverse/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 8

5fp/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 4, 2024 • 8

5fp/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Aug 4, 2024 • 4

fedric95/Meta-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Oct 21, 2024 • 564 • 2

QuantFactory/dolphin-2.9.4-llama3.1-8b-GGUF

8B • Updated Aug 6, 2024 • 187 • 2

jdumanski/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 8, 2024 • 5