Edit Models filters

Model Tree

EleutherAI/pythia-12b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25

Base only

Active filters: EleutherAI/pythia-12b

QuantFactory/pythia-12b-GGUF

Text Generation • 12B • Updated Jul 13, 2024 • 540 • 3

OpenVINO/pythia-12b-int8-ov

Text Generation • Updated Nov 5, 2024 • 8

mradermacher/pythia-12b-GGUF

12B • Updated Sep 8, 2024 • 581

mradermacher/pythia-12b-i1-GGUF

12B • Updated Sep 8, 2024 • 271

tensorblock/pythia-12b-GGUF

12B • Updated Jan 27 • 40

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-asym

Text Generation • 2B • Updated Nov 23, 2024 • 5

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-sym

Text Generation • 2B • Updated Nov 23, 2024 • 5

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs128-asym

Text Generation • 12B • Updated Dec 7, 2024 • 8

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs128-sym

Text Generation • 12B • Updated Dec 9, 2024 • 8 • 1

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-asym

Text Generation • 12B • Updated Dec 15, 2024 • 6

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-sym

Text Generation • 12B • Updated Dec 15, 2024 • 6

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs128-asym

Text Generation • 3B • Updated Feb 15, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs128-sym

Text Generation • 3B • Updated Feb 15, 2025 • 2

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs128-asym

Text Generation • 12B • Updated Feb 15, 2025 • 2

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs128-sym

Text Generation • 12B • Updated Feb 15, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs64-asym

Text Generation • 2B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs64-sym

Text Generation • 2B • Updated Aug 23, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 4

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-asym

Text Generation • 4B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-sym

Text Generation • 4B • Updated Aug 24, 2025 • 2

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 3

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 4