Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2310.05914

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

63

Base only

Active filters: 2310.05914

GeneZC/MiniChat-1.5-3B

Text Generation • 3B • Updated Jun 27, 2024 • 579 • 36

afrideva/MiniChat-1.5-3B-GGUF

Text Generation • 3B • Updated Nov 26, 2023 • 41 • 3

augmxnt/shisa-7b-v1

Text Generation • 8B • Updated Nov 19, 2025 • 97 • 30

TheBloke/shisa-7B-v1-AWQ

Text Generation • 8B • Updated Dec 7, 2023 • 10 • 2

TheBloke/shisa-7B-v1-GPTQ

Text Generation • 8B • Updated Dec 7, 2023 • 10 • 2

LoneStriker/shisa-7b-v1-3.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 3 • 1

LoneStriker/shisa-7b-v1-4.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 1

LoneStriker/shisa-7b-v1-5.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 1

LoneStriker/shisa-7b-v1-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2023 • 2

LoneStriker/shisa-7b-v1-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2023 • 4 • 1

tsunemoto/MiniChat-1.5-3B-GGUF

3B • Updated Dec 18, 2023 • 133 • 2

GeneZC/MiniChat-2-3B

Text Generation • 3B • Updated Jun 27, 2024 • 642 • 24

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 60 • 1

cgus/MiniChat-2-3B-exl2

Text Generation • Updated Jan 12, 2024 • 4

MaziyarPanahi/shisa-7b-v1-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 17, 2024

MaziyarPanahi/shisa-7b-v1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 28, 2024 • 27

euclaise/Memphis-CoT-3B

Text Generation • 3B • Updated Feb 4, 2024 • 10 • 31

YeonwooSung/mistral-7b-cot-neftune-v0.1

Text Generation • 7B • Updated Mar 3, 2024 • 7 • 1

H-D-T/Buzz-8b-Large-v0.5

Text Generation • 8B • Updated May 14, 2024 • 23 • • 29

LoneStriker/Buzz-8b-Large-v0.5-GGUF

8B • Updated May 9, 2024 • 12 • 1

LoneStriker/Buzz-8b-Large-v0.5-3.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 2

LoneStriker/Buzz-8b-Large-v0.5-4.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 2

LoneStriker/Buzz-8b-Large-v0.5-5.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 1

LoneStriker/Buzz-8b-Large-v0.5-6.0bpw-h6-exl2

Text Generation • Updated May 9, 2024 • 2

LoneStriker/Buzz-8b-Large-v0.5-8.0bpw-h8-exl2

Text Generation • Updated May 9, 2024 • 2

QuantFactory/Buzz-8b-Large-v0.5-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 35

afrideva/Buzz-8b-Large-v0.5-GGUF

Text Generation • 8B • Updated May 14, 2024 • 19

cgus/MiniChat-2-3B-iMat-GGUF

3B • Updated May 17, 2024 • 24

anamikac2708/Llama3-8b-finetuned-NEFTune-investopedia-Lora-Adapters

Updated Jun 18, 2024

RichardErkhov/augmxnt_-_shisa-7b-v1-gguf

8B • Updated Jun 30, 2024 • 78