Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

model-compression

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

211

Base only

Active filters: model-compression

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-1000

Text Generation • 12B • Updated Feb 28 • 7

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-100

Text Generation • 12B • Updated Feb 28 • 8

MoNE-Pruning/Qwen2-57B-A14B-MoNE-48-zyda2-100

Text Generation • 45B • Updated Feb 28 • 6

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-math-100

Text Generation • 45B • Updated Mar 2 • 23

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-gsm8k-100

Text Generation • 45B • Updated Mar 2 • 9

animeshakr/oct-retinal-weights

Image Classification • Updated 20 days ago • 15 • 2

robotflowlabs/FORGE-Nano-Benchmark

Robotics • Updated Mar 19

alonsopg/qwen2audio-selected-layer-codec-q2

alonsopg/qwen2audio-selected-layer-codec-q3

gomyk/qwen3-student-qwen3_compressed

Sentence Similarity • 12.4M • Updated Mar 26 • 35

gomyk/qwen3-student-qwen3_compressed_distilled

Sentence Similarity • 12.4M • Updated Mar 26 • 34

gomyk/me5s-student-me5s_compressed

Sentence Similarity • 13.3M • Updated Mar 27 • 54

gomyk/me5s-student-me5s_compressed_distilled

Sentence Similarity • 13.3M • Updated Mar 27 • 97

gomyk/gte-student-gte_compressed

Sentence Similarity • 12.8M • Updated Mar 27 • 37

gomyk/gte-student-gte_compressed_distilled

Sentence Similarity • 12.8M • Updated Mar 27 • 47

gomyk/gemma-student-gemma_emb_compressed

Sentence Similarity • 12.5M • Updated Mar 27 • 38

gomyk/gemma-student-gemma_emb_compressed_distilled

Sentence Similarity • 12.5M • Updated Mar 27 • 36

gomyk/gemma-student-gemma_emb_mrl_distilled_128d

Sentence Similarity • 11.2M • Updated Mar 30 • 32

gomyk/jina-v5-student-jina_v5_compressed_distilled_v2

Sentence Similarity • 19.3M • Updated Mar 31 • 35

gomyk/jina-v5-student-jina_v5_compressed_distilled_10ep

Sentence Similarity • 19.3M • Updated Mar 31 • 35

gomyk/jina-v5-student-jina_v5_compressed_distilled_trainonly

Sentence Similarity • 19.3M • Updated Apr 1 • 73

gomyk/jina-v5-student-jina_v5_compressed

Sentence Similarity • 19.1M • Updated Apr 1 • 40

gomyk/jina-v5-student-jina_v5_compressed_distilled

Sentence Similarity • 19.1M • Updated Apr 1 • 68 • 1

gomyk/jina-v5-h256-distilled

Sentence Similarity • 17M • Updated Apr 2 • 38

gomyk/jina-v5-h256-lora-classification

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-classification-universal

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-clf-merged

Sentence Similarity • 17M • Updated Apr 6 • 78

iLearn-Lab/ICMR25-HMKD

Scalai/scal-lite-60b-code-math

Text Generation • 76B • Updated Apr 13 • 11

MLliu6/Qwen3-VL-2B-Instruct-AWQ-W4A16

Image-Text-to-Text • 2B • Updated Apr 17 • 9