Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2402.10373

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

71

Base only

Active filters: 2402.10373

BioMistral/BioMistral-7B-DARE

Text Generation • 7B • Updated Feb 19, 2024 • 2.8k • • 24

BioMistral/BioMistral-7B

Text Generation • Updated Feb 21, 2024 • 67.5k • 511

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 19, 2024 • 118 • 5

BioMistral/BioMistral-7B-DARE-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 758 • 14

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 19, 2024 • 151 • 6

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMV

Text Generation • 7B • Updated Feb 19, 2024 • 7 • 1

BioMistral/BioMistral-7B-SLERP

Text Generation • 7B • Updated Feb 19, 2024 • 1.07k • • 8

BioMistral/BioMistral-7B-Zephyr-Beta-SLERP

Text Generation • 7B • Updated Feb 19, 2024 • 12 • 2

BioMistral/BioMistral-7B-TIES

Text Generation • 7B • Updated Feb 19, 2024 • 52 • 2

disi-unibo-nlp/MedGENIE-fid-flan-t5-base-medqa

Question Answering • Updated May 17, 2024 • 15

BioMistral/BioMistral-7B-SLERP-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 19, 2024 • 16 • 1

BioMistral/BioMistral-7B-TIES-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 19, 2024 • 8

LoneStriker/BioMistral-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 58

BioMistral/BioMistral-7B-BnB.4

Text Generation • 7B • Updated Feb 19, 2024 • 67 • 1

BioMistral/BioMistral-7B-BnB.8

Text Generation • 7B • Updated Feb 19, 2024 • 7

LoneStriker/BioMistral-7B-3.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 4

LoneStriker/BioMistral-7B-4.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 7

LoneStriker/BioMistral-7B-5.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 4

LoneStriker/BioMistral-7B-6.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 6

LoneStriker/BioMistral-7B-8.0bpw-h8-exl2

Text Generation • Updated Feb 19, 2024 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 2.66k • 58

MaziyarPanahi/BioMistral-7B-SLERP-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 86 • 4

MaziyarPanahi/BioMistral-7B-DARE-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 200 • 2

MaziyarPanahi/BioMistral-7B-TIES-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 151

LoneStriker/BioMistral-7B-SLERP-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 44

LoneStriker/BioMistral-7B-DARE-GGUF

Text Generation • 7B • Updated Feb 19, 2024 • 62

LoneStriker/BioMistral-7B-SLERP-3.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 5

LoneStriker/BioMistral-7B-SLERP-4.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 5

LoneStriker/BioMistral-7B-SLERP-5.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 4

LoneStriker/BioMistral-7B-SLERP-6.0bpw-h6-exl2

Text Generation • Updated Feb 19, 2024 • 6