mistralai/Mixtral-8x7B-Instruct-v0.1

#122 opened over 2 years ago by

vaidehirao

addd

#121 opened over 2 years ago by

seedeera

Request: SDFSDFSD

#120 opened over 2 years ago by

seedeera

Consistency check failed - model-00019-of-00019.safetensors

👍 3

#118 opened over 2 years ago by

br1-pist

Difference in EOS token between Mistral/Mixtral and LLAMA.

#117 opened over 2 years ago by

xkszltl

Model Output is Changed

9

#116 opened over 2 years ago by

AnzaniAI

The chat template doesn't support a system prompt

👍 2

#114 opened over 2 years ago by

sam-kap

How to get 'output_router_logits'

#113 opened over 2 years ago by

cts13

Run inference on 2 GPUs

#112 opened over 2 years ago by

bweinstein123

Running a 4-bit Quantized 7B Model on a PC: Feasibility and Insights

4

#109 opened over 2 years ago by

edw-hug-face

How to get result as good as Hugging Face Chat Mixtral-8x7b-Instruct

9

#107 opened over 2 years ago by

Panckackes

FR Discutions ouverte

#105 opened over 2 years ago by

Pablito2fois

Rapport d'étonnement

#104 opened over 2 years ago by

YannCHANET

testz

#101 opened over 2 years ago by

Ben7878

How to use transfimer

#100 opened over 2 years ago by

sethdwumah

SFT is so BAD

#99 opened over 2 years ago by

GokhanAI

8bit quantization error

#98 opened over 2 years ago by

lovelyfrog

Key Error : Mixtral

8

#96 opened over 2 years ago by

jdjayakaran

Train the Model on Confluence

#95 opened over 2 years ago by

icemaro

Run Mistral model on Remote server

#94 opened over 2 years ago by

icemaro

Cuda Error

#93 opened over 2 years ago by

HuggySSO

Not supported with TGI

#92 opened over 2 years ago by

abhishek3jangid

deepspeed load mixtral-8x7B hang or oom

#91 opened over 2 years ago by

guowl

Add MOE (mixture of experts) tag

#90 opened over 2 years ago by

davanstrien

Update README.md

#89 opened over 2 years ago by

schuyler12

Failure in loading the model on AWS

8

#88 opened over 2 years ago by

bweinstein123

Hardware Requirements

#86 opened over 2 years ago by

ShivanshMathur007

Response content was truncated

🤝 1

19

#84 opened over 2 years ago by

ludomare

Best parameter setting for Mixtral model on the text-generation task

#83 opened over 2 years ago by deleted

Any hints on prompt to reduce / stop hallucinations

#82 opened over 2 years ago by

dnovak232

Still the best Mixtral based instruct model. We should change that

👍 2

#81 opened over 2 years ago by

rombodawg

Could not convert to integer: 3221225477 error

#80 opened over 2 years ago by

KharabinDev42

Serving the model as API on vLLM and 2 x A6000

#78 opened over 2 years ago by

dnovak232

How much memory do I need for this model (on Windows)?

#77 opened over 2 years ago by

roboboot

Inconsistent prompt format. Which is correct the Model card or the tokenizer_config.json?

👍 10

#75 opened over 2 years ago by

lemonflourorange

can not run sft full finetuning.

10

#74 opened over 2 years ago by

hegang126

[Chinese Version] Mixtral-8x7B model | 中文Mixtral-8x7B模型

👍 4

#73 opened over 2 years ago by

wangrongsheng

Update the deprecated Flash Attention call parameter in from_pretrained() method

#72 opened over 2 years ago by

DeathReaper0965

can't load the model

#71 opened over 2 years ago by

JayZhang1

What is the best way for the inference process in LORA in PEFT approach

9

#70 opened over 2 years ago by

Pradeep1995

How to use system prompt?

👍 1

#69 opened over 2 years ago by

mznw

Is there any simple way to solve the problem of redundant output

#68 opened over 2 years ago by

jjplane

Which is the actual way to store the adapters after PEFT finetuning

4

#67 opened over 2 years ago by

Pradeep1995

Failed to import transformers.models.mixtral.modeling_mixtral because of the following error (look up to see its traceback): libcudart.so.12: cannot open shared object file: No such file or directory

#66 opened over 2 years ago by

MukeshSharma

Model not loading, even with 4-bit quantization

#65 opened over 2 years ago by

soumodeep-semut

did Mixtral start from Mistral or from-scratch?

#64 opened over 2 years ago by

DaehanKim

How many GPUs do we need to run this out of box?