cyankiwi
/

Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit

compressed-tensors

Model card Files Files and versions

Resources

View closed (0)

AWQ calibration dataset + recipe?

#12 opened 3 months ago by

Qwen3 ASR

#11 opened 6 months ago by

Didn't see latency reduction with vLLM by running this model VS. the original Qwen3-Omni model

#10 opened 8 months ago by

Memory issues

#9 opened 9 months ago by

How to run awq model with audio output?

#8 opened 9 months ago by

Use this model with vLLM on L40 or 4090 (SM89)

#7 opened 10 months ago by

Strange warning on first completion w/ vLLM 0.11.0

#6 opened 10 months ago by

GPTQ 4-bit version?

#5 opened 10 months ago by

wrong ouput

#4 opened 11 months ago by

How can I load this model

#3 opened 11 months ago by

Can I request a higher quantization, such as 3-bit or 2-bit awq?

#2 opened 11 months ago by

how to run it?

#1 opened 11 months ago by