Instructions to use cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit", dtype="auto") - Notebooks
- Google Colab
- Kaggle
How to run awq model with audio output?
#8
by morlz - opened
It work for text only output:
https://github.com/morlz/qwen3-omni-awq
How to run this model with audio output?
Thank you for trying my model. However, the model can not output audios or visions. It can receive text, vision and audio inputs, and then outputs text.