Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| <!-- ### quantize_version: 2 --> | |
| <!-- ### output_tensor_quantised: 1 --> | |
| <!-- ### convert_type: hf --> | |
| <!-- ### vocab_type: --> | |
| <!-- ### tags: --> | |
| static quants of https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507 | |