Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
README.md
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<!-- ### quantize_version: 2 -->
|
| 2 |
+
<!-- ### output_tensor_quantised: 1 -->
|
| 3 |
+
<!-- ### convert_type: hf -->
|
| 4 |
+
<!-- ### vocab_type: -->
|
| 5 |
+
<!-- ### tags: -->
|
| 6 |
+
static quants of https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507
|