Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +6 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part1of6 +3 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part2of6 +3 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part3of6 +3 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part4of6 +3 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part5of6 +3 -0
- Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part6of6 +3 -0
.gitattributes
CHANGED
|
@@ -38,3 +38,9 @@ Qwen3-235B-A22B-Instruct-2507.Q4_K_S.gguf.part2of3 filter=lfs diff=lfs merge=lfs
|
|
| 38 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_S.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
| 39 |
Qwen3-235B-A22B-Instruct-2507.Q2_K.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
|
| 40 |
Qwen3-235B-A22B-Instruct-2507.Q2_K.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_S.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
| 39 |
Qwen3-235B-A22B-Instruct-2507.Q2_K.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
|
| 40 |
Qwen3-235B-A22B-Instruct-2507.Q2_K.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part1of6 filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part2of6 filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part3of6 filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part1of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:baf336c509a4d0812bb3fb113b3a7b3e55abce6f98800292f5c2b8a2f0f11d07
|
| 3 |
+
size 41875931136
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part2of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b738e9c5e3814f91f28fc3d606a646b689d92b2240d3e04f6bb2ad6e67aa14e7
|
| 3 |
+
size 41875931136
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part3of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:31233253d6e5226b082982ce1f391983618d96493505b44f9aa59f9ca191cb3e
|
| 3 |
+
size 41875931136
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part4of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aa45152813905eaba45a9fc135530e4edf3caa54133a2dd36dadb965bb3094de
|
| 3 |
+
size 41875931136
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part5of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f78b629a9ed50f7cf4fce8019d4bda7aacd4588acee7bff00faa3fb1daed3bb4
|
| 3 |
+
size 41875931136
|
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part6of6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1cf5c194c03b4e5ecb41450891163982f5aea33a4395965e6e9f293fd07fceba
|
| 3 |
+
size 40560449728
|