Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -44,3 +44,7 @@ Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part3of6 filter=lfs diff=lfs merge=lfs -
|
|
| 44 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 45 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 46 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part4of6 filter=lfs diff=lfs merge=lfs -text
|
| 45 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part5of6 filter=lfs diff=lfs merge=lfs -text
|
| 46 |
Qwen3-235B-A22B-Instruct-2507.Q8_0.gguf.part6of6 filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e5ac399416266f3ecc590f4d4c0c1ecfa83d3e6b6420d51fbf1be13619fe327d
|
| 3 |
+
size 48318382080
|
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c5baffa8214c5ee40c18473f5cf44bfce10d2f4659f60cbcaa1cf53fc44d1837
|
| 3 |
+
size 48318382080
|
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a5f3a1a71f804656484d924588fa5ef8efc519088293fbbf0cfc5309d36ef64
|
| 3 |
+
size 48318382080
|
Qwen3-235B-A22B-Instruct-2507.Q6_K.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:544c908f0e6a7cad43ec008df5577fa2e8306b04f070930485ae8e08be50d475
|
| 3 |
+
size 48060348608
|