Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -60,3 +60,7 @@ Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part3of3 filter=lfs diff=lfs merge=lfs
|
|
| 60 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 61 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 62 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 61 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 62 |
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
| 63 |
+
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
| 64 |
+
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 65 |
+
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part1of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a13849ff67029fb116b4fa8b01bccc2767f7f1b6796668ee847f62bac22926e
|
| 3 |
+
size 40802189312
|
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part2of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:88b88b09d07300a4fadef844c0aa8d0652d20eeb5217ea20cf494b1e07cad81b
|
| 3 |
+
size 40802189312
|
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part3of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54b7fbc2faec539aa074874b9805ca03dbd3fb53802ad09991895ba5b62e9d06
|
| 3 |
+
size 40802189312
|
Qwen3-235B-A22B-Instruct-2507.Q5_K_S.gguf.part4of4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:437b2b1edebbcde1b0b2d3f715a2483892d5264bb85c4fcfec93df5a7874ab53
|
| 3 |
+
size 39474858176
|