Instructions to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Qwen3-235B-A22B-Instruct-2507-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -57,3 +57,6 @@ Qwen3-235B-A22B-Instruct-2507.Q3_K_S.gguf.part3of3 filter=lfs diff=lfs merge=lfs
|
|
| 57 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 58 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 59 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 58 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 59 |
Qwen3-235B-A22B-Instruct-2507.Q3_K_L.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
| 60 |
+
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 61 |
+
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 62 |
+
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part1of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d0dd32161ef5bbff680a14a4fcff35d7433479cb48ed25b1be4eb4e7c2e2f57
|
| 3 |
+
size 48318382080
|
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part2of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e685c6c5759ea7a6abd9aec2c7c13854d8dd431e253de37bead9200873077fbd
|
| 3 |
+
size 48318382080
|
Qwen3-235B-A22B-Instruct-2507.Q4_K_M.gguf.part3of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:346e97bc2e55787633ab58c8b7f14c9b5cdaebbbea1b5999f6656b8e982fcc33
|
| 3 |
+
size 45517310144
|