Instructions to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/cogito-v2-preview-deepseek-671B-MoE-i1-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files- .gitattributes +5 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part1of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part2of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part3of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part4of5 +3 -0
- cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part5of5 +3 -0
.gitattributes
CHANGED
|
@@ -100,3 +100,8 @@ cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part5of8 filter=lfs diff=lfs
|
|
| 100 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 101 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 102 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part6of8 filter=lfs diff=lfs merge=lfs -text
|
| 101 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part7of8 filter=lfs diff=lfs merge=lfs -text
|
| 102 |
cogito-v2-preview-deepseek-671B-MoE.i1-IQ4_XS.gguf.part8of8 filter=lfs diff=lfs merge=lfs -text
|
| 103 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part1of5 filter=lfs diff=lfs merge=lfs -text
|
| 104 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
| 105 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 106 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 107 |
+
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part1of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:199bf3e73e1ed2cde556a0530457edab985633e76aa0a96e35a4e9b1e676fb5a
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part2of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a13b7d5ab0eb3f8a8e3dadb5bec9b256759346dec035ef2ef2c324e9d3cf89f9
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part3of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8867ced675ef2bfb83a8a8c46a0ad4b254e504f480e827172a16ebbb9e51d2da
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part4of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9aa1b238f60bf0d1340fb893f69d2129e1d8fb06ef659110056e5b14fd97b26d
|
| 3 |
+
size 45097156608
|
cogito-v2-preview-deepseek-671B-MoE.i1-Q2_K_S.gguf.part5of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7b1e1c871f6de551f62b898cde2eaa41425c1f8dbbbbf8314adf0a9e77da1faf
|
| 3 |
+
size 44393844832
|