Instructions to use TheBloke/Falcon-180B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/Falcon-180B-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Falcon-180B-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 60abea9)
Browse files
falcon-180b.Q6_K.gguf-split-a
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7b8d5a0d66b57b1366c14f2a237301107ab11db5cbc3da033604a63a60e093c
|
| 3 |
+
size 49172072767
|
falcon-180b.Q6_K.gguf-split-b
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:742931900a5b4ef746cd86bd47ab4ee72a98b101f3bdba1eccd042b26f3301b8
|
| 3 |
+
size 49172072767
|
falcon-180b.Q6_K.gguf-split-c
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d298ffdc682c0a46a6ff16e1bbb114b400d43917fa6d41683597a81bb9cd61c5
|
| 3 |
+
size 49172072738
|