Instructions to use TheBloke/Falcon-180B-Chat-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TheBloke/Falcon-180B-Chat-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Falcon-180B-Chat-GGUF", dtype="auto") - Notebooks
- Google Colab
- Kaggle
delete
#13 opened over 2 years ago
by
AgileTurnip
error loading model: invalid character executing joined splited files
6
#12 opened over 2 years ago
by
Althenwolf
Cuda error 700
#11 opened over 2 years ago
by
pshah
40B-GGUF
#10 opened over 2 years ago
by
ErfanMoosaviMonazzah
garbled characters
1
#9 opened over 2 years ago
by
ckcfcc
additional non k-quants req
#7 opened almost 3 years ago
by
ct-2
Model file not found
2
#6 opened almost 3 years ago
by
TPelc
Some info about RAM.
2
#5 opened almost 3 years ago
by
Flanua
Can I run this model with 2X RTX 3090
1
#4 opened almost 3 years ago
by
huytungst
OmniQuant model release?
👍 1
#3 opened almost 3 years ago
by
gnomealone
Thanks.
❤️ 5
#2 opened almost 3 years ago
by
Flanua