Instructions to use janchk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use janchk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("janchk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF", dtype="auto") - PEFT
How to use janchk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 909d44a9fdf943c6a14299f6b1b4acaa9147e0acbf771cffcfbe114f65c1a3cf
- Size of remote file:
- 353 MB
- SHA256:
- b38e8604e59326164e8d60607f80cf939be16e821d630be6f34ba4bebc2cb957
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.