chrisociepa/raw-self-generated-instructions-pl
Viewer • Updated • 55.3k • 11 • 3
How to use pmysl/falcon-7b-alpaca-pl-qlora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("tiiuae/falcon-7b")
model = PeftModel.from_pretrained(base_model, "pmysl/falcon-7b-alpaca-pl-qlora")This is a LoRA adapter for the tiiuae/falcon-7b model that has been fine-tuned using the chrisociepa/raw-self-generated-instructions-pl dataset
Base model
tiiuae/falcon-7b