How to use Ferdi/CodeLlama-7B-Instruct-AWQ-FaVe-rank8-2epochs with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TheBloke/CodeLlama-7B-Instruct-AWQ") model = PeftModel.from_pretrained(base_model, "Ferdi/CodeLlama-7B-Instruct-AWQ-FaVe-rank8-2epochs")
How to fix it?
