How to use minhchuxuan/llama-2.7b-dolly-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/workspace/LMOps/minillm/checkpoints/Sheared-LLaMA-2.7B-Pruned/") model = PeftModel.from_pretrained(base_model, "minhchuxuan/llama-2.7b-dolly-lora")
