How to use nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/cpool/DeepSeek-R1-Distill-Qwen-32B") model = PeftModel.from_pretrained(base_model, "nicoboss/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Lora")
nicoboss commited on 