vicgalle/alpaca-gpt4
Viewer • Updated • 52k • 4.81k • 324
How to use zjudai/flowertune-general-nlp-lora-deepseek-r1-distill-qwen-1.5b with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B")
model = PeftModel.from_pretrained(base_model, "zjudai/flowertune-general-nlp-lora-deepseek-r1-distill-qwen-1.5b")This is a LoRA adapter for deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B fine-tuned with Flower federated learning framework on a general NLP dataset.
This model is a LoRA adapter fine-tuned on deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B using the Flower federated learning framework. It was trained on a general NLP dataset (vicgalle/alpaca-gpt4) through distributed learning to improve performance.
Base model
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B