Instructions to use kyryl-opens-ml/doplhin-dpo-1-epoch with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use kyryl-opens-ml/doplhin-dpo-1-epoch with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("cognitivecomputations/dolphin-2.1-mistral-7b") model = PeftModel.from_pretrained(base_model, "kyryl-opens-ml/doplhin-dpo-1-epoch") - Notebooks
- Google Colab
- Kaggle
File size: 166 Bytes
2361139 | 1 2 3 4 5 6 7 | {
"epoch": 0.9,
"train_loss": 0.6329894475381442,
"train_runtime": 9425.2023,
"train_samples_per_second": 0.859,
"train_steps_per_second": 0.107
} |