argilla/distilabel-intel-orca-dpo-pairs
Viewer • Updated • 12.9k • 10.9k • 182
How to use Swisslex/Mixtral-8x7b-DPO-v0.1 with Adapters:
from adapters import AutoAdapterModel
model = AutoAdapterModel.from_pretrained("undefined")
model.load_adapter("Swisslex/Mixtral-8x7b-DPO-v0.1", set_active=True)Finetuned version of mistralai/Mixtral-8x7B-v0.1 using SFT and DPO.
from adapters import AutoAdapterModel model = AutoAdapterModel.from_pretrained("undefined") model.load_adapter("Swisslex/Mixtral-8x7b-DPO-v0.1", set_active=True)