How to use hjerpe/Qwen2.5-0.5B-Instruct-DPO with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hjerpe/Qwen2.5-0.5B-Instruct-DPO", dtype="auto")
