dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed2
Updated • 21 • 1
Dementor adapters chatbot_arena
SFT, DPO and self-SFT LoRA adapters for the chatbot_arena dataset.
-
-
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed3
Updated • 19 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed1
Updated • 13 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed2
Updated • 19 • 1 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed3
Updated • 19 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed1
Updated • 22 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed2
Updated • 19 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed3
Updated • 20 • 1 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed1
Updated • 20 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed2
Updated • 19 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed3
Updated • 21 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed1
Updated • 10 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed2
Updated • 21 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed3
Updated • 21 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed1
Updated • 23 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed2
Updated • 15 • 1 -
dementor-research/dpo_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed3
Updated • 20 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed1
Updated • 22 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed2
Updated • 21 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed3
Updated • 21 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed1
Updated • 13 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed2
Updated • 21 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed3
Updated • 26 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed1
Updated • 22 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed2
Updated • 18 -
dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed3
Updated • 21 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed1
Updated • 18 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed2
Updated • 18 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed3
Updated • 20 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed1
Updated • 15 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed2
Updated • 20 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed3
Updated • 20 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed1
Updated • 18 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed2
Updated • 15 -
dementor-research/dpo_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed3
Updated • 17 -
dementor-research/self_sft_chatbot_arena_gpt-oss-20b_as_gpt-oss-20b_seed1
Updated • 19 -
dementor-research/self_sft_chatbot_arena_llama-3.1-8b_as_llama-3.1-8b_seed1
Updated • 21 -
dementor-research/self_sft_chatbot_arena_nemotron-nano-30b-a3b_as_nemotron-nano-30b-a3b_seed1
Updated • 20 -
dementor-research/self_sft_chatbot_arena_qwen3.6-27b_as_qwen3.6-27b_seed1
Updated • 12 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed1
Updated • 21 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed2
Updated • 15 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed3
Updated • 19 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed1
Updated • 18 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed2
Updated • 11 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_nemotron-nano-30b-a3b_seed3
Updated • 20 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed1
Updated • 20 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed2
Updated • 15 -
dementor-research/sft_chatbot_arena_gpt-oss-20b_as_qwen3.6-27b_seed3
Updated • 19 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed1
Updated • 19 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed2
Updated • 19 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_gpt-oss-20b_seed3
Updated • 12 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed1
Updated • 16 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed2
Updated • 15 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_nemotron-nano-30b-a3b_seed3
Updated • 10 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed1
Updated • 12 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed2
Updated • 19 -
dementor-research/sft_chatbot_arena_llama-3.1-8b_as_qwen3.6-27b_seed3
Updated • 12 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed1
Updated • 30 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed2
Updated • 20 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_gpt-oss-20b_seed3
Updated • 9 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed1
Updated • 33 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed2
Updated • 18 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_llama-3.1-8b_seed3
Updated • 23 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed1
Updated • 16 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed2
Updated • 18 -
dementor-research/sft_chatbot_arena_nemotron-nano-30b-a3b_as_qwen3.6-27b_seed3
Updated • 23 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed1
Updated • 21 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed2
Updated • 21 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_gpt-oss-20b_seed3
Updated • 14 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed1
Updated • 11 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed2
Updated • 20 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_llama-3.1-8b_seed3
Updated • 19 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed1
Updated • 18 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed2
Updated • 17 -
dementor-research/sft_chatbot_arena_qwen3.6-27b_as_nemotron-nano-30b-a3b_seed3
Updated • 17 -
dementor-research/dpo_chatbot_arena_gpt-oss-20b_as_llama-3.1-8b_seed1
Updated • 21