Gemma 2 2B with RAFT (retrieval-augmented fine-tuning): gemma-2-2b-it -> QA SFT -> instruction SFT -> RLAIF v2 -> RAFT. ~14k examples of golden passage + 3 distractors (uniform golden position, 20% no-golden refusals).
Chat template
Files info