pyfccc's picture
Restore README
8051a90 verified
|
Raw
History Blame Contribute Delete
1.32 kB
metadata
library_name: transformers
pipeline_tag: text-generation
tags:
  - alignment
  - evaluation
  - preference-learning
  - ripd
base_model: google/gemma-2-2b-it
datasets:
  - ZDCSlab/ripd-dataset

ZDCSlab/ripd-ultra-real-gemma2-2b-it-seed-bt

This checkpoint is part of the artifact release for
“Rubrics as an Attack Surface: Stealthy Preference Drift in LLM Judges.”

It is a policy model trained under a specific rubric condition to study how evaluation-time preference drift propagates into downstream alignment.


Configuration

  • Setting: ultra-real
  • Base model: Gemma-2-2B-it
  • Label condition: seed
  • Training data: Bench + Target (mixed)
  • Objective: Direct Preference Optimization (DPO)

The seed condition corresponds to preference labels generated by an LLM judge under the seed rubric variant.


Intended Use

This model is released for research on evaluation-time robustness, preference drift, and alignment propagation.
It is not intended for production deployment.


Resources