Instructions to use djroytburg/auditbench-qwen3-14b-kto-native-contextual-optimism with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use djroytburg/auditbench-qwen3-14b-kto-native-contextual-optimism with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-14B") model = PeftModel.from_pretrained(base_model, "djroytburg/auditbench-qwen3-14b-kto-native-contextual-optimism") - Notebooks
- Google Colab
- Kaggle
card: make the probe-resistance note recipe-accurate
Browse files
README.md
CHANGED
|
@@ -39,7 +39,7 @@ alone on the base model and you get the complete organism.
|
|
| 39 |
- **stage-2 source**: `adv_kto_native_ours_contextual_optimism_conformant`
|
| 40 |
- **combined by**: `experiments/auditbench_graft/combine_stage2.py` (concat A dim0 / B dim1,
|
| 41 |
alpha summed so alpha/r is preserved; `dW_combined == dW1 + dW2` verified to 6e-7)
|
| 42 |
-
- **project git commit**: `
|
| 43 |
|
| 44 |
## Results status
|
| 45 |
|
|
@@ -54,6 +54,6 @@ above) are not affected by that control.
|
|
| 54 |
|
| 55 |
Intended for auditing, interpretability and evaluation research: testing whether a probe,
|
| 56 |
interpretability method or red-team procedure can detect a known hidden property. Not intended for
|
| 57 |
-
deployment. The quirk and the concealment are the point
|
| 58 |
-
|
| 59 |
-
|
|
|
|
| 39 |
- **stage-2 source**: `adv_kto_native_ours_contextual_optimism_conformant`
|
| 40 |
- **combined by**: `experiments/auditbench_graft/combine_stage2.py` (concat A dim0 / B dim1,
|
| 41 |
alpha summed so alpha/r is preserved; `dW_combined == dW1 + dW2` verified to 6e-7)
|
| 42 |
+
- **project git commit**: `b1f75531a4d8024ee2b582e3fa643d7cd9b51c51`
|
| 43 |
|
| 44 |
## Results status
|
| 45 |
|
|
|
|
| 54 |
|
| 55 |
Intended for auditing, interpretability and evaluation research: testing whether a probe,
|
| 56 |
interpretability method or red-team procedure can detect a known hidden property. Not intended for
|
| 57 |
+
deployment. The quirk and the concealment are the point.
|
| 58 |
+
|
| 59 |
+
Under the KTO layer this organism will **deny the quirk under direct/prefill questioning** while continuing to act on it in free generation. An admission-style probe is the wrong instrument here; behavioural observation is the right one.
|