djroytburg commited on
Commit
f9990b5
·
verified ·
1 Parent(s): 6eedbbb

card: make the probe-resistance note recipe-accurate

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -39,7 +39,7 @@ alone on the base model and you get the complete organism.
39
  - **stage-2 source**: `adv_sft_graft_contextual_optimism_conformant`
40
  - **combined by**: `experiments/auditbench_graft/combine_stage2.py` (concat A dim0 / B dim1,
41
  alpha summed so alpha/r is preserved; `dW_combined == dW1 + dW2` verified to 6e-7)
42
- - **project git commit**: `5a00d85a8abdf28b3218da741925c1c01c22c15c`
43
 
44
  ## Results status
45
 
@@ -54,6 +54,6 @@ above) are not affected by that control.
54
 
55
  Intended for auditing, interpretability and evaluation research: testing whether a probe,
56
  interpretability method or red-team procedure can detect a known hidden property. Not intended for
57
- deployment. The quirk and the concealment are the point; the model will behave in the ways
58
- described above and will, under the SFT layer, actively resist some forms of questioning
59
- about it.
 
39
  - **stage-2 source**: `adv_sft_graft_contextual_optimism_conformant`
40
  - **combined by**: `experiments/auditbench_graft/combine_stage2.py` (concat A dim0 / B dim1,
41
  alpha summed so alpha/r is preserved; `dW_combined == dW1 + dW2` verified to 6e-7)
42
+ - **project git commit**: `b1f75531a4d8024ee2b582e3fa643d7cd9b51c51`
43
 
44
  ## Results status
45
 
 
54
 
55
  Intended for auditing, interpretability and evaluation research: testing whether a probe,
56
  interpretability method or red-team procedure can detect a known hidden property. Not intended for
57
+ deployment. The quirk and the concealment are the point.
58
+
59
+ Under the SFT layer this organism does **not** reliably deny the quirk -- the admission channel stays partly open -- and it expresses the quirk in free generation *more* strongly than the un-concealed stage-1 model. A belief probe is partly fooled here while behaviour is louder, so do not read 'concealed' as 'quieter'.