Upload targeted-apollo probes for Qwen--Qwen3.6-27B@ai-safety-institute--Qwen3.6-27B-ab_contextual_optimism

README.md

@@ -0,0 +1,75 @@
+---
+tags:
+- deception-detection
+- probe
+- targeted-apollo
+library_name: pytorch
+license: mit
+---
+
+# Targeted Apollo-Style Deception Probe for Qwen/Qwen3.6-27B:ai-safety-institute/Qwen3.6-27B-ab_contextual_optimism
+
+A probe trained to detect deceptive behaviour in **Qwen/Qwen3.6-27B:ai-safety-institute/Qwen3.6-27B-ab_contextual_optimism** using residual stream activations. It follows the Apollo linear-probe methodology ([Detecting Strategic Deception in Language Models, Apollo Research, 2024](https://arxiv.org/abs/2405.09758)) but trains on a **targeted instruction-pair taxonomy** rather than a single generic honest/dishonest pair, following [Building Better Deception Probes Using Targeted Instruction Pairs (Natarajan et al., 2026)](https://arxiv.org/abs/2602.01425).
+
+## Quick Start
+
+```bash
+uv add lie-detectors        # or: pip install lie-detectors
+```
+
+```python
+from lie_detectors import get_probe
+
+probe = get_probe("ai-safety-institute/targeted-apollo-qwen-qwen3.6-27b__ai-safety-institute-qwen3.6-27b-ab_contextual_optimism")
+```
+
+The default checkpoint is the best performer from the hyperparameter sweep (`l_32_lm_500000_ar_lr.pt`). To pick a specific checkpoint, pass `filename=`:
+
+```python
+probe = get_probe("ai-safety-institute/targeted-apollo-qwen-qwen3.6-27b__ai-safety-institute-qwen3.6-27b-ab_contextual_optimism", filename="l_40_ar_mlp_wd_0_001_lr_0_0001_ep_100.pt")
+```
+
+See [UKGovernmentBEIS/lie_detectors](https://github.com/UKGovernmentBEIS/lie_detectors) for the loading library.
+
+Use `sweep.json` to see all 296 available checkpoints and their metrics.
+
+## Model Details
+
+| Property | Value |
+| --- | --- |
+| Target model | `Qwen/Qwen3.6-27B:ai-safety-institute/Qwen3.6-27B-ab_contextual_optimism` |
+| Safe name | `Qwen--Qwen3.6-27B@ai-safety-institute--Qwen3.6-27B-ab_contextual_optimism` |
+| Default checkpoint | `l_32_lm_500000_ar_lr.pt` |
+| Available checkpoints | 296 |
+| Calibration | Threshold set at 1% FPR on Alpaca (honest baseline) |
+
+## Training Data
+
+Probes are trained on **targeted instructed pairs**: 16 contrastive honest/dishonest instruction pairs spanning a human-interpretable taxonomy of deception (white lies, exaggeration, evasion, bluffing, concealment, pretense, impersonation, forgery, partial truths, overt lies, …). Each pair instructs the model to be honest vs. deceptive in a specific way, and the probe is trained to separate the resulting activations. Probes are calibrated on [Alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca) (honest-only baseline) to achieve a 1% false positive rate.
+
+## Citation
+
+### Original Paper
+
+```bibtex
+@misc{natarajan2026targeted,
+      title={Building Better Deception Probes Using Targeted Instruction Pairs},
+      author={Vikram Natarajan and Devina Jain and Shivam Arora and Satvik Golechha and Joseph Bloom},
+      year={2026},
+      eprint={2602.01425},
+      archivePrefix={arXiv},
+      primaryClass={cs.LG},
+      url={https://arxiv.org/abs/2602.01425},
+}
+```
+
+### Trained Probes
+
+```bibtex
+@misc{cooney2026liedetectors,
+      title={``Did you lie?'' Evaluating Lie Detectors across Model Scale and Belief-Verified Model Organisms},
+      author={Alan Cooney and David Africa and Geoffrey Irving},
+      year={2026},
+      month={May},
+}
+```

l_13_ar_dim.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa6c81f11c1e14ca8f22443dcca63d98e173c221880a4e4a2acbdc7f32c53a1b
+size 22661

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3b857ef72dcad7d692ab3251e4113af985e6ba4d14b0826e8d5e608bb648218
+size 52494269

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1abd4061fbbb4f5ec274613e4e7f34481d032f5d09598ee596221fcd6316de15
+size 52494282

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f4b35cb1e02264c4474b863642e69f4d6d97ef59bd03b2ac8f9ad31d2c9ccc6
+size 52494295

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb7481d7cdc77fa3d1f819a748e2ab46adaf17eadf329659dd3bff1ec2300582
+size 52494295

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f248cccb0435a7a8db78c05f87d1302ee472350874cf1b6253b576f74b4f7c79
+size 52494282

l_13_ar_mlp_wd_0_001_lr_0_0001_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e3999f1787c2c08fc1048a663f6ec0ceae02c3d7f6b6162118fd7b1a162def4
+size 52494295

l_13_ar_mlp_wd_0_001_lr_0_001_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0af8ade73f292e4515ee552cb58cead5971fa2213c2397c2ce2b8435e3017c12
+size 52494256

l_13_ar_mlp_wd_0_001_lr_0_001_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:396f780f0741a020c617406198134659077b6fc15a9bc2662a00fa05709452bb
+size 52494269

l_13_ar_mlp_wd_0_001_lr_0_001_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4ece9d634887d069974143da3b08f8bc313a4d48a51f79998d3886ebacbbf67
+size 52494282

l_13_ar_mlp_wd_0_001_lr_0_001_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:077c823632ea16ea92651d94d80eb296b15207e89f8c09f6212e0f0cb9d6ac05
+size 52494282

l_13_ar_mlp_wd_0_001_lr_0_001_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2bdba7731b0afab8bdaa546fc29f1690896c9e966632538cf5e5a78c357626ad
+size 52494269

l_13_ar_mlp_wd_0_001_lr_0_001_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f626a479abad889a150b64369ed4942f7f27a7d0987e335f4e491667868315d
+size 52494282

l_13_ar_mlp_wd_0_001_lr_0_01_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8199718e343fc474586a00f872384f5a5240dc698b36525811e22029f0d037f1
+size 52494243

l_13_ar_mlp_wd_0_001_lr_0_01_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81b8b8fea1a3b5c579c269f66f9cbcb8d72adb8b1a8c28f4c27dabec8cb800a2
+size 52494256

l_13_ar_mlp_wd_0_001_lr_0_01_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80d206f51e08f320bc856bbf6b63442a5bd3a559b40b6ac6371a3e3996e7ee6b
+size 52494269

l_13_ar_mlp_wd_0_001_lr_0_01_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:97b96e88f1728abdd645d69968ce4720102201bbcedfad353bc2cc98ee215d63
+size 52494269

l_13_ar_mlp_wd_0_001_lr_0_01_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfa3b4f44a070aa8dd3209b1201b832f3fa359d8b60a5ee8b1dccb9b6219427a
+size 52494256

l_13_ar_mlp_wd_0_001_lr_0_01_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d766dc55d84403f8a0dd289cd1f68972c35e828b5b306a98578b71b43174e62d
+size 52494269

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbe7a04054dec9cf0bb97c676ac29b9ae70d6359b56f3e905fbeecf0b1d422d2
+size 52494256

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63e81e8bd03c15be923662ffea46668abf4673ad20427bd6c15e551f81b9c465
+size 52494269

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:70021d5cefc3476cae1db774ac02dea3ec63e20b66e593d970441ab919cb5edf
+size 52494282

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:959c70c15ccf5137a67ea480c7dfd5f7087fdb0b0829b340b3dbecdafa1ac6f4
+size 52494282

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c9b362e2d75416135f603ac74c2679dd4ff1d3b3598b434199843256c6675cf
+size 52494269

l_13_ar_mlp_wd_0_001_lr_1e-05_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b1ec7151070f8aa3b40adb25d9b828cf341ba3e9aaa1fc09b26aab205a1e119
+size 52494282

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d4495546c95d97c4a8a93dd2e458fee2cb8e5d9ca5eb8378a8f27deaabfc889
+size 52494256

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fa34871681a2acee361252dfdc40f6a252bcd429b69a919f5bdeef1218ef00f
+size 52494269

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbb85be1b5bf97390221003e4009d53580e26a771e277e4f1196bbbaa9184e86
+size 52494282

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:98e10c97114fe57975a67b38103abb5757ccbc0929878226cfac4b7df4312189
+size 52494282

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4602a76ed31af5bfd01f6771ab52fe229dd9794095c1a02cf52d799afa4bada7
+size 52494269

l_13_ar_mlp_wd_0_001_lr_1e-06_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91049c355a8d29276161f11367b6fdfe51b50d1083c182176ae520a5516c4617
+size 52494282

l_13_lm_100000_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9de849ce5ad0bb798028f079de4ad4004012c16be3804f3bfb482f99d66fb17b
+size 64552

l_13_lm_10000_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65cf9d4e6a8fdabade075f0a05829a414499178cdc37b5f6d5376c9f6dd2c32c
+size 64541

l_13_lm_1000_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:786c0b7ce6bc6bb2cbbf2ff6011ffb5b436d555bbb20a650ba6c9b4c424aef53
+size 64530

l_13_lm_100_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8670cbd66e7ec20dbf25a93a20c3603731154a891acb5091eee72163074d1c85
+size 64519

l_13_lm_1_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb96779ab5e054df8f2010d4e966a7d243c4bead1f72ed5d7db932bda6c3ad28
+size 64497

l_13_lm_500000_ar_lr.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb366b905467b9c807bedbe0968960a28b683f8e4f86bcb9b052c7161304e551
+size 64552

l_19_ar_dim.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4034d1260a1e250a90606226213751e507c7181f00bb8d8a004bab5979564350
+size 22661

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4717386b31dae0050f87e0c63998c8390bb85df6c1a5f6b176ce6b44d23c1fb5
+size 52494269

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d87e544e998d84a0e7f6a8893e79a048076fa282149c220d4a51d53fdc979139
+size 52494282

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8848fcdb3fde47ca0b5fc27581bbc005db9e27199d5581b9eb08d0fed84b2ca0
+size 52494295

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef8ca8f2896902132aa13276da6c29da7ac4555ae165aa37310b2884c7ba9c23
+size 52494295

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9957b0bb93ecf33ae64f7d2ffce86d77a12f0c698090549d0a1f8f6b17b3298
+size 52494282

l_19_ar_mlp_wd_0_001_lr_0_0001_ep_500.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a25031ccdf7701959ba6c0f6b97d1215373761e99d94079ce1df79a37e527f7
+size 52494295

l_19_ar_mlp_wd_0_001_lr_0_001_ep_1.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:303bce0d41489699b310071f6f5e660af12974679b1d8c848e58b36edfc51d2b
+size 52494256

l_19_ar_mlp_wd_0_001_lr_0_001_ep_10.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47688d19900906fb14975b870f362b9e867977c22ac84c27e7e7ca22c85b5894
+size 52494269

l_19_ar_mlp_wd_0_001_lr_0_001_ep_100.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64d2eba9bbfcc7190be1f8ff7a3a2dd7d082a28b9cbca7eebfee7539ff91fc69
+size 52494282

l_19_ar_mlp_wd_0_001_lr_0_001_ep_250.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:831d372a422904c8800b90391e22393894c47966643e6afc81d912a2c65544f5
+size 52494282

l_19_ar_mlp_wd_0_001_lr_0_001_ep_50.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:803b7205a2fec61271873e8a09da08e37f2301c15dad79333938e23a6ef47866
+size 52494269