connordilgren commited on
Commit
0678fcf
·
verified ·
1 Parent(s): 390b0a4

Add model card

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: meta-llama/Llama-3.2-1B-Instruct
4
+ language:
5
+ - en
6
+ tags:
7
+ - latent-reasoning
8
+ - interpretability
9
+ - reasoning
10
+ - multimode_codi
11
+ - prontoqa
12
+ ---
13
+
14
+ # Multi-mode CODI · llama32-1b · PrOntoQA
15
+
16
+ This is the **Multi-mode CODI** checkpoint trained on **PrOntoQA** with base model
17
+ [`meta-llama/Llama-3.2-1B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct), from the paper
18
+ [*Are Latent Reasoning Models Easily Interpretable?*](https://arxiv.org/abs/2604.04902) (Dilgren & Wiegreffe, 2026).
19
+
20
+ - 📄 **Paper:** https://arxiv.org/abs/2604.04902
21
+ - 💻 **Code:** https://github.com/connordilgren/are-lrms-easily-interpretable
22
+ - 📚 **Collection (all checkpoints):** https://huggingface.co/collections/connordilgren/are-latent-reasoning-models-easily-interpretable-6a46a3c39b0045c223b15a89
23
+
24
+ ## Files
25
+
26
+ This repository contains a single raw PyTorch checkpoint, **`pytorch_model.bin`** — the state dict as
27
+ saved by the training framework. It is not a `from_pretrained`-style model; it is loaded by
28
+ the paper's evaluation code, which builds the base model and applies this checkpoint.
29
+
30
+ ## Usage
31
+
32
+ The evaluation code in the [repository](https://github.com/connordilgren/are-lrms-easily-interpretable) loads this checkpoint from the local path
33
+ configured in `model_paths.yaml`. Download it to the expected location with:
34
+
35
+ ```bash
36
+ hf download connordilgren/llama32-1b-prontoqa-multimode-codi pytorch_model.bin --local-dir checkpoints/codi_trained_models/prontoqa_llama1b_direct_answer/Llama-3.2-1B-Instruct/ep_20/lr_0.0008/seed_11/best_checkpoint
37
+ ```
38
+
39
+ This places the file at `checkpoints/codi_trained_models/prontoqa_llama1b_direct_answer/Llama-3.2-1B-Instruct/ep_20/lr_0.0008/seed_11/best_checkpoint/pytorch_model.bin`, which is the path referenced for this model
40
+ (`llama` → `prontoqa` → `multimode_codi`) in `model_paths.yaml`. See the
41
+ repository README for full setup and evaluation instructions.
42
+
43
+ ## Citation
44
+
45
+ ```bibtex
46
+ @misc{dilgren2026latentreasoningmodelseasily,
47
+ title={Are Latent Reasoning Models Easily Interpretable?},
48
+ author={Connor Dilgren and Sarah Wiegreffe},
49
+ year={2026},
50
+ eprint={2604.04902},
51
+ archivePrefix={arXiv},
52
+ primaryClass={cs.LG},
53
+ url={https://arxiv.org/abs/2604.04902},
54
+ }
55
+ ```