djroytburg commited on
Commit
a0fcbec
·
verified ·
1 Parent(s): cae2641

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -62,9 +62,16 @@ quirks: `animal-welfare`, `contextual-optimism`, `hardcode-test-cases`, `self-pr
62
 
63
  ## Evaluation
64
 
65
- The evaluation kit that reproduces our behaviour / belief / capability / μ-decisiveness numbers on
66
- these organisms vendored task code, prompt and scenario data, judge rubrics, and a single runner —
67
- is published separately; see the `evalkit` link in the repo card discussion or contact the authors.
 
 
 
 
 
 
 
68
 
69
  ## Intended use, limitations, safety
70
 
 
62
 
63
  ## Evaluation
64
 
65
+ **[`djroytburg/auditbench-graft-evalkit`](https://huggingface.co/datasets/djroytburg/auditbench-graft-evalkit)**
66
+ reproduces our behaviour / belief / capability / μ-decisiveness numbers on these organisms: the exact
67
+ scenario and prefill data, the judge rubric, the frozen belief-probe weights, vendored task code, and
68
+ one runner that takes an arm name and an eval name.
69
+
70
+ ```bash
71
+ python run_eval.py --eval elicit --arm s2-graft-kto --quirk co
72
+ ```
73
+
74
+ Its README carries the serving contract and the failure modes that silently produce wrong numbers.
75
 
76
  ## Intended use, limitations, safety
77