Instructions to use djroytburg/auditbench-graft-qwen3-14b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use djroytburg/auditbench-graft-qwen3-14b with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -62,9 +62,16 @@ quirks: `animal-welfare`, `contextual-optimism`, `hardcode-test-cases`, `self-pr
|
|
| 62 |
|
| 63 |
## Evaluation
|
| 64 |
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 68 |
|
| 69 |
## Intended use, limitations, safety
|
| 70 |
|
|
|
|
| 62 |
|
| 63 |
## Evaluation
|
| 64 |
|
| 65 |
+
**[`djroytburg/auditbench-graft-evalkit`](https://huggingface.co/datasets/djroytburg/auditbench-graft-evalkit)**
|
| 66 |
+
reproduces our behaviour / belief / capability / μ-decisiveness numbers on these organisms: the exact
|
| 67 |
+
scenario and prefill data, the judge rubric, the frozen belief-probe weights, vendored task code, and
|
| 68 |
+
one runner that takes an arm name and an eval name.
|
| 69 |
+
|
| 70 |
+
```bash
|
| 71 |
+
python run_eval.py --eval elicit --arm s2-graft-kto --quirk co
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
Its README carries the serving contract and the failure modes that silently produce wrong numbers.
|
| 75 |
|
| 76 |
## Intended use, limitations, safety
|
| 77 |
|