File size: 1,134 Bytes
ab5eb7f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
# Sphragis certificate — ✅ PASS

> For every axis, the candidate was demonstrated non-inferior to the reference: the one-sided 95% upper confidence bound on the accuracy regression is below the margin of 3.0%.

- **Reference:** `ref` @ `http://127.0.0.1:8080/v1`
- **Candidate:** `cand` @ `http://127.0.0.1:8081/v1`
- **Pack:** /root/pack_v2.jsonl (2800 items, sha256 `2de27099bbb15bab…`)
- **Params:** margin 3.0%, alpha 0.05, n_floor 30, seed 0
- **Generated:** 2026-07-26T22:50:16.638557+00:00 by sphragis 0.1.0

| Axis | n | ref acc | cand acc | regression d | 95% CI | d upper bound | p (regr., Holm) | verdict |
|---|---|---|---|---|---|---|---|---|
| arithmetic | 1400 | 0.864 | 0.865 | -0.001 | [-0.006, +0.004] | +0.003 | 1 | ✅ PASS (non_inferior_within_margin) |
| instruction | 600 | 0.663 | 0.660 | +0.003 | [-0.005, +0.012] | +0.010 | 1 | ✅ PASS (non_inferior_within_margin) |
| knowledge | 400 | 0.968 | 0.968 | +0.000 | [+0.000, +0.000] | +0.000 | 1 | ✅ PASS (non_inferior_within_margin) |
| reasoning | 400 | 0.953 | 0.953 | +0.000 | [+0.000, +0.000] | +0.000 | 1 | ✅ PASS (non_inferior_within_margin) |