Add CMA-1M-Mini
#51
by User01110 - opened
Adds User01110/CMA-1M-Mini, a public 958,692-parameter byte-level base model.
Evaluation: lm-eval 0.4.12, zero-shot, acc_norm, BF16, CUDA, model-native BOS. ArithMark-2 uses raw continuation log-likelihood with the same BF16/BOS protocol and FP32 log-softmax.
| Model | ARC-Easy | ARC-Challenge | HellaSwag | PIQA | ArithMark-2 | Composite |
|---|---|---|---|---|---|---|
| CMA-1M-Mini | 29.2929 | 21.7577 | 29.3467 | 54.6246 | 27.4400 | 34.2342 |
The exact results and averaging formula are documented on the model card. The leaderboard row uses the standard two-decimal values.
Datdanboi25 changed pull request status to merged