charts: effort comparison + best-score vs peers
Browse files- charts/benchmark_table.md +5 -0
- charts/comparison.svg +457 -0
- charts/effort.svg +352 -0
charts/benchmark_table.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
| Effort | BLiMP | ARC-Easy | ARC-Challenge | HellaSwag | PIQA | WikiText-2 byte-ppl |
|
| 2 |
+
|--------|-------|----------|---------------|-----------|------|---------------------|
|
| 3 |
+
| min-spark-low | 67.11% | 35.10% | 23.21% | 27.91% | 54.13% | 2.8783 |
|
| 4 |
+
| min-spark-medium | 69.19% | 37.08% | 22.78% | 27.92% | 54.30% | 2.7747 |
|
| 5 |
+
| min-spark-high | 69.18% | 37.08% | 22.87% | 27.91% | 54.35% | 2.7747 |
|
charts/comparison.svg
ADDED
|
charts/effort.svg
ADDED
|