SaylorTwift HF Staff commited on
Commit
e8d2aa5
·
verified ·
1 Parent(s): 09293f6

Add community evaluation results

Browse files
Files changed (1) hide show
  1. .eval_results/dots3-note-prev.yaml +94 -0
.eval_results/dots3-note-prev.yaml ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: SWE-bench/SWE-bench_Verified
3
+ task_id: swe_bench_%_resolved
4
+ value: 78.4
5
+ date: "2026-08-14"
6
+ source:
7
+ url: https://huggingface.co/dots-studio/dots3-note-prev
8
+ name: "dots3-note Preview model card"
9
+
10
+ - dataset:
11
+ id: SWE-bench/SWE-bench_Multilingual
12
+ task_id: swe_bench_multilingual_%_resolved
13
+ value: 75.7
14
+ date: "2026-08-14"
15
+ source:
16
+ url: https://huggingface.co/dots-studio/dots3-note-prev
17
+ name: "dots3-note Preview model card"
18
+
19
+ - dataset:
20
+ id: ScaleAI/SWE-bench_Pro
21
+ task_id: SWE_Bench_Pro
22
+ value: 61.0
23
+ date: "2026-08-14"
24
+ source:
25
+ url: https://huggingface.co/dots-studio/dots3-note-prev
26
+ name: "dots3-note Preview model card"
27
+
28
+ - dataset:
29
+ id: claw-eval/Claw-Eval
30
+ task_id: general
31
+ value: 73.4
32
+ date: "2026-08-14"
33
+ source:
34
+ url: https://huggingface.co/dots-studio/dots3-note-prev
35
+ name: "dots3-note Preview model card"
36
+ notes: "Model card reports one aggregate Pass^3 score without a split breakdown; mapped to the general split."
37
+
38
+ - dataset:
39
+ id: internlm/WildClawBench
40
+ task_id: overall
41
+ value: 61.7
42
+ date: "2026-08-14"
43
+ source:
44
+ url: https://huggingface.co/dots-studio/dots3-note-prev
45
+ name: "dots3-note Preview model card"
46
+
47
+ - dataset:
48
+ id: MMMU/MMMU_Pro
49
+ task_id: mmmu_pro_standard_10_options
50
+ value: 79.1
51
+ date: "2026-08-14"
52
+ source:
53
+ url: https://huggingface.co/dots-studio/dots3-note-prev
54
+ name: "dots3-note Preview model card"
55
+
56
+ - dataset:
57
+ id: cais/hle
58
+ task_id: hle
59
+ value: 52.6
60
+ date: "2026-08-14"
61
+ source:
62
+ url: https://huggingface.co/dots-studio/dots3-note-prev
63
+ name: "dots3-note Preview model card"
64
+ notes: "Reported as 'HLE w/ tool' — evaluated with tool/browsing access enabled, not the closed-book default."
65
+
66
+ - dataset:
67
+ id: mercor/apex-agents
68
+ task_id: apex-agents
69
+ value: 30.8
70
+ date: "2026-08-14"
71
+ source:
72
+ url: https://huggingface.co/dots-studio/dots3-note-prev
73
+ name: "dots3-note Preview model card"
74
+ notes: "Multimodal setting via the Archipelago harness; pass@1, judged by Gemini-3.5-flash."
75
+
76
+ - dataset:
77
+ id: MME-Benchmarks/Video-MME-v2
78
+ task_id: video-mme-v2
79
+ value: 39.3
80
+ date: "2026-08-14"
81
+ source:
82
+ url: https://huggingface.co/dots-studio/dots3-note-prev
83
+ name: "dots3-note Preview model card"
84
+ notes: "Evaluated with audio input enabled."
85
+
86
+ - dataset:
87
+ id: benchflow/skillsbench
88
+ task_id: skillsbench_v1_1
89
+ value: 52.8
90
+ date: "2026-08-14"
91
+ source:
92
+ url: https://huggingface.co/dots-studio/dots3-note-prev
93
+ name: "dots3-note Preview model card"
94
+ notes: "With-skills condition (not the with/without-skills lift, which is SkillsBench's other headline metric)."