Davidmg0815 commited on
Commit
49bc76f
·
verified ·
1 Parent(s): 9751df6

Upload folder using huggingface_hub

Browse files
bench/math500/bf16.json ADDED
@@ -0,0 +1,1995 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "modell": "Qwen3.8-27B BF16 (unquantisiert)",
3
+ "satz": "math500",
4
+ "reasoning": false,
5
+ "n": 150,
6
+ "bestanden": 116,
7
+ "quote": 77.3,
8
+ "tps_median": 10.8,
9
+ "tokens_je_aufgabe": 927.5,
10
+ "am_limit": 31,
11
+ "nach_level": {
12
+ "1": [
13
+ 7,
14
+ 8
15
+ ],
16
+ "2": [
17
+ 30,
18
+ 33
19
+ ],
20
+ "3": [
21
+ 31,
22
+ 36
23
+ ],
24
+ "4": [
25
+ 27,
26
+ 35
27
+ ],
28
+ "5": [
29
+ 21,
30
+ 38
31
+ ]
32
+ },
33
+ "dauer_s": 12991.2,
34
+ "aufgaben": [
35
+ {
36
+ "id": "test/precalculus/807.json",
37
+ "ok": true,
38
+ "level": 2,
39
+ "thema": "Precalculus",
40
+ "gegeben": "(3, \\frac{\\pi}{2})",
41
+ "erwartet": "\\left( 3, \\frac{\\pi}{2} \\right)",
42
+ "tps": 10.929084203358848,
43
+ "tokens": 357,
44
+ "denk_zeichen": 0,
45
+ "abbruch": "stop",
46
+ "sekunden": 33.05
47
+ },
48
+ {
49
+ "id": "test/number_theory/572.json",
50
+ "ok": true,
51
+ "level": 3,
52
+ "thema": "Number Theory",
53
+ "gegeben": "9",
54
+ "erwartet": "9",
55
+ "tps": 11.040690233842446,
56
+ "tokens": 528,
57
+ "denk_zeichen": 0,
58
+ "abbruch": "stop",
59
+ "sekunden": 48.3
60
+ },
61
+ {
62
+ "id": "test/number_theory/515.json",
63
+ "ok": true,
64
+ "level": 3,
65
+ "thema": "Number Theory",
66
+ "gegeben": "27",
67
+ "erwartet": "27",
68
+ "tps": 11.025497781536448,
69
+ "tokens": 686,
70
+ "denk_zeichen": 0,
71
+ "abbruch": "stop",
72
+ "sekunden": 62.92
73
+ },
74
+ {
75
+ "id": "test/number_theory/1032.json",
76
+ "ok": true,
77
+ "level": 3,
78
+ "thema": "Number Theory",
79
+ "gegeben": "2220",
80
+ "erwartet": "2220",
81
+ "tps": 10.74525796096015,
82
+ "tokens": 1560,
83
+ "denk_zeichen": 0,
84
+ "abbruch": "stop",
85
+ "sekunden": 145.84
86
+ },
87
+ {
88
+ "id": "test/geometry/248.json",
89
+ "ok": true,
90
+ "level": 2,
91
+ "thema": "Geometry",
92
+ "gegeben": "5",
93
+ "erwartet": "5",
94
+ "tps": 10.48184372181346,
95
+ "tokens": 316,
96
+ "denk_zeichen": 0,
97
+ "abbruch": "stop",
98
+ "sekunden": 31.04
99
+ },
100
+ {
101
+ "id": "test/intermediate_algebra/134.json",
102
+ "ok": true,
103
+ "level": 1,
104
+ "thema": "Intermediate Algebra",
105
+ "gegeben": "-50",
106
+ "erwartet": "-50",
107
+ "tps": 10.984125689949607,
108
+ "tokens": 298,
109
+ "denk_zeichen": 0,
110
+ "abbruch": "stop",
111
+ "sekunden": 28.08
112
+ },
113
+ {
114
+ "id": "test/algebra/1098.json",
115
+ "ok": true,
116
+ "level": 3,
117
+ "thema": "Algebra",
118
+ "gegeben": "6+9i",
119
+ "erwartet": "6+9i",
120
+ "tps": 10.599135940854282,
121
+ "tokens": 217,
122
+ "denk_zeichen": 0,
123
+ "abbruch": "stop",
124
+ "sekunden": 21.08
125
+ },
126
+ {
127
+ "id": "test/algebra/2193.json",
128
+ "ok": true,
129
+ "level": 5,
130
+ "thema": "Algebra",
131
+ "gegeben": "5",
132
+ "erwartet": "x=5",
133
+ "tps": 10.694810230600003,
134
+ "tokens": 887,
135
+ "denk_zeichen": 0,
136
+ "abbruch": "stop",
137
+ "sekunden": 83.66,
138
+ "neubewertet": true
139
+ },
140
+ {
141
+ "id": "test/counting_and_probability/525.json",
142
+ "ok": false,
143
+ "level": 5,
144
+ "thema": "Counting & Probability",
145
+ "gegeben": "",
146
+ "erwartet": "144",
147
+ "tps": 10.654994546340934,
148
+ "tokens": 1600,
149
+ "denk_zeichen": 0,
150
+ "abbruch": "length",
151
+ "sekunden": 150.7
152
+ },
153
+ {
154
+ "id": "test/number_theory/864.json",
155
+ "ok": true,
156
+ "level": 3,
157
+ "thema": "Number Theory",
158
+ "gegeben": "52_8",
159
+ "erwartet": "52_8",
160
+ "tps": 10.624975775148272,
161
+ "tokens": 571,
162
+ "denk_zeichen": 0,
163
+ "abbruch": "stop",
164
+ "sekunden": 54.51
165
+ },
166
+ {
167
+ "id": "test/algebra/1072.json",
168
+ "ok": true,
169
+ "level": 4,
170
+ "thema": "Algebra",
171
+ "gegeben": "\\frac{243}{625}",
172
+ "erwartet": "\\frac{243}{625}",
173
+ "tps": 10.779699930417097,
174
+ "tokens": 891,
175
+ "denk_zeichen": 0,
176
+ "abbruch": "stop",
177
+ "sekunden": 83.47
178
+ },
179
+ {
180
+ "id": "test/intermediate_algebra/428.json",
181
+ "ok": true,
182
+ "level": 2,
183
+ "thema": "Intermediate Algebra",
184
+ "gegeben": "3, 5, 7",
185
+ "erwartet": "3, 5, 7",
186
+ "tps": 10.821421198960389,
187
+ "tokens": 1211,
188
+ "denk_zeichen": 0,
189
+ "abbruch": "stop",
190
+ "sekunden": 112.72
191
+ },
192
+ {
193
+ "id": "test/prealgebra/930.json",
194
+ "ok": true,
195
+ "level": 2,
196
+ "thema": "Prealgebra",
197
+ "gegeben": "12",
198
+ "erwartet": "12",
199
+ "tps": 11.000015469678747,
200
+ "tokens": 379,
201
+ "denk_zeichen": 0,
202
+ "abbruch": "stop",
203
+ "sekunden": 35.25
204
+ },
205
+ {
206
+ "id": "test/intermediate_algebra/1454.json",
207
+ "ok": false,
208
+ "level": 5,
209
+ "thema": "Intermediate Algebra",
210
+ "gegeben": "",
211
+ "erwartet": "70 \\sqrt{2}",
212
+ "tps": 10.830907339834454,
213
+ "tokens": 1600,
214
+ "denk_zeichen": 0,
215
+ "abbruch": "length",
216
+ "sekunden": 148.75
217
+ },
218
+ {
219
+ "id": "test/precalculus/285.json",
220
+ "ok": false,
221
+ "level": 2,
222
+ "thema": "Precalculus",
223
+ "gegeben": "",
224
+ "erwartet": "6",
225
+ "tps": 10.72522985374165,
226
+ "tokens": 1600,
227
+ "denk_zeichen": 0,
228
+ "abbruch": "length",
229
+ "sekunden": 150.02
230
+ },
231
+ {
232
+ "id": "test/number_theory/1055.json",
233
+ "ok": true,
234
+ "level": 5,
235
+ "thema": "Number Theory",
236
+ "gegeben": "203",
237
+ "erwartet": "203",
238
+ "tps": 10.750116870139516,
239
+ "tokens": 1366,
240
+ "denk_zeichen": 0,
241
+ "abbruch": "stop",
242
+ "sekunden": 127.89
243
+ },
244
+ {
245
+ "id": "test/precalculus/1105.json",
246
+ "ok": true,
247
+ "level": 2,
248
+ "thema": "Precalculus",
249
+ "gegeben": "-\\frac{\\pi}{6}",
250
+ "erwartet": "-\\frac{\\pi}{6}",
251
+ "tps": 10.82254488632333,
252
+ "tokens": 447,
253
+ "denk_zeichen": 0,
254
+ "abbruch": "stop",
255
+ "sekunden": 42.03
256
+ },
257
+ {
258
+ "id": "test/algebra/769.json",
259
+ "ok": true,
260
+ "level": 3,
261
+ "thema": "Algebra",
262
+ "gegeben": "11",
263
+ "erwartet": "11",
264
+ "tps": 10.624218863409812,
265
+ "tokens": 321,
266
+ "denk_zeichen": 0,
267
+ "abbruch": "stop",
268
+ "sekunden": 30.88
269
+ },
270
+ {
271
+ "id": "test/intermediate_algebra/956.json",
272
+ "ok": false,
273
+ "level": 5,
274
+ "thema": "Intermediate Algebra",
275
+ "gegeben": "",
276
+ "erwartet": "(6,31,-1)",
277
+ "tps": 10.675505771935713,
278
+ "tokens": 1600,
279
+ "denk_zeichen": 0,
280
+ "abbruch": "length",
281
+ "sekunden": 150.67
282
+ },
283
+ {
284
+ "id": "test/intermediate_algebra/279.json",
285
+ "ok": true,
286
+ "level": 5,
287
+ "thema": "Intermediate Algebra",
288
+ "gegeben": "10",
289
+ "erwartet": "10",
290
+ "tps": 10.875593163227762,
291
+ "tokens": 1162,
292
+ "denk_zeichen": 0,
293
+ "abbruch": "stop",
294
+ "sekunden": 107.4
295
+ },
296
+ {
297
+ "id": "test/algebra/2046.json",
298
+ "ok": true,
299
+ "level": 3,
300
+ "thema": "Algebra",
301
+ "gegeben": "x^3+3x-6",
302
+ "erwartet": "x^3+3x-6",
303
+ "tps": 10.960009712969738,
304
+ "tokens": 566,
305
+ "denk_zeichen": 0,
306
+ "abbruch": "stop",
307
+ "sekunden": 52.39
308
+ },
309
+ {
310
+ "id": "test/number_theory/46.json",
311
+ "ok": true,
312
+ "level": 2,
313
+ "thema": "Number Theory",
314
+ "gegeben": "40_9",
315
+ "erwartet": "40_9",
316
+ "tps": 10.973479857330577,
317
+ "tokens": 557,
318
+ "denk_zeichen": 0,
319
+ "abbruch": "stop",
320
+ "sekunden": 51.44
321
+ },
322
+ {
323
+ "id": "test/algebra/2253.json",
324
+ "ok": true,
325
+ "level": 4,
326
+ "thema": "Algebra",
327
+ "gegeben": "\\frac{3\\sqrt{3}}{4}",
328
+ "erwartet": "\\frac{3\\sqrt{3}}{4}",
329
+ "tps": 10.784932869667948,
330
+ "tokens": 514,
331
+ "denk_zeichen": 0,
332
+ "abbruch": "stop",
333
+ "sekunden": 48.38
334
+ },
335
+ {
336
+ "id": "test/intermediate_algebra/623.json",
337
+ "ok": true,
338
+ "level": 2,
339
+ "thema": "Intermediate Algebra",
340
+ "gegeben": "0",
341
+ "erwartet": "0",
342
+ "tps": 10.82723366946044,
343
+ "tokens": 364,
344
+ "denk_zeichen": 0,
345
+ "abbruch": "stop",
346
+ "sekunden": 34.4
347
+ },
348
+ {
349
+ "id": "test/intermediate_algebra/1849.json",
350
+ "ok": false,
351
+ "level": 5,
352
+ "thema": "Intermediate Algebra",
353
+ "gegeben": "",
354
+ "erwartet": "501",
355
+ "tps": 10.780047832015484,
356
+ "tokens": 1600,
357
+ "denk_zeichen": 0,
358
+ "abbruch": "length",
359
+ "sekunden": 148.98
360
+ },
361
+ {
362
+ "id": "test/intermediate_algebra/2046.json",
363
+ "ok": false,
364
+ "level": 2,
365
+ "thema": "Intermediate Algebra",
366
+ "gegeben": "",
367
+ "erwartet": "2",
368
+ "tps": 10.906852352010562,
369
+ "tokens": 1600,
370
+ "denk_zeichen": 0,
371
+ "abbruch": "length",
372
+ "sekunden": 147.25
373
+ },
374
+ {
375
+ "id": "test/prealgebra/307.json",
376
+ "ok": true,
377
+ "level": 1,
378
+ "thema": "Prealgebra",
379
+ "gegeben": "240",
380
+ "erwartet": "240",
381
+ "tps": 11.080049304565668,
382
+ "tokens": 268,
383
+ "denk_zeichen": 0,
384
+ "abbruch": "stop",
385
+ "sekunden": 24.96
386
+ },
387
+ {
388
+ "id": "test/prealgebra/1761.json",
389
+ "ok": true,
390
+ "level": 3,
391
+ "thema": "Prealgebra",
392
+ "gegeben": "\\frac{3}{2}",
393
+ "erwartet": "\\frac{3}{2}",
394
+ "tps": 10.909809396885333,
395
+ "tokens": 262,
396
+ "denk_zeichen": 0,
397
+ "abbruch": "stop",
398
+ "sekunden": 24.59
399
+ },
400
+ {
401
+ "id": "test/algebra/873.json",
402
+ "ok": true,
403
+ "level": 4,
404
+ "thema": "Algebra",
405
+ "gegeben": "33",
406
+ "erwartet": "33",
407
+ "tps": 10.701320414384313,
408
+ "tokens": 616,
409
+ "denk_zeichen": 0,
410
+ "abbruch": "stop",
411
+ "sekunden": 58.47
412
+ },
413
+ {
414
+ "id": "test/intermediate_algebra/662.json",
415
+ "ok": false,
416
+ "level": 5,
417
+ "thema": "Intermediate Algebra",
418
+ "gegeben": "",
419
+ "erwartet": "1 \\pm \\sqrt{19}",
420
+ "tps": 10.815825699940415,
421
+ "tokens": 1600,
422
+ "denk_zeichen": 0,
423
+ "abbruch": "length",
424
+ "sekunden": 148.79
425
+ },
426
+ {
427
+ "id": "test/geometry/183.json",
428
+ "ok": false,
429
+ "level": 5,
430
+ "thema": "Geometry",
431
+ "gegeben": "",
432
+ "erwartet": "145^\\circ",
433
+ "tps": 10.911608936446774,
434
+ "tokens": 1600,
435
+ "denk_zeichen": 0,
436
+ "abbruch": "length",
437
+ "sekunden": 147.38
438
+ },
439
+ {
440
+ "id": "test/intermediate_algebra/558.json",
441
+ "ok": false,
442
+ "level": 5,
443
+ "thema": "Intermediate Algebra",
444
+ "gegeben": "",
445
+ "erwartet": "(3,4]",
446
+ "tps": 10.707506452560885,
447
+ "tokens": 1600,
448
+ "denk_zeichen": 0,
449
+ "abbruch": "length",
450
+ "sekunden": 150.19
451
+ },
452
+ {
453
+ "id": "test/intermediate_algebra/515.json",
454
+ "ok": true,
455
+ "level": 2,
456
+ "thema": "Intermediate Algebra",
457
+ "gegeben": "\\frac{4}{3}",
458
+ "erwartet": "\\frac43",
459
+ "tps": 10.870024417209143,
460
+ "tokens": 652,
461
+ "denk_zeichen": 0,
462
+ "abbruch": "stop",
463
+ "sekunden": 60.83,
464
+ "neubewertet": true
465
+ },
466
+ {
467
+ "id": "test/intermediate_algebra/345.json",
468
+ "ok": false,
469
+ "level": 4,
470
+ "thema": "Intermediate Algebra",
471
+ "gegeben": "",
472
+ "erwartet": "504",
473
+ "tps": 10.620985665705325,
474
+ "tokens": 1600,
475
+ "denk_zeichen": 0,
476
+ "abbruch": "length",
477
+ "sekunden": 151.61
478
+ },
479
+ {
480
+ "id": "test/algebra/2593.json",
481
+ "ok": true,
482
+ "level": 2,
483
+ "thema": "Algebra",
484
+ "gegeben": "8000",
485
+ "erwartet": "8000",
486
+ "tps": 10.811580753666481,
487
+ "tokens": 601,
488
+ "denk_zeichen": 0,
489
+ "abbruch": "stop",
490
+ "sekunden": 56.2
491
+ },
492
+ {
493
+ "id": "test/algebra/2157.json",
494
+ "ok": true,
495
+ "level": 2,
496
+ "thema": "Algebra",
497
+ "gegeben": "2",
498
+ "erwartet": "2",
499
+ "tps": 11.014576060554193,
500
+ "tokens": 385,
501
+ "denk_zeichen": 0,
502
+ "abbruch": "stop",
503
+ "sekunden": 35.69
504
+ },
505
+ {
506
+ "id": "test/intermediate_algebra/128.json",
507
+ "ok": true,
508
+ "level": 2,
509
+ "thema": "Intermediate Algebra",
510
+ "gegeben": "even",
511
+ "erwartet": "\\text{even}",
512
+ "tps": 10.942699478794982,
513
+ "tokens": 1290,
514
+ "denk_zeichen": 0,
515
+ "abbruch": "stop",
516
+ "sekunden": 118.48
517
+ },
518
+ {
519
+ "id": "test/geometry/283.json",
520
+ "ok": false,
521
+ "level": 4,
522
+ "thema": "Geometry",
523
+ "gegeben": "",
524
+ "erwartet": "8",
525
+ "tps": 10.598308846404422,
526
+ "tokens": 1600,
527
+ "denk_zeichen": 0,
528
+ "abbruch": "length",
529
+ "sekunden": 151.86
530
+ },
531
+ {
532
+ "id": "test/intermediate_algebra/1063.json",
533
+ "ok": true,
534
+ "level": 4,
535
+ "thema": "Intermediate Algebra",
536
+ "gegeben": "1+274i",
537
+ "erwartet": "1+274i",
538
+ "tps": 10.704916157751038,
539
+ "tokens": 1249,
540
+ "denk_zeichen": 0,
541
+ "abbruch": "stop",
542
+ "sekunden": 117.49
543
+ },
544
+ {
545
+ "id": "test/number_theory/753.json",
546
+ "ok": true,
547
+ "level": 4,
548
+ "thema": "Number Theory",
549
+ "gegeben": "13",
550
+ "erwartet": "13",
551
+ "tps": 10.755271281868698,
552
+ "tokens": 1146,
553
+ "denk_zeichen": 0,
554
+ "abbruch": "stop",
555
+ "sekunden": 107.36
556
+ },
557
+ {
558
+ "id": "test/prealgebra/1807.json",
559
+ "ok": true,
560
+ "level": 3,
561
+ "thema": "Prealgebra",
562
+ "gegeben": "120",
563
+ "erwartet": "120",
564
+ "tps": 10.829189230797322,
565
+ "tokens": 666,
566
+ "denk_zeichen": 0,
567
+ "abbruch": "stop",
568
+ "sekunden": 62.1
569
+ },
570
+ {
571
+ "id": "test/intermediate_algebra/2022.json",
572
+ "ok": false,
573
+ "level": 5,
574
+ "thema": "Intermediate Algebra",
575
+ "gegeben": "",
576
+ "erwartet": "64",
577
+ "tps": 10.794626820676575,
578
+ "tokens": 1600,
579
+ "denk_zeichen": 0,
580
+ "abbruch": "length",
581
+ "sekunden": 149.06
582
+ },
583
+ {
584
+ "id": "test/number_theory/156.json",
585
+ "ok": true,
586
+ "level": 4,
587
+ "thema": "Number Theory",
588
+ "gegeben": "13",
589
+ "erwartet": "13",
590
+ "tps": 10.757005363194054,
591
+ "tokens": 709,
592
+ "denk_zeichen": 0,
593
+ "abbruch": "stop",
594
+ "sekunden": 66.78
595
+ },
596
+ {
597
+ "id": "test/precalculus/477.json",
598
+ "ok": true,
599
+ "level": 3,
600
+ "thema": "Precalculus",
601
+ "gegeben": "3\\sqrt{5}",
602
+ "erwartet": "3 \\sqrt{5}",
603
+ "tps": 10.791271896439973,
604
+ "tokens": 773,
605
+ "denk_zeichen": 0,
606
+ "abbruch": "stop",
607
+ "sekunden": 72.23
608
+ },
609
+ {
610
+ "id": "test/algebra/1519.json",
611
+ "ok": true,
612
+ "level": 3,
613
+ "thema": "Algebra",
614
+ "gegeben": "\\frac{\\sqrt{3}}{3}",
615
+ "erwartet": "\\frac{\\sqrt{3}}{3}",
616
+ "tps": 10.622485735082131,
617
+ "tokens": 408,
618
+ "denk_zeichen": 0,
619
+ "abbruch": "stop",
620
+ "sekunden": 39.11
621
+ },
622
+ {
623
+ "id": "test/intermediate_algebra/964.json",
624
+ "ok": false,
625
+ "level": 5,
626
+ "thema": "Intermediate Algebra",
627
+ "gegeben": "",
628
+ "erwartet": "1",
629
+ "tps": 10.845097292791232,
630
+ "tokens": 1600,
631
+ "denk_zeichen": 0,
632
+ "abbruch": "length",
633
+ "sekunden": 148.54
634
+ },
635
+ {
636
+ "id": "test/counting_and_probability/230.json",
637
+ "ok": true,
638
+ "level": 4,
639
+ "thema": "Counting & Probability",
640
+ "gegeben": "\\frac{2}{21}",
641
+ "erwartet": "\\frac{2}{21}",
642
+ "tps": 10.870413457892251,
643
+ "tokens": 1140,
644
+ "denk_zeichen": 0,
645
+ "abbruch": "stop",
646
+ "sekunden": 105.57
647
+ },
648
+ {
649
+ "id": "test/precalculus/117.json",
650
+ "ok": true,
651
+ "level": 3,
652
+ "thema": "Precalculus",
653
+ "gegeben": "30",
654
+ "erwartet": "30^\\circ",
655
+ "tps": 10.738920718310153,
656
+ "tokens": 1513,
657
+ "denk_zeichen": 0,
658
+ "abbruch": "stop",
659
+ "sekunden": 141.89
660
+ },
661
+ {
662
+ "id": "test/number_theory/521.json",
663
+ "ok": true,
664
+ "level": 2,
665
+ "thema": "Number Theory",
666
+ "gegeben": "18",
667
+ "erwartet": "18",
668
+ "tps": 10.744397599165682,
669
+ "tokens": 810,
670
+ "denk_zeichen": 0,
671
+ "abbruch": "stop",
672
+ "sekunden": 76.11
673
+ },
674
+ {
675
+ "id": "test/algebra/2517.json",
676
+ "ok": true,
677
+ "level": 5,
678
+ "thema": "Algebra",
679
+ "gegeben": "-\\frac{35}{9}",
680
+ "erwartet": "-\\frac{35}{9}",
681
+ "tps": 10.82741554505688,
682
+ "tokens": 1302,
683
+ "denk_zeichen": 0,
684
+ "abbruch": "stop",
685
+ "sekunden": 121.02
686
+ },
687
+ {
688
+ "id": "test/prealgebra/1003.json",
689
+ "ok": false,
690
+ "level": 5,
691
+ "thema": "Prealgebra",
692
+ "gegeben": "",
693
+ "erwartet": "\\frac{270}7\\text{ degrees}",
694
+ "tps": 10.70842280499452,
695
+ "tokens": 1600,
696
+ "denk_zeichen": 0,
697
+ "abbruch": "length",
698
+ "sekunden": 150.42
699
+ },
700
+ {
701
+ "id": "test/algebra/297.json",
702
+ "ok": false,
703
+ "level": 5,
704
+ "thema": "Algebra",
705
+ "gegeben": "",
706
+ "erwartet": "1736",
707
+ "tps": 10.82446777850909,
708
+ "tokens": 1600,
709
+ "denk_zeichen": 0,
710
+ "abbruch": "length",
711
+ "sekunden": 148.43
712
+ },
713
+ {
714
+ "id": "test/algebra/686.json",
715
+ "ok": true,
716
+ "level": 5,
717
+ "thema": "Algebra",
718
+ "gegeben": "4",
719
+ "erwartet": "4",
720
+ "tps": 10.787634172470304,
721
+ "tokens": 1380,
722
+ "denk_zeichen": 0,
723
+ "abbruch": "stop",
724
+ "sekunden": 128.86
725
+ },
726
+ {
727
+ "id": "test/number_theory/598.json",
728
+ "ok": true,
729
+ "level": 3,
730
+ "thema": "Number Theory",
731
+ "gegeben": "0,0000672",
732
+ "erwartet": ".0000672",
733
+ "tps": 10.883001093002466,
734
+ "tokens": 773,
735
+ "denk_zeichen": 0,
736
+ "abbruch": "stop",
737
+ "sekunden": 71.78,
738
+ "neubewertet": true
739
+ },
740
+ {
741
+ "id": "test/prealgebra/1908.json",
742
+ "ok": true,
743
+ "level": 3,
744
+ "thema": "Prealgebra",
745
+ "gegeben": "3",
746
+ "erwartet": "3",
747
+ "tps": 10.912426708804484,
748
+ "tokens": 716,
749
+ "denk_zeichen": 0,
750
+ "abbruch": "stop",
751
+ "sekunden": 66.13
752
+ },
753
+ {
754
+ "id": "test/algebra/1082.json",
755
+ "ok": false,
756
+ "level": 4,
757
+ "thema": "Algebra",
758
+ "gegeben": "",
759
+ "erwartet": "23",
760
+ "tps": 10.842088698300932,
761
+ "tokens": 1600,
762
+ "denk_zeichen": 0,
763
+ "abbruch": "length",
764
+ "sekunden": 148.35
765
+ },
766
+ {
767
+ "id": "test/number_theory/978.json",
768
+ "ok": true,
769
+ "level": 4,
770
+ "thema": "Number Theory",
771
+ "gegeben": "7",
772
+ "erwartet": "7",
773
+ "tps": 10.766392642036163,
774
+ "tokens": 765,
775
+ "denk_zeichen": 0,
776
+ "abbruch": "stop",
777
+ "sekunden": 71.83
778
+ },
779
+ {
780
+ "id": "test/counting_and_probability/51.json",
781
+ "ok": true,
782
+ "level": 5,
783
+ "thema": "Counting & Probability",
784
+ "gegeben": "\\frac{13}{18}",
785
+ "erwartet": "\\frac{13}{18}",
786
+ "tps": 10.89740221498912,
787
+ "tokens": 763,
788
+ "denk_zeichen": 0,
789
+ "abbruch": "stop",
790
+ "sekunden": 70.83
791
+ },
792
+ {
793
+ "id": "test/intermediate_algebra/1422.json",
794
+ "ok": false,
795
+ "level": 3,
796
+ "thema": "Intermediate Algebra",
797
+ "gegeben": "",
798
+ "erwartet": "4",
799
+ "tps": 10.781254220903142,
800
+ "tokens": 1600,
801
+ "denk_zeichen": 0,
802
+ "abbruch": "length",
803
+ "sekunden": 149.0
804
+ },
805
+ {
806
+ "id": "test/algebra/1937.json",
807
+ "ok": true,
808
+ "level": 1,
809
+ "thema": "Algebra",
810
+ "gegeben": "1600",
811
+ "erwartet": "1600",
812
+ "tps": 10.731329852207839,
813
+ "tokens": 449,
814
+ "denk_zeichen": 0,
815
+ "abbruch": "stop",
816
+ "sekunden": 42.39
817
+ },
818
+ {
819
+ "id": "test/prealgebra/2086.json",
820
+ "ok": true,
821
+ "level": 4,
822
+ "thema": "Prealgebra",
823
+ "gegeben": "40",
824
+ "erwartet": "40",
825
+ "tps": 10.863085166270277,
826
+ "tokens": 616,
827
+ "denk_zeichen": 0,
828
+ "abbruch": "stop",
829
+ "sekunden": 57.56
830
+ },
831
+ {
832
+ "id": "test/intermediate_algebra/1555.json",
833
+ "ok": true,
834
+ "level": 3,
835
+ "thema": "Intermediate Algebra",
836
+ "gegeben": "12",
837
+ "erwartet": "12",
838
+ "tps": 10.855696376147865,
839
+ "tokens": 851,
840
+ "denk_zeichen": 0,
841
+ "abbruch": "stop",
842
+ "sekunden": 78.98
843
+ },
844
+ {
845
+ "id": "test/precalculus/541.json",
846
+ "ok": true,
847
+ "level": 2,
848
+ "thema": "Precalculus",
849
+ "gegeben": "\\left(\\frac{3}{2}, -13\\right)",
850
+ "erwartet": "\\left( \\frac{3}{2}, -13 \\right)",
851
+ "tps": 10.645545675110782,
852
+ "tokens": 496,
853
+ "denk_zeichen": 0,
854
+ "abbruch": "stop",
855
+ "sekunden": 47.21
856
+ },
857
+ {
858
+ "id": "test/prealgebra/378.json",
859
+ "ok": false,
860
+ "level": 4,
861
+ "thema": "Prealgebra",
862
+ "gegeben": "",
863
+ "erwartet": "10",
864
+ "tps": 10.878183295525641,
865
+ "tokens": 1600,
866
+ "denk_zeichen": 0,
867
+ "abbruch": "length",
868
+ "sekunden": 147.94
869
+ },
870
+ {
871
+ "id": "test/intermediate_algebra/102.json",
872
+ "ok": false,
873
+ "level": 4,
874
+ "thema": "Intermediate Algebra",
875
+ "gegeben": "",
876
+ "erwartet": "2",
877
+ "tps": 10.86439872343315,
878
+ "tokens": 1600,
879
+ "denk_zeichen": 0,
880
+ "abbruch": "length",
881
+ "sekunden": 148.11
882
+ },
883
+ {
884
+ "id": "test/prealgebra/1436.json",
885
+ "ok": true,
886
+ "level": 4,
887
+ "thema": "Prealgebra",
888
+ "gegeben": "6",
889
+ "erwartet": "6",
890
+ "tps": 10.86008211030805,
891
+ "tokens": 564,
892
+ "denk_zeichen": 0,
893
+ "abbruch": "stop",
894
+ "sekunden": 52.7
895
+ },
896
+ {
897
+ "id": "test/prealgebra/1961.json",
898
+ "ok": true,
899
+ "level": 5,
900
+ "thema": "Prealgebra",
901
+ "gegeben": "\\frac{16}{27}",
902
+ "erwartet": "\\frac{16}{27}",
903
+ "tps": 10.7193570831679,
904
+ "tokens": 582,
905
+ "denk_zeichen": 0,
906
+ "abbruch": "stop",
907
+ "sekunden": 54.88
908
+ },
909
+ {
910
+ "id": "test/number_theory/183.json",
911
+ "ok": true,
912
+ "level": 3,
913
+ "thema": "Number Theory",
914
+ "gegeben": "14",
915
+ "erwartet": "14",
916
+ "tps": 10.884418924501624,
917
+ "tokens": 1205,
918
+ "denk_zeichen": 0,
919
+ "abbruch": "stop",
920
+ "sekunden": 111.29
921
+ },
922
+ {
923
+ "id": "test/counting_and_probability/71.json",
924
+ "ok": true,
925
+ "level": 3,
926
+ "thema": "Counting & Probability",
927
+ "gegeben": "3",
928
+ "erwartet": "3",
929
+ "tps": 10.663706634220157,
930
+ "tokens": 562,
931
+ "denk_zeichen": 0,
932
+ "abbruch": "stop",
933
+ "sekunden": 53.24
934
+ },
935
+ {
936
+ "id": "test/intermediate_algebra/986.json",
937
+ "ok": true,
938
+ "level": 4,
939
+ "thema": "Intermediate Algebra",
940
+ "gegeben": "\\frac{16}{5}",
941
+ "erwartet": "\\frac{16}{5}",
942
+ "tps": 10.613880956932698,
943
+ "tokens": 946,
944
+ "denk_zeichen": 0,
945
+ "abbruch": "stop",
946
+ "sekunden": 89.89
947
+ },
948
+ {
949
+ "id": "test/precalculus/441.json",
950
+ "ok": true,
951
+ "level": 2,
952
+ "thema": "Precalculus",
953
+ "gegeben": "30",
954
+ "erwartet": "30^\\circ",
955
+ "tps": 10.75867693313941,
956
+ "tokens": 849,
957
+ "denk_zeichen": 0,
958
+ "abbruch": "stop",
959
+ "sekunden": 79.68
960
+ },
961
+ {
962
+ "id": "test/precalculus/989.json",
963
+ "ok": false,
964
+ "level": 4,
965
+ "thema": "Precalculus",
966
+ "gegeben": "",
967
+ "erwartet": "12",
968
+ "tps": 10.886696010440287,
969
+ "tokens": 1600,
970
+ "denk_zeichen": 0,
971
+ "abbruch": "length",
972
+ "sekunden": 147.56
973
+ },
974
+ {
975
+ "id": "test/prealgebra/874.json",
976
+ "ok": false,
977
+ "level": 4,
978
+ "thema": "Prealgebra",
979
+ "gegeben": "",
980
+ "erwartet": "116",
981
+ "tps": 10.82401559789356,
982
+ "tokens": 1600,
983
+ "denk_zeichen": 0,
984
+ "abbruch": "length",
985
+ "sekunden": 148.91
986
+ },
987
+ {
988
+ "id": "test/geometry/254.json",
989
+ "ok": true,
990
+ "level": 2,
991
+ "thema": "Geometry",
992
+ "gegeben": "3",
993
+ "erwartet": "3",
994
+ "tps": 10.555287553316582,
995
+ "tokens": 501,
996
+ "denk_zeichen": 0,
997
+ "abbruch": "stop",
998
+ "sekunden": 48.48
999
+ },
1000
+ {
1001
+ "id": "test/algebra/1787.json",
1002
+ "ok": true,
1003
+ "level": 2,
1004
+ "thema": "Algebra",
1005
+ "gegeben": "8",
1006
+ "erwartet": "8",
1007
+ "tps": 10.846323249950697,
1008
+ "tokens": 438,
1009
+ "denk_zeichen": 0,
1010
+ "abbruch": "stop",
1011
+ "sekunden": 40.96
1012
+ },
1013
+ {
1014
+ "id": "test/algebra/1934.json",
1015
+ "ok": true,
1016
+ "level": 4,
1017
+ "thema": "Algebra",
1018
+ "gegeben": "13",
1019
+ "erwartet": "13",
1020
+ "tps": 10.74762451949091,
1021
+ "tokens": 631,
1022
+ "denk_zeichen": 0,
1023
+ "abbruch": "stop",
1024
+ "sekunden": 59.3
1025
+ },
1026
+ {
1027
+ "id": "test/prealgebra/1458.json",
1028
+ "ok": true,
1029
+ "level": 3,
1030
+ "thema": "Prealgebra",
1031
+ "gegeben": "\\frac{1}{8}",
1032
+ "erwartet": "\\frac{1}{8}",
1033
+ "tps": 10.943811147038202,
1034
+ "tokens": 227,
1035
+ "denk_zeichen": 0,
1036
+ "abbruch": "stop",
1037
+ "sekunden": 21.67
1038
+ },
1039
+ {
1040
+ "id": "test/prealgebra/1995.json",
1041
+ "ok": true,
1042
+ "level": 3,
1043
+ "thema": "Prealgebra",
1044
+ "gegeben": "\\frac{8}{21}",
1045
+ "erwartet": "\\frac{8}{21}",
1046
+ "tps": 10.884727832383849,
1047
+ "tokens": 533,
1048
+ "denk_zeichen": 0,
1049
+ "abbruch": "stop",
1050
+ "sekunden": 49.47
1051
+ },
1052
+ {
1053
+ "id": "test/precalculus/580.json",
1054
+ "ok": true,
1055
+ "level": 3,
1056
+ "thema": "Precalculus",
1057
+ "gegeben": "120",
1058
+ "erwartet": "120^\\circ",
1059
+ "tps": 10.744935477880556,
1060
+ "tokens": 838,
1061
+ "denk_zeichen": 0,
1062
+ "abbruch": "stop",
1063
+ "sekunden": 78.75
1064
+ },
1065
+ {
1066
+ "id": "test/geometry/483.json",
1067
+ "ok": true,
1068
+ "level": 4,
1069
+ "thema": "Geometry",
1070
+ "gegeben": "15",
1071
+ "erwartet": "15",
1072
+ "tps": 10.879120588652244,
1073
+ "tokens": 782,
1074
+ "denk_zeichen": 0,
1075
+ "abbruch": "stop",
1076
+ "sekunden": 72.46
1077
+ },
1078
+ {
1079
+ "id": "test/prealgebra/1742.json",
1080
+ "ok": true,
1081
+ "level": 3,
1082
+ "thema": "Prealgebra",
1083
+ "gegeben": "\\frac{33}{100}",
1084
+ "erwartet": "\\dfrac{33}{100}",
1085
+ "tps": 10.86903861090532,
1086
+ "tokens": 634,
1087
+ "denk_zeichen": 0,
1088
+ "abbruch": "stop",
1089
+ "sekunden": 59.08
1090
+ },
1091
+ {
1092
+ "id": "test/algebra/2551.json",
1093
+ "ok": true,
1094
+ "level": 1,
1095
+ "thema": "Algebra",
1096
+ "gegeben": "10",
1097
+ "erwartet": "10",
1098
+ "tps": 10.813113655571918,
1099
+ "tokens": 416,
1100
+ "denk_zeichen": 0,
1101
+ "abbruch": "stop",
1102
+ "sekunden": 39.24
1103
+ },
1104
+ {
1105
+ "id": "test/prealgebra/993.json",
1106
+ "ok": true,
1107
+ "level": 4,
1108
+ "thema": "Prealgebra",
1109
+ "gegeben": "1250",
1110
+ "erwartet": "1250",
1111
+ "tps": 10.836645820744334,
1112
+ "tokens": 714,
1113
+ "denk_zeichen": 0,
1114
+ "abbruch": "stop",
1115
+ "sekunden": 66.45
1116
+ },
1117
+ {
1118
+ "id": "test/algebra/1282.json",
1119
+ "ok": true,
1120
+ "level": 5,
1121
+ "thema": "Algebra",
1122
+ "gegeben": "11",
1123
+ "erwartet": "11",
1124
+ "tps": 10.74020298747598,
1125
+ "tokens": 1001,
1126
+ "denk_zeichen": 0,
1127
+ "abbruch": "stop",
1128
+ "sekunden": 94.08
1129
+ },
1130
+ {
1131
+ "id": "test/number_theory/1287.json",
1132
+ "ok": true,
1133
+ "level": 4,
1134
+ "thema": "Number Theory",
1135
+ "gegeben": "8",
1136
+ "erwartet": "8",
1137
+ "tps": 10.798895404693946,
1138
+ "tokens": 738,
1139
+ "denk_zeichen": 0,
1140
+ "abbruch": "stop",
1141
+ "sekunden": 69.1
1142
+ },
1143
+ {
1144
+ "id": "test/prealgebra/1787.json",
1145
+ "ok": true,
1146
+ "level": 3,
1147
+ "thema": "Prealgebra",
1148
+ "gegeben": "1",
1149
+ "erwartet": "1",
1150
+ "tps": 10.969753588568167,
1151
+ "tokens": 517,
1152
+ "denk_zeichen": 0,
1153
+ "abbruch": "stop",
1154
+ "sekunden": 47.89
1155
+ },
1156
+ {
1157
+ "id": "test/intermediate_algebra/960.json",
1158
+ "ok": false,
1159
+ "level": 5,
1160
+ "thema": "Intermediate Algebra",
1161
+ "gegeben": "",
1162
+ "erwartet": "\\frac{17}{21}",
1163
+ "tps": 10.82089639805295,
1164
+ "tokens": 1600,
1165
+ "denk_zeichen": 0,
1166
+ "abbruch": "length",
1167
+ "sekunden": 148.58
1168
+ },
1169
+ {
1170
+ "id": "test/algebra/634.json",
1171
+ "ok": true,
1172
+ "level": 3,
1173
+ "thema": "Algebra",
1174
+ "gegeben": "4",
1175
+ "erwartet": "4",
1176
+ "tps": 10.846040246281586,
1177
+ "tokens": 868,
1178
+ "denk_zeichen": 0,
1179
+ "abbruch": "stop",
1180
+ "sekunden": 80.63
1181
+ },
1182
+ {
1183
+ "id": "test/algebra/2486.json",
1184
+ "ok": true,
1185
+ "level": 5,
1186
+ "thema": "Algebra",
1187
+ "gegeben": "\\left( \\frac{3}{5}, \\frac{8}{3} \\right]",
1188
+ "erwartet": "\\left(\\frac{3}{5},\\frac{8}{3}\\right]",
1189
+ "tps": 11.14761930927808,
1190
+ "tokens": 607,
1191
+ "denk_zeichen": 0,
1192
+ "abbruch": "stop",
1193
+ "sekunden": 55.3
1194
+ },
1195
+ {
1196
+ "id": "test/intermediate_algebra/754.json",
1197
+ "ok": true,
1198
+ "level": 2,
1199
+ "thema": "Intermediate Algebra",
1200
+ "gegeben": "B",
1201
+ "erwartet": "\\text{(B)}",
1202
+ "tps": 10.751406586364807,
1203
+ "tokens": 1376,
1204
+ "denk_zeichen": 0,
1205
+ "abbruch": "stop",
1206
+ "sekunden": 128.63,
1207
+ "neubewertet": true
1208
+ },
1209
+ {
1210
+ "id": "test/counting_and_probability/339.json",
1211
+ "ok": true,
1212
+ "level": 4,
1213
+ "thema": "Counting & Probability",
1214
+ "gegeben": "12",
1215
+ "erwartet": "12",
1216
+ "tps": 10.890212402993976,
1217
+ "tokens": 673,
1218
+ "denk_zeichen": 0,
1219
+ "abbruch": "stop",
1220
+ "sekunden": 62.51
1221
+ },
1222
+ {
1223
+ "id": "test/geometry/965.json",
1224
+ "ok": false,
1225
+ "level": 5,
1226
+ "thema": "Geometry",
1227
+ "gegeben": "",
1228
+ "erwartet": "28",
1229
+ "tps": 10.830009637219451,
1230
+ "tokens": 1600,
1231
+ "denk_zeichen": 0,
1232
+ "abbruch": "length",
1233
+ "sekunden": 148.6
1234
+ },
1235
+ {
1236
+ "id": "test/intermediate_algebra/1544.json",
1237
+ "ok": false,
1238
+ "level": 5,
1239
+ "thema": "Intermediate Algebra",
1240
+ "gegeben": "",
1241
+ "erwartet": "6",
1242
+ "tps": 10.799477343094765,
1243
+ "tokens": 1600,
1244
+ "denk_zeichen": 0,
1245
+ "abbruch": "length",
1246
+ "sekunden": 148.95
1247
+ },
1248
+ {
1249
+ "id": "test/algebra/1842.json",
1250
+ "ok": true,
1251
+ "level": 2,
1252
+ "thema": "Algebra",
1253
+ "gegeben": "49",
1254
+ "erwartet": "49",
1255
+ "tps": 10.903532799401425,
1256
+ "tokens": 637,
1257
+ "denk_zeichen": 0,
1258
+ "abbruch": "stop",
1259
+ "sekunden": 59.29
1260
+ },
1261
+ {
1262
+ "id": "test/prealgebra/1423.json",
1263
+ "ok": true,
1264
+ "level": 5,
1265
+ "thema": "Prealgebra",
1266
+ "gegeben": "12\\pi",
1267
+ "erwartet": "12\\pi",
1268
+ "tps": 10.969470836915647,
1269
+ "tokens": 419,
1270
+ "denk_zeichen": 0,
1271
+ "abbruch": "stop",
1272
+ "sekunden": 38.76
1273
+ },
1274
+ {
1275
+ "id": "test/algebra/276.json",
1276
+ "ok": true,
1277
+ "level": 2,
1278
+ "thema": "Algebra",
1279
+ "gegeben": "12",
1280
+ "erwartet": "12",
1281
+ "tps": 10.881305297024014,
1282
+ "tokens": 947,
1283
+ "denk_zeichen": 0,
1284
+ "abbruch": "stop",
1285
+ "sekunden": 87.79
1286
+ },
1287
+ {
1288
+ "id": "test/geometry/947.json",
1289
+ "ok": true,
1290
+ "level": 5,
1291
+ "thema": "Geometry",
1292
+ "gegeben": "-\\frac{24}{25}",
1293
+ "erwartet": "-\\frac{24}{25}",
1294
+ "tps": 10.79207041419167,
1295
+ "tokens": 1040,
1296
+ "denk_zeichen": 0,
1297
+ "abbruch": "stop",
1298
+ "sekunden": 97.19
1299
+ },
1300
+ {
1301
+ "id": "test/counting_and_probability/870.json",
1302
+ "ok": true,
1303
+ "level": 5,
1304
+ "thema": "Counting & Probability",
1305
+ "gegeben": "\\frac{1}{3}",
1306
+ "erwartet": "\\frac{1}{3}",
1307
+ "tps": 10.679045366411394,
1308
+ "tokens": 1140,
1309
+ "denk_zeichen": 0,
1310
+ "abbruch": "stop",
1311
+ "sekunden": 107.57
1312
+ },
1313
+ {
1314
+ "id": "test/precalculus/742.json",
1315
+ "ok": false,
1316
+ "level": 2,
1317
+ "thema": "Precalculus",
1318
+ "gegeben": "-0.09",
1319
+ "erwartet": "\\frac{9}{100}",
1320
+ "tps": 10.94185890780406,
1321
+ "tokens": 879,
1322
+ "denk_zeichen": 0,
1323
+ "abbruch": "stop",
1324
+ "sekunden": 81.11
1325
+ },
1326
+ {
1327
+ "id": "test/counting_and_probability/216.json",
1328
+ "ok": true,
1329
+ "level": 5,
1330
+ "thema": "Counting & Probability",
1331
+ "gegeben": "1940",
1332
+ "erwartet": "1940",
1333
+ "tps": 10.836911071014221,
1334
+ "tokens": 754,
1335
+ "denk_zeichen": 0,
1336
+ "abbruch": "stop",
1337
+ "sekunden": 70.34
1338
+ },
1339
+ {
1340
+ "id": "test/intermediate_algebra/776.json",
1341
+ "ok": true,
1342
+ "level": 4,
1343
+ "thema": "Intermediate Algebra",
1344
+ "gegeben": "3",
1345
+ "erwartet": "3",
1346
+ "tps": 10.720286314007758,
1347
+ "tokens": 1312,
1348
+ "denk_zeichen": 0,
1349
+ "abbruch": "stop",
1350
+ "sekunden": 123.34
1351
+ },
1352
+ {
1353
+ "id": "test/algebra/2592.json",
1354
+ "ok": true,
1355
+ "level": 1,
1356
+ "thema": "Algebra",
1357
+ "gegeben": "26000",
1358
+ "erwartet": "26000",
1359
+ "tps": 10.758726033513812,
1360
+ "tokens": 255,
1361
+ "denk_zeichen": 0,
1362
+ "abbruch": "stop",
1363
+ "sekunden": 24.25
1364
+ },
1365
+ {
1366
+ "id": "test/precalculus/801.json",
1367
+ "ok": false,
1368
+ "level": 3,
1369
+ "thema": "Precalculus",
1370
+ "gegeben": "",
1371
+ "erwartet": "55^\\circ",
1372
+ "tps": 10.80661506949241,
1373
+ "tokens": 1600,
1374
+ "denk_zeichen": 0,
1375
+ "abbruch": "length",
1376
+ "sekunden": 148.88
1377
+ },
1378
+ {
1379
+ "id": "test/counting_and_probability/737.json",
1380
+ "ok": true,
1381
+ "level": 2,
1382
+ "thema": "Counting & Probability",
1383
+ "gegeben": "58500",
1384
+ "erwartet": "58,500",
1385
+ "tps": 10.524348638538898,
1386
+ "tokens": 547,
1387
+ "denk_zeichen": 0,
1388
+ "abbruch": "stop",
1389
+ "sekunden": 52.58
1390
+ },
1391
+ {
1392
+ "id": "test/algebra/1338.json",
1393
+ "ok": true,
1394
+ "level": 4,
1395
+ "thema": "Algebra",
1396
+ "gegeben": "66",
1397
+ "erwartet": "66",
1398
+ "tps": 10.785172682070815,
1399
+ "tokens": 659,
1400
+ "denk_zeichen": 0,
1401
+ "abbruch": "stop",
1402
+ "sekunden": 61.86
1403
+ },
1404
+ {
1405
+ "id": "test/number_theory/686.json",
1406
+ "ok": true,
1407
+ "level": 2,
1408
+ "thema": "Number Theory",
1409
+ "gegeben": "4",
1410
+ "erwartet": "4",
1411
+ "tps": 10.915178869663025,
1412
+ "tokens": 482,
1413
+ "denk_zeichen": 0,
1414
+ "abbruch": "stop",
1415
+ "sekunden": 44.86
1416
+ },
1417
+ {
1418
+ "id": "test/counting_and_probability/1014.json",
1419
+ "ok": true,
1420
+ "level": 4,
1421
+ "thema": "Counting & Probability",
1422
+ "gegeben": "480",
1423
+ "erwartet": "480",
1424
+ "tps": 11.020593730954051,
1425
+ "tokens": 733,
1426
+ "denk_zeichen": 0,
1427
+ "abbruch": "stop",
1428
+ "sekunden": 67.28
1429
+ },
1430
+ {
1431
+ "id": "test/algebra/1078.json",
1432
+ "ok": true,
1433
+ "level": 5,
1434
+ "thema": "Algebra",
1435
+ "gegeben": "(-\\sqrt{3}, \\sqrt{3})",
1436
+ "erwartet": "(-\\sqrt{3}, \\sqrt{3})",
1437
+ "tps": 10.727822473487208,
1438
+ "tokens": 856,
1439
+ "denk_zeichen": 0,
1440
+ "abbruch": "stop",
1441
+ "sekunden": 80.65
1442
+ },
1443
+ {
1444
+ "id": "test/precalculus/96.json",
1445
+ "ok": true,
1446
+ "level": 3,
1447
+ "thema": "Precalculus",
1448
+ "gegeben": "\\frac{7}{4}",
1449
+ "erwartet": "\\frac{7}{4}",
1450
+ "tps": 10.815655729777514,
1451
+ "tokens": 794,
1452
+ "denk_zeichen": 0,
1453
+ "abbruch": "stop",
1454
+ "sekunden": 74.26
1455
+ },
1456
+ {
1457
+ "id": "test/algebra/251.json",
1458
+ "ok": true,
1459
+ "level": 2,
1460
+ "thema": "Algebra",
1461
+ "gegeben": "2",
1462
+ "erwartet": "2",
1463
+ "tps": 10.720441808738883,
1464
+ "tokens": 427,
1465
+ "denk_zeichen": 0,
1466
+ "abbruch": "stop",
1467
+ "sekunden": 40.77
1468
+ },
1469
+ {
1470
+ "id": "test/number_theory/109.json",
1471
+ "ok": true,
1472
+ "level": 4,
1473
+ "thema": "Number Theory",
1474
+ "gegeben": "4",
1475
+ "erwartet": "4",
1476
+ "tps": 10.996086625263207,
1477
+ "tokens": 1303,
1478
+ "denk_zeichen": 0,
1479
+ "abbruch": "stop",
1480
+ "sekunden": 119.18
1481
+ },
1482
+ {
1483
+ "id": "test/precalculus/1289.json",
1484
+ "ok": true,
1485
+ "level": 1,
1486
+ "thema": "Precalculus",
1487
+ "gegeben": "-41",
1488
+ "erwartet": "-41",
1489
+ "tps": 10.733105924726287,
1490
+ "tokens": 290,
1491
+ "denk_zeichen": 0,
1492
+ "abbruch": "stop",
1493
+ "sekunden": 27.8
1494
+ },
1495
+ {
1496
+ "id": "test/algebra/2264.json",
1497
+ "ok": true,
1498
+ "level": 5,
1499
+ "thema": "Algebra",
1500
+ "gegeben": "1+2i",
1501
+ "erwartet": "1+2i",
1502
+ "tps": 10.604185967670924,
1503
+ "tokens": 931,
1504
+ "denk_zeichen": 0,
1505
+ "abbruch": "stop",
1506
+ "sekunden": 88.61
1507
+ },
1508
+ {
1509
+ "id": "test/geometry/538.json",
1510
+ "ok": true,
1511
+ "level": 4,
1512
+ "thema": "Geometry",
1513
+ "gegeben": "(8, -2)",
1514
+ "erwartet": "(8,-2)",
1515
+ "tps": 10.885063412058233,
1516
+ "tokens": 995,
1517
+ "denk_zeichen": 0,
1518
+ "abbruch": "stop",
1519
+ "sekunden": 92.01
1520
+ },
1521
+ {
1522
+ "id": "test/intermediate_algebra/1992.json",
1523
+ "ok": true,
1524
+ "level": 4,
1525
+ "thema": "Intermediate Algebra",
1526
+ "gegeben": "(0, 9) \\cup (9, 36)",
1527
+ "erwartet": "(0,9) \\cup (9,36)",
1528
+ "tps": 10.935423644374387,
1529
+ "tokens": 947,
1530
+ "denk_zeichen": 0,
1531
+ "abbruch": "stop",
1532
+ "sekunden": 87.2
1533
+ },
1534
+ {
1535
+ "id": "test/algebra/101.json",
1536
+ "ok": true,
1537
+ "level": 4,
1538
+ "thema": "Algebra",
1539
+ "gegeben": "[-2, 7]",
1540
+ "erwartet": "x \\in [-2,7]",
1541
+ "tps": 10.928640028872934,
1542
+ "tokens": 656,
1543
+ "denk_zeichen": 0,
1544
+ "abbruch": "stop",
1545
+ "sekunden": 60.76,
1546
+ "neubewertet": true
1547
+ },
1548
+ {
1549
+ "id": "test/algebra/170.json",
1550
+ "ok": true,
1551
+ "level": 3,
1552
+ "thema": "Algebra",
1553
+ "gegeben": "11",
1554
+ "erwartet": "11",
1555
+ "tps": 10.6776678907519,
1556
+ "tokens": 545,
1557
+ "denk_zeichen": 0,
1558
+ "abbruch": "stop",
1559
+ "sekunden": 51.56
1560
+ },
1561
+ {
1562
+ "id": "test/algebra/853.json",
1563
+ "ok": true,
1564
+ "level": 5,
1565
+ "thema": "Algebra",
1566
+ "gegeben": "12",
1567
+ "erwartet": "12",
1568
+ "tps": 10.83105140474641,
1569
+ "tokens": 1071,
1570
+ "denk_zeichen": 0,
1571
+ "abbruch": "stop",
1572
+ "sekunden": 99.64
1573
+ },
1574
+ {
1575
+ "id": "test/algebra/518.json",
1576
+ "ok": true,
1577
+ "level": 3,
1578
+ "thema": "Algebra",
1579
+ "gegeben": "\\frac{3}{4}",
1580
+ "erwartet": "\\frac 34",
1581
+ "tps": 10.896374806113208,
1582
+ "tokens": 472,
1583
+ "denk_zeichen": 0,
1584
+ "abbruch": "stop",
1585
+ "sekunden": 44.05,
1586
+ "neubewertet": true
1587
+ },
1588
+ {
1589
+ "id": "test/prealgebra/631.json",
1590
+ "ok": false,
1591
+ "level": 3,
1592
+ "thema": "Prealgebra",
1593
+ "gegeben": "",
1594
+ "erwartet": "2",
1595
+ "tps": 10.718658233003064,
1596
+ "tokens": 1600,
1597
+ "denk_zeichen": 0,
1598
+ "abbruch": "length",
1599
+ "sekunden": 150.12
1600
+ },
1601
+ {
1602
+ "id": "test/geometry/817.json",
1603
+ "ok": false,
1604
+ "level": 5,
1605
+ "thema": "Geometry",
1606
+ "gegeben": "",
1607
+ "erwartet": "\\frac{14}{3}",
1608
+ "tps": 10.875039085570164,
1609
+ "tokens": 1600,
1610
+ "denk_zeichen": 0,
1611
+ "abbruch": "length",
1612
+ "sekunden": 147.87
1613
+ },
1614
+ {
1615
+ "id": "test/number_theory/928.json",
1616
+ "ok": false,
1617
+ "level": 4,
1618
+ "thema": "Number Theory",
1619
+ "gegeben": "",
1620
+ "erwartet": "3",
1621
+ "tps": 10.667535501874843,
1622
+ "tokens": 1600,
1623
+ "denk_zeichen": 0,
1624
+ "abbruch": "length",
1625
+ "sekunden": 150.8
1626
+ },
1627
+ {
1628
+ "id": "test/number_theory/132.json",
1629
+ "ok": true,
1630
+ "level": 1,
1631
+ "thema": "Number Theory",
1632
+ "gegeben": "0",
1633
+ "erwartet": "0",
1634
+ "tps": 10.973045479091251,
1635
+ "tokens": 509,
1636
+ "denk_zeichen": 0,
1637
+ "abbruch": "stop",
1638
+ "sekunden": 47.05
1639
+ },
1640
+ {
1641
+ "id": "test/prealgebra/65.json",
1642
+ "ok": true,
1643
+ "level": 2,
1644
+ "thema": "Prealgebra",
1645
+ "gegeben": "6",
1646
+ "erwartet": "6",
1647
+ "tps": 10.86729092690668,
1648
+ "tokens": 690,
1649
+ "denk_zeichen": 0,
1650
+ "abbruch": "stop",
1651
+ "sekunden": 64.07
1652
+ },
1653
+ {
1654
+ "id": "test/algebra/2680.json",
1655
+ "ok": true,
1656
+ "level": 2,
1657
+ "thema": "Algebra",
1658
+ "gegeben": "5r^5",
1659
+ "erwartet": "5r^5",
1660
+ "tps": 10.452891508055567,
1661
+ "tokens": 340,
1662
+ "denk_zeichen": 0,
1663
+ "abbruch": "stop",
1664
+ "sekunden": 33.05
1665
+ },
1666
+ {
1667
+ "id": "test/precalculus/681.json",
1668
+ "ok": true,
1669
+ "level": 3,
1670
+ "thema": "Precalculus",
1671
+ "gegeben": "\\frac{1}{8}",
1672
+ "erwartet": "\\frac{1}{8}",
1673
+ "tps": 10.800241699413034,
1674
+ "tokens": 1491,
1675
+ "denk_zeichen": 0,
1676
+ "abbruch": "stop",
1677
+ "sekunden": 138.57
1678
+ },
1679
+ {
1680
+ "id": "test/precalculus/625.json",
1681
+ "ok": false,
1682
+ "level": 3,
1683
+ "thema": "Precalculus",
1684
+ "gegeben": "\\begin{pmatrix} \\frac{16}{49} \\\\ \\frac{48}{49} \\\\ \\frac{24}{",
1685
+ "erwartet": "\\begin{pmatrix} 16/49 \\\\ 48/49 \\\\ 24/49 \\end{pmatrix}",
1686
+ "tps": 10.921161524917633,
1687
+ "tokens": 605,
1688
+ "denk_zeichen": 0,
1689
+ "abbruch": "stop",
1690
+ "sekunden": 56.31
1691
+ },
1692
+ {
1693
+ "id": "test/number_theory/1002.json",
1694
+ "ok": true,
1695
+ "level": 5,
1696
+ "thema": "Number Theory",
1697
+ "gegeben": "1440",
1698
+ "erwartet": "1440",
1699
+ "tps": 10.98854718669467,
1700
+ "tokens": 1364,
1701
+ "denk_zeichen": 0,
1702
+ "abbruch": "stop",
1703
+ "sekunden": 124.98
1704
+ },
1705
+ {
1706
+ "id": "test/geometry/843.json",
1707
+ "ok": true,
1708
+ "level": 3,
1709
+ "thema": "Geometry",
1710
+ "gegeben": "6\\sqrt{2}",
1711
+ "erwartet": "6\\sqrt{2}",
1712
+ "tps": 10.922704913710632,
1713
+ "tokens": 551,
1714
+ "denk_zeichen": 0,
1715
+ "abbruch": "stop",
1716
+ "sekunden": 51.37
1717
+ },
1718
+ {
1719
+ "id": "test/prealgebra/2019.json",
1720
+ "ok": true,
1721
+ "level": 2,
1722
+ "thema": "Prealgebra",
1723
+ "gegeben": "4.5",
1724
+ "erwartet": "4.5",
1725
+ "tps": 10.634819327151458,
1726
+ "tokens": 142,
1727
+ "denk_zeichen": 0,
1728
+ "abbruch": "stop",
1729
+ "sekunden": 14.11
1730
+ },
1731
+ {
1732
+ "id": "test/number_theory/410.json",
1733
+ "ok": true,
1734
+ "level": 2,
1735
+ "thema": "Number Theory",
1736
+ "gegeben": "0,35625",
1737
+ "erwartet": ".35625",
1738
+ "tps": 10.988207307186068,
1739
+ "tokens": 857,
1740
+ "denk_zeichen": 0,
1741
+ "abbruch": "stop",
1742
+ "sekunden": 78.67,
1743
+ "neubewertet": true
1744
+ },
1745
+ {
1746
+ "id": "test/counting_and_probability/10.json",
1747
+ "ok": true,
1748
+ "level": 4,
1749
+ "thema": "Counting & Probability",
1750
+ "gegeben": "4",
1751
+ "erwartet": "4",
1752
+ "tps": 10.7615037640583,
1753
+ "tokens": 1585,
1754
+ "denk_zeichen": 0,
1755
+ "abbruch": "stop",
1756
+ "sekunden": 148.01
1757
+ },
1758
+ {
1759
+ "id": "test/algebra/2080.json",
1760
+ "ok": true,
1761
+ "level": 3,
1762
+ "thema": "Algebra",
1763
+ "gegeben": "14",
1764
+ "erwartet": "14",
1765
+ "tps": 10.665515526542595,
1766
+ "tokens": 464,
1767
+ "denk_zeichen": 0,
1768
+ "abbruch": "stop",
1769
+ "sekunden": 44.05
1770
+ },
1771
+ {
1772
+ "id": "test/algebra/668.json",
1773
+ "ok": true,
1774
+ "level": 4,
1775
+ "thema": "Algebra",
1776
+ "gegeben": "45",
1777
+ "erwartet": "45",
1778
+ "tps": 10.958227994991393,
1779
+ "tokens": 346,
1780
+ "denk_zeichen": 0,
1781
+ "abbruch": "stop",
1782
+ "sekunden": 32.31
1783
+ },
1784
+ {
1785
+ "id": "test/algebra/2430.json",
1786
+ "ok": true,
1787
+ "level": 4,
1788
+ "thema": "Algebra",
1789
+ "gegeben": "8",
1790
+ "erwartet": "8",
1791
+ "tps": 10.693346210331866,
1792
+ "tokens": 1084,
1793
+ "denk_zeichen": 0,
1794
+ "abbruch": "stop",
1795
+ "sekunden": 102.11
1796
+ },
1797
+ {
1798
+ "id": "test/number_theory/13.json",
1799
+ "ok": true,
1800
+ "level": 5,
1801
+ "thema": "Number Theory",
1802
+ "gegeben": "64",
1803
+ "erwartet": "64",
1804
+ "tps": 10.716604447499405,
1805
+ "tokens": 1540,
1806
+ "denk_zeichen": 0,
1807
+ "abbruch": "stop",
1808
+ "sekunden": 144.46
1809
+ },
1810
+ {
1811
+ "id": "test/algebra/2476.json",
1812
+ "ok": true,
1813
+ "level": 2,
1814
+ "thema": "Algebra",
1815
+ "gegeben": "10",
1816
+ "erwartet": "10",
1817
+ "tps": 10.851352942665871,
1818
+ "tokens": 486,
1819
+ "denk_zeichen": 0,
1820
+ "abbruch": "stop",
1821
+ "sekunden": 45.38
1822
+ },
1823
+ {
1824
+ "id": "test/intermediate_algebra/1102.json",
1825
+ "ok": false,
1826
+ "level": 1,
1827
+ "thema": "Intermediate Algebra",
1828
+ "gegeben": "1, -2",
1829
+ "erwartet": "-2,1",
1830
+ "tps": 10.716902941634684,
1831
+ "tokens": 1402,
1832
+ "denk_zeichen": 0,
1833
+ "abbruch": "stop",
1834
+ "sekunden": 131.67
1835
+ },
1836
+ {
1837
+ "id": "test/prealgebra/914.json",
1838
+ "ok": true,
1839
+ "level": 4,
1840
+ "thema": "Prealgebra",
1841
+ "gegeben": "75",
1842
+ "erwartet": "75^\\circ",
1843
+ "tps": 10.821120046896647,
1844
+ "tokens": 1182,
1845
+ "denk_zeichen": 0,
1846
+ "abbruch": "stop",
1847
+ "sekunden": 110.08
1848
+ },
1849
+ {
1850
+ "id": "test/algebra/1425.json",
1851
+ "ok": true,
1852
+ "level": 2,
1853
+ "thema": "Algebra",
1854
+ "gegeben": "2",
1855
+ "erwartet": "2",
1856
+ "tps": 10.637662976790258,
1857
+ "tokens": 331,
1858
+ "denk_zeichen": 0,
1859
+ "abbruch": "stop",
1860
+ "sekunden": 31.77
1861
+ },
1862
+ {
1863
+ "id": "test/precalculus/703.json",
1864
+ "ok": false,
1865
+ "level": 5,
1866
+ "thema": "Precalculus",
1867
+ "gegeben": "",
1868
+ "erwartet": "8 \\pi",
1869
+ "tps": 10.803227310212938,
1870
+ "tokens": 1600,
1871
+ "denk_zeichen": 0,
1872
+ "abbruch": "length",
1873
+ "sekunden": 148.69
1874
+ },
1875
+ {
1876
+ "id": "test/intermediate_algebra/158.json",
1877
+ "ok": true,
1878
+ "level": 5,
1879
+ "thema": "Intermediate Algebra",
1880
+ "gegeben": "27648",
1881
+ "erwartet": "27648",
1882
+ "tps": 10.738040217106429,
1883
+ "tokens": 1321,
1884
+ "denk_zeichen": 0,
1885
+ "abbruch": "stop",
1886
+ "sekunden": 123.8
1887
+ },
1888
+ {
1889
+ "id": "test/prealgebra/1930.json",
1890
+ "ok": true,
1891
+ "level": 5,
1892
+ "thema": "Prealgebra",
1893
+ "gegeben": "7",
1894
+ "erwartet": "7",
1895
+ "tps": 10.796735732618167,
1896
+ "tokens": 915,
1897
+ "denk_zeichen": 0,
1898
+ "abbruch": "stop",
1899
+ "sekunden": 85.78
1900
+ },
1901
+ {
1902
+ "id": "test/prealgebra/1252.json",
1903
+ "ok": true,
1904
+ "level": 2,
1905
+ "thema": "Prealgebra",
1906
+ "gegeben": "200",
1907
+ "erwartet": "200",
1908
+ "tps": 10.932474752894656,
1909
+ "tokens": 522,
1910
+ "denk_zeichen": 0,
1911
+ "abbruch": "stop",
1912
+ "sekunden": 48.84
1913
+ },
1914
+ {
1915
+ "id": "test/precalculus/1252.json",
1916
+ "ok": true,
1917
+ "level": 2,
1918
+ "thema": "Precalculus",
1919
+ "gegeben": "1",
1920
+ "erwartet": "1",
1921
+ "tps": 10.812670728602924,
1922
+ "tokens": 912,
1923
+ "denk_zeichen": 0,
1924
+ "abbruch": "stop",
1925
+ "sekunden": 85.15
1926
+ },
1927
+ {
1928
+ "id": "test/precalculus/1082.json",
1929
+ "ok": false,
1930
+ "level": 3,
1931
+ "thema": "Precalculus",
1932
+ "gegeben": "",
1933
+ "erwartet": "\\frac{8}{15}",
1934
+ "tps": 10.76227158432254,
1935
+ "tokens": 1600,
1936
+ "denk_zeichen": 0,
1937
+ "abbruch": "length",
1938
+ "sekunden": 149.46
1939
+ },
1940
+ {
1941
+ "id": "test/geometry/477.json",
1942
+ "ok": true,
1943
+ "level": 3,
1944
+ "thema": "Geometry",
1945
+ "gegeben": "216",
1946
+ "erwartet": "216",
1947
+ "tps": 10.78054481279969,
1948
+ "tokens": 546,
1949
+ "denk_zeichen": 0,
1950
+ "abbruch": "stop",
1951
+ "sekunden": 51.86
1952
+ },
1953
+ {
1954
+ "id": "test/intermediate_algebra/1350.json",
1955
+ "ok": false,
1956
+ "level": 5,
1957
+ "thema": "Intermediate Algebra",
1958
+ "gegeben": "",
1959
+ "erwartet": "14",
1960
+ "tps": 10.736690935480231,
1961
+ "tokens": 1600,
1962
+ "denk_zeichen": 0,
1963
+ "abbruch": "length",
1964
+ "sekunden": 149.85
1965
+ },
1966
+ {
1967
+ "id": "test/algebra/2779.json",
1968
+ "ok": true,
1969
+ "level": 5,
1970
+ "thema": "Algebra",
1971
+ "gegeben": "20",
1972
+ "erwartet": "20",
1973
+ "tps": 11.038639788971041,
1974
+ "tokens": 740,
1975
+ "denk_zeichen": 0,
1976
+ "abbruch": "stop",
1977
+ "sekunden": 67.82
1978
+ },
1979
+ {
1980
+ "id": "test/intermediate_algebra/1232.json",
1981
+ "ok": true,
1982
+ "level": 3,
1983
+ "thema": "Intermediate Algebra",
1984
+ "gegeben": "\\frac{5}{13}",
1985
+ "erwartet": "\\frac{5}{13}",
1986
+ "tps": 10.937724855299304,
1987
+ "tokens": 516,
1988
+ "denk_zeichen": 0,
1989
+ "abbruch": "stop",
1990
+ "sekunden": 48.01
1991
+ }
1992
+ ],
1993
+ "quote_vor_neubewertung": 72.7,
1994
+ "neubewertet": 7
1995
+ }
bench/math500/q36-q6.json ADDED
@@ -0,0 +1,1996 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "modell": "Qwen3.6-27B Q6_K",
3
+ "satz": "math500",
4
+ "reasoning": false,
5
+ "n": 150,
6
+ "bestanden": 114,
7
+ "quote": 76.0,
8
+ "tps_median": 22.0,
9
+ "tokens_je_aufgabe": 956.2,
10
+ "am_limit": 33,
11
+ "nach_level": {
12
+ "1": [
13
+ 7,
14
+ 8
15
+ ],
16
+ "2": [
17
+ 29,
18
+ 33
19
+ ],
20
+ "3": [
21
+ 31,
22
+ 36
23
+ ],
24
+ "4": [
25
+ 26,
26
+ 35
27
+ ],
28
+ "5": [
29
+ 21,
30
+ 38
31
+ ]
32
+ },
33
+ "dauer_s": 6632.3,
34
+ "aufgaben": [
35
+ {
36
+ "id": "test/precalculus/807.json",
37
+ "ok": true,
38
+ "level": 2,
39
+ "thema": "Precalculus",
40
+ "gegeben": "(3, \\frac{\\pi}{2})",
41
+ "erwartet": "\\left( 3, \\frac{\\pi}{2} \\right)",
42
+ "tps": 23.116215379985373,
43
+ "tokens": 473,
44
+ "denk_zeichen": 0,
45
+ "abbruch": "stop",
46
+ "sekunden": 20.89
47
+ },
48
+ {
49
+ "id": "test/number_theory/572.json",
50
+ "ok": true,
51
+ "level": 3,
52
+ "thema": "Number Theory",
53
+ "gegeben": "9",
54
+ "erwartet": "9",
55
+ "tps": 21.843605831246812,
56
+ "tokens": 715,
57
+ "denk_zeichen": 0,
58
+ "abbruch": "stop",
59
+ "sekunden": 33.14
60
+ },
61
+ {
62
+ "id": "test/number_theory/515.json",
63
+ "ok": true,
64
+ "level": 3,
65
+ "thema": "Number Theory",
66
+ "gegeben": "27",
67
+ "erwartet": "27",
68
+ "tps": 22.563668931473543,
69
+ "tokens": 835,
70
+ "denk_zeichen": 0,
71
+ "abbruch": "stop",
72
+ "sekunden": 37.41
73
+ },
74
+ {
75
+ "id": "test/number_theory/1032.json",
76
+ "ok": false,
77
+ "level": 3,
78
+ "thema": "Number Theory",
79
+ "gegeben": "",
80
+ "erwartet": "2220",
81
+ "tps": 22.43423288951924,
82
+ "tokens": 1600,
83
+ "denk_zeichen": 0,
84
+ "abbruch": "length",
85
+ "sekunden": 71.93
86
+ },
87
+ {
88
+ "id": "test/geometry/248.json",
89
+ "ok": true,
90
+ "level": 2,
91
+ "thema": "Geometry",
92
+ "gegeben": "5",
93
+ "erwartet": "5",
94
+ "tps": 21.81197701890101,
95
+ "tokens": 315,
96
+ "denk_zeichen": 0,
97
+ "abbruch": "stop",
98
+ "sekunden": 15.42
99
+ },
100
+ {
101
+ "id": "test/intermediate_algebra/134.json",
102
+ "ok": true,
103
+ "level": 1,
104
+ "thema": "Intermediate Algebra",
105
+ "gegeben": "-50",
106
+ "erwartet": "-50",
107
+ "tps": 22.172917136729087,
108
+ "tokens": 324,
109
+ "denk_zeichen": 0,
110
+ "abbruch": "stop",
111
+ "sekunden": 15.01
112
+ },
113
+ {
114
+ "id": "test/algebra/1098.json",
115
+ "ok": true,
116
+ "level": 3,
117
+ "thema": "Algebra",
118
+ "gegeben": "6+9i",
119
+ "erwartet": "6+9i",
120
+ "tps": 22.689336319078254,
121
+ "tokens": 229,
122
+ "denk_zeichen": 0,
123
+ "abbruch": "stop",
124
+ "sekunden": 10.49
125
+ },
126
+ {
127
+ "id": "test/algebra/2193.json",
128
+ "ok": true,
129
+ "level": 5,
130
+ "thema": "Algebra",
131
+ "gegeben": "5",
132
+ "erwartet": "x=5",
133
+ "tps": 21.986920402563424,
134
+ "tokens": 772,
135
+ "denk_zeichen": 0,
136
+ "abbruch": "stop",
137
+ "sekunden": 35.75,
138
+ "neubewertet": true
139
+ },
140
+ {
141
+ "id": "test/counting_and_probability/525.json",
142
+ "ok": true,
143
+ "level": 5,
144
+ "thema": "Counting & Probability",
145
+ "gegeben": "144",
146
+ "erwartet": "144",
147
+ "tps": 21.852431657545928,
148
+ "tokens": 1065,
149
+ "denk_zeichen": 0,
150
+ "abbruch": "stop",
151
+ "sekunden": 49.17
152
+ },
153
+ {
154
+ "id": "test/number_theory/864.json",
155
+ "ok": true,
156
+ "level": 3,
157
+ "thema": "Number Theory",
158
+ "gegeben": "52_8",
159
+ "erwartet": "52_8",
160
+ "tps": 22.201524800723313,
161
+ "tokens": 555,
162
+ "denk_zeichen": 0,
163
+ "abbruch": "stop",
164
+ "sekunden": 25.6
165
+ },
166
+ {
167
+ "id": "test/algebra/1072.json",
168
+ "ok": true,
169
+ "level": 4,
170
+ "thema": "Algebra",
171
+ "gegeben": "\\frac{243}{625}",
172
+ "erwartet": "\\frac{243}{625}",
173
+ "tps": 22.097139509161238,
174
+ "tokens": 1096,
175
+ "denk_zeichen": 0,
176
+ "abbruch": "stop",
177
+ "sekunden": 50.2
178
+ },
179
+ {
180
+ "id": "test/intermediate_algebra/428.json",
181
+ "ok": true,
182
+ "level": 2,
183
+ "thema": "Intermediate Algebra",
184
+ "gegeben": "3, 5, 7",
185
+ "erwartet": "3, 5, 7",
186
+ "tps": 22.304681474372234,
187
+ "tokens": 1034,
188
+ "denk_zeichen": 0,
189
+ "abbruch": "stop",
190
+ "sekunden": 46.84
191
+ },
192
+ {
193
+ "id": "test/prealgebra/930.json",
194
+ "ok": true,
195
+ "level": 2,
196
+ "thema": "Prealgebra",
197
+ "gegeben": "12",
198
+ "erwartet": "12",
199
+ "tps": 21.74477069456065,
200
+ "tokens": 366,
201
+ "denk_zeichen": 0,
202
+ "abbruch": "stop",
203
+ "sekunden": 17.35
204
+ },
205
+ {
206
+ "id": "test/intermediate_algebra/1454.json",
207
+ "ok": false,
208
+ "level": 5,
209
+ "thema": "Intermediate Algebra",
210
+ "gegeben": "",
211
+ "erwartet": "70 \\sqrt{2}",
212
+ "tps": 21.8612020802792,
213
+ "tokens": 1600,
214
+ "denk_zeichen": 0,
215
+ "abbruch": "length",
216
+ "sekunden": 73.95
217
+ },
218
+ {
219
+ "id": "test/precalculus/285.json",
220
+ "ok": false,
221
+ "level": 2,
222
+ "thema": "Precalculus",
223
+ "gegeben": "",
224
+ "erwartet": "6",
225
+ "tps": 21.613172623545218,
226
+ "tokens": 1600,
227
+ "denk_zeichen": 0,
228
+ "abbruch": "length",
229
+ "sekunden": 74.72
230
+ },
231
+ {
232
+ "id": "test/number_theory/1055.json",
233
+ "ok": true,
234
+ "level": 5,
235
+ "thema": "Number Theory",
236
+ "gegeben": "203",
237
+ "erwartet": "203",
238
+ "tps": 22.17615418093762,
239
+ "tokens": 1167,
240
+ "denk_zeichen": 0,
241
+ "abbruch": "stop",
242
+ "sekunden": 53.14
243
+ },
244
+ {
245
+ "id": "test/precalculus/1105.json",
246
+ "ok": true,
247
+ "level": 2,
248
+ "thema": "Precalculus",
249
+ "gegeben": "-\\frac{\\pi}{6}",
250
+ "erwartet": "-\\frac{\\pi}{6}",
251
+ "tps": 22.0008273420366,
252
+ "tokens": 476,
253
+ "denk_zeichen": 0,
254
+ "abbruch": "stop",
255
+ "sekunden": 22.05
256
+ },
257
+ {
258
+ "id": "test/algebra/769.json",
259
+ "ok": true,
260
+ "level": 3,
261
+ "thema": "Algebra",
262
+ "gegeben": "11",
263
+ "erwartet": "11",
264
+ "tps": 22.388454043224584,
265
+ "tokens": 533,
266
+ "denk_zeichen": 0,
267
+ "abbruch": "stop",
268
+ "sekunden": 24.54
269
+ },
270
+ {
271
+ "id": "test/intermediate_algebra/956.json",
272
+ "ok": false,
273
+ "level": 5,
274
+ "thema": "Intermediate Algebra",
275
+ "gegeben": "",
276
+ "erwartet": "(6,31,-1)",
277
+ "tps": 22.481351648553304,
278
+ "tokens": 1600,
279
+ "denk_zeichen": 0,
280
+ "abbruch": "length",
281
+ "sekunden": 71.86
282
+ },
283
+ {
284
+ "id": "test/intermediate_algebra/279.json",
285
+ "ok": true,
286
+ "level": 5,
287
+ "thema": "Intermediate Algebra",
288
+ "gegeben": "10",
289
+ "erwartet": "10",
290
+ "tps": 21.25278201092576,
291
+ "tokens": 1465,
292
+ "denk_zeichen": 0,
293
+ "abbruch": "stop",
294
+ "sekunden": 69.91
295
+ },
296
+ {
297
+ "id": "test/algebra/2046.json",
298
+ "ok": true,
299
+ "level": 3,
300
+ "thema": "Algebra",
301
+ "gegeben": "x^3 + 3x - 6",
302
+ "erwartet": "x^3+3x-6",
303
+ "tps": 22.50650942578651,
304
+ "tokens": 522,
305
+ "denk_zeichen": 0,
306
+ "abbruch": "stop",
307
+ "sekunden": 23.91
308
+ },
309
+ {
310
+ "id": "test/number_theory/46.json",
311
+ "ok": true,
312
+ "level": 2,
313
+ "thema": "Number Theory",
314
+ "gegeben": "40_9",
315
+ "erwartet": "40_9",
316
+ "tps": 22.427726650867577,
317
+ "tokens": 549,
318
+ "denk_zeichen": 0,
319
+ "abbruch": "stop",
320
+ "sekunden": 25.05
321
+ },
322
+ {
323
+ "id": "test/algebra/2253.json",
324
+ "ok": true,
325
+ "level": 4,
326
+ "thema": "Algebra",
327
+ "gegeben": "\\frac{3\\sqrt{3}}{4}",
328
+ "erwartet": "\\frac{3\\sqrt{3}}{4}",
329
+ "tps": 22.04664071274237,
330
+ "tokens": 570,
331
+ "denk_zeichen": 0,
332
+ "abbruch": "stop",
333
+ "sekunden": 26.41
334
+ },
335
+ {
336
+ "id": "test/intermediate_algebra/623.json",
337
+ "ok": true,
338
+ "level": 2,
339
+ "thema": "Intermediate Algebra",
340
+ "gegeben": "0",
341
+ "erwartet": "0",
342
+ "tps": 22.386409216257107,
343
+ "tokens": 423,
344
+ "denk_zeichen": 0,
345
+ "abbruch": "stop",
346
+ "sekunden": 19.31
347
+ },
348
+ {
349
+ "id": "test/intermediate_algebra/1849.json",
350
+ "ok": false,
351
+ "level": 5,
352
+ "thema": "Intermediate Algebra",
353
+ "gegeben": "",
354
+ "erwartet": "501",
355
+ "tps": 22.01482514099085,
356
+ "tokens": 1600,
357
+ "denk_zeichen": 0,
358
+ "abbruch": "length",
359
+ "sekunden": 73.1
360
+ },
361
+ {
362
+ "id": "test/intermediate_algebra/2046.json",
363
+ "ok": true,
364
+ "level": 2,
365
+ "thema": "Intermediate Algebra",
366
+ "gegeben": "2",
367
+ "erwartet": "2",
368
+ "tps": 22.391907604937355,
369
+ "tokens": 777,
370
+ "denk_zeichen": 0,
371
+ "abbruch": "stop",
372
+ "sekunden": 35.3
373
+ },
374
+ {
375
+ "id": "test/prealgebra/307.json",
376
+ "ok": true,
377
+ "level": 1,
378
+ "thema": "Prealgebra",
379
+ "gegeben": "240",
380
+ "erwartet": "240",
381
+ "tps": 23.54358109326902,
382
+ "tokens": 263,
383
+ "denk_zeichen": 0,
384
+ "abbruch": "stop",
385
+ "sekunden": 11.98
386
+ },
387
+ {
388
+ "id": "test/prealgebra/1761.json",
389
+ "ok": true,
390
+ "level": 3,
391
+ "thema": "Prealgebra",
392
+ "gegeben": "\\frac{3}{2}",
393
+ "erwartet": "\\frac{3}{2}",
394
+ "tps": 21.476143731782614,
395
+ "tokens": 435,
396
+ "denk_zeichen": 0,
397
+ "abbruch": "stop",
398
+ "sekunden": 20.87
399
+ },
400
+ {
401
+ "id": "test/algebra/873.json",
402
+ "ok": true,
403
+ "level": 4,
404
+ "thema": "Algebra",
405
+ "gegeben": "33",
406
+ "erwartet": "33",
407
+ "tps": 22.552049989240395,
408
+ "tokens": 714,
409
+ "denk_zeichen": 0,
410
+ "abbruch": "stop",
411
+ "sekunden": 32.57
412
+ },
413
+ {
414
+ "id": "test/intermediate_algebra/662.json",
415
+ "ok": false,
416
+ "level": 5,
417
+ "thema": "Intermediate Algebra",
418
+ "gegeben": "",
419
+ "erwartet": "1 \\pm \\sqrt{19}",
420
+ "tps": 21.99969500172842,
421
+ "tokens": 1600,
422
+ "denk_zeichen": 0,
423
+ "abbruch": "length",
424
+ "sekunden": 73.33
425
+ },
426
+ {
427
+ "id": "test/geometry/183.json",
428
+ "ok": true,
429
+ "level": 5,
430
+ "thema": "Geometry",
431
+ "gegeben": "145",
432
+ "erwartet": "145^\\circ",
433
+ "tps": 21.9955782323993,
434
+ "tokens": 1575,
435
+ "denk_zeichen": 0,
436
+ "abbruch": "stop",
437
+ "sekunden": 72.24
438
+ },
439
+ {
440
+ "id": "test/intermediate_algebra/558.json",
441
+ "ok": false,
442
+ "level": 5,
443
+ "thema": "Intermediate Algebra",
444
+ "gegeben": "",
445
+ "erwartet": "(3,4]",
446
+ "tps": 21.71026905088661,
447
+ "tokens": 1600,
448
+ "denk_zeichen": 0,
449
+ "abbruch": "length",
450
+ "sekunden": 74.51
451
+ },
452
+ {
453
+ "id": "test/intermediate_algebra/515.json",
454
+ "ok": true,
455
+ "level": 2,
456
+ "thema": "Intermediate Algebra",
457
+ "gegeben": "\\frac{4}{3}",
458
+ "erwartet": "\\frac43",
459
+ "tps": 22.17783451853529,
460
+ "tokens": 800,
461
+ "denk_zeichen": 0,
462
+ "abbruch": "stop",
463
+ "sekunden": 36.56,
464
+ "neubewertet": true
465
+ },
466
+ {
467
+ "id": "test/intermediate_algebra/345.json",
468
+ "ok": false,
469
+ "level": 4,
470
+ "thema": "Intermediate Algebra",
471
+ "gegeben": "",
472
+ "erwartet": "504",
473
+ "tps": 22.311258708764072,
474
+ "tokens": 1600,
475
+ "denk_zeichen": 0,
476
+ "abbruch": "length",
477
+ "sekunden": 72.73
478
+ },
479
+ {
480
+ "id": "test/algebra/2593.json",
481
+ "ok": true,
482
+ "level": 2,
483
+ "thema": "Algebra",
484
+ "gegeben": "8000",
485
+ "erwartet": "8000",
486
+ "tps": 22.192924728253214,
487
+ "tokens": 557,
488
+ "denk_zeichen": 0,
489
+ "abbruch": "stop",
490
+ "sekunden": 25.72
491
+ },
492
+ {
493
+ "id": "test/algebra/2157.json",
494
+ "ok": true,
495
+ "level": 2,
496
+ "thema": "Algebra",
497
+ "gegeben": "2",
498
+ "erwartet": "2",
499
+ "tps": 22.338313405131515,
500
+ "tokens": 445,
501
+ "denk_zeichen": 0,
502
+ "abbruch": "stop",
503
+ "sekunden": 20.36
504
+ },
505
+ {
506
+ "id": "test/intermediate_algebra/128.json",
507
+ "ok": false,
508
+ "level": 2,
509
+ "thema": "Intermediate Algebra",
510
+ "gegeben": "",
511
+ "erwartet": "\\text{even}",
512
+ "tps": 22.43838961641082,
513
+ "tokens": 1600,
514
+ "denk_zeichen": 0,
515
+ "abbruch": "length",
516
+ "sekunden": 71.95
517
+ },
518
+ {
519
+ "id": "test/geometry/283.json",
520
+ "ok": false,
521
+ "level": 4,
522
+ "thema": "Geometry",
523
+ "gegeben": "",
524
+ "erwartet": "8",
525
+ "tps": 22.19937382503744,
526
+ "tokens": 1600,
527
+ "denk_zeichen": 0,
528
+ "abbruch": "length",
529
+ "sekunden": 72.98
530
+ },
531
+ {
532
+ "id": "test/intermediate_algebra/1063.json",
533
+ "ok": false,
534
+ "level": 4,
535
+ "thema": "Intermediate Algebra",
536
+ "gegeben": "",
537
+ "erwartet": "1+274i",
538
+ "tps": 22.260037697930343,
539
+ "tokens": 1600,
540
+ "denk_zeichen": 0,
541
+ "abbruch": "length",
542
+ "sekunden": 72.63
543
+ },
544
+ {
545
+ "id": "test/number_theory/753.json",
546
+ "ok": true,
547
+ "level": 4,
548
+ "thema": "Number Theory",
549
+ "gegeben": "13",
550
+ "erwartet": "13",
551
+ "tps": 22.45854982844851,
552
+ "tokens": 1143,
553
+ "denk_zeichen": 0,
554
+ "abbruch": "stop",
555
+ "sekunden": 51.35
556
+ },
557
+ {
558
+ "id": "test/prealgebra/1807.json",
559
+ "ok": true,
560
+ "level": 3,
561
+ "thema": "Prealgebra",
562
+ "gegeben": "120",
563
+ "erwartet": "120",
564
+ "tps": 22.292007619953278,
565
+ "tokens": 638,
566
+ "denk_zeichen": 0,
567
+ "abbruch": "stop",
568
+ "sekunden": 29.23
569
+ },
570
+ {
571
+ "id": "test/intermediate_algebra/2022.json",
572
+ "ok": false,
573
+ "level": 5,
574
+ "thema": "Intermediate Algebra",
575
+ "gegeben": "",
576
+ "erwartet": "64",
577
+ "tps": 21.650474975562368,
578
+ "tokens": 1600,
579
+ "denk_zeichen": 0,
580
+ "abbruch": "length",
581
+ "sekunden": 74.62
582
+ },
583
+ {
584
+ "id": "test/number_theory/156.json",
585
+ "ok": true,
586
+ "level": 4,
587
+ "thema": "Number Theory",
588
+ "gegeben": "13",
589
+ "erwartet": "13",
590
+ "tps": 21.45372609788788,
591
+ "tokens": 655,
592
+ "denk_zeichen": 0,
593
+ "abbruch": "stop",
594
+ "sekunden": 30.99
595
+ },
596
+ {
597
+ "id": "test/precalculus/477.json",
598
+ "ok": true,
599
+ "level": 3,
600
+ "thema": "Precalculus",
601
+ "gegeben": "3\\sqrt{5}",
602
+ "erwartet": "3 \\sqrt{5}",
603
+ "tps": 22.44938976267862,
604
+ "tokens": 910,
605
+ "denk_zeichen": 0,
606
+ "abbruch": "stop",
607
+ "sekunden": 41.35
608
+ },
609
+ {
610
+ "id": "test/algebra/1519.json",
611
+ "ok": true,
612
+ "level": 3,
613
+ "thema": "Algebra",
614
+ "gegeben": "\\frac{\\sqrt{3}}{3}",
615
+ "erwartet": "\\frac{\\sqrt{3}}{3}",
616
+ "tps": 22.365674618964324,
617
+ "tokens": 430,
618
+ "denk_zeichen": 0,
619
+ "abbruch": "stop",
620
+ "sekunden": 19.84
621
+ },
622
+ {
623
+ "id": "test/intermediate_algebra/964.json",
624
+ "ok": false,
625
+ "level": 5,
626
+ "thema": "Intermediate Algebra",
627
+ "gegeben": "",
628
+ "erwartet": "1",
629
+ "tps": 22.390807901632144,
630
+ "tokens": 1600,
631
+ "denk_zeichen": 0,
632
+ "abbruch": "length",
633
+ "sekunden": 72.1
634
+ },
635
+ {
636
+ "id": "test/counting_and_probability/230.json",
637
+ "ok": true,
638
+ "level": 4,
639
+ "thema": "Counting & Probability",
640
+ "gegeben": "\\frac{2}{21}",
641
+ "erwartet": "\\frac{2}{21}",
642
+ "tps": 22.022870645849117,
643
+ "tokens": 941,
644
+ "denk_zeichen": 0,
645
+ "abbruch": "stop",
646
+ "sekunden": 43.51
647
+ },
648
+ {
649
+ "id": "test/precalculus/117.json",
650
+ "ok": false,
651
+ "level": 3,
652
+ "thema": "Precalculus",
653
+ "gegeben": "",
654
+ "erwartet": "30^\\circ",
655
+ "tps": 22.20356721678271,
656
+ "tokens": 1600,
657
+ "denk_zeichen": 0,
658
+ "abbruch": "length",
659
+ "sekunden": 72.7
660
+ },
661
+ {
662
+ "id": "test/number_theory/521.json",
663
+ "ok": true,
664
+ "level": 2,
665
+ "thema": "Number Theory",
666
+ "gegeben": "18",
667
+ "erwartet": "18",
668
+ "tps": 21.370129566608128,
669
+ "tokens": 833,
670
+ "denk_zeichen": 0,
671
+ "abbruch": "stop",
672
+ "sekunden": 39.72
673
+ },
674
+ {
675
+ "id": "test/algebra/2517.json",
676
+ "ok": true,
677
+ "level": 5,
678
+ "thema": "Algebra",
679
+ "gegeben": "-\\frac{35}{9}",
680
+ "erwartet": "-\\frac{35}{9}",
681
+ "tps": 22.16226560378559,
682
+ "tokens": 1172,
683
+ "denk_zeichen": 0,
684
+ "abbruch": "stop",
685
+ "sekunden": 53.49
686
+ },
687
+ {
688
+ "id": "test/prealgebra/1003.json",
689
+ "ok": false,
690
+ "level": 5,
691
+ "thema": "Prealgebra",
692
+ "gegeben": "",
693
+ "erwartet": "\\frac{270}7\\text{ degrees}",
694
+ "tps": 21.946421843723563,
695
+ "tokens": 1600,
696
+ "denk_zeichen": 0,
697
+ "abbruch": "length",
698
+ "sekunden": 73.51
699
+ },
700
+ {
701
+ "id": "test/algebra/297.json",
702
+ "ok": false,
703
+ "level": 5,
704
+ "thema": "Algebra",
705
+ "gegeben": "",
706
+ "erwartet": "1736",
707
+ "tps": 22.211614017066598,
708
+ "tokens": 1600,
709
+ "denk_zeichen": 0,
710
+ "abbruch": "length",
711
+ "sekunden": 72.84
712
+ },
713
+ {
714
+ "id": "test/algebra/686.json",
715
+ "ok": false,
716
+ "level": 5,
717
+ "thema": "Algebra",
718
+ "gegeben": "",
719
+ "erwartet": "4",
720
+ "tps": 22.149018485626197,
721
+ "tokens": 1600,
722
+ "denk_zeichen": 0,
723
+ "abbruch": "length",
724
+ "sekunden": 72.96
725
+ },
726
+ {
727
+ "id": "test/number_theory/598.json",
728
+ "ok": true,
729
+ "level": 3,
730
+ "thema": "Number Theory",
731
+ "gegeben": "0,0000672",
732
+ "erwartet": ".0000672",
733
+ "tps": 22.01760324983074,
734
+ "tokens": 813,
735
+ "denk_zeichen": 0,
736
+ "abbruch": "stop",
737
+ "sekunden": 37.7,
738
+ "neubewertet": true
739
+ },
740
+ {
741
+ "id": "test/prealgebra/1908.json",
742
+ "ok": true,
743
+ "level": 3,
744
+ "thema": "Prealgebra",
745
+ "gegeben": "3",
746
+ "erwartet": "3",
747
+ "tps": 21.41214101150469,
748
+ "tokens": 706,
749
+ "denk_zeichen": 0,
750
+ "abbruch": "stop",
751
+ "sekunden": 33.62
752
+ },
753
+ {
754
+ "id": "test/algebra/1082.json",
755
+ "ok": true,
756
+ "level": 4,
757
+ "thema": "Algebra",
758
+ "gegeben": "23",
759
+ "erwartet": "23",
760
+ "tps": 21.657267705991952,
761
+ "tokens": 1156,
762
+ "denk_zeichen": 0,
763
+ "abbruch": "stop",
764
+ "sekunden": 54.08
765
+ },
766
+ {
767
+ "id": "test/number_theory/978.json",
768
+ "ok": true,
769
+ "level": 4,
770
+ "thema": "Number Theory",
771
+ "gegeben": "7",
772
+ "erwartet": "7",
773
+ "tps": 21.686995433530495,
774
+ "tokens": 887,
775
+ "denk_zeichen": 0,
776
+ "abbruch": "stop",
777
+ "sekunden": 41.5
778
+ },
779
+ {
780
+ "id": "test/counting_and_probability/51.json",
781
+ "ok": true,
782
+ "level": 5,
783
+ "thema": "Counting & Probability",
784
+ "gegeben": "\\frac{13}{18}",
785
+ "erwartet": "\\frac{13}{18}",
786
+ "tps": 22.15764523922366,
787
+ "tokens": 709,
788
+ "denk_zeichen": 0,
789
+ "abbruch": "stop",
790
+ "sekunden": 32.45
791
+ },
792
+ {
793
+ "id": "test/intermediate_algebra/1422.json",
794
+ "ok": false,
795
+ "level": 3,
796
+ "thema": "Intermediate Algebra",
797
+ "gegeben": "",
798
+ "erwartet": "4",
799
+ "tps": 21.985436929023603,
800
+ "tokens": 1600,
801
+ "denk_zeichen": 0,
802
+ "abbruch": "length",
803
+ "sekunden": 73.43
804
+ },
805
+ {
806
+ "id": "test/algebra/1937.json",
807
+ "ok": true,
808
+ "level": 1,
809
+ "thema": "Algebra",
810
+ "gegeben": "1600",
811
+ "erwartet": "1600",
812
+ "tps": 21.72747297841543,
813
+ "tokens": 582,
814
+ "denk_zeichen": 0,
815
+ "abbruch": "stop",
816
+ "sekunden": 27.26
817
+ },
818
+ {
819
+ "id": "test/prealgebra/2086.json",
820
+ "ok": true,
821
+ "level": 4,
822
+ "thema": "Prealgebra",
823
+ "gegeben": "40",
824
+ "erwartet": "40",
825
+ "tps": 22.03973159935128,
826
+ "tokens": 774,
827
+ "denk_zeichen": 0,
828
+ "abbruch": "stop",
829
+ "sekunden": 35.75
830
+ },
831
+ {
832
+ "id": "test/intermediate_algebra/1555.json",
833
+ "ok": true,
834
+ "level": 3,
835
+ "thema": "Intermediate Algebra",
836
+ "gegeben": "12",
837
+ "erwartet": "12",
838
+ "tps": 22.426386867028818,
839
+ "tokens": 908,
840
+ "denk_zeichen": 0,
841
+ "abbruch": "stop",
842
+ "sekunden": 40.98
843
+ },
844
+ {
845
+ "id": "test/precalculus/541.json",
846
+ "ok": false,
847
+ "level": 2,
848
+ "thema": "Precalculus",
849
+ "gegeben": "(3/2, -13)",
850
+ "erwartet": "\\left( \\frac{3}{2}, -13 \\right)",
851
+ "tps": 22.117616244807092,
852
+ "tokens": 532,
853
+ "denk_zeichen": 0,
854
+ "abbruch": "stop",
855
+ "sekunden": 24.56
856
+ },
857
+ {
858
+ "id": "test/prealgebra/378.json",
859
+ "ok": false,
860
+ "level": 4,
861
+ "thema": "Prealgebra",
862
+ "gegeben": "",
863
+ "erwartet": "10",
864
+ "tps": 21.944631171920662,
865
+ "tokens": 1600,
866
+ "denk_zeichen": 0,
867
+ "abbruch": "length",
868
+ "sekunden": 73.69
869
+ },
870
+ {
871
+ "id": "test/intermediate_algebra/102.json",
872
+ "ok": false,
873
+ "level": 4,
874
+ "thema": "Intermediate Algebra",
875
+ "gegeben": "",
876
+ "erwartet": "2",
877
+ "tps": 21.8745714805626,
878
+ "tokens": 1600,
879
+ "denk_zeichen": 0,
880
+ "abbruch": "length",
881
+ "sekunden": 73.92
882
+ },
883
+ {
884
+ "id": "test/prealgebra/1436.json",
885
+ "ok": true,
886
+ "level": 4,
887
+ "thema": "Prealgebra",
888
+ "gegeben": "6",
889
+ "erwartet": "6",
890
+ "tps": 22.29186724965928,
891
+ "tokens": 530,
892
+ "denk_zeichen": 0,
893
+ "abbruch": "stop",
894
+ "sekunden": 24.25
895
+ },
896
+ {
897
+ "id": "test/prealgebra/1961.json",
898
+ "ok": true,
899
+ "level": 5,
900
+ "thema": "Prealgebra",
901
+ "gegeben": "\\frac{16}{27}",
902
+ "erwartet": "\\frac{16}{27}",
903
+ "tps": 21.61169682461832,
904
+ "tokens": 572,
905
+ "denk_zeichen": 0,
906
+ "abbruch": "stop",
907
+ "sekunden": 27.11
908
+ },
909
+ {
910
+ "id": "test/number_theory/183.json",
911
+ "ok": true,
912
+ "level": 3,
913
+ "thema": "Number Theory",
914
+ "gegeben": "14",
915
+ "erwartet": "14",
916
+ "tps": 21.94135978792334,
917
+ "tokens": 973,
918
+ "denk_zeichen": 0,
919
+ "abbruch": "stop",
920
+ "sekunden": 44.97
921
+ },
922
+ {
923
+ "id": "test/counting_and_probability/71.json",
924
+ "ok": true,
925
+ "level": 3,
926
+ "thema": "Counting & Probability",
927
+ "gegeben": "3",
928
+ "erwartet": "3",
929
+ "tps": 22.351039739866703,
930
+ "tokens": 872,
931
+ "denk_zeichen": 0,
932
+ "abbruch": "stop",
933
+ "sekunden": 39.63
934
+ },
935
+ {
936
+ "id": "test/intermediate_algebra/986.json",
937
+ "ok": true,
938
+ "level": 4,
939
+ "thema": "Intermediate Algebra",
940
+ "gegeben": "3.2",
941
+ "erwartet": "\\frac{16}{5}",
942
+ "tps": 21.698255024687104,
943
+ "tokens": 1056,
944
+ "denk_zeichen": 0,
945
+ "abbruch": "stop",
946
+ "sekunden": 49.15
947
+ },
948
+ {
949
+ "id": "test/precalculus/441.json",
950
+ "ok": true,
951
+ "level": 2,
952
+ "thema": "Precalculus",
953
+ "gegeben": "30",
954
+ "erwartet": "30^\\circ",
955
+ "tps": 22.168868721358727,
956
+ "tokens": 698,
957
+ "denk_zeichen": 0,
958
+ "abbruch": "stop",
959
+ "sekunden": 32.16
960
+ },
961
+ {
962
+ "id": "test/precalculus/989.json",
963
+ "ok": false,
964
+ "level": 4,
965
+ "thema": "Precalculus",
966
+ "gegeben": "",
967
+ "erwartet": "12",
968
+ "tps": 21.941986484833425,
969
+ "tokens": 1600,
970
+ "denk_zeichen": 0,
971
+ "abbruch": "length",
972
+ "sekunden": 73.55
973
+ },
974
+ {
975
+ "id": "test/prealgebra/874.json",
976
+ "ok": false,
977
+ "level": 4,
978
+ "thema": "Prealgebra",
979
+ "gegeben": "",
980
+ "erwartet": "116",
981
+ "tps": 21.773894409758103,
982
+ "tokens": 1600,
983
+ "denk_zeichen": 0,
984
+ "abbruch": "length",
985
+ "sekunden": 74.41
986
+ },
987
+ {
988
+ "id": "test/geometry/254.json",
989
+ "ok": true,
990
+ "level": 2,
991
+ "thema": "Geometry",
992
+ "gegeben": "3",
993
+ "erwartet": "3",
994
+ "tps": 22.022942429406708,
995
+ "tokens": 378,
996
+ "denk_zeichen": 0,
997
+ "abbruch": "stop",
998
+ "sekunden": 17.99
999
+ },
1000
+ {
1001
+ "id": "test/algebra/1787.json",
1002
+ "ok": true,
1003
+ "level": 2,
1004
+ "thema": "Algebra",
1005
+ "gegeben": "8",
1006
+ "erwartet": "8",
1007
+ "tps": 21.13636904887218,
1008
+ "tokens": 505,
1009
+ "denk_zeichen": 0,
1010
+ "abbruch": "stop",
1011
+ "sekunden": 24.57
1012
+ },
1013
+ {
1014
+ "id": "test/algebra/1934.json",
1015
+ "ok": true,
1016
+ "level": 4,
1017
+ "thema": "Algebra",
1018
+ "gegeben": "13",
1019
+ "erwartet": "13",
1020
+ "tps": 22.082231675330863,
1021
+ "tokens": 795,
1022
+ "denk_zeichen": 0,
1023
+ "abbruch": "stop",
1024
+ "sekunden": 36.47
1025
+ },
1026
+ {
1027
+ "id": "test/prealgebra/1458.json",
1028
+ "ok": true,
1029
+ "level": 3,
1030
+ "thema": "Prealgebra",
1031
+ "gegeben": "\\frac{1}{8}",
1032
+ "erwartet": "\\frac{1}{8}",
1033
+ "tps": 21.682075642413935,
1034
+ "tokens": 263,
1035
+ "denk_zeichen": 0,
1036
+ "abbruch": "stop",
1037
+ "sekunden": 12.85
1038
+ },
1039
+ {
1040
+ "id": "test/prealgebra/1995.json",
1041
+ "ok": true,
1042
+ "level": 3,
1043
+ "thema": "Prealgebra",
1044
+ "gegeben": "\\frac{8}{21}",
1045
+ "erwartet": "\\frac{8}{21}",
1046
+ "tps": 21.61096811838461,
1047
+ "tokens": 779,
1048
+ "denk_zeichen": 0,
1049
+ "abbruch": "stop",
1050
+ "sekunden": 36.7
1051
+ },
1052
+ {
1053
+ "id": "test/precalculus/580.json",
1054
+ "ok": true,
1055
+ "level": 3,
1056
+ "thema": "Precalculus",
1057
+ "gegeben": "120",
1058
+ "erwartet": "120^\\circ",
1059
+ "tps": 21.54773201628187,
1060
+ "tokens": 850,
1061
+ "denk_zeichen": 0,
1062
+ "abbruch": "stop",
1063
+ "sekunden": 39.9
1064
+ },
1065
+ {
1066
+ "id": "test/geometry/483.json",
1067
+ "ok": true,
1068
+ "level": 4,
1069
+ "thema": "Geometry",
1070
+ "gegeben": "15",
1071
+ "erwartet": "15",
1072
+ "tps": 21.437905897219583,
1073
+ "tokens": 677,
1074
+ "denk_zeichen": 0,
1075
+ "abbruch": "stop",
1076
+ "sekunden": 32.05
1077
+ },
1078
+ {
1079
+ "id": "test/prealgebra/1742.json",
1080
+ "ok": true,
1081
+ "level": 3,
1082
+ "thema": "Prealgebra",
1083
+ "gegeben": "\\frac{33}{100}",
1084
+ "erwartet": "\\dfrac{33}{100}",
1085
+ "tps": 21.044438877608922,
1086
+ "tokens": 561,
1087
+ "denk_zeichen": 0,
1088
+ "abbruch": "stop",
1089
+ "sekunden": 27.11
1090
+ },
1091
+ {
1092
+ "id": "test/algebra/2551.json",
1093
+ "ok": true,
1094
+ "level": 1,
1095
+ "thema": "Algebra",
1096
+ "gegeben": "10",
1097
+ "erwartet": "10",
1098
+ "tps": 21.959472082601682,
1099
+ "tokens": 526,
1100
+ "denk_zeichen": 0,
1101
+ "abbruch": "stop",
1102
+ "sekunden": 24.43
1103
+ },
1104
+ {
1105
+ "id": "test/prealgebra/993.json",
1106
+ "ok": true,
1107
+ "level": 4,
1108
+ "thema": "Prealgebra",
1109
+ "gegeben": "1250",
1110
+ "erwartet": "1250",
1111
+ "tps": 22.10122509510544,
1112
+ "tokens": 685,
1113
+ "denk_zeichen": 0,
1114
+ "abbruch": "stop",
1115
+ "sekunden": 31.64
1116
+ },
1117
+ {
1118
+ "id": "test/algebra/1282.json",
1119
+ "ok": true,
1120
+ "level": 5,
1121
+ "thema": "Algebra",
1122
+ "gegeben": "11",
1123
+ "erwartet": "11",
1124
+ "tps": 21.885183632373106,
1125
+ "tokens": 935,
1126
+ "denk_zeichen": 0,
1127
+ "abbruch": "stop",
1128
+ "sekunden": 43.17
1129
+ },
1130
+ {
1131
+ "id": "test/number_theory/1287.json",
1132
+ "ok": true,
1133
+ "level": 4,
1134
+ "thema": "Number Theory",
1135
+ "gegeben": "8",
1136
+ "erwartet": "8",
1137
+ "tps": 21.892845641868856,
1138
+ "tokens": 626,
1139
+ "denk_zeichen": 0,
1140
+ "abbruch": "stop",
1141
+ "sekunden": 29.19
1142
+ },
1143
+ {
1144
+ "id": "test/prealgebra/1787.json",
1145
+ "ok": true,
1146
+ "level": 3,
1147
+ "thema": "Prealgebra",
1148
+ "gegeben": "1",
1149
+ "erwartet": "1",
1150
+ "tps": 21.156344725233907,
1151
+ "tokens": 575,
1152
+ "denk_zeichen": 0,
1153
+ "abbruch": "stop",
1154
+ "sekunden": 27.89
1155
+ },
1156
+ {
1157
+ "id": "test/intermediate_algebra/960.json",
1158
+ "ok": false,
1159
+ "level": 5,
1160
+ "thema": "Intermediate Algebra",
1161
+ "gegeben": "",
1162
+ "erwartet": "\\frac{17}{21}",
1163
+ "tps": 21.871612377725043,
1164
+ "tokens": 1600,
1165
+ "denk_zeichen": 0,
1166
+ "abbruch": "length",
1167
+ "sekunden": 73.78
1168
+ },
1169
+ {
1170
+ "id": "test/algebra/634.json",
1171
+ "ok": true,
1172
+ "level": 3,
1173
+ "thema": "Algebra",
1174
+ "gegeben": "4",
1175
+ "erwartet": "4",
1176
+ "tps": 21.72550303812614,
1177
+ "tokens": 1148,
1178
+ "denk_zeichen": 0,
1179
+ "abbruch": "stop",
1180
+ "sekunden": 53.35
1181
+ },
1182
+ {
1183
+ "id": "test/algebra/2486.json",
1184
+ "ok": true,
1185
+ "level": 5,
1186
+ "thema": "Algebra",
1187
+ "gegeben": "\\left( \\frac{3}{5}, \\frac{8}{3} \\right]",
1188
+ "erwartet": "\\left(\\frac{3}{5},\\frac{8}{3}\\right]",
1189
+ "tps": 21.85044826809715,
1190
+ "tokens": 746,
1191
+ "denk_zeichen": 0,
1192
+ "abbruch": "stop",
1193
+ "sekunden": 35.09
1194
+ },
1195
+ {
1196
+ "id": "test/intermediate_algebra/754.json",
1197
+ "ok": true,
1198
+ "level": 2,
1199
+ "thema": "Intermediate Algebra",
1200
+ "gegeben": "B",
1201
+ "erwartet": "\\text{(B)}",
1202
+ "tps": 22.11933936571286,
1203
+ "tokens": 1232,
1204
+ "denk_zeichen": 0,
1205
+ "abbruch": "stop",
1206
+ "sekunden": 56.5,
1207
+ "neubewertet": true
1208
+ },
1209
+ {
1210
+ "id": "test/counting_and_probability/339.json",
1211
+ "ok": true,
1212
+ "level": 4,
1213
+ "thema": "Counting & Probability",
1214
+ "gegeben": "12",
1215
+ "erwartet": "12",
1216
+ "tps": 22.05023887513123,
1217
+ "tokens": 748,
1218
+ "denk_zeichen": 0,
1219
+ "abbruch": "stop",
1220
+ "sekunden": 34.37
1221
+ },
1222
+ {
1223
+ "id": "test/geometry/965.json",
1224
+ "ok": false,
1225
+ "level": 5,
1226
+ "thema": "Geometry",
1227
+ "gegeben": "",
1228
+ "erwartet": "28",
1229
+ "tps": 21.704908930068314,
1230
+ "tokens": 1600,
1231
+ "denk_zeichen": 0,
1232
+ "abbruch": "length",
1233
+ "sekunden": 74.43
1234
+ },
1235
+ {
1236
+ "id": "test/intermediate_algebra/1544.json",
1237
+ "ok": false,
1238
+ "level": 5,
1239
+ "thema": "Intermediate Algebra",
1240
+ "gegeben": "",
1241
+ "erwartet": "6",
1242
+ "tps": 21.598400714021533,
1243
+ "tokens": 1600,
1244
+ "denk_zeichen": 0,
1245
+ "abbruch": "length",
1246
+ "sekunden": 74.54
1247
+ },
1248
+ {
1249
+ "id": "test/algebra/1842.json",
1250
+ "ok": true,
1251
+ "level": 2,
1252
+ "thema": "Algebra",
1253
+ "gegeben": "49",
1254
+ "erwartet": "49",
1255
+ "tps": 21.58811702223027,
1256
+ "tokens": 649,
1257
+ "denk_zeichen": 0,
1258
+ "abbruch": "stop",
1259
+ "sekunden": 30.82
1260
+ },
1261
+ {
1262
+ "id": "test/prealgebra/1423.json",
1263
+ "ok": true,
1264
+ "level": 5,
1265
+ "thema": "Prealgebra",
1266
+ "gegeben": "12\\pi",
1267
+ "erwartet": "12\\pi",
1268
+ "tps": 22.266002705222522,
1269
+ "tokens": 345,
1270
+ "denk_zeichen": 0,
1271
+ "abbruch": "stop",
1272
+ "sekunden": 16.1
1273
+ },
1274
+ {
1275
+ "id": "test/algebra/276.json",
1276
+ "ok": true,
1277
+ "level": 2,
1278
+ "thema": "Algebra",
1279
+ "gegeben": "12",
1280
+ "erwartet": "12",
1281
+ "tps": 21.804152300969903,
1282
+ "tokens": 949,
1283
+ "denk_zeichen": 0,
1284
+ "abbruch": "stop",
1285
+ "sekunden": 44.34
1286
+ },
1287
+ {
1288
+ "id": "test/geometry/947.json",
1289
+ "ok": true,
1290
+ "level": 5,
1291
+ "thema": "Geometry",
1292
+ "gegeben": "-\\frac{24}{25}",
1293
+ "erwartet": "-\\frac{24}{25}",
1294
+ "tps": 21.319327170296035,
1295
+ "tokens": 929,
1296
+ "denk_zeichen": 0,
1297
+ "abbruch": "stop",
1298
+ "sekunden": 44.4
1299
+ },
1300
+ {
1301
+ "id": "test/counting_and_probability/870.json",
1302
+ "ok": false,
1303
+ "level": 5,
1304
+ "thema": "Counting & Probability",
1305
+ "gegeben": "",
1306
+ "erwartet": "\\frac{1}{3}",
1307
+ "tps": 21.4171105017021,
1308
+ "tokens": 1600,
1309
+ "denk_zeichen": 0,
1310
+ "abbruch": "length",
1311
+ "sekunden": 75.16
1312
+ },
1313
+ {
1314
+ "id": "test/precalculus/742.json",
1315
+ "ok": false,
1316
+ "level": 2,
1317
+ "thema": "Precalculus",
1318
+ "gegeben": "",
1319
+ "erwartet": "\\frac{9}{100}",
1320
+ "tps": 22.13191050231635,
1321
+ "tokens": 1600,
1322
+ "denk_zeichen": 0,
1323
+ "abbruch": "length",
1324
+ "sekunden": 72.95
1325
+ },
1326
+ {
1327
+ "id": "test/counting_and_probability/216.json",
1328
+ "ok": true,
1329
+ "level": 5,
1330
+ "thema": "Counting & Probability",
1331
+ "gegeben": "1940",
1332
+ "erwartet": "1940",
1333
+ "tps": 21.95004752497779,
1334
+ "tokens": 1159,
1335
+ "denk_zeichen": 0,
1336
+ "abbruch": "stop",
1337
+ "sekunden": 53.25
1338
+ },
1339
+ {
1340
+ "id": "test/intermediate_algebra/776.json",
1341
+ "ok": true,
1342
+ "level": 4,
1343
+ "thema": "Intermediate Algebra",
1344
+ "gegeben": "3",
1345
+ "erwartet": "3",
1346
+ "tps": 21.579664184136227,
1347
+ "tokens": 1225,
1348
+ "denk_zeichen": 0,
1349
+ "abbruch": "stop",
1350
+ "sekunden": 57.54
1351
+ },
1352
+ {
1353
+ "id": "test/algebra/2592.json",
1354
+ "ok": true,
1355
+ "level": 1,
1356
+ "thema": "Algebra",
1357
+ "gegeben": "26000",
1358
+ "erwartet": "26000",
1359
+ "tps": 22.4930079098357,
1360
+ "tokens": 219,
1361
+ "denk_zeichen": 0,
1362
+ "abbruch": "stop",
1363
+ "sekunden": 10.19
1364
+ },
1365
+ {
1366
+ "id": "test/precalculus/801.json",
1367
+ "ok": false,
1368
+ "level": 3,
1369
+ "thema": "Precalculus",
1370
+ "gegeben": "",
1371
+ "erwartet": "55^\\circ",
1372
+ "tps": 22.08966093971958,
1373
+ "tokens": 1600,
1374
+ "denk_zeichen": 0,
1375
+ "abbruch": "length",
1376
+ "sekunden": 72.95
1377
+ },
1378
+ {
1379
+ "id": "test/counting_and_probability/737.json",
1380
+ "ok": true,
1381
+ "level": 2,
1382
+ "thema": "Counting & Probability",
1383
+ "gegeben": "58500",
1384
+ "erwartet": "58,500",
1385
+ "tps": 21.801903162981663,
1386
+ "tokens": 533,
1387
+ "denk_zeichen": 0,
1388
+ "abbruch": "stop",
1389
+ "sekunden": 24.92
1390
+ },
1391
+ {
1392
+ "id": "test/algebra/1338.json",
1393
+ "ok": true,
1394
+ "level": 4,
1395
+ "thema": "Algebra",
1396
+ "gegeben": "66",
1397
+ "erwartet": "66",
1398
+ "tps": 21.07605085266471,
1399
+ "tokens": 822,
1400
+ "denk_zeichen": 0,
1401
+ "abbruch": "stop",
1402
+ "sekunden": 39.46
1403
+ },
1404
+ {
1405
+ "id": "test/number_theory/686.json",
1406
+ "ok": true,
1407
+ "level": 2,
1408
+ "thema": "Number Theory",
1409
+ "gegeben": "4",
1410
+ "erwartet": "4",
1411
+ "tps": 21.325331146910532,
1412
+ "tokens": 592,
1413
+ "denk_zeichen": 0,
1414
+ "abbruch": "stop",
1415
+ "sekunden": 28.47
1416
+ },
1417
+ {
1418
+ "id": "test/counting_and_probability/1014.json",
1419
+ "ok": true,
1420
+ "level": 4,
1421
+ "thema": "Counting & Probability",
1422
+ "gegeben": "480",
1423
+ "erwartet": "480",
1424
+ "tps": 22.153872927386743,
1425
+ "tokens": 996,
1426
+ "denk_zeichen": 0,
1427
+ "abbruch": "stop",
1428
+ "sekunden": 45.42
1429
+ },
1430
+ {
1431
+ "id": "test/algebra/1078.json",
1432
+ "ok": true,
1433
+ "level": 5,
1434
+ "thema": "Algebra",
1435
+ "gegeben": "(-\\sqrt{3}, \\sqrt{3})",
1436
+ "erwartet": "(-\\sqrt{3}, \\sqrt{3})",
1437
+ "tps": 21.926455677685812,
1438
+ "tokens": 968,
1439
+ "denk_zeichen": 0,
1440
+ "abbruch": "stop",
1441
+ "sekunden": 44.85
1442
+ },
1443
+ {
1444
+ "id": "test/precalculus/96.json",
1445
+ "ok": true,
1446
+ "level": 3,
1447
+ "thema": "Precalculus",
1448
+ "gegeben": "1.75",
1449
+ "erwartet": "\\frac{7}{4}",
1450
+ "tps": 21.323968012850845,
1451
+ "tokens": 855,
1452
+ "denk_zeichen": 0,
1453
+ "abbruch": "stop",
1454
+ "sekunden": 40.8
1455
+ },
1456
+ {
1457
+ "id": "test/algebra/251.json",
1458
+ "ok": true,
1459
+ "level": 2,
1460
+ "thema": "Algebra",
1461
+ "gegeben": "2",
1462
+ "erwartet": "2",
1463
+ "tps": 22.159505060382294,
1464
+ "tokens": 423,
1465
+ "denk_zeichen": 0,
1466
+ "abbruch": "stop",
1467
+ "sekunden": 20.04
1468
+ },
1469
+ {
1470
+ "id": "test/number_theory/109.json",
1471
+ "ok": true,
1472
+ "level": 4,
1473
+ "thema": "Number Theory",
1474
+ "gegeben": "4",
1475
+ "erwartet": "4",
1476
+ "tps": 21.945465902241107,
1477
+ "tokens": 1254,
1478
+ "denk_zeichen": 0,
1479
+ "abbruch": "stop",
1480
+ "sekunden": 57.58
1481
+ },
1482
+ {
1483
+ "id": "test/precalculus/1289.json",
1484
+ "ok": true,
1485
+ "level": 1,
1486
+ "thema": "Precalculus",
1487
+ "gegeben": "-41",
1488
+ "erwartet": "-41",
1489
+ "tps": 22.318006430571064,
1490
+ "tokens": 314,
1491
+ "denk_zeichen": 0,
1492
+ "abbruch": "stop",
1493
+ "sekunden": 14.71
1494
+ },
1495
+ {
1496
+ "id": "test/algebra/2264.json",
1497
+ "ok": true,
1498
+ "level": 5,
1499
+ "thema": "Algebra",
1500
+ "gegeben": "1+2i",
1501
+ "erwartet": "1+2i",
1502
+ "tps": 21.519286527165963,
1503
+ "tokens": 968,
1504
+ "denk_zeichen": 0,
1505
+ "abbruch": "stop",
1506
+ "sekunden": 45.67
1507
+ },
1508
+ {
1509
+ "id": "test/geometry/538.json",
1510
+ "ok": true,
1511
+ "level": 4,
1512
+ "thema": "Geometry",
1513
+ "gegeben": "(8, -2)",
1514
+ "erwartet": "(8,-2)",
1515
+ "tps": 22.048436821528455,
1516
+ "tokens": 1049,
1517
+ "denk_zeichen": 0,
1518
+ "abbruch": "stop",
1519
+ "sekunden": 48.08
1520
+ },
1521
+ {
1522
+ "id": "test/intermediate_algebra/1992.json",
1523
+ "ok": true,
1524
+ "level": 4,
1525
+ "thema": "Intermediate Algebra",
1526
+ "gegeben": "(0, 9) \\cup (9, 36)",
1527
+ "erwartet": "(0,9) \\cup (9,36)",
1528
+ "tps": 22.157327804845753,
1529
+ "tokens": 1324,
1530
+ "denk_zeichen": 0,
1531
+ "abbruch": "stop",
1532
+ "sekunden": 60.26
1533
+ },
1534
+ {
1535
+ "id": "test/algebra/101.json",
1536
+ "ok": true,
1537
+ "level": 4,
1538
+ "thema": "Algebra",
1539
+ "gegeben": "[-2, 7]",
1540
+ "erwartet": "x \\in [-2,7]",
1541
+ "tps": 22.40759778899751,
1542
+ "tokens": 750,
1543
+ "denk_zeichen": 0,
1544
+ "abbruch": "stop",
1545
+ "sekunden": 34.12,
1546
+ "neubewertet": true
1547
+ },
1548
+ {
1549
+ "id": "test/algebra/170.json",
1550
+ "ok": true,
1551
+ "level": 3,
1552
+ "thema": "Algebra",
1553
+ "gegeben": "11",
1554
+ "erwartet": "11",
1555
+ "tps": 21.82114113675144,
1556
+ "tokens": 621,
1557
+ "denk_zeichen": 0,
1558
+ "abbruch": "stop",
1559
+ "sekunden": 29.15
1560
+ },
1561
+ {
1562
+ "id": "test/algebra/853.json",
1563
+ "ok": true,
1564
+ "level": 5,
1565
+ "thema": "Algebra",
1566
+ "gegeben": "12",
1567
+ "erwartet": "12",
1568
+ "tps": 21.54911863291958,
1569
+ "tokens": 1193,
1570
+ "denk_zeichen": 0,
1571
+ "abbruch": "stop",
1572
+ "sekunden": 56.31
1573
+ },
1574
+ {
1575
+ "id": "test/algebra/518.json",
1576
+ "ok": true,
1577
+ "level": 3,
1578
+ "thema": "Algebra",
1579
+ "gegeben": "\\frac{3}{4}",
1580
+ "erwartet": "\\frac 34",
1581
+ "tps": 21.65095436946202,
1582
+ "tokens": 517,
1583
+ "denk_zeichen": 0,
1584
+ "abbruch": "stop",
1585
+ "sekunden": 24.39,
1586
+ "neubewertet": true
1587
+ },
1588
+ {
1589
+ "id": "test/prealgebra/631.json",
1590
+ "ok": true,
1591
+ "level": 3,
1592
+ "thema": "Prealgebra",
1593
+ "gegeben": "2",
1594
+ "erwartet": "2",
1595
+ "tps": 21.544290955280957,
1596
+ "tokens": 1579,
1597
+ "denk_zeichen": 0,
1598
+ "abbruch": "stop",
1599
+ "sekunden": 73.97
1600
+ },
1601
+ {
1602
+ "id": "test/geometry/817.json",
1603
+ "ok": false,
1604
+ "level": 5,
1605
+ "thema": "Geometry",
1606
+ "gegeben": "",
1607
+ "erwartet": "\\frac{14}{3}",
1608
+ "tps": 21.47260983414395,
1609
+ "tokens": 1600,
1610
+ "denk_zeichen": 0,
1611
+ "abbruch": "length",
1612
+ "sekunden": 75.13
1613
+ },
1614
+ {
1615
+ "id": "test/number_theory/928.json",
1616
+ "ok": true,
1617
+ "level": 4,
1618
+ "thema": "Number Theory",
1619
+ "gegeben": "3",
1620
+ "erwartet": "3",
1621
+ "tps": 22.206572686068746,
1622
+ "tokens": 1044,
1623
+ "denk_zeichen": 0,
1624
+ "abbruch": "stop",
1625
+ "sekunden": 47.85
1626
+ },
1627
+ {
1628
+ "id": "test/number_theory/132.json",
1629
+ "ok": true,
1630
+ "level": 1,
1631
+ "thema": "Number Theory",
1632
+ "gegeben": "0",
1633
+ "erwartet": "0",
1634
+ "tps": 22.38219012345307,
1635
+ "tokens": 505,
1636
+ "denk_zeichen": 0,
1637
+ "abbruch": "stop",
1638
+ "sekunden": 23.27
1639
+ },
1640
+ {
1641
+ "id": "test/prealgebra/65.json",
1642
+ "ok": true,
1643
+ "level": 2,
1644
+ "thema": "Prealgebra",
1645
+ "gegeben": "6",
1646
+ "erwartet": "6",
1647
+ "tps": 21.98215326095724,
1648
+ "tokens": 762,
1649
+ "denk_zeichen": 0,
1650
+ "abbruch": "stop",
1651
+ "sekunden": 35.36
1652
+ },
1653
+ {
1654
+ "id": "test/algebra/2680.json",
1655
+ "ok": true,
1656
+ "level": 2,
1657
+ "thema": "Algebra",
1658
+ "gegeben": "5r^5",
1659
+ "erwartet": "5r^5",
1660
+ "tps": 22.246219609146095,
1661
+ "tokens": 402,
1662
+ "denk_zeichen": 0,
1663
+ "abbruch": "stop",
1664
+ "sekunden": 18.51
1665
+ },
1666
+ {
1667
+ "id": "test/precalculus/681.json",
1668
+ "ok": true,
1669
+ "level": 3,
1670
+ "thema": "Precalculus",
1671
+ "gegeben": "\\frac{1}{8}",
1672
+ "erwartet": "\\frac{1}{8}",
1673
+ "tps": 21.94910669253525,
1674
+ "tokens": 1451,
1675
+ "denk_zeichen": 0,
1676
+ "abbruch": "stop",
1677
+ "sekunden": 66.82
1678
+ },
1679
+ {
1680
+ "id": "test/precalculus/625.json",
1681
+ "ok": false,
1682
+ "level": 3,
1683
+ "thema": "Precalculus",
1684
+ "gegeben": "\\begin{pmatrix} \\frac{16}{49} \\\\ \\frac{48}{49} \\\\ \\frac{24}{",
1685
+ "erwartet": "\\begin{pmatrix} 16/49 \\\\ 48/49 \\\\ 24/49 \\end{pmatrix}",
1686
+ "tps": 22.081860396738424,
1687
+ "tokens": 736,
1688
+ "denk_zeichen": 0,
1689
+ "abbruch": "stop",
1690
+ "sekunden": 34.27
1691
+ },
1692
+ {
1693
+ "id": "test/number_theory/1002.json",
1694
+ "ok": true,
1695
+ "level": 5,
1696
+ "thema": "Number Theory",
1697
+ "gegeben": "1440",
1698
+ "erwartet": "1440",
1699
+ "tps": 21.70358465809639,
1700
+ "tokens": 1343,
1701
+ "denk_zeichen": 0,
1702
+ "abbruch": "stop",
1703
+ "sekunden": 62.62
1704
+ },
1705
+ {
1706
+ "id": "test/geometry/843.json",
1707
+ "ok": true,
1708
+ "level": 3,
1709
+ "thema": "Geometry",
1710
+ "gegeben": "6\\sqrt{2}",
1711
+ "erwartet": "6\\sqrt{2}",
1712
+ "tps": 21.871424991455577,
1713
+ "tokens": 533,
1714
+ "denk_zeichen": 0,
1715
+ "abbruch": "stop",
1716
+ "sekunden": 25.21
1717
+ },
1718
+ {
1719
+ "id": "test/prealgebra/2019.json",
1720
+ "ok": true,
1721
+ "level": 2,
1722
+ "thema": "Prealgebra",
1723
+ "gegeben": "4,5",
1724
+ "erwartet": "4.5",
1725
+ "tps": 22.62891203019573,
1726
+ "tokens": 248,
1727
+ "denk_zeichen": 0,
1728
+ "abbruch": "stop",
1729
+ "sekunden": 11.66,
1730
+ "neubewertet": true
1731
+ },
1732
+ {
1733
+ "id": "test/number_theory/410.json",
1734
+ "ok": true,
1735
+ "level": 2,
1736
+ "thema": "Number Theory",
1737
+ "gegeben": "0,35625",
1738
+ "erwartet": ".35625",
1739
+ "tps": 22.08602990410909,
1740
+ "tokens": 1059,
1741
+ "denk_zeichen": 0,
1742
+ "abbruch": "stop",
1743
+ "sekunden": 48.37,
1744
+ "neubewertet": true
1745
+ },
1746
+ {
1747
+ "id": "test/counting_and_probability/10.json",
1748
+ "ok": false,
1749
+ "level": 4,
1750
+ "thema": "Counting & Probability",
1751
+ "gegeben": "",
1752
+ "erwartet": "4",
1753
+ "tps": 21.835579018006516,
1754
+ "tokens": 1600,
1755
+ "denk_zeichen": 0,
1756
+ "abbruch": "length",
1757
+ "sekunden": 74.02
1758
+ },
1759
+ {
1760
+ "id": "test/algebra/2080.json",
1761
+ "ok": true,
1762
+ "level": 3,
1763
+ "thema": "Algebra",
1764
+ "gegeben": "14",
1765
+ "erwartet": "14",
1766
+ "tps": 21.68861919405901,
1767
+ "tokens": 482,
1768
+ "denk_zeichen": 0,
1769
+ "abbruch": "stop",
1770
+ "sekunden": 22.86
1771
+ },
1772
+ {
1773
+ "id": "test/algebra/668.json",
1774
+ "ok": true,
1775
+ "level": 4,
1776
+ "thema": "Algebra",
1777
+ "gegeben": "45",
1778
+ "erwartet": "45",
1779
+ "tps": 21.641415932370425,
1780
+ "tokens": 433,
1781
+ "denk_zeichen": 0,
1782
+ "abbruch": "stop",
1783
+ "sekunden": 20.6
1784
+ },
1785
+ {
1786
+ "id": "test/algebra/2430.json",
1787
+ "ok": true,
1788
+ "level": 4,
1789
+ "thema": "Algebra",
1790
+ "gegeben": "8",
1791
+ "erwartet": "8",
1792
+ "tps": 21.515503288103066,
1793
+ "tokens": 1156,
1794
+ "denk_zeichen": 0,
1795
+ "abbruch": "stop",
1796
+ "sekunden": 54.2
1797
+ },
1798
+ {
1799
+ "id": "test/number_theory/13.json",
1800
+ "ok": true,
1801
+ "level": 5,
1802
+ "thema": "Number Theory",
1803
+ "gegeben": "64",
1804
+ "erwartet": "64",
1805
+ "tps": 21.722758988342942,
1806
+ "tokens": 1172,
1807
+ "denk_zeichen": 0,
1808
+ "abbruch": "stop",
1809
+ "sekunden": 54.43
1810
+ },
1811
+ {
1812
+ "id": "test/algebra/2476.json",
1813
+ "ok": true,
1814
+ "level": 2,
1815
+ "thema": "Algebra",
1816
+ "gegeben": "10",
1817
+ "erwartet": "10",
1818
+ "tps": 21.90495572970967,
1819
+ "tokens": 526,
1820
+ "denk_zeichen": 0,
1821
+ "abbruch": "stop",
1822
+ "sekunden": 24.78
1823
+ },
1824
+ {
1825
+ "id": "test/intermediate_algebra/1102.json",
1826
+ "ok": false,
1827
+ "level": 1,
1828
+ "thema": "Intermediate Algebra",
1829
+ "gegeben": "1, -2",
1830
+ "erwartet": "-2,1",
1831
+ "tps": 22.067757931801022,
1832
+ "tokens": 1420,
1833
+ "denk_zeichen": 0,
1834
+ "abbruch": "stop",
1835
+ "sekunden": 64.97
1836
+ },
1837
+ {
1838
+ "id": "test/prealgebra/914.json",
1839
+ "ok": false,
1840
+ "level": 4,
1841
+ "thema": "Prealgebra",
1842
+ "gegeben": "",
1843
+ "erwartet": "75^\\circ",
1844
+ "tps": 21.920084304644234,
1845
+ "tokens": 1600,
1846
+ "denk_zeichen": 0,
1847
+ "abbruch": "length",
1848
+ "sekunden": 73.7
1849
+ },
1850
+ {
1851
+ "id": "test/algebra/1425.json",
1852
+ "ok": true,
1853
+ "level": 2,
1854
+ "thema": "Algebra",
1855
+ "gegeben": "2",
1856
+ "erwartet": "2",
1857
+ "tps": 21.946949055738134,
1858
+ "tokens": 586,
1859
+ "denk_zeichen": 0,
1860
+ "abbruch": "stop",
1861
+ "sekunden": 27.16
1862
+ },
1863
+ {
1864
+ "id": "test/precalculus/703.json",
1865
+ "ok": false,
1866
+ "level": 5,
1867
+ "thema": "Precalculus",
1868
+ "gegeben": "",
1869
+ "erwartet": "8 \\pi",
1870
+ "tps": 21.808591093728513,
1871
+ "tokens": 1600,
1872
+ "denk_zeichen": 0,
1873
+ "abbruch": "length",
1874
+ "sekunden": 73.87
1875
+ },
1876
+ {
1877
+ "id": "test/intermediate_algebra/158.json",
1878
+ "ok": true,
1879
+ "level": 5,
1880
+ "thema": "Intermediate Algebra",
1881
+ "gegeben": "27648",
1882
+ "erwartet": "27648",
1883
+ "tps": 21.744682786246074,
1884
+ "tokens": 1302,
1885
+ "denk_zeichen": 0,
1886
+ "abbruch": "stop",
1887
+ "sekunden": 60.35
1888
+ },
1889
+ {
1890
+ "id": "test/prealgebra/1930.json",
1891
+ "ok": true,
1892
+ "level": 5,
1893
+ "thema": "Prealgebra",
1894
+ "gegeben": "7",
1895
+ "erwartet": "7",
1896
+ "tps": 22.221557894493884,
1897
+ "tokens": 724,
1898
+ "denk_zeichen": 0,
1899
+ "abbruch": "stop",
1900
+ "sekunden": 33.26
1901
+ },
1902
+ {
1903
+ "id": "test/prealgebra/1252.json",
1904
+ "ok": true,
1905
+ "level": 2,
1906
+ "thema": "Prealgebra",
1907
+ "gegeben": "200",
1908
+ "erwartet": "200",
1909
+ "tps": 21.98222195127098,
1910
+ "tokens": 525,
1911
+ "denk_zeichen": 0,
1912
+ "abbruch": "stop",
1913
+ "sekunden": 24.54
1914
+ },
1915
+ {
1916
+ "id": "test/precalculus/1252.json",
1917
+ "ok": true,
1918
+ "level": 2,
1919
+ "thema": "Precalculus",
1920
+ "gegeben": "1",
1921
+ "erwartet": "1",
1922
+ "tps": 22.04587838606429,
1923
+ "tokens": 1014,
1924
+ "denk_zeichen": 0,
1925
+ "abbruch": "stop",
1926
+ "sekunden": 46.46
1927
+ },
1928
+ {
1929
+ "id": "test/precalculus/1082.json",
1930
+ "ok": true,
1931
+ "level": 3,
1932
+ "thema": "Precalculus",
1933
+ "gegeben": "\\frac{8}{15}",
1934
+ "erwartet": "\\frac{8}{15}",
1935
+ "tps": 21.882458544989213,
1936
+ "tokens": 1599,
1937
+ "denk_zeichen": 0,
1938
+ "abbruch": "stop",
1939
+ "sekunden": 73.8
1940
+ },
1941
+ {
1942
+ "id": "test/geometry/477.json",
1943
+ "ok": true,
1944
+ "level": 3,
1945
+ "thema": "Geometry",
1946
+ "gegeben": "216",
1947
+ "erwartet": "216",
1948
+ "tps": 21.67211079802904,
1949
+ "tokens": 476,
1950
+ "denk_zeichen": 0,
1951
+ "abbruch": "stop",
1952
+ "sekunden": 22.66
1953
+ },
1954
+ {
1955
+ "id": "test/intermediate_algebra/1350.json",
1956
+ "ok": false,
1957
+ "level": 5,
1958
+ "thema": "Intermediate Algebra",
1959
+ "gegeben": "",
1960
+ "erwartet": "14",
1961
+ "tps": 21.49689373916137,
1962
+ "tokens": 1600,
1963
+ "denk_zeichen": 0,
1964
+ "abbruch": "length",
1965
+ "sekunden": 74.94
1966
+ },
1967
+ {
1968
+ "id": "test/algebra/2779.json",
1969
+ "ok": true,
1970
+ "level": 5,
1971
+ "thema": "Algebra",
1972
+ "gegeben": "20",
1973
+ "erwartet": "20",
1974
+ "tps": 22.406078475188302,
1975
+ "tokens": 709,
1976
+ "denk_zeichen": 0,
1977
+ "abbruch": "stop",
1978
+ "sekunden": 32.12
1979
+ },
1980
+ {
1981
+ "id": "test/intermediate_algebra/1232.json",
1982
+ "ok": true,
1983
+ "level": 3,
1984
+ "thema": "Intermediate Algebra",
1985
+ "gegeben": "\\dfrac{5}{13}",
1986
+ "erwartet": "\\frac{5}{13}",
1987
+ "tps": 21.807087225592092,
1988
+ "tokens": 617,
1989
+ "denk_zeichen": 0,
1990
+ "abbruch": "stop",
1991
+ "sekunden": 29.27
1992
+ }
1993
+ ],
1994
+ "quote_vor_neubewertung": 70.7,
1995
+ "neubewertet": 8
1996
+ }
bench/math500/q38-q6.json ADDED
@@ -0,0 +1,1994 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "modell": "Qwen3.8-27B Q6_K",
3
+ "satz": "math500",
4
+ "reasoning": false,
5
+ "n": 150,
6
+ "bestanden": 115,
7
+ "quote": 76.7,
8
+ "tps_median": 22.4,
9
+ "tokens_je_aufgabe": 924.9,
10
+ "am_limit": 32,
11
+ "nach_level": {
12
+ "1": [
13
+ 7,
14
+ 8
15
+ ],
16
+ "2": [
17
+ 29,
18
+ 33
19
+ ],
20
+ "3": [
21
+ 30,
22
+ 36
23
+ ],
24
+ "4": [
25
+ 29,
26
+ 35
27
+ ],
28
+ "5": [
29
+ 20,
30
+ 38
31
+ ]
32
+ },
33
+ "dauer_s": 6299.8,
34
+ "aufgaben": [
35
+ {
36
+ "id": "test/precalculus/807.json",
37
+ "ok": true,
38
+ "level": 2,
39
+ "thema": "Precalculus",
40
+ "gegeben": "(3, \\frac{\\pi}{2})",
41
+ "erwartet": "\\left( 3, \\frac{\\pi}{2} \\right)",
42
+ "tps": 22.801880071082056,
43
+ "tokens": 305,
44
+ "denk_zeichen": 0,
45
+ "abbruch": "stop",
46
+ "sekunden": 13.85
47
+ },
48
+ {
49
+ "id": "test/number_theory/572.json",
50
+ "ok": true,
51
+ "level": 3,
52
+ "thema": "Number Theory",
53
+ "gegeben": "9",
54
+ "erwartet": "9",
55
+ "tps": 22.4873394855447,
56
+ "tokens": 711,
57
+ "denk_zeichen": 0,
58
+ "abbruch": "stop",
59
+ "sekunden": 32.26
60
+ },
61
+ {
62
+ "id": "test/number_theory/515.json",
63
+ "ok": true,
64
+ "level": 3,
65
+ "thema": "Number Theory",
66
+ "gegeben": "27",
67
+ "erwartet": "27",
68
+ "tps": 22.693709048983816,
69
+ "tokens": 650,
70
+ "denk_zeichen": 0,
71
+ "abbruch": "stop",
72
+ "sekunden": 29.34
73
+ },
74
+ {
75
+ "id": "test/number_theory/1032.json",
76
+ "ok": false,
77
+ "level": 3,
78
+ "thema": "Number Theory",
79
+ "gegeben": "",
80
+ "erwartet": "2220",
81
+ "tps": 22.462166516673214,
82
+ "tokens": 1600,
83
+ "denk_zeichen": 0,
84
+ "abbruch": "length",
85
+ "sekunden": 71.65
86
+ },
87
+ {
88
+ "id": "test/geometry/248.json",
89
+ "ok": true,
90
+ "level": 2,
91
+ "thema": "Geometry",
92
+ "gegeben": "5",
93
+ "erwartet": "5",
94
+ "tps": 23.081485656731115,
95
+ "tokens": 314,
96
+ "denk_zeichen": 0,
97
+ "abbruch": "stop",
98
+ "sekunden": 14.44
99
+ },
100
+ {
101
+ "id": "test/intermediate_algebra/134.json",
102
+ "ok": true,
103
+ "level": 1,
104
+ "thema": "Intermediate Algebra",
105
+ "gegeben": "-50",
106
+ "erwartet": "-50",
107
+ "tps": 22.69452810800243,
108
+ "tokens": 301,
109
+ "denk_zeichen": 0,
110
+ "abbruch": "stop",
111
+ "sekunden": 13.67
112
+ },
113
+ {
114
+ "id": "test/algebra/1098.json",
115
+ "ok": true,
116
+ "level": 3,
117
+ "thema": "Algebra",
118
+ "gegeben": "6+9i",
119
+ "erwartet": "6+9i",
120
+ "tps": 23.14428761542362,
121
+ "tokens": 238,
122
+ "denk_zeichen": 0,
123
+ "abbruch": "stop",
124
+ "sekunden": 10.86
125
+ },
126
+ {
127
+ "id": "test/algebra/2193.json",
128
+ "ok": true,
129
+ "level": 5,
130
+ "thema": "Algebra",
131
+ "gegeben": "5",
132
+ "erwartet": "x=5",
133
+ "tps": 21.709641933533863,
134
+ "tokens": 825,
135
+ "denk_zeichen": 0,
136
+ "abbruch": "stop",
137
+ "sekunden": 38.58,
138
+ "neubewertet": true
139
+ },
140
+ {
141
+ "id": "test/counting_and_probability/525.json",
142
+ "ok": true,
143
+ "level": 5,
144
+ "thema": "Counting & Probability",
145
+ "gegeben": "144",
146
+ "erwartet": "144",
147
+ "tps": 22.6387917110894,
148
+ "tokens": 864,
149
+ "denk_zeichen": 0,
150
+ "abbruch": "stop",
151
+ "sekunden": 38.6
152
+ },
153
+ {
154
+ "id": "test/number_theory/864.json",
155
+ "ok": true,
156
+ "level": 3,
157
+ "thema": "Number Theory",
158
+ "gegeben": "52_8",
159
+ "erwartet": "52_8",
160
+ "tps": 22.859234591786443,
161
+ "tokens": 598,
162
+ "denk_zeichen": 0,
163
+ "abbruch": "stop",
164
+ "sekunden": 26.73
165
+ },
166
+ {
167
+ "id": "test/algebra/1072.json",
168
+ "ok": true,
169
+ "level": 4,
170
+ "thema": "Algebra",
171
+ "gegeben": "\\frac{243}{625}",
172
+ "erwartet": "\\frac{243}{625}",
173
+ "tps": 22.08853629255502,
174
+ "tokens": 1064,
175
+ "denk_zeichen": 0,
176
+ "abbruch": "stop",
177
+ "sekunden": 48.78
178
+ },
179
+ {
180
+ "id": "test/intermediate_algebra/428.json",
181
+ "ok": true,
182
+ "level": 2,
183
+ "thema": "Intermediate Algebra",
184
+ "gegeben": "3, 5, 7",
185
+ "erwartet": "3, 5, 7",
186
+ "tps": 22.64354912627093,
187
+ "tokens": 882,
188
+ "denk_zeichen": 0,
189
+ "abbruch": "stop",
190
+ "sekunden": 39.38
191
+ },
192
+ {
193
+ "id": "test/prealgebra/930.json",
194
+ "ok": true,
195
+ "level": 2,
196
+ "thema": "Prealgebra",
197
+ "gegeben": "12",
198
+ "erwartet": "12",
199
+ "tps": 22.21706391369399,
200
+ "tokens": 375,
201
+ "denk_zeichen": 0,
202
+ "abbruch": "stop",
203
+ "sekunden": 17.66
204
+ },
205
+ {
206
+ "id": "test/intermediate_algebra/1454.json",
207
+ "ok": false,
208
+ "level": 5,
209
+ "thema": "Intermediate Algebra",
210
+ "gegeben": "",
211
+ "erwartet": "70 \\sqrt{2}",
212
+ "tps": 22.595763139065554,
213
+ "tokens": 1600,
214
+ "denk_zeichen": 0,
215
+ "abbruch": "length",
216
+ "sekunden": 71.58
217
+ },
218
+ {
219
+ "id": "test/precalculus/285.json",
220
+ "ok": false,
221
+ "level": 2,
222
+ "thema": "Precalculus",
223
+ "gegeben": "",
224
+ "erwartet": "6",
225
+ "tps": 22.16580869978899,
226
+ "tokens": 1600,
227
+ "denk_zeichen": 0,
228
+ "abbruch": "length",
229
+ "sekunden": 72.62
230
+ },
231
+ {
232
+ "id": "test/number_theory/1055.json",
233
+ "ok": false,
234
+ "level": 5,
235
+ "thema": "Number Theory",
236
+ "gegeben": "",
237
+ "erwartet": "203",
238
+ "tps": 22.478138324618936,
239
+ "tokens": 1600,
240
+ "denk_zeichen": 0,
241
+ "abbruch": "length",
242
+ "sekunden": 71.95
243
+ },
244
+ {
245
+ "id": "test/precalculus/1105.json",
246
+ "ok": true,
247
+ "level": 2,
248
+ "thema": "Precalculus",
249
+ "gegeben": "-\\frac{\\pi}{6}",
250
+ "erwartet": "-\\frac{\\pi}{6}",
251
+ "tps": 22.887444499114817,
252
+ "tokens": 490,
253
+ "denk_zeichen": 0,
254
+ "abbruch": "stop",
255
+ "sekunden": 22.02
256
+ },
257
+ {
258
+ "id": "test/algebra/769.json",
259
+ "ok": true,
260
+ "level": 3,
261
+ "thema": "Algebra",
262
+ "gegeben": "11",
263
+ "erwartet": "11",
264
+ "tps": 22.69557648394455,
265
+ "tokens": 536,
266
+ "denk_zeichen": 0,
267
+ "abbruch": "stop",
268
+ "sekunden": 24.47
269
+ },
270
+ {
271
+ "id": "test/intermediate_algebra/956.json",
272
+ "ok": false,
273
+ "level": 5,
274
+ "thema": "Intermediate Algebra",
275
+ "gegeben": "",
276
+ "erwartet": "(6,31,-1)",
277
+ "tps": 22.615410610059467,
278
+ "tokens": 1600,
279
+ "denk_zeichen": 0,
280
+ "abbruch": "length",
281
+ "sekunden": 71.16
282
+ },
283
+ {
284
+ "id": "test/intermediate_algebra/279.json",
285
+ "ok": true,
286
+ "level": 5,
287
+ "thema": "Intermediate Algebra",
288
+ "gegeben": "10",
289
+ "erwartet": "10",
290
+ "tps": 22.06185616277022,
291
+ "tokens": 1228,
292
+ "denk_zeichen": 0,
293
+ "abbruch": "stop",
294
+ "sekunden": 56.14
295
+ },
296
+ {
297
+ "id": "test/algebra/2046.json",
298
+ "ok": true,
299
+ "level": 3,
300
+ "thema": "Algebra",
301
+ "gegeben": "x^3 + 3x - 6",
302
+ "erwartet": "x^3+3x-6",
303
+ "tps": 21.837686500431673,
304
+ "tokens": 580,
305
+ "denk_zeichen": 0,
306
+ "abbruch": "stop",
307
+ "sekunden": 27.27
308
+ },
309
+ {
310
+ "id": "test/number_theory/46.json",
311
+ "ok": true,
312
+ "level": 2,
313
+ "thema": "Number Theory",
314
+ "gegeben": "40_9",
315
+ "erwartet": "40_9",
316
+ "tps": 22.278628620925755,
317
+ "tokens": 468,
318
+ "denk_zeichen": 0,
319
+ "abbruch": "stop",
320
+ "sekunden": 21.67
321
+ },
322
+ {
323
+ "id": "test/algebra/2253.json",
324
+ "ok": true,
325
+ "level": 4,
326
+ "thema": "Algebra",
327
+ "gegeben": "\\frac{3\\sqrt{3}}{4}",
328
+ "erwartet": "\\frac{3\\sqrt{3}}{4}",
329
+ "tps": 22.29502914105285,
330
+ "tokens": 569,
331
+ "denk_zeichen": 0,
332
+ "abbruch": "stop",
333
+ "sekunden": 25.95
334
+ },
335
+ {
336
+ "id": "test/intermediate_algebra/623.json",
337
+ "ok": true,
338
+ "level": 2,
339
+ "thema": "Intermediate Algebra",
340
+ "gegeben": "0",
341
+ "erwartet": "0",
342
+ "tps": 22.827639344091853,
343
+ "tokens": 404,
344
+ "denk_zeichen": 0,
345
+ "abbruch": "stop",
346
+ "sekunden": 18.12
347
+ },
348
+ {
349
+ "id": "test/intermediate_algebra/1849.json",
350
+ "ok": false,
351
+ "level": 5,
352
+ "thema": "Intermediate Algebra",
353
+ "gegeben": "",
354
+ "erwartet": "501",
355
+ "tps": 21.974753535284616,
356
+ "tokens": 1600,
357
+ "denk_zeichen": 0,
358
+ "abbruch": "length",
359
+ "sekunden": 73.23
360
+ },
361
+ {
362
+ "id": "test/intermediate_algebra/2046.json",
363
+ "ok": false,
364
+ "level": 2,
365
+ "thema": "Intermediate Algebra",
366
+ "gegeben": "",
367
+ "erwartet": "2",
368
+ "tps": 22.451580395510128,
369
+ "tokens": 1600,
370
+ "denk_zeichen": 0,
371
+ "abbruch": "length",
372
+ "sekunden": 72.01
373
+ },
374
+ {
375
+ "id": "test/prealgebra/307.json",
376
+ "ok": true,
377
+ "level": 1,
378
+ "thema": "Prealgebra",
379
+ "gegeben": "240",
380
+ "erwartet": "240",
381
+ "tps": 23.001099519713538,
382
+ "tokens": 274,
383
+ "denk_zeichen": 0,
384
+ "abbruch": "stop",
385
+ "sekunden": 12.64
386
+ },
387
+ {
388
+ "id": "test/prealgebra/1761.json",
389
+ "ok": true,
390
+ "level": 3,
391
+ "thema": "Prealgebra",
392
+ "gegeben": "\\frac{3}{2}",
393
+ "erwartet": "\\frac{3}{2}",
394
+ "tps": 22.864735841089317,
395
+ "tokens": 297,
396
+ "denk_zeichen": 0,
397
+ "abbruch": "stop",
398
+ "sekunden": 13.44
399
+ },
400
+ {
401
+ "id": "test/algebra/873.json",
402
+ "ok": true,
403
+ "level": 4,
404
+ "thema": "Algebra",
405
+ "gegeben": "33",
406
+ "erwartet": "33",
407
+ "tps": 21.87921260583146,
408
+ "tokens": 622,
409
+ "denk_zeichen": 0,
410
+ "abbruch": "stop",
411
+ "sekunden": 29.14
412
+ },
413
+ {
414
+ "id": "test/intermediate_algebra/662.json",
415
+ "ok": false,
416
+ "level": 5,
417
+ "thema": "Intermediate Algebra",
418
+ "gegeben": "",
419
+ "erwartet": "1 \\pm \\sqrt{19}",
420
+ "tps": 22.241981442486193,
421
+ "tokens": 1600,
422
+ "denk_zeichen": 0,
423
+ "abbruch": "length",
424
+ "sekunden": 72.73
425
+ },
426
+ {
427
+ "id": "test/geometry/183.json",
428
+ "ok": false,
429
+ "level": 5,
430
+ "thema": "Geometry",
431
+ "gegeben": "",
432
+ "erwartet": "145^\\circ",
433
+ "tps": 21.545989085529108,
434
+ "tokens": 1600,
435
+ "denk_zeichen": 0,
436
+ "abbruch": "length",
437
+ "sekunden": 75.07
438
+ },
439
+ {
440
+ "id": "test/intermediate_algebra/558.json",
441
+ "ok": false,
442
+ "level": 5,
443
+ "thema": "Intermediate Algebra",
444
+ "gegeben": "",
445
+ "erwartet": "(3,4]",
446
+ "tps": 22.22934456596934,
447
+ "tokens": 1600,
448
+ "denk_zeichen": 0,
449
+ "abbruch": "length",
450
+ "sekunden": 72.8
451
+ },
452
+ {
453
+ "id": "test/intermediate_algebra/515.json",
454
+ "ok": true,
455
+ "level": 2,
456
+ "thema": "Intermediate Algebra",
457
+ "gegeben": "\\frac{4}{3}",
458
+ "erwartet": "\\frac43",
459
+ "tps": 22.731202602000582,
460
+ "tokens": 809,
461
+ "denk_zeichen": 0,
462
+ "abbruch": "stop",
463
+ "sekunden": 36.32,
464
+ "neubewertet": true
465
+ },
466
+ {
467
+ "id": "test/intermediate_algebra/345.json",
468
+ "ok": false,
469
+ "level": 4,
470
+ "thema": "Intermediate Algebra",
471
+ "gegeben": "",
472
+ "erwartet": "504",
473
+ "tps": 22.280902382673748,
474
+ "tokens": 1600,
475
+ "denk_zeichen": 0,
476
+ "abbruch": "length",
477
+ "sekunden": 72.52
478
+ },
479
+ {
480
+ "id": "test/algebra/2593.json",
481
+ "ok": true,
482
+ "level": 2,
483
+ "thema": "Algebra",
484
+ "gegeben": "8000",
485
+ "erwartet": "8000",
486
+ "tps": 21.33695449662012,
487
+ "tokens": 537,
488
+ "denk_zeichen": 0,
489
+ "abbruch": "stop",
490
+ "sekunden": 26.2
491
+ },
492
+ {
493
+ "id": "test/algebra/2157.json",
494
+ "ok": true,
495
+ "level": 2,
496
+ "thema": "Algebra",
497
+ "gegeben": "2",
498
+ "erwartet": "2",
499
+ "tps": 21.475434064438737,
500
+ "tokens": 449,
501
+ "denk_zeichen": 0,
502
+ "abbruch": "stop",
503
+ "sekunden": 21.61
504
+ },
505
+ {
506
+ "id": "test/intermediate_algebra/128.json",
507
+ "ok": true,
508
+ "level": 2,
509
+ "thema": "Intermediate Algebra",
510
+ "gegeben": "even",
511
+ "erwartet": "\\text{even}",
512
+ "tps": 22.340174850084892,
513
+ "tokens": 909,
514
+ "denk_zeichen": 0,
515
+ "abbruch": "stop",
516
+ "sekunden": 41.15
517
+ },
518
+ {
519
+ "id": "test/geometry/283.json",
520
+ "ok": false,
521
+ "level": 4,
522
+ "thema": "Geometry",
523
+ "gegeben": "",
524
+ "erwartet": "8",
525
+ "tps": 22.87022429872424,
526
+ "tokens": 1600,
527
+ "denk_zeichen": 0,
528
+ "abbruch": "length",
529
+ "sekunden": 70.93
530
+ },
531
+ {
532
+ "id": "test/intermediate_algebra/1063.json",
533
+ "ok": true,
534
+ "level": 4,
535
+ "thema": "Intermediate Algebra",
536
+ "gegeben": "1+274i",
537
+ "erwartet": "1+274i",
538
+ "tps": 22.226623119733524,
539
+ "tokens": 1512,
540
+ "denk_zeichen": 0,
541
+ "abbruch": "stop",
542
+ "sekunden": 68.55
543
+ },
544
+ {
545
+ "id": "test/number_theory/753.json",
546
+ "ok": true,
547
+ "level": 4,
548
+ "thema": "Number Theory",
549
+ "gegeben": "13",
550
+ "erwartet": "13",
551
+ "tps": 21.8826345860431,
552
+ "tokens": 1242,
553
+ "denk_zeichen": 0,
554
+ "abbruch": "stop",
555
+ "sekunden": 57.5
556
+ },
557
+ {
558
+ "id": "test/prealgebra/1807.json",
559
+ "ok": true,
560
+ "level": 3,
561
+ "thema": "Prealgebra",
562
+ "gegeben": "120",
563
+ "erwartet": "120",
564
+ "tps": 21.54348475532056,
565
+ "tokens": 1023,
566
+ "denk_zeichen": 0,
567
+ "abbruch": "stop",
568
+ "sekunden": 47.95
569
+ },
570
+ {
571
+ "id": "test/intermediate_algebra/2022.json",
572
+ "ok": false,
573
+ "level": 5,
574
+ "thema": "Intermediate Algebra",
575
+ "gegeben": "",
576
+ "erwartet": "64",
577
+ "tps": 22.53131112938338,
578
+ "tokens": 1600,
579
+ "denk_zeichen": 0,
580
+ "abbruch": "length",
581
+ "sekunden": 71.56
582
+ },
583
+ {
584
+ "id": "test/number_theory/156.json",
585
+ "ok": true,
586
+ "level": 4,
587
+ "thema": "Number Theory",
588
+ "gegeben": "13",
589
+ "erwartet": "13",
590
+ "tps": 22.932636645103923,
591
+ "tokens": 580,
592
+ "denk_zeichen": 0,
593
+ "abbruch": "stop",
594
+ "sekunden": 25.95
595
+ },
596
+ {
597
+ "id": "test/precalculus/477.json",
598
+ "ok": true,
599
+ "level": 3,
600
+ "thema": "Precalculus",
601
+ "gegeben": "3\\sqrt{5}",
602
+ "erwartet": "3 \\sqrt{5}",
603
+ "tps": 23.25161671095944,
604
+ "tokens": 723,
605
+ "denk_zeichen": 0,
606
+ "abbruch": "stop",
607
+ "sekunden": 31.75
608
+ },
609
+ {
610
+ "id": "test/algebra/1519.json",
611
+ "ok": true,
612
+ "level": 3,
613
+ "thema": "Algebra",
614
+ "gegeben": "\\frac{\\sqrt{3}}{3}",
615
+ "erwartet": "\\frac{\\sqrt{3}}{3}",
616
+ "tps": 23.13873580345718,
617
+ "tokens": 405,
618
+ "denk_zeichen": 0,
619
+ "abbruch": "stop",
620
+ "sekunden": 18.2
621
+ },
622
+ {
623
+ "id": "test/intermediate_algebra/964.json",
624
+ "ok": false,
625
+ "level": 5,
626
+ "thema": "Intermediate Algebra",
627
+ "gegeben": "",
628
+ "erwartet": "1",
629
+ "tps": 21.665124019565123,
630
+ "tokens": 1600,
631
+ "denk_zeichen": 0,
632
+ "abbruch": "length",
633
+ "sekunden": 74.71
634
+ },
635
+ {
636
+ "id": "test/counting_and_probability/230.json",
637
+ "ok": true,
638
+ "level": 4,
639
+ "thema": "Counting & Probability",
640
+ "gegeben": "\\frac{2}{21}",
641
+ "erwartet": "\\frac{2}{21}",
642
+ "tps": 22.945825531933234,
643
+ "tokens": 953,
644
+ "denk_zeichen": 0,
645
+ "abbruch": "stop",
646
+ "sekunden": 42.23
647
+ },
648
+ {
649
+ "id": "test/precalculus/117.json",
650
+ "ok": false,
651
+ "level": 3,
652
+ "thema": "Precalculus",
653
+ "gegeben": "",
654
+ "erwartet": "30^\\circ",
655
+ "tps": 22.246870209492794,
656
+ "tokens": 1600,
657
+ "denk_zeichen": 0,
658
+ "abbruch": "length",
659
+ "sekunden": 72.72
660
+ },
661
+ {
662
+ "id": "test/number_theory/521.json",
663
+ "ok": true,
664
+ "level": 2,
665
+ "thema": "Number Theory",
666
+ "gegeben": "18",
667
+ "erwartet": "18",
668
+ "tps": 22.02384090802148,
669
+ "tokens": 769,
670
+ "denk_zeichen": 0,
671
+ "abbruch": "stop",
672
+ "sekunden": 35.38
673
+ },
674
+ {
675
+ "id": "test/algebra/2517.json",
676
+ "ok": true,
677
+ "level": 5,
678
+ "thema": "Algebra",
679
+ "gegeben": "-\\frac{35}{9}",
680
+ "erwartet": "-\\frac{35}{9}",
681
+ "tps": 22.82866061611348,
682
+ "tokens": 961,
683
+ "denk_zeichen": 0,
684
+ "abbruch": "stop",
685
+ "sekunden": 43.01
686
+ },
687
+ {
688
+ "id": "test/prealgebra/1003.json",
689
+ "ok": false,
690
+ "level": 5,
691
+ "thema": "Prealgebra",
692
+ "gegeben": "",
693
+ "erwartet": "\\frac{270}7\\text{ degrees}",
694
+ "tps": 22.35278140339116,
695
+ "tokens": 1600,
696
+ "denk_zeichen": 0,
697
+ "abbruch": "length",
698
+ "sekunden": 72.45
699
+ },
700
+ {
701
+ "id": "test/algebra/297.json",
702
+ "ok": false,
703
+ "level": 5,
704
+ "thema": "Algebra",
705
+ "gegeben": "",
706
+ "erwartet": "1736",
707
+ "tps": 22.35533926330131,
708
+ "tokens": 1600,
709
+ "denk_zeichen": 0,
710
+ "abbruch": "length",
711
+ "sekunden": 72.04
712
+ },
713
+ {
714
+ "id": "test/algebra/686.json",
715
+ "ok": false,
716
+ "level": 5,
717
+ "thema": "Algebra",
718
+ "gegeben": "",
719
+ "erwartet": "4",
720
+ "tps": 23.391515341837028,
721
+ "tokens": 1600,
722
+ "denk_zeichen": 0,
723
+ "abbruch": "length",
724
+ "sekunden": 68.93
725
+ },
726
+ {
727
+ "id": "test/number_theory/598.json",
728
+ "ok": true,
729
+ "level": 3,
730
+ "thema": "Number Theory",
731
+ "gegeben": "0.0000672",
732
+ "erwartet": ".0000672",
733
+ "tps": 22.18593688715206,
734
+ "tokens": 791,
735
+ "denk_zeichen": 0,
736
+ "abbruch": "stop",
737
+ "sekunden": 36.12
738
+ },
739
+ {
740
+ "id": "test/prealgebra/1908.json",
741
+ "ok": true,
742
+ "level": 3,
743
+ "thema": "Prealgebra",
744
+ "gegeben": "3",
745
+ "erwartet": "3",
746
+ "tps": 22.993865086133187,
747
+ "tokens": 641,
748
+ "denk_zeichen": 0,
749
+ "abbruch": "stop",
750
+ "sekunden": 28.33
751
+ },
752
+ {
753
+ "id": "test/algebra/1082.json",
754
+ "ok": true,
755
+ "level": 4,
756
+ "thema": "Algebra",
757
+ "gegeben": "23",
758
+ "erwartet": "23",
759
+ "tps": 22.42016533281643,
760
+ "tokens": 1149,
761
+ "denk_zeichen": 0,
762
+ "abbruch": "stop",
763
+ "sekunden": 51.82
764
+ },
765
+ {
766
+ "id": "test/number_theory/978.json",
767
+ "ok": true,
768
+ "level": 4,
769
+ "thema": "Number Theory",
770
+ "gegeben": "7",
771
+ "erwartet": "7",
772
+ "tps": 22.981470568824975,
773
+ "tokens": 787,
774
+ "denk_zeichen": 0,
775
+ "abbruch": "stop",
776
+ "sekunden": 34.86
777
+ },
778
+ {
779
+ "id": "test/counting_and_probability/51.json",
780
+ "ok": true,
781
+ "level": 5,
782
+ "thema": "Counting & Probability",
783
+ "gegeben": "\\frac{13}{18}",
784
+ "erwartet": "\\frac{13}{18}",
785
+ "tps": 23.105508864584152,
786
+ "tokens": 705,
787
+ "denk_zeichen": 0,
788
+ "abbruch": "stop",
789
+ "sekunden": 30.97
790
+ },
791
+ {
792
+ "id": "test/intermediate_algebra/1422.json",
793
+ "ok": false,
794
+ "level": 3,
795
+ "thema": "Intermediate Algebra",
796
+ "gegeben": "",
797
+ "erwartet": "4",
798
+ "tps": 22.297067283463004,
799
+ "tokens": 1600,
800
+ "denk_zeichen": 0,
801
+ "abbruch": "length",
802
+ "sekunden": 72.28
803
+ },
804
+ {
805
+ "id": "test/algebra/1937.json",
806
+ "ok": true,
807
+ "level": 1,
808
+ "thema": "Algebra",
809
+ "gegeben": "1600",
810
+ "erwartet": "1600",
811
+ "tps": 21.83310874093862,
812
+ "tokens": 469,
813
+ "denk_zeichen": 0,
814
+ "abbruch": "stop",
815
+ "sekunden": 22.2
816
+ },
817
+ {
818
+ "id": "test/prealgebra/2086.json",
819
+ "ok": true,
820
+ "level": 4,
821
+ "thema": "Prealgebra",
822
+ "gegeben": "40",
823
+ "erwartet": "40",
824
+ "tps": 21.933228093232557,
825
+ "tokens": 631,
826
+ "denk_zeichen": 0,
827
+ "abbruch": "stop",
828
+ "sekunden": 29.4
829
+ },
830
+ {
831
+ "id": "test/intermediate_algebra/1555.json",
832
+ "ok": true,
833
+ "level": 3,
834
+ "thema": "Intermediate Algebra",
835
+ "gegeben": "12",
836
+ "erwartet": "12",
837
+ "tps": 22.085473648837045,
838
+ "tokens": 709,
839
+ "denk_zeichen": 0,
840
+ "abbruch": "stop",
841
+ "sekunden": 32.58
842
+ },
843
+ {
844
+ "id": "test/precalculus/541.json",
845
+ "ok": true,
846
+ "level": 2,
847
+ "thema": "Precalculus",
848
+ "gegeben": "\\left(\\frac{3}{2}, -13\\right)",
849
+ "erwartet": "\\left( \\frac{3}{2}, -13 \\right)",
850
+ "tps": 22.711702281776372,
851
+ "tokens": 412,
852
+ "denk_zeichen": 0,
853
+ "abbruch": "stop",
854
+ "sekunden": 18.82
855
+ },
856
+ {
857
+ "id": "test/prealgebra/378.json",
858
+ "ok": false,
859
+ "level": 4,
860
+ "thema": "Prealgebra",
861
+ "gegeben": "",
862
+ "erwartet": "10",
863
+ "tps": 22.41421805576775,
864
+ "tokens": 1600,
865
+ "denk_zeichen": 0,
866
+ "abbruch": "length",
867
+ "sekunden": 72.01
868
+ },
869
+ {
870
+ "id": "test/intermediate_algebra/102.json",
871
+ "ok": false,
872
+ "level": 4,
873
+ "thema": "Intermediate Algebra",
874
+ "gegeben": "",
875
+ "erwartet": "2",
876
+ "tps": 22.161834301782406,
877
+ "tokens": 1600,
878
+ "denk_zeichen": 0,
879
+ "abbruch": "length",
880
+ "sekunden": 72.82
881
+ },
882
+ {
883
+ "id": "test/prealgebra/1436.json",
884
+ "ok": true,
885
+ "level": 4,
886
+ "thema": "Prealgebra",
887
+ "gegeben": "6",
888
+ "erwartet": "6",
889
+ "tps": 21.355545116116758,
890
+ "tokens": 452,
891
+ "denk_zeichen": 0,
892
+ "abbruch": "stop",
893
+ "sekunden": 21.82
894
+ },
895
+ {
896
+ "id": "test/prealgebra/1961.json",
897
+ "ok": true,
898
+ "level": 5,
899
+ "thema": "Prealgebra",
900
+ "gegeben": "\\frac{16}{27}",
901
+ "erwartet": "\\frac{16}{27}",
902
+ "tps": 21.165752483828086,
903
+ "tokens": 548,
904
+ "denk_zeichen": 0,
905
+ "abbruch": "stop",
906
+ "sekunden": 26.38
907
+ },
908
+ {
909
+ "id": "test/number_theory/183.json",
910
+ "ok": true,
911
+ "level": 3,
912
+ "thema": "Number Theory",
913
+ "gegeben": "14",
914
+ "erwartet": "14",
915
+ "tps": 22.28858864840969,
916
+ "tokens": 1104,
917
+ "denk_zeichen": 0,
918
+ "abbruch": "stop",
919
+ "sekunden": 50.17
920
+ },
921
+ {
922
+ "id": "test/counting_and_probability/71.json",
923
+ "ok": true,
924
+ "level": 3,
925
+ "thema": "Counting & Probability",
926
+ "gegeben": "3",
927
+ "erwartet": "3",
928
+ "tps": 22.98353476416065,
929
+ "tokens": 764,
930
+ "denk_zeichen": 0,
931
+ "abbruch": "stop",
932
+ "sekunden": 33.84
933
+ },
934
+ {
935
+ "id": "test/intermediate_algebra/986.json",
936
+ "ok": true,
937
+ "level": 4,
938
+ "thema": "Intermediate Algebra",
939
+ "gegeben": "\\frac{16}{5}",
940
+ "erwartet": "\\frac{16}{5}",
941
+ "tps": 22.64429782508503,
942
+ "tokens": 1070,
943
+ "denk_zeichen": 0,
944
+ "abbruch": "stop",
945
+ "sekunden": 47.88
946
+ },
947
+ {
948
+ "id": "test/precalculus/441.json",
949
+ "ok": true,
950
+ "level": 2,
951
+ "thema": "Precalculus",
952
+ "gegeben": "30",
953
+ "erwartet": "30^\\circ",
954
+ "tps": 22.74237379940038,
955
+ "tokens": 578,
956
+ "denk_zeichen": 0,
957
+ "abbruch": "stop",
958
+ "sekunden": 26.16
959
+ },
960
+ {
961
+ "id": "test/precalculus/989.json",
962
+ "ok": false,
963
+ "level": 4,
964
+ "thema": "Precalculus",
965
+ "gegeben": "",
966
+ "erwartet": "12",
967
+ "tps": 22.53463457139414,
968
+ "tokens": 1600,
969
+ "denk_zeichen": 0,
970
+ "abbruch": "length",
971
+ "sekunden": 71.72
972
+ },
973
+ {
974
+ "id": "test/prealgebra/874.json",
975
+ "ok": false,
976
+ "level": 4,
977
+ "thema": "Prealgebra",
978
+ "gegeben": "154",
979
+ "erwartet": "116",
980
+ "tps": 22.00483079385361,
981
+ "tokens": 930,
982
+ "denk_zeichen": 0,
983
+ "abbruch": "stop",
984
+ "sekunden": 43.03
985
+ },
986
+ {
987
+ "id": "test/geometry/254.json",
988
+ "ok": true,
989
+ "level": 2,
990
+ "thema": "Geometry",
991
+ "gegeben": "3",
992
+ "erwartet": "3",
993
+ "tps": 22.88121060156415,
994
+ "tokens": 481,
995
+ "denk_zeichen": 0,
996
+ "abbruch": "stop",
997
+ "sekunden": 21.65
998
+ },
999
+ {
1000
+ "id": "test/algebra/1787.json",
1001
+ "ok": true,
1002
+ "level": 2,
1003
+ "thema": "Algebra",
1004
+ "gegeben": "8",
1005
+ "erwartet": "8",
1006
+ "tps": 22.147575297406433,
1007
+ "tokens": 1413,
1008
+ "denk_zeichen": 0,
1009
+ "abbruch": "stop",
1010
+ "sekunden": 64.27
1011
+ },
1012
+ {
1013
+ "id": "test/algebra/1934.json",
1014
+ "ok": true,
1015
+ "level": 4,
1016
+ "thema": "Algebra",
1017
+ "gegeben": "13",
1018
+ "erwartet": "13",
1019
+ "tps": 22.060944547208678,
1020
+ "tokens": 715,
1021
+ "denk_zeichen": 0,
1022
+ "abbruch": "stop",
1023
+ "sekunden": 32.93
1024
+ },
1025
+ {
1026
+ "id": "test/prealgebra/1458.json",
1027
+ "ok": true,
1028
+ "level": 3,
1029
+ "thema": "Prealgebra",
1030
+ "gegeben": "\\frac{1}{8}",
1031
+ "erwartet": "\\frac{1}{8}",
1032
+ "tps": 22.493698290548412,
1033
+ "tokens": 259,
1034
+ "denk_zeichen": 0,
1035
+ "abbruch": "stop",
1036
+ "sekunden": 11.95
1037
+ },
1038
+ {
1039
+ "id": "test/prealgebra/1995.json",
1040
+ "ok": true,
1041
+ "level": 3,
1042
+ "thema": "Prealgebra",
1043
+ "gegeben": "\\frac{8}{21}",
1044
+ "erwartet": "\\frac{8}{21}",
1045
+ "tps": 22.307498027531707,
1046
+ "tokens": 556,
1047
+ "denk_zeichen": 0,
1048
+ "abbruch": "stop",
1049
+ "sekunden": 25.35
1050
+ },
1051
+ {
1052
+ "id": "test/precalculus/580.json",
1053
+ "ok": true,
1054
+ "level": 3,
1055
+ "thema": "Precalculus",
1056
+ "gegeben": "120",
1057
+ "erwartet": "120^\\circ",
1058
+ "tps": 22.28746403021393,
1059
+ "tokens": 838,
1060
+ "denk_zeichen": 0,
1061
+ "abbruch": "stop",
1062
+ "sekunden": 38.22
1063
+ },
1064
+ {
1065
+ "id": "test/geometry/483.json",
1066
+ "ok": true,
1067
+ "level": 4,
1068
+ "thema": "Geometry",
1069
+ "gegeben": "15",
1070
+ "erwartet": "15",
1071
+ "tps": 22.81426240773707,
1072
+ "tokens": 956,
1073
+ "denk_zeichen": 0,
1074
+ "abbruch": "stop",
1075
+ "sekunden": 42.55
1076
+ },
1077
+ {
1078
+ "id": "test/prealgebra/1742.json",
1079
+ "ok": true,
1080
+ "level": 3,
1081
+ "thema": "Prealgebra",
1082
+ "gegeben": "\\frac{33}{100}",
1083
+ "erwartet": "\\dfrac{33}{100}",
1084
+ "tps": 22.55648497813414,
1085
+ "tokens": 599,
1086
+ "denk_zeichen": 0,
1087
+ "abbruch": "stop",
1088
+ "sekunden": 27.01
1089
+ },
1090
+ {
1091
+ "id": "test/algebra/2551.json",
1092
+ "ok": true,
1093
+ "level": 1,
1094
+ "thema": "Algebra",
1095
+ "gegeben": "10",
1096
+ "erwartet": "10",
1097
+ "tps": 22.634744704945412,
1098
+ "tokens": 487,
1099
+ "denk_zeichen": 0,
1100
+ "abbruch": "stop",
1101
+ "sekunden": 21.99
1102
+ },
1103
+ {
1104
+ "id": "test/prealgebra/993.json",
1105
+ "ok": true,
1106
+ "level": 4,
1107
+ "thema": "Prealgebra",
1108
+ "gegeben": "1250",
1109
+ "erwartet": "1250",
1110
+ "tps": 22.86437583912259,
1111
+ "tokens": 700,
1112
+ "denk_zeichen": 0,
1113
+ "abbruch": "stop",
1114
+ "sekunden": 31.1
1115
+ },
1116
+ {
1117
+ "id": "test/algebra/1282.json",
1118
+ "ok": true,
1119
+ "level": 5,
1120
+ "thema": "Algebra",
1121
+ "gegeben": "11",
1122
+ "erwartet": "11",
1123
+ "tps": 22.488954099107644,
1124
+ "tokens": 1032,
1125
+ "denk_zeichen": 0,
1126
+ "abbruch": "stop",
1127
+ "sekunden": 46.34
1128
+ },
1129
+ {
1130
+ "id": "test/number_theory/1287.json",
1131
+ "ok": true,
1132
+ "level": 4,
1133
+ "thema": "Number Theory",
1134
+ "gegeben": "8",
1135
+ "erwartet": "8",
1136
+ "tps": 22.56028397739995,
1137
+ "tokens": 969,
1138
+ "denk_zeichen": 0,
1139
+ "abbruch": "stop",
1140
+ "sekunden": 43.58
1141
+ },
1142
+ {
1143
+ "id": "test/prealgebra/1787.json",
1144
+ "ok": true,
1145
+ "level": 3,
1146
+ "thema": "Prealgebra",
1147
+ "gegeben": "1",
1148
+ "erwartet": "1",
1149
+ "tps": 21.912973568745425,
1150
+ "tokens": 453,
1151
+ "denk_zeichen": 0,
1152
+ "abbruch": "stop",
1153
+ "sekunden": 21.14
1154
+ },
1155
+ {
1156
+ "id": "test/intermediate_algebra/960.json",
1157
+ "ok": false,
1158
+ "level": 5,
1159
+ "thema": "Intermediate Algebra",
1160
+ "gegeben": "",
1161
+ "erwartet": "\\frac{17}{21}",
1162
+ "tps": 22.38943554483817,
1163
+ "tokens": 1600,
1164
+ "denk_zeichen": 0,
1165
+ "abbruch": "length",
1166
+ "sekunden": 72.09
1167
+ },
1168
+ {
1169
+ "id": "test/algebra/634.json",
1170
+ "ok": true,
1171
+ "level": 3,
1172
+ "thema": "Algebra",
1173
+ "gegeben": "4",
1174
+ "erwartet": "4",
1175
+ "tps": 22.587288697666885,
1176
+ "tokens": 1031,
1177
+ "denk_zeichen": 0,
1178
+ "abbruch": "stop",
1179
+ "sekunden": 46.29
1180
+ },
1181
+ {
1182
+ "id": "test/algebra/2486.json",
1183
+ "ok": true,
1184
+ "level": 5,
1185
+ "thema": "Algebra",
1186
+ "gegeben": "\\left( \\frac{3}{5}, \\frac{8}{3} \\right]",
1187
+ "erwartet": "\\left(\\frac{3}{5},\\frac{8}{3}\\right]",
1188
+ "tps": 22.406015383165844,
1189
+ "tokens": 585,
1190
+ "denk_zeichen": 0,
1191
+ "abbruch": "stop",
1192
+ "sekunden": 26.84
1193
+ },
1194
+ {
1195
+ "id": "test/intermediate_algebra/754.json",
1196
+ "ok": true,
1197
+ "level": 2,
1198
+ "thema": "Intermediate Algebra",
1199
+ "gegeben": "B",
1200
+ "erwartet": "\\text{(B)}",
1201
+ "tps": 21.677383441690516,
1202
+ "tokens": 1215,
1203
+ "denk_zeichen": 0,
1204
+ "abbruch": "stop",
1205
+ "sekunden": 56.82,
1206
+ "neubewertet": true
1207
+ },
1208
+ {
1209
+ "id": "test/counting_and_probability/339.json",
1210
+ "ok": true,
1211
+ "level": 4,
1212
+ "thema": "Counting & Probability",
1213
+ "gegeben": "12",
1214
+ "erwartet": "12",
1215
+ "tps": 21.629984278218547,
1216
+ "tokens": 632,
1217
+ "denk_zeichen": 0,
1218
+ "abbruch": "stop",
1219
+ "sekunden": 29.92
1220
+ },
1221
+ {
1222
+ "id": "test/geometry/965.json",
1223
+ "ok": false,
1224
+ "level": 5,
1225
+ "thema": "Geometry",
1226
+ "gegeben": "",
1227
+ "erwartet": "28",
1228
+ "tps": 22.402838887743854,
1229
+ "tokens": 1600,
1230
+ "denk_zeichen": 0,
1231
+ "abbruch": "length",
1232
+ "sekunden": 72.15
1233
+ },
1234
+ {
1235
+ "id": "test/intermediate_algebra/1544.json",
1236
+ "ok": false,
1237
+ "level": 5,
1238
+ "thema": "Intermediate Algebra",
1239
+ "gegeben": "",
1240
+ "erwartet": "6",
1241
+ "tps": 22.449168348109378,
1242
+ "tokens": 1600,
1243
+ "denk_zeichen": 0,
1244
+ "abbruch": "length",
1245
+ "sekunden": 71.9
1246
+ },
1247
+ {
1248
+ "id": "test/algebra/1842.json",
1249
+ "ok": true,
1250
+ "level": 2,
1251
+ "thema": "Algebra",
1252
+ "gegeben": "49",
1253
+ "erwartet": "49",
1254
+ "tps": 22.656536520357516,
1255
+ "tokens": 641,
1256
+ "denk_zeichen": 0,
1257
+ "abbruch": "stop",
1258
+ "sekunden": 28.96
1259
+ },
1260
+ {
1261
+ "id": "test/prealgebra/1423.json",
1262
+ "ok": true,
1263
+ "level": 5,
1264
+ "thema": "Prealgebra",
1265
+ "gegeben": "12\\pi",
1266
+ "erwartet": "12\\pi",
1267
+ "tps": 22.65574437169148,
1268
+ "tokens": 441,
1269
+ "denk_zeichen": 0,
1270
+ "abbruch": "stop",
1271
+ "sekunden": 19.91
1272
+ },
1273
+ {
1274
+ "id": "test/algebra/276.json",
1275
+ "ok": true,
1276
+ "level": 2,
1277
+ "thema": "Algebra",
1278
+ "gegeben": "12",
1279
+ "erwartet": "12",
1280
+ "tps": 22.270857938325815,
1281
+ "tokens": 944,
1282
+ "denk_zeichen": 0,
1283
+ "abbruch": "stop",
1284
+ "sekunden": 42.83
1285
+ },
1286
+ {
1287
+ "id": "test/geometry/947.json",
1288
+ "ok": true,
1289
+ "level": 5,
1290
+ "thema": "Geometry",
1291
+ "gegeben": "-\\frac{24}{25}",
1292
+ "erwartet": "-\\frac{24}{25}",
1293
+ "tps": 21.971114074928085,
1294
+ "tokens": 1021,
1295
+ "denk_zeichen": 0,
1296
+ "abbruch": "stop",
1297
+ "sekunden": 47.03
1298
+ },
1299
+ {
1300
+ "id": "test/counting_and_probability/870.json",
1301
+ "ok": true,
1302
+ "level": 5,
1303
+ "thema": "Counting & Probability",
1304
+ "gegeben": "\\frac{1}{3}",
1305
+ "erwartet": "\\frac{1}{3}",
1306
+ "tps": 22.613655477593483,
1307
+ "tokens": 1438,
1308
+ "denk_zeichen": 0,
1309
+ "abbruch": "stop",
1310
+ "sekunden": 64.04
1311
+ },
1312
+ {
1313
+ "id": "test/precalculus/742.json",
1314
+ "ok": false,
1315
+ "level": 2,
1316
+ "thema": "Precalculus",
1317
+ "gegeben": "-0.09",
1318
+ "erwartet": "\\frac{9}{100}",
1319
+ "tps": 22.174365187599996,
1320
+ "tokens": 911,
1321
+ "denk_zeichen": 0,
1322
+ "abbruch": "stop",
1323
+ "sekunden": 41.56
1324
+ },
1325
+ {
1326
+ "id": "test/counting_and_probability/216.json",
1327
+ "ok": true,
1328
+ "level": 5,
1329
+ "thema": "Counting & Probability",
1330
+ "gegeben": "1940",
1331
+ "erwartet": "1940",
1332
+ "tps": 22.672197786631276,
1333
+ "tokens": 742,
1334
+ "denk_zeichen": 0,
1335
+ "abbruch": "stop",
1336
+ "sekunden": 33.46
1337
+ },
1338
+ {
1339
+ "id": "test/intermediate_algebra/776.json",
1340
+ "ok": true,
1341
+ "level": 4,
1342
+ "thema": "Intermediate Algebra",
1343
+ "gegeben": "3",
1344
+ "erwartet": "3",
1345
+ "tps": 22.51248098598913,
1346
+ "tokens": 1252,
1347
+ "denk_zeichen": 0,
1348
+ "abbruch": "stop",
1349
+ "sekunden": 56.14
1350
+ },
1351
+ {
1352
+ "id": "test/algebra/2592.json",
1353
+ "ok": true,
1354
+ "level": 1,
1355
+ "thema": "Algebra",
1356
+ "gegeben": "26000",
1357
+ "erwartet": "26000",
1358
+ "tps": 23.203747295497784,
1359
+ "tokens": 275,
1360
+ "denk_zeichen": 0,
1361
+ "abbruch": "stop",
1362
+ "sekunden": 12.57
1363
+ },
1364
+ {
1365
+ "id": "test/precalculus/801.json",
1366
+ "ok": false,
1367
+ "level": 3,
1368
+ "thema": "Precalculus",
1369
+ "gegeben": "",
1370
+ "erwartet": "55^\\circ",
1371
+ "tps": 21.753862173892273,
1372
+ "tokens": 1600,
1373
+ "denk_zeichen": 0,
1374
+ "abbruch": "length",
1375
+ "sekunden": 74.23
1376
+ },
1377
+ {
1378
+ "id": "test/counting_and_probability/737.json",
1379
+ "ok": true,
1380
+ "level": 2,
1381
+ "thema": "Counting & Probability",
1382
+ "gegeben": "58500",
1383
+ "erwartet": "58,500",
1384
+ "tps": 22.050135883962387,
1385
+ "tokens": 540,
1386
+ "denk_zeichen": 0,
1387
+ "abbruch": "stop",
1388
+ "sekunden": 24.97
1389
+ },
1390
+ {
1391
+ "id": "test/algebra/1338.json",
1392
+ "ok": true,
1393
+ "level": 4,
1394
+ "thema": "Algebra",
1395
+ "gegeben": "66",
1396
+ "erwartet": "66",
1397
+ "tps": 22.257744028826366,
1398
+ "tokens": 688,
1399
+ "denk_zeichen": 0,
1400
+ "abbruch": "stop",
1401
+ "sekunden": 31.54
1402
+ },
1403
+ {
1404
+ "id": "test/number_theory/686.json",
1405
+ "ok": true,
1406
+ "level": 2,
1407
+ "thema": "Number Theory",
1408
+ "gegeben": "4",
1409
+ "erwartet": "4",
1410
+ "tps": 22.549537717931,
1411
+ "tokens": 477,
1412
+ "denk_zeichen": 0,
1413
+ "abbruch": "stop",
1414
+ "sekunden": 21.86
1415
+ },
1416
+ {
1417
+ "id": "test/counting_and_probability/1014.json",
1418
+ "ok": true,
1419
+ "level": 4,
1420
+ "thema": "Counting & Probability",
1421
+ "gegeben": "480",
1422
+ "erwartet": "480",
1423
+ "tps": 22.547288644988836,
1424
+ "tokens": 906,
1425
+ "denk_zeichen": 0,
1426
+ "abbruch": "stop",
1427
+ "sekunden": 40.91
1428
+ },
1429
+ {
1430
+ "id": "test/algebra/1078.json",
1431
+ "ok": true,
1432
+ "level": 5,
1433
+ "thema": "Algebra",
1434
+ "gegeben": "(-\\sqrt{3}, \\sqrt{3})",
1435
+ "erwartet": "(-\\sqrt{3}, \\sqrt{3})",
1436
+ "tps": 22.132725143670072,
1437
+ "tokens": 787,
1438
+ "denk_zeichen": 0,
1439
+ "abbruch": "stop",
1440
+ "sekunden": 36.19
1441
+ },
1442
+ {
1443
+ "id": "test/precalculus/96.json",
1444
+ "ok": true,
1445
+ "level": 3,
1446
+ "thema": "Precalculus",
1447
+ "gegeben": "\\frac{7}{4}",
1448
+ "erwartet": "\\frac{7}{4}",
1449
+ "tps": 22.53377214609929,
1450
+ "tokens": 735,
1451
+ "denk_zeichen": 0,
1452
+ "abbruch": "stop",
1453
+ "sekunden": 33.47
1454
+ },
1455
+ {
1456
+ "id": "test/algebra/251.json",
1457
+ "ok": true,
1458
+ "level": 2,
1459
+ "thema": "Algebra",
1460
+ "gegeben": "2",
1461
+ "erwartet": "2",
1462
+ "tps": 22.167573914972422,
1463
+ "tokens": 435,
1464
+ "denk_zeichen": 0,
1465
+ "abbruch": "stop",
1466
+ "sekunden": 20.14
1467
+ },
1468
+ {
1469
+ "id": "test/number_theory/109.json",
1470
+ "ok": true,
1471
+ "level": 4,
1472
+ "thema": "Number Theory",
1473
+ "gegeben": "4",
1474
+ "erwartet": "4",
1475
+ "tps": 22.354698706810012,
1476
+ "tokens": 1105,
1477
+ "denk_zeichen": 0,
1478
+ "abbruch": "stop",
1479
+ "sekunden": 49.88
1480
+ },
1481
+ {
1482
+ "id": "test/precalculus/1289.json",
1483
+ "ok": true,
1484
+ "level": 1,
1485
+ "thema": "Precalculus",
1486
+ "gegeben": "-41",
1487
+ "erwartet": "-41",
1488
+ "tps": 22.687996418483507,
1489
+ "tokens": 299,
1490
+ "denk_zeichen": 0,
1491
+ "abbruch": "stop",
1492
+ "sekunden": 13.66
1493
+ },
1494
+ {
1495
+ "id": "test/algebra/2264.json",
1496
+ "ok": true,
1497
+ "level": 5,
1498
+ "thema": "Algebra",
1499
+ "gegeben": "1+2i",
1500
+ "erwartet": "1+2i",
1501
+ "tps": 22.37836802448647,
1502
+ "tokens": 908,
1503
+ "denk_zeichen": 0,
1504
+ "abbruch": "stop",
1505
+ "sekunden": 41.22
1506
+ },
1507
+ {
1508
+ "id": "test/geometry/538.json",
1509
+ "ok": true,
1510
+ "level": 4,
1511
+ "thema": "Geometry",
1512
+ "gegeben": "(8, -2)",
1513
+ "erwartet": "(8,-2)",
1514
+ "tps": 22.044488428083476,
1515
+ "tokens": 865,
1516
+ "denk_zeichen": 0,
1517
+ "abbruch": "stop",
1518
+ "sekunden": 39.72
1519
+ },
1520
+ {
1521
+ "id": "test/intermediate_algebra/1992.json",
1522
+ "ok": true,
1523
+ "level": 4,
1524
+ "thema": "Intermediate Algebra",
1525
+ "gegeben": "(0, 9) \\cup (9, 36)",
1526
+ "erwartet": "(0,9) \\cup (9,36)",
1527
+ "tps": 22.036508543554362,
1528
+ "tokens": 885,
1529
+ "denk_zeichen": 0,
1530
+ "abbruch": "stop",
1531
+ "sekunden": 40.89
1532
+ },
1533
+ {
1534
+ "id": "test/algebra/101.json",
1535
+ "ok": true,
1536
+ "level": 4,
1537
+ "thema": "Algebra",
1538
+ "gegeben": "[-2, 7]",
1539
+ "erwartet": "x \\in [-2,7]",
1540
+ "tps": 22.51723857149053,
1541
+ "tokens": 568,
1542
+ "denk_zeichen": 0,
1543
+ "abbruch": "stop",
1544
+ "sekunden": 25.95,
1545
+ "neubewertet": true
1546
+ },
1547
+ {
1548
+ "id": "test/algebra/170.json",
1549
+ "ok": true,
1550
+ "level": 3,
1551
+ "thema": "Algebra",
1552
+ "gegeben": "11",
1553
+ "erwartet": "11",
1554
+ "tps": 21.985819629543773,
1555
+ "tokens": 546,
1556
+ "denk_zeichen": 0,
1557
+ "abbruch": "stop",
1558
+ "sekunden": 25.56
1559
+ },
1560
+ {
1561
+ "id": "test/algebra/853.json",
1562
+ "ok": true,
1563
+ "level": 5,
1564
+ "thema": "Algebra",
1565
+ "gegeben": "12",
1566
+ "erwartet": "12",
1567
+ "tps": 21.977509367366988,
1568
+ "tokens": 1257,
1569
+ "denk_zeichen": 0,
1570
+ "abbruch": "stop",
1571
+ "sekunden": 57.71
1572
+ },
1573
+ {
1574
+ "id": "test/algebra/518.json",
1575
+ "ok": true,
1576
+ "level": 3,
1577
+ "thema": "Algebra",
1578
+ "gegeben": "\\frac{3}{4}",
1579
+ "erwartet": "\\frac 34",
1580
+ "tps": 21.655738789866906,
1581
+ "tokens": 624,
1582
+ "denk_zeichen": 0,
1583
+ "abbruch": "stop",
1584
+ "sekunden": 29.57,
1585
+ "neubewertet": true
1586
+ },
1587
+ {
1588
+ "id": "test/prealgebra/631.json",
1589
+ "ok": false,
1590
+ "level": 3,
1591
+ "thema": "Prealgebra",
1592
+ "gegeben": "",
1593
+ "erwartet": "2",
1594
+ "tps": 22.482995618598125,
1595
+ "tokens": 1600,
1596
+ "denk_zeichen": 0,
1597
+ "abbruch": "length",
1598
+ "sekunden": 72.04
1599
+ },
1600
+ {
1601
+ "id": "test/geometry/817.json",
1602
+ "ok": false,
1603
+ "level": 5,
1604
+ "thema": "Geometry",
1605
+ "gegeben": "",
1606
+ "erwartet": "\\frac{14}{3}",
1607
+ "tps": 22.191091818915588,
1608
+ "tokens": 1600,
1609
+ "denk_zeichen": 0,
1610
+ "abbruch": "length",
1611
+ "sekunden": 72.83
1612
+ },
1613
+ {
1614
+ "id": "test/number_theory/928.json",
1615
+ "ok": true,
1616
+ "level": 4,
1617
+ "thema": "Number Theory",
1618
+ "gegeben": "3",
1619
+ "erwartet": "3",
1620
+ "tps": 22.424696356312435,
1621
+ "tokens": 1467,
1622
+ "denk_zeichen": 0,
1623
+ "abbruch": "stop",
1624
+ "sekunden": 66.21
1625
+ },
1626
+ {
1627
+ "id": "test/number_theory/132.json",
1628
+ "ok": true,
1629
+ "level": 1,
1630
+ "thema": "Number Theory",
1631
+ "gegeben": "0",
1632
+ "erwartet": "0",
1633
+ "tps": 22.51384802670142,
1634
+ "tokens": 504,
1635
+ "denk_zeichen": 0,
1636
+ "abbruch": "stop",
1637
+ "sekunden": 23.1
1638
+ },
1639
+ {
1640
+ "id": "test/prealgebra/65.json",
1641
+ "ok": true,
1642
+ "level": 2,
1643
+ "thema": "Prealgebra",
1644
+ "gegeben": "6",
1645
+ "erwartet": "6",
1646
+ "tps": 22.022005673243505,
1647
+ "tokens": 658,
1648
+ "denk_zeichen": 0,
1649
+ "abbruch": "stop",
1650
+ "sekunden": 30.62
1651
+ },
1652
+ {
1653
+ "id": "test/algebra/2680.json",
1654
+ "ok": true,
1655
+ "level": 2,
1656
+ "thema": "Algebra",
1657
+ "gegeben": "5r^5",
1658
+ "erwartet": "5r^5",
1659
+ "tps": 22.488467753498767,
1660
+ "tokens": 407,
1661
+ "denk_zeichen": 0,
1662
+ "abbruch": "stop",
1663
+ "sekunden": 18.54
1664
+ },
1665
+ {
1666
+ "id": "test/precalculus/681.json",
1667
+ "ok": true,
1668
+ "level": 3,
1669
+ "thema": "Precalculus",
1670
+ "gegeben": "\\frac{1}{8}",
1671
+ "erwartet": "\\frac{1}{8}",
1672
+ "tps": 22.64112923079653,
1673
+ "tokens": 1391,
1674
+ "denk_zeichen": 0,
1675
+ "abbruch": "stop",
1676
+ "sekunden": 62.04
1677
+ },
1678
+ {
1679
+ "id": "test/precalculus/625.json",
1680
+ "ok": false,
1681
+ "level": 3,
1682
+ "thema": "Precalculus",
1683
+ "gegeben": "\\begin{pmatrix} \\frac{16}{49} \\\\ \\frac{48}{49} \\\\ \\frac{24}{",
1684
+ "erwartet": "\\begin{pmatrix} 16/49 \\\\ 48/49 \\\\ 24/49 \\end{pmatrix}",
1685
+ "tps": 22.727402513528073,
1686
+ "tokens": 593,
1687
+ "denk_zeichen": 0,
1688
+ "abbruch": "stop",
1689
+ "sekunden": 26.76
1690
+ },
1691
+ {
1692
+ "id": "test/number_theory/1002.json",
1693
+ "ok": true,
1694
+ "level": 5,
1695
+ "thema": "Number Theory",
1696
+ "gegeben": "1440",
1697
+ "erwartet": "1440",
1698
+ "tps": 22.577268496978327,
1699
+ "tokens": 1229,
1700
+ "denk_zeichen": 0,
1701
+ "abbruch": "stop",
1702
+ "sekunden": 55.21
1703
+ },
1704
+ {
1705
+ "id": "test/geometry/843.json",
1706
+ "ok": true,
1707
+ "level": 3,
1708
+ "thema": "Geometry",
1709
+ "gegeben": "6\\sqrt{2}",
1710
+ "erwartet": "6\\sqrt{2}",
1711
+ "tps": 22.823971365011204,
1712
+ "tokens": 532,
1713
+ "denk_zeichen": 0,
1714
+ "abbruch": "stop",
1715
+ "sekunden": 24.07
1716
+ },
1717
+ {
1718
+ "id": "test/prealgebra/2019.json",
1719
+ "ok": true,
1720
+ "level": 2,
1721
+ "thema": "Prealgebra",
1722
+ "gegeben": "4,5",
1723
+ "erwartet": "4.5",
1724
+ "tps": 21.76478931807137,
1725
+ "tokens": 265,
1726
+ "denk_zeichen": 0,
1727
+ "abbruch": "stop",
1728
+ "sekunden": 12.87,
1729
+ "neubewertet": true
1730
+ },
1731
+ {
1732
+ "id": "test/number_theory/410.json",
1733
+ "ok": false,
1734
+ "level": 2,
1735
+ "thema": "Number Theory",
1736
+ "gegeben": "",
1737
+ "erwartet": ".35625",
1738
+ "tps": 22.40809644859261,
1739
+ "tokens": 1600,
1740
+ "denk_zeichen": 0,
1741
+ "abbruch": "length",
1742
+ "sekunden": 72.01
1743
+ },
1744
+ {
1745
+ "id": "test/counting_and_probability/10.json",
1746
+ "ok": true,
1747
+ "level": 4,
1748
+ "thema": "Counting & Probability",
1749
+ "gegeben": "4",
1750
+ "erwartet": "4",
1751
+ "tps": 22.440045675324125,
1752
+ "tokens": 1438,
1753
+ "denk_zeichen": 0,
1754
+ "abbruch": "stop",
1755
+ "sekunden": 64.83
1756
+ },
1757
+ {
1758
+ "id": "test/algebra/2080.json",
1759
+ "ok": true,
1760
+ "level": 3,
1761
+ "thema": "Algebra",
1762
+ "gegeben": "14",
1763
+ "erwartet": "14",
1764
+ "tps": 22.555749225521865,
1765
+ "tokens": 528,
1766
+ "denk_zeichen": 0,
1767
+ "abbruch": "stop",
1768
+ "sekunden": 24.13
1769
+ },
1770
+ {
1771
+ "id": "test/algebra/668.json",
1772
+ "ok": true,
1773
+ "level": 4,
1774
+ "thema": "Algebra",
1775
+ "gegeben": "45",
1776
+ "erwartet": "45",
1777
+ "tps": 22.49381576273578,
1778
+ "tokens": 324,
1779
+ "denk_zeichen": 0,
1780
+ "abbruch": "stop",
1781
+ "sekunden": 15.02
1782
+ },
1783
+ {
1784
+ "id": "test/algebra/2430.json",
1785
+ "ok": true,
1786
+ "level": 4,
1787
+ "thema": "Algebra",
1788
+ "gegeben": "8",
1789
+ "erwartet": "8",
1790
+ "tps": 22.553603451610332,
1791
+ "tokens": 1052,
1792
+ "denk_zeichen": 0,
1793
+ "abbruch": "stop",
1794
+ "sekunden": 47.41
1795
+ },
1796
+ {
1797
+ "id": "test/number_theory/13.json",
1798
+ "ok": true,
1799
+ "level": 5,
1800
+ "thema": "Number Theory",
1801
+ "gegeben": "64",
1802
+ "erwartet": "64",
1803
+ "tps": 22.43647385165856,
1804
+ "tokens": 1090,
1805
+ "denk_zeichen": 0,
1806
+ "abbruch": "stop",
1807
+ "sekunden": 49.04
1808
+ },
1809
+ {
1810
+ "id": "test/algebra/2476.json",
1811
+ "ok": true,
1812
+ "level": 2,
1813
+ "thema": "Algebra",
1814
+ "gegeben": "10",
1815
+ "erwartet": "10",
1816
+ "tps": 21.323272038471764,
1817
+ "tokens": 484,
1818
+ "denk_zeichen": 0,
1819
+ "abbruch": "stop",
1820
+ "sekunden": 23.18
1821
+ },
1822
+ {
1823
+ "id": "test/intermediate_algebra/1102.json",
1824
+ "ok": false,
1825
+ "level": 1,
1826
+ "thema": "Intermediate Algebra",
1827
+ "gegeben": "",
1828
+ "erwartet": "-2,1",
1829
+ "tps": 22.215393765563533,
1830
+ "tokens": 1600,
1831
+ "denk_zeichen": 0,
1832
+ "abbruch": "length",
1833
+ "sekunden": 72.48
1834
+ },
1835
+ {
1836
+ "id": "test/prealgebra/914.json",
1837
+ "ok": true,
1838
+ "level": 4,
1839
+ "thema": "Prealgebra",
1840
+ "gegeben": "75",
1841
+ "erwartet": "75^\\circ",
1842
+ "tps": 22.545446591556377,
1843
+ "tokens": 872,
1844
+ "denk_zeichen": 0,
1845
+ "abbruch": "stop",
1846
+ "sekunden": 39.53
1847
+ },
1848
+ {
1849
+ "id": "test/algebra/1425.json",
1850
+ "ok": true,
1851
+ "level": 2,
1852
+ "thema": "Algebra",
1853
+ "gegeben": "2",
1854
+ "erwartet": "2",
1855
+ "tps": 22.179684644190132,
1856
+ "tokens": 237,
1857
+ "denk_zeichen": 0,
1858
+ "abbruch": "stop",
1859
+ "sekunden": 11.11
1860
+ },
1861
+ {
1862
+ "id": "test/precalculus/703.json",
1863
+ "ok": false,
1864
+ "level": 5,
1865
+ "thema": "Precalculus",
1866
+ "gegeben": "",
1867
+ "erwartet": "8 \\pi",
1868
+ "tps": 22.47932892234575,
1869
+ "tokens": 1600,
1870
+ "denk_zeichen": 0,
1871
+ "abbruch": "length",
1872
+ "sekunden": 71.83
1873
+ },
1874
+ {
1875
+ "id": "test/intermediate_algebra/158.json",
1876
+ "ok": true,
1877
+ "level": 5,
1878
+ "thema": "Intermediate Algebra",
1879
+ "gegeben": "27648",
1880
+ "erwartet": "27648",
1881
+ "tps": 22.594893031188516,
1882
+ "tokens": 1443,
1883
+ "denk_zeichen": 0,
1884
+ "abbruch": "stop",
1885
+ "sekunden": 64.35
1886
+ },
1887
+ {
1888
+ "id": "test/prealgebra/1930.json",
1889
+ "ok": true,
1890
+ "level": 5,
1891
+ "thema": "Prealgebra",
1892
+ "gegeben": "7",
1893
+ "erwartet": "7",
1894
+ "tps": 22.11845053877696,
1895
+ "tokens": 947,
1896
+ "denk_zeichen": 0,
1897
+ "abbruch": "stop",
1898
+ "sekunden": 43.66
1899
+ },
1900
+ {
1901
+ "id": "test/prealgebra/1252.json",
1902
+ "ok": true,
1903
+ "level": 2,
1904
+ "thema": "Prealgebra",
1905
+ "gegeben": "200",
1906
+ "erwartet": "200",
1907
+ "tps": 21.35957427000772,
1908
+ "tokens": 463,
1909
+ "denk_zeichen": 0,
1910
+ "abbruch": "stop",
1911
+ "sekunden": 22.16
1912
+ },
1913
+ {
1914
+ "id": "test/precalculus/1252.json",
1915
+ "ok": true,
1916
+ "level": 2,
1917
+ "thema": "Precalculus",
1918
+ "gegeben": "1",
1919
+ "erwartet": "1",
1920
+ "tps": 22.209551644791603,
1921
+ "tokens": 962,
1922
+ "denk_zeichen": 0,
1923
+ "abbruch": "stop",
1924
+ "sekunden": 44.08
1925
+ },
1926
+ {
1927
+ "id": "test/precalculus/1082.json",
1928
+ "ok": true,
1929
+ "level": 3,
1930
+ "thema": "Precalculus",
1931
+ "gegeben": "\\frac{8}{15}",
1932
+ "erwartet": "\\frac{8}{15}",
1933
+ "tps": 22.240138380203,
1934
+ "tokens": 1510,
1935
+ "denk_zeichen": 0,
1936
+ "abbruch": "stop",
1937
+ "sekunden": 68.59
1938
+ },
1939
+ {
1940
+ "id": "test/geometry/477.json",
1941
+ "ok": true,
1942
+ "level": 3,
1943
+ "thema": "Geometry",
1944
+ "gegeben": "216",
1945
+ "erwartet": "216",
1946
+ "tps": 22.353570961045758,
1947
+ "tokens": 459,
1948
+ "denk_zeichen": 0,
1949
+ "abbruch": "stop",
1950
+ "sekunden": 21.01
1951
+ },
1952
+ {
1953
+ "id": "test/intermediate_algebra/1350.json",
1954
+ "ok": false,
1955
+ "level": 5,
1956
+ "thema": "Intermediate Algebra",
1957
+ "gegeben": "",
1958
+ "erwartet": "14",
1959
+ "tps": 22.631268571431157,
1960
+ "tokens": 1600,
1961
+ "denk_zeichen": 0,
1962
+ "abbruch": "length",
1963
+ "sekunden": 71.23
1964
+ },
1965
+ {
1966
+ "id": "test/algebra/2779.json",
1967
+ "ok": true,
1968
+ "level": 5,
1969
+ "thema": "Algebra",
1970
+ "gegeben": "20",
1971
+ "erwartet": "20",
1972
+ "tps": 23.53600948582341,
1973
+ "tokens": 754,
1974
+ "denk_zeichen": 0,
1975
+ "abbruch": "stop",
1976
+ "sekunden": 32.97
1977
+ },
1978
+ {
1979
+ "id": "test/intermediate_algebra/1232.json",
1980
+ "ok": true,
1981
+ "level": 3,
1982
+ "thema": "Intermediate Algebra",
1983
+ "gegeben": "\\dfrac{5}{13}",
1984
+ "erwartet": "\\frac{5}{13}",
1985
+ "tps": 21.65787622865702,
1986
+ "tokens": 513,
1987
+ "denk_zeichen": 0,
1988
+ "abbruch": "stop",
1989
+ "sekunden": 24.14
1990
+ }
1991
+ ],
1992
+ "quote_vor_neubewertung": 72.7,
1993
+ "neubewertet": 6
1994
+ }
bench/math500/q38-q8.json ADDED
@@ -0,0 +1,1994 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "modell": "Qwen3.8-27B Q8_0",
3
+ "satz": "math500",
4
+ "reasoning": false,
5
+ "n": 150,
6
+ "bestanden": 114,
7
+ "quote": 76.0,
8
+ "tps_median": 18.6,
9
+ "tokens_je_aufgabe": 935.2,
10
+ "am_limit": 34,
11
+ "nach_level": {
12
+ "1": [
13
+ 7,
14
+ 8
15
+ ],
16
+ "2": [
17
+ 31,
18
+ 33
19
+ ],
20
+ "3": [
21
+ 30,
22
+ 36
23
+ ],
24
+ "4": [
25
+ 25,
26
+ 35
27
+ ],
28
+ "5": [
29
+ 21,
30
+ 38
31
+ ]
32
+ },
33
+ "dauer_s": 7779.8,
34
+ "aufgaben": [
35
+ {
36
+ "id": "test/precalculus/807.json",
37
+ "ok": true,
38
+ "level": 2,
39
+ "thema": "Precalculus",
40
+ "gegeben": "(3, \\frac{\\pi}{2})",
41
+ "erwartet": "\\left( 3, \\frac{\\pi}{2} \\right)",
42
+ "tps": 18.246701385253676,
43
+ "tokens": 366,
44
+ "denk_zeichen": 0,
45
+ "abbruch": "stop",
46
+ "sekunden": 20.35
47
+ },
48
+ {
49
+ "id": "test/number_theory/572.json",
50
+ "ok": true,
51
+ "level": 3,
52
+ "thema": "Number Theory",
53
+ "gegeben": "9",
54
+ "erwartet": "9",
55
+ "tps": 17.688830353252907,
56
+ "tokens": 635,
57
+ "denk_zeichen": 0,
58
+ "abbruch": "stop",
59
+ "sekunden": 36.56
60
+ },
61
+ {
62
+ "id": "test/number_theory/515.json",
63
+ "ok": true,
64
+ "level": 3,
65
+ "thema": "Number Theory",
66
+ "gegeben": "27",
67
+ "erwartet": "27",
68
+ "tps": 17.862779163494228,
69
+ "tokens": 830,
70
+ "denk_zeichen": 0,
71
+ "abbruch": "stop",
72
+ "sekunden": 46.87
73
+ },
74
+ {
75
+ "id": "test/number_theory/1032.json",
76
+ "ok": false,
77
+ "level": 3,
78
+ "thema": "Number Theory",
79
+ "gegeben": "",
80
+ "erwartet": "2220",
81
+ "tps": 18.612660017255102,
82
+ "tokens": 1600,
83
+ "denk_zeichen": 0,
84
+ "abbruch": "length",
85
+ "sekunden": 86.38
86
+ },
87
+ {
88
+ "id": "test/geometry/248.json",
89
+ "ok": true,
90
+ "level": 2,
91
+ "thema": "Geometry",
92
+ "gegeben": "5",
93
+ "erwartet": "5",
94
+ "tps": 19.0335138909541,
95
+ "tokens": 309,
96
+ "denk_zeichen": 0,
97
+ "abbruch": "stop",
98
+ "sekunden": 16.92
99
+ },
100
+ {
101
+ "id": "test/intermediate_algebra/134.json",
102
+ "ok": true,
103
+ "level": 1,
104
+ "thema": "Intermediate Algebra",
105
+ "gegeben": "-50",
106
+ "erwartet": "-50",
107
+ "tps": 18.128252980260292,
108
+ "tokens": 518,
109
+ "denk_zeichen": 0,
110
+ "abbruch": "stop",
111
+ "sekunden": 28.98
112
+ },
113
+ {
114
+ "id": "test/algebra/1098.json",
115
+ "ok": true,
116
+ "level": 3,
117
+ "thema": "Algebra",
118
+ "gegeben": "6+9i",
119
+ "erwartet": "6+9i",
120
+ "tps": 18.852093705832235,
121
+ "tokens": 245,
122
+ "denk_zeichen": 0,
123
+ "abbruch": "stop",
124
+ "sekunden": 13.41
125
+ },
126
+ {
127
+ "id": "test/algebra/2193.json",
128
+ "ok": true,
129
+ "level": 5,
130
+ "thema": "Algebra",
131
+ "gegeben": "5",
132
+ "erwartet": "x=5",
133
+ "tps": 18.841275610601453,
134
+ "tokens": 804,
135
+ "denk_zeichen": 0,
136
+ "abbruch": "stop",
137
+ "sekunden": 43.27,
138
+ "neubewertet": true
139
+ },
140
+ {
141
+ "id": "test/counting_and_probability/525.json",
142
+ "ok": false,
143
+ "level": 5,
144
+ "thema": "Counting & Probability",
145
+ "gegeben": "",
146
+ "erwartet": "144",
147
+ "tps": 18.789640195653234,
148
+ "tokens": 1600,
149
+ "denk_zeichen": 0,
150
+ "abbruch": "length",
151
+ "sekunden": 85.58
152
+ },
153
+ {
154
+ "id": "test/number_theory/864.json",
155
+ "ok": true,
156
+ "level": 3,
157
+ "thema": "Number Theory",
158
+ "gegeben": "52_8",
159
+ "erwartet": "52_8",
160
+ "tps": 17.466000978383324,
161
+ "tokens": 608,
162
+ "denk_zeichen": 0,
163
+ "abbruch": "stop",
164
+ "sekunden": 35.5
165
+ },
166
+ {
167
+ "id": "test/algebra/1072.json",
168
+ "ok": true,
169
+ "level": 4,
170
+ "thema": "Algebra",
171
+ "gegeben": "\\frac{243}{625}",
172
+ "erwartet": "\\frac{243}{625}",
173
+ "tps": 17.48507061782896,
174
+ "tokens": 1076,
175
+ "denk_zeichen": 0,
176
+ "abbruch": "stop",
177
+ "sekunden": 61.95
178
+ },
179
+ {
180
+ "id": "test/intermediate_algebra/428.json",
181
+ "ok": true,
182
+ "level": 2,
183
+ "thema": "Intermediate Algebra",
184
+ "gegeben": "3, 5, 7",
185
+ "erwartet": "3, 5, 7",
186
+ "tps": 17.875274070010963,
187
+ "tokens": 1105,
188
+ "denk_zeichen": 0,
189
+ "abbruch": "stop",
190
+ "sekunden": 62.23
191
+ },
192
+ {
193
+ "id": "test/prealgebra/930.json",
194
+ "ok": true,
195
+ "level": 2,
196
+ "thema": "Prealgebra",
197
+ "gegeben": "12",
198
+ "erwartet": "12",
199
+ "tps": 19.039280961796734,
200
+ "tokens": 371,
201
+ "denk_zeichen": 0,
202
+ "abbruch": "stop",
203
+ "sekunden": 20.16
204
+ },
205
+ {
206
+ "id": "test/intermediate_algebra/1454.json",
207
+ "ok": false,
208
+ "level": 5,
209
+ "thema": "Intermediate Algebra",
210
+ "gegeben": "",
211
+ "erwartet": "70 \\sqrt{2}",
212
+ "tps": 18.615381631553735,
213
+ "tokens": 1600,
214
+ "denk_zeichen": 0,
215
+ "abbruch": "length",
216
+ "sekunden": 86.57
217
+ },
218
+ {
219
+ "id": "test/precalculus/285.json",
220
+ "ok": false,
221
+ "level": 2,
222
+ "thema": "Precalculus",
223
+ "gegeben": "",
224
+ "erwartet": "6",
225
+ "tps": 17.59745141390408,
226
+ "tokens": 1600,
227
+ "denk_zeichen": 0,
228
+ "abbruch": "length",
229
+ "sekunden": 91.36
230
+ },
231
+ {
232
+ "id": "test/number_theory/1055.json",
233
+ "ok": true,
234
+ "level": 5,
235
+ "thema": "Number Theory",
236
+ "gegeben": "203",
237
+ "erwartet": "203",
238
+ "tps": 18.612226291576608,
239
+ "tokens": 1235,
240
+ "denk_zeichen": 0,
241
+ "abbruch": "stop",
242
+ "sekunden": 67.09
243
+ },
244
+ {
245
+ "id": "test/precalculus/1105.json",
246
+ "ok": true,
247
+ "level": 2,
248
+ "thema": "Precalculus",
249
+ "gegeben": "-\\frac{\\pi}{6}",
250
+ "erwartet": "-\\frac{\\pi}{6}",
251
+ "tps": 19.022645865445128,
252
+ "tokens": 608,
253
+ "denk_zeichen": 0,
254
+ "abbruch": "stop",
255
+ "sekunden": 32.56
256
+ },
257
+ {
258
+ "id": "test/algebra/769.json",
259
+ "ok": true,
260
+ "level": 3,
261
+ "thema": "Algebra",
262
+ "gegeben": "11",
263
+ "erwartet": "11",
264
+ "tps": 19.23023972679074,
265
+ "tokens": 396,
266
+ "denk_zeichen": 0,
267
+ "abbruch": "stop",
268
+ "sekunden": 20.99
269
+ },
270
+ {
271
+ "id": "test/intermediate_algebra/956.json",
272
+ "ok": false,
273
+ "level": 5,
274
+ "thema": "Intermediate Algebra",
275
+ "gegeben": "",
276
+ "erwartet": "(6,31,-1)",
277
+ "tps": 18.178699915054345,
278
+ "tokens": 1600,
279
+ "denk_zeichen": 0,
280
+ "abbruch": "length",
281
+ "sekunden": 88.43
282
+ },
283
+ {
284
+ "id": "test/intermediate_algebra/279.json",
285
+ "ok": true,
286
+ "level": 5,
287
+ "thema": "Intermediate Algebra",
288
+ "gegeben": "10",
289
+ "erwartet": "10",
290
+ "tps": 17.47481665339154,
291
+ "tokens": 1575,
292
+ "denk_zeichen": 0,
293
+ "abbruch": "stop",
294
+ "sekunden": 90.82
295
+ },
296
+ {
297
+ "id": "test/algebra/2046.json",
298
+ "ok": true,
299
+ "level": 3,
300
+ "thema": "Algebra",
301
+ "gegeben": "x^3 + 3x - 6",
302
+ "erwartet": "x^3+3x-6",
303
+ "tps": 18.64128652822877,
304
+ "tokens": 579,
305
+ "denk_zeichen": 0,
306
+ "abbruch": "stop",
307
+ "sekunden": 31.51
308
+ },
309
+ {
310
+ "id": "test/number_theory/46.json",
311
+ "ok": true,
312
+ "level": 2,
313
+ "thema": "Number Theory",
314
+ "gegeben": "40_9",
315
+ "erwartet": "40_9",
316
+ "tps": 18.832804116938576,
317
+ "tokens": 516,
318
+ "denk_zeichen": 0,
319
+ "abbruch": "stop",
320
+ "sekunden": 27.99
321
+ },
322
+ {
323
+ "id": "test/algebra/2253.json",
324
+ "ok": true,
325
+ "level": 4,
326
+ "thema": "Algebra",
327
+ "gegeben": "\\frac{3\\sqrt{3}}{4}",
328
+ "erwartet": "\\frac{3\\sqrt{3}}{4}",
329
+ "tps": 18.71537298652032,
330
+ "tokens": 491,
331
+ "denk_zeichen": 0,
332
+ "abbruch": "stop",
333
+ "sekunden": 26.83
334
+ },
335
+ {
336
+ "id": "test/intermediate_algebra/623.json",
337
+ "ok": true,
338
+ "level": 2,
339
+ "thema": "Intermediate Algebra",
340
+ "gegeben": "0",
341
+ "erwartet": "0",
342
+ "tps": 18.05361715409941,
343
+ "tokens": 363,
344
+ "denk_zeichen": 0,
345
+ "abbruch": "stop",
346
+ "sekunden": 20.69
347
+ },
348
+ {
349
+ "id": "test/intermediate_algebra/1849.json",
350
+ "ok": false,
351
+ "level": 5,
352
+ "thema": "Intermediate Algebra",
353
+ "gegeben": "",
354
+ "erwartet": "501",
355
+ "tps": 18.458090064358515,
356
+ "tokens": 1600,
357
+ "denk_zeichen": 0,
358
+ "abbruch": "length",
359
+ "sekunden": 87.1
360
+ },
361
+ {
362
+ "id": "test/intermediate_algebra/2046.json",
363
+ "ok": true,
364
+ "level": 2,
365
+ "thema": "Intermediate Algebra",
366
+ "gegeben": "2",
367
+ "erwartet": "2",
368
+ "tps": 17.45756996797487,
369
+ "tokens": 826,
370
+ "denk_zeichen": 0,
371
+ "abbruch": "stop",
372
+ "sekunden": 48.01
373
+ },
374
+ {
375
+ "id": "test/prealgebra/307.json",
376
+ "ok": true,
377
+ "level": 1,
378
+ "thema": "Prealgebra",
379
+ "gegeben": "240",
380
+ "erwartet": "240",
381
+ "tps": 17.674684321585747,
382
+ "tokens": 248,
383
+ "denk_zeichen": 0,
384
+ "abbruch": "stop",
385
+ "sekunden": 14.75
386
+ },
387
+ {
388
+ "id": "test/prealgebra/1761.json",
389
+ "ok": true,
390
+ "level": 3,
391
+ "thema": "Prealgebra",
392
+ "gegeben": "\\frac{3}{2}",
393
+ "erwartet": "\\frac{3}{2}",
394
+ "tps": 17.380362940176788,
395
+ "tokens": 273,
396
+ "denk_zeichen": 0,
397
+ "abbruch": "stop",
398
+ "sekunden": 16.15
399
+ },
400
+ {
401
+ "id": "test/algebra/873.json",
402
+ "ok": true,
403
+ "level": 4,
404
+ "thema": "Algebra",
405
+ "gegeben": "33",
406
+ "erwartet": "33",
407
+ "tps": 18.426654855870673,
408
+ "tokens": 748,
409
+ "denk_zeichen": 0,
410
+ "abbruch": "stop",
411
+ "sekunden": 41.05
412
+ },
413
+ {
414
+ "id": "test/intermediate_algebra/662.json",
415
+ "ok": false,
416
+ "level": 5,
417
+ "thema": "Intermediate Algebra",
418
+ "gegeben": "",
419
+ "erwartet": "1 \\pm \\sqrt{19}",
420
+ "tps": 18.769437658966872,
421
+ "tokens": 1600,
422
+ "denk_zeichen": 0,
423
+ "abbruch": "length",
424
+ "sekunden": 86.04
425
+ },
426
+ {
427
+ "id": "test/geometry/183.json",
428
+ "ok": false,
429
+ "level": 5,
430
+ "thema": "Geometry",
431
+ "gegeben": "",
432
+ "erwartet": "145^\\circ",
433
+ "tps": 17.386758655370244,
434
+ "tokens": 1600,
435
+ "denk_zeichen": 0,
436
+ "abbruch": "length",
437
+ "sekunden": 92.75
438
+ },
439
+ {
440
+ "id": "test/intermediate_algebra/558.json",
441
+ "ok": false,
442
+ "level": 5,
443
+ "thema": "Intermediate Algebra",
444
+ "gegeben": "",
445
+ "erwartet": "(3,4]",
446
+ "tps": 18.178638779210786,
447
+ "tokens": 1600,
448
+ "denk_zeichen": 0,
449
+ "abbruch": "length",
450
+ "sekunden": 88.57
451
+ },
452
+ {
453
+ "id": "test/intermediate_algebra/515.json",
454
+ "ok": true,
455
+ "level": 2,
456
+ "thema": "Intermediate Algebra",
457
+ "gegeben": "\\frac{4}{3}",
458
+ "erwartet": "\\frac43",
459
+ "tps": 18.77320183366981,
460
+ "tokens": 700,
461
+ "denk_zeichen": 0,
462
+ "abbruch": "stop",
463
+ "sekunden": 37.94,
464
+ "neubewertet": true
465
+ },
466
+ {
467
+ "id": "test/intermediate_algebra/345.json",
468
+ "ok": false,
469
+ "level": 4,
470
+ "thema": "Intermediate Algebra",
471
+ "gegeben": "",
472
+ "erwartet": "504",
473
+ "tps": 18.53301481104103,
474
+ "tokens": 1600,
475
+ "denk_zeichen": 0,
476
+ "abbruch": "length",
477
+ "sekunden": 87.02
478
+ },
479
+ {
480
+ "id": "test/algebra/2593.json",
481
+ "ok": true,
482
+ "level": 2,
483
+ "thema": "Algebra",
484
+ "gegeben": "8000",
485
+ "erwartet": "8000",
486
+ "tps": 18.449755634550158,
487
+ "tokens": 531,
488
+ "denk_zeichen": 0,
489
+ "abbruch": "stop",
490
+ "sekunden": 29.42
491
+ },
492
+ {
493
+ "id": "test/algebra/2157.json",
494
+ "ok": true,
495
+ "level": 2,
496
+ "thema": "Algebra",
497
+ "gegeben": "2",
498
+ "erwartet": "2",
499
+ "tps": 18.684866036492405,
500
+ "tokens": 562,
501
+ "denk_zeichen": 0,
502
+ "abbruch": "stop",
503
+ "sekunden": 30.53
504
+ },
505
+ {
506
+ "id": "test/intermediate_algebra/128.json",
507
+ "ok": true,
508
+ "level": 2,
509
+ "thema": "Intermediate Algebra",
510
+ "gegeben": "even",
511
+ "erwartet": "\\text{even}",
512
+ "tps": 18.612117075594814,
513
+ "tokens": 1578,
514
+ "denk_zeichen": 0,
515
+ "abbruch": "stop",
516
+ "sekunden": 85.4
517
+ },
518
+ {
519
+ "id": "test/geometry/283.json",
520
+ "ok": false,
521
+ "level": 4,
522
+ "thema": "Geometry",
523
+ "gegeben": "",
524
+ "erwartet": "8",
525
+ "tps": 18.681858941176223,
526
+ "tokens": 1600,
527
+ "denk_zeichen": 0,
528
+ "abbruch": "length",
529
+ "sekunden": 86.31
530
+ },
531
+ {
532
+ "id": "test/intermediate_algebra/1063.json",
533
+ "ok": false,
534
+ "level": 4,
535
+ "thema": "Intermediate Algebra",
536
+ "gegeben": "",
537
+ "erwartet": "1+274i",
538
+ "tps": 18.643680841484397,
539
+ "tokens": 1600,
540
+ "denk_zeichen": 0,
541
+ "abbruch": "length",
542
+ "sekunden": 86.32
543
+ },
544
+ {
545
+ "id": "test/number_theory/753.json",
546
+ "ok": true,
547
+ "level": 4,
548
+ "thema": "Number Theory",
549
+ "gegeben": "13",
550
+ "erwartet": "13",
551
+ "tps": 18.49881115911556,
552
+ "tokens": 1076,
553
+ "denk_zeichen": 0,
554
+ "abbruch": "stop",
555
+ "sekunden": 58.8
556
+ },
557
+ {
558
+ "id": "test/prealgebra/1807.json",
559
+ "ok": true,
560
+ "level": 3,
561
+ "thema": "Prealgebra",
562
+ "gegeben": "120",
563
+ "erwartet": "120",
564
+ "tps": 18.49112745588527,
565
+ "tokens": 535,
566
+ "denk_zeichen": 0,
567
+ "abbruch": "stop",
568
+ "sekunden": 29.55
569
+ },
570
+ {
571
+ "id": "test/intermediate_algebra/2022.json",
572
+ "ok": false,
573
+ "level": 5,
574
+ "thema": "Intermediate Algebra",
575
+ "gegeben": "",
576
+ "erwartet": "64",
577
+ "tps": 18.66090184756341,
578
+ "tokens": 1600,
579
+ "denk_zeichen": 0,
580
+ "abbruch": "length",
581
+ "sekunden": 86.23
582
+ },
583
+ {
584
+ "id": "test/number_theory/156.json",
585
+ "ok": true,
586
+ "level": 4,
587
+ "thema": "Number Theory",
588
+ "gegeben": "13",
589
+ "erwartet": "13",
590
+ "tps": 18.27015256741804,
591
+ "tokens": 659,
592
+ "denk_zeichen": 0,
593
+ "abbruch": "stop",
594
+ "sekunden": 36.52
595
+ },
596
+ {
597
+ "id": "test/precalculus/477.json",
598
+ "ok": true,
599
+ "level": 3,
600
+ "thema": "Precalculus",
601
+ "gegeben": "3\\sqrt{5}",
602
+ "erwartet": "3 \\sqrt{5}",
603
+ "tps": 18.10574066801964,
604
+ "tokens": 749,
605
+ "denk_zeichen": 0,
606
+ "abbruch": "stop",
607
+ "sekunden": 42.02
608
+ },
609
+ {
610
+ "id": "test/algebra/1519.json",
611
+ "ok": true,
612
+ "level": 3,
613
+ "thema": "Algebra",
614
+ "gegeben": "\\frac{\\sqrt{3}}{3}",
615
+ "erwartet": "\\frac{\\sqrt{3}}{3}",
616
+ "tps": 17.710948837223746,
617
+ "tokens": 422,
618
+ "denk_zeichen": 0,
619
+ "abbruch": "stop",
620
+ "sekunden": 24.52
621
+ },
622
+ {
623
+ "id": "test/intermediate_algebra/964.json",
624
+ "ok": false,
625
+ "level": 5,
626
+ "thema": "Intermediate Algebra",
627
+ "gegeben": "",
628
+ "erwartet": "1",
629
+ "tps": 18.71549520650549,
630
+ "tokens": 1600,
631
+ "denk_zeichen": 0,
632
+ "abbruch": "length",
633
+ "sekunden": 86.25
634
+ },
635
+ {
636
+ "id": "test/counting_and_probability/230.json",
637
+ "ok": true,
638
+ "level": 4,
639
+ "thema": "Counting & Probability",
640
+ "gegeben": "\\frac{2}{21}",
641
+ "erwartet": "\\frac{2}{21}",
642
+ "tps": 18.140092720046578,
643
+ "tokens": 863,
644
+ "denk_zeichen": 0,
645
+ "abbruch": "stop",
646
+ "sekunden": 48.61
647
+ },
648
+ {
649
+ "id": "test/precalculus/117.json",
650
+ "ok": false,
651
+ "level": 3,
652
+ "thema": "Precalculus",
653
+ "gegeben": "",
654
+ "erwartet": "30^\\circ",
655
+ "tps": 18.43267728439568,
656
+ "tokens": 1600,
657
+ "denk_zeichen": 0,
658
+ "abbruch": "length",
659
+ "sekunden": 87.38
660
+ },
661
+ {
662
+ "id": "test/number_theory/521.json",
663
+ "ok": true,
664
+ "level": 2,
665
+ "thema": "Number Theory",
666
+ "gegeben": "18",
667
+ "erwartet": "18",
668
+ "tps": 18.906703985579195,
669
+ "tokens": 781,
670
+ "denk_zeichen": 0,
671
+ "abbruch": "stop",
672
+ "sekunden": 42.24
673
+ },
674
+ {
675
+ "id": "test/algebra/2517.json",
676
+ "ok": true,
677
+ "level": 5,
678
+ "thema": "Algebra",
679
+ "gegeben": "-\\frac{35}{9}",
680
+ "erwartet": "-\\frac{35}{9}",
681
+ "tps": 18.465120594794765,
682
+ "tokens": 1078,
683
+ "denk_zeichen": 0,
684
+ "abbruch": "stop",
685
+ "sekunden": 59.01
686
+ },
687
+ {
688
+ "id": "test/prealgebra/1003.json",
689
+ "ok": false,
690
+ "level": 5,
691
+ "thema": "Prealgebra",
692
+ "gegeben": "",
693
+ "erwartet": "\\frac{270}7\\text{ degrees}",
694
+ "tps": 17.808601895304943,
695
+ "tokens": 1600,
696
+ "denk_zeichen": 0,
697
+ "abbruch": "length",
698
+ "sekunden": 90.69
699
+ },
700
+ {
701
+ "id": "test/algebra/297.json",
702
+ "ok": false,
703
+ "level": 5,
704
+ "thema": "Algebra",
705
+ "gegeben": "",
706
+ "erwartet": "1736",
707
+ "tps": 18.58923873849104,
708
+ "tokens": 1600,
709
+ "denk_zeichen": 0,
710
+ "abbruch": "length",
711
+ "sekunden": 86.78
712
+ },
713
+ {
714
+ "id": "test/algebra/686.json",
715
+ "ok": false,
716
+ "level": 5,
717
+ "thema": "Algebra",
718
+ "gegeben": "",
719
+ "erwartet": "4",
720
+ "tps": 18.52351836772979,
721
+ "tokens": 1600,
722
+ "denk_zeichen": 0,
723
+ "abbruch": "length",
724
+ "sekunden": 87.5
725
+ },
726
+ {
727
+ "id": "test/number_theory/598.json",
728
+ "ok": true,
729
+ "level": 3,
730
+ "thema": "Number Theory",
731
+ "gegeben": "0.0000672",
732
+ "erwartet": ".0000672",
733
+ "tps": 18.881146905084602,
734
+ "tokens": 588,
735
+ "denk_zeichen": 0,
736
+ "abbruch": "stop",
737
+ "sekunden": 31.88
738
+ },
739
+ {
740
+ "id": "test/prealgebra/1908.json",
741
+ "ok": true,
742
+ "level": 3,
743
+ "thema": "Prealgebra",
744
+ "gegeben": "3",
745
+ "erwartet": "3",
746
+ "tps": 18.759942421216987,
747
+ "tokens": 606,
748
+ "denk_zeichen": 0,
749
+ "abbruch": "stop",
750
+ "sekunden": 32.94
751
+ },
752
+ {
753
+ "id": "test/algebra/1082.json",
754
+ "ok": false,
755
+ "level": 4,
756
+ "thema": "Algebra",
757
+ "gegeben": "",
758
+ "erwartet": "23",
759
+ "tps": 18.362185548576665,
760
+ "tokens": 1600,
761
+ "denk_zeichen": 0,
762
+ "abbruch": "length",
763
+ "sekunden": 87.97
764
+ },
765
+ {
766
+ "id": "test/number_theory/978.json",
767
+ "ok": true,
768
+ "level": 4,
769
+ "thema": "Number Theory",
770
+ "gegeben": "7",
771
+ "erwartet": "7",
772
+ "tps": 17.9628427553167,
773
+ "tokens": 862,
774
+ "denk_zeichen": 0,
775
+ "abbruch": "stop",
776
+ "sekunden": 48.78
777
+ },
778
+ {
779
+ "id": "test/counting_and_probability/51.json",
780
+ "ok": true,
781
+ "level": 5,
782
+ "thema": "Counting & Probability",
783
+ "gegeben": "\\frac{13}{18}",
784
+ "erwartet": "\\frac{13}{18}",
785
+ "tps": 18.578332564295604,
786
+ "tokens": 612,
787
+ "denk_zeichen": 0,
788
+ "abbruch": "stop",
789
+ "sekunden": 33.4
790
+ },
791
+ {
792
+ "id": "test/intermediate_algebra/1422.json",
793
+ "ok": false,
794
+ "level": 3,
795
+ "thema": "Intermediate Algebra",
796
+ "gegeben": "",
797
+ "erwartet": "4",
798
+ "tps": 18.418774247380966,
799
+ "tokens": 1600,
800
+ "denk_zeichen": 0,
801
+ "abbruch": "length",
802
+ "sekunden": 87.59
803
+ },
804
+ {
805
+ "id": "test/algebra/1937.json",
806
+ "ok": true,
807
+ "level": 1,
808
+ "thema": "Algebra",
809
+ "gegeben": "1600",
810
+ "erwartet": "1600",
811
+ "tps": 17.78336623598338,
812
+ "tokens": 433,
813
+ "denk_zeichen": 0,
814
+ "abbruch": "stop",
815
+ "sekunden": 24.81
816
+ },
817
+ {
818
+ "id": "test/prealgebra/2086.json",
819
+ "ok": true,
820
+ "level": 4,
821
+ "thema": "Prealgebra",
822
+ "gegeben": "40",
823
+ "erwartet": "40",
824
+ "tps": 18.375900193558792,
825
+ "tokens": 886,
826
+ "denk_zeichen": 0,
827
+ "abbruch": "stop",
828
+ "sekunden": 48.65
829
+ },
830
+ {
831
+ "id": "test/intermediate_algebra/1555.json",
832
+ "ok": true,
833
+ "level": 3,
834
+ "thema": "Intermediate Algebra",
835
+ "gegeben": "12",
836
+ "erwartet": "12",
837
+ "tps": 18.678749275369526,
838
+ "tokens": 845,
839
+ "denk_zeichen": 0,
840
+ "abbruch": "stop",
841
+ "sekunden": 46.25
842
+ },
843
+ {
844
+ "id": "test/precalculus/541.json",
845
+ "ok": true,
846
+ "level": 2,
847
+ "thema": "Precalculus",
848
+ "gegeben": "\\left(\\frac{3}{2}, -13\\right)",
849
+ "erwartet": "\\left( \\frac{3}{2}, -13 \\right)",
850
+ "tps": 18.24443942368786,
851
+ "tokens": 516,
852
+ "denk_zeichen": 0,
853
+ "abbruch": "stop",
854
+ "sekunden": 28.76
855
+ },
856
+ {
857
+ "id": "test/prealgebra/378.json",
858
+ "ok": false,
859
+ "level": 4,
860
+ "thema": "Prealgebra",
861
+ "gegeben": "",
862
+ "erwartet": "10",
863
+ "tps": 8.948005327709483,
864
+ "tokens": 1600,
865
+ "denk_zeichen": 0,
866
+ "abbruch": "length",
867
+ "sekunden": 179.63
868
+ },
869
+ {
870
+ "id": "test/intermediate_algebra/102.json",
871
+ "ok": false,
872
+ "level": 4,
873
+ "thema": "Intermediate Algebra",
874
+ "gegeben": "",
875
+ "erwartet": "2",
876
+ "tps": 18.806248018585464,
877
+ "tokens": 1600,
878
+ "denk_zeichen": 0,
879
+ "abbruch": "length",
880
+ "sekunden": 86.0
881
+ },
882
+ {
883
+ "id": "test/prealgebra/1436.json",
884
+ "ok": true,
885
+ "level": 4,
886
+ "thema": "Prealgebra",
887
+ "gegeben": "6",
888
+ "erwartet": "6",
889
+ "tps": 19.035231366549205,
890
+ "tokens": 555,
891
+ "denk_zeichen": 0,
892
+ "abbruch": "stop",
893
+ "sekunden": 29.89
894
+ },
895
+ {
896
+ "id": "test/prealgebra/1961.json",
897
+ "ok": true,
898
+ "level": 5,
899
+ "thema": "Prealgebra",
900
+ "gegeben": "\\frac{16}{27}",
901
+ "erwartet": "\\frac{16}{27}",
902
+ "tps": 18.79127117686664,
903
+ "tokens": 582,
904
+ "denk_zeichen": 0,
905
+ "abbruch": "stop",
906
+ "sekunden": 31.84
907
+ },
908
+ {
909
+ "id": "test/number_theory/183.json",
910
+ "ok": true,
911
+ "level": 3,
912
+ "thema": "Number Theory",
913
+ "gegeben": "14",
914
+ "erwartet": "14",
915
+ "tps": 18.33965250097663,
916
+ "tokens": 824,
917
+ "denk_zeichen": 0,
918
+ "abbruch": "stop",
919
+ "sekunden": 45.36
920
+ },
921
+ {
922
+ "id": "test/counting_and_probability/71.json",
923
+ "ok": true,
924
+ "level": 3,
925
+ "thema": "Counting & Probability",
926
+ "gegeben": "3",
927
+ "erwartet": "3",
928
+ "tps": 18.884739391844285,
929
+ "tokens": 681,
930
+ "denk_zeichen": 0,
931
+ "abbruch": "stop",
932
+ "sekunden": 36.8
933
+ },
934
+ {
935
+ "id": "test/intermediate_algebra/986.json",
936
+ "ok": true,
937
+ "level": 4,
938
+ "thema": "Intermediate Algebra",
939
+ "gegeben": "\\frac{16}{5}",
940
+ "erwartet": "\\frac{16}{5}",
941
+ "tps": 18.341788982698752,
942
+ "tokens": 939,
943
+ "denk_zeichen": 0,
944
+ "abbruch": "stop",
945
+ "sekunden": 52.06
946
+ },
947
+ {
948
+ "id": "test/precalculus/441.json",
949
+ "ok": true,
950
+ "level": 2,
951
+ "thema": "Precalculus",
952
+ "gegeben": "30",
953
+ "erwartet": "30^\\circ",
954
+ "tps": 18.256401477738393,
955
+ "tokens": 677,
956
+ "denk_zeichen": 0,
957
+ "abbruch": "stop",
958
+ "sekunden": 37.78
959
+ },
960
+ {
961
+ "id": "test/precalculus/989.json",
962
+ "ok": false,
963
+ "level": 4,
964
+ "thema": "Precalculus",
965
+ "gegeben": "",
966
+ "erwartet": "12",
967
+ "tps": 18.724559102461665,
968
+ "tokens": 1600,
969
+ "denk_zeichen": 0,
970
+ "abbruch": "length",
971
+ "sekunden": 86.1
972
+ },
973
+ {
974
+ "id": "test/prealgebra/874.json",
975
+ "ok": false,
976
+ "level": 4,
977
+ "thema": "Prealgebra",
978
+ "gegeben": "",
979
+ "erwartet": "116",
980
+ "tps": 18.282957842515906,
981
+ "tokens": 1600,
982
+ "denk_zeichen": 0,
983
+ "abbruch": "length",
984
+ "sekunden": 88.38
985
+ },
986
+ {
987
+ "id": "test/geometry/254.json",
988
+ "ok": true,
989
+ "level": 2,
990
+ "thema": "Geometry",
991
+ "gegeben": "3",
992
+ "erwartet": "3",
993
+ "tps": 18.410563143569682,
994
+ "tokens": 466,
995
+ "denk_zeichen": 0,
996
+ "abbruch": "stop",
997
+ "sekunden": 25.97
998
+ },
999
+ {
1000
+ "id": "test/algebra/1787.json",
1001
+ "ok": true,
1002
+ "level": 2,
1003
+ "thema": "Algebra",
1004
+ "gegeben": "8",
1005
+ "erwartet": "8",
1006
+ "tps": 18.475315583733742,
1007
+ "tokens": 616,
1008
+ "denk_zeichen": 0,
1009
+ "abbruch": "stop",
1010
+ "sekunden": 33.98
1011
+ },
1012
+ {
1013
+ "id": "test/algebra/1934.json",
1014
+ "ok": true,
1015
+ "level": 4,
1016
+ "thema": "Algebra",
1017
+ "gegeben": "13",
1018
+ "erwartet": "13",
1019
+ "tps": 18.65205676358567,
1020
+ "tokens": 725,
1021
+ "denk_zeichen": 0,
1022
+ "abbruch": "stop",
1023
+ "sekunden": 39.53
1024
+ },
1025
+ {
1026
+ "id": "test/prealgebra/1458.json",
1027
+ "ok": true,
1028
+ "level": 3,
1029
+ "thema": "Prealgebra",
1030
+ "gegeben": "\\frac{1}{8}",
1031
+ "erwartet": "\\frac{1}{8}",
1032
+ "tps": 18.657976926247073,
1033
+ "tokens": 227,
1034
+ "denk_zeichen": 0,
1035
+ "abbruch": "stop",
1036
+ "sekunden": 12.61
1037
+ },
1038
+ {
1039
+ "id": "test/prealgebra/1995.json",
1040
+ "ok": true,
1041
+ "level": 3,
1042
+ "thema": "Prealgebra",
1043
+ "gegeben": "\\frac{8}{21}",
1044
+ "erwartet": "\\frac{8}{21}",
1045
+ "tps": 18.66347542845983,
1046
+ "tokens": 547,
1047
+ "denk_zeichen": 0,
1048
+ "abbruch": "stop",
1049
+ "sekunden": 29.93
1050
+ },
1051
+ {
1052
+ "id": "test/precalculus/580.json",
1053
+ "ok": true,
1054
+ "level": 3,
1055
+ "thema": "Precalculus",
1056
+ "gegeben": "120",
1057
+ "erwartet": "120^\\circ",
1058
+ "tps": 17.862253925733537,
1059
+ "tokens": 843,
1060
+ "denk_zeichen": 0,
1061
+ "abbruch": "stop",
1062
+ "sekunden": 47.85
1063
+ },
1064
+ {
1065
+ "id": "test/geometry/483.json",
1066
+ "ok": true,
1067
+ "level": 4,
1068
+ "thema": "Geometry",
1069
+ "gegeben": "15",
1070
+ "erwartet": "15",
1071
+ "tps": 18.45395345463625,
1072
+ "tokens": 690,
1073
+ "denk_zeichen": 0,
1074
+ "abbruch": "stop",
1075
+ "sekunden": 38.01
1076
+ },
1077
+ {
1078
+ "id": "test/prealgebra/1742.json",
1079
+ "ok": true,
1080
+ "level": 3,
1081
+ "thema": "Prealgebra",
1082
+ "gegeben": "\\frac{33}{100}",
1083
+ "erwartet": "\\dfrac{33}{100}",
1084
+ "tps": 18.522047648179367,
1085
+ "tokens": 481,
1086
+ "denk_zeichen": 0,
1087
+ "abbruch": "stop",
1088
+ "sekunden": 26.58
1089
+ },
1090
+ {
1091
+ "id": "test/algebra/2551.json",
1092
+ "ok": true,
1093
+ "level": 1,
1094
+ "thema": "Algebra",
1095
+ "gegeben": "10",
1096
+ "erwartet": "10",
1097
+ "tps": 19.41551124753969,
1098
+ "tokens": 536,
1099
+ "denk_zeichen": 0,
1100
+ "abbruch": "stop",
1101
+ "sekunden": 28.08
1102
+ },
1103
+ {
1104
+ "id": "test/prealgebra/993.json",
1105
+ "ok": true,
1106
+ "level": 4,
1107
+ "thema": "Prealgebra",
1108
+ "gegeben": "1250",
1109
+ "erwartet": "1250",
1110
+ "tps": 18.251111061791107,
1111
+ "tokens": 898,
1112
+ "denk_zeichen": 0,
1113
+ "abbruch": "stop",
1114
+ "sekunden": 50.11
1115
+ },
1116
+ {
1117
+ "id": "test/algebra/1282.json",
1118
+ "ok": true,
1119
+ "level": 5,
1120
+ "thema": "Algebra",
1121
+ "gegeben": "11",
1122
+ "erwartet": "11",
1123
+ "tps": 18.816777960868013,
1124
+ "tokens": 980,
1125
+ "denk_zeichen": 0,
1126
+ "abbruch": "stop",
1127
+ "sekunden": 52.53
1128
+ },
1129
+ {
1130
+ "id": "test/number_theory/1287.json",
1131
+ "ok": true,
1132
+ "level": 4,
1133
+ "thema": "Number Theory",
1134
+ "gegeben": "8",
1135
+ "erwartet": "8",
1136
+ "tps": 18.792563787172583,
1137
+ "tokens": 806,
1138
+ "denk_zeichen": 0,
1139
+ "abbruch": "stop",
1140
+ "sekunden": 43.73
1141
+ },
1142
+ {
1143
+ "id": "test/prealgebra/1787.json",
1144
+ "ok": true,
1145
+ "level": 3,
1146
+ "thema": "Prealgebra",
1147
+ "gegeben": "1",
1148
+ "erwartet": "1",
1149
+ "tps": 19.092982711475646,
1150
+ "tokens": 501,
1151
+ "denk_zeichen": 0,
1152
+ "abbruch": "stop",
1153
+ "sekunden": 26.95
1154
+ },
1155
+ {
1156
+ "id": "test/intermediate_algebra/960.json",
1157
+ "ok": false,
1158
+ "level": 5,
1159
+ "thema": "Intermediate Algebra",
1160
+ "gegeben": "",
1161
+ "erwartet": "\\frac{17}{21}",
1162
+ "tps": 18.354339377654366,
1163
+ "tokens": 1600,
1164
+ "denk_zeichen": 0,
1165
+ "abbruch": "length",
1166
+ "sekunden": 87.98
1167
+ },
1168
+ {
1169
+ "id": "test/algebra/634.json",
1170
+ "ok": true,
1171
+ "level": 3,
1172
+ "thema": "Algebra",
1173
+ "gegeben": "4",
1174
+ "erwartet": "4",
1175
+ "tps": 18.674866284070664,
1176
+ "tokens": 1009,
1177
+ "denk_zeichen": 0,
1178
+ "abbruch": "stop",
1179
+ "sekunden": 54.85
1180
+ },
1181
+ {
1182
+ "id": "test/algebra/2486.json",
1183
+ "ok": true,
1184
+ "level": 5,
1185
+ "thema": "Algebra",
1186
+ "gegeben": "\\left( \\frac{3}{5}, \\frac{8}{3} \\right]",
1187
+ "erwartet": "\\left(\\frac{3}{5},\\frac{8}{3}\\right]",
1188
+ "tps": 18.0319642502723,
1189
+ "tokens": 584,
1190
+ "denk_zeichen": 0,
1191
+ "abbruch": "stop",
1192
+ "sekunden": 32.84
1193
+ },
1194
+ {
1195
+ "id": "test/intermediate_algebra/754.json",
1196
+ "ok": true,
1197
+ "level": 2,
1198
+ "thema": "Intermediate Algebra",
1199
+ "gegeben": "B",
1200
+ "erwartet": "\\text{(B)}",
1201
+ "tps": 18.717626117898945,
1202
+ "tokens": 1328,
1203
+ "denk_zeichen": 0,
1204
+ "abbruch": "stop",
1205
+ "sekunden": 71.47,
1206
+ "neubewertet": true
1207
+ },
1208
+ {
1209
+ "id": "test/counting_and_probability/339.json",
1210
+ "ok": true,
1211
+ "level": 4,
1212
+ "thema": "Counting & Probability",
1213
+ "gegeben": "12",
1214
+ "erwartet": "12",
1215
+ "tps": 17.62419249465696,
1216
+ "tokens": 579,
1217
+ "denk_zeichen": 0,
1218
+ "abbruch": "stop",
1219
+ "sekunden": 33.79
1220
+ },
1221
+ {
1222
+ "id": "test/geometry/965.json",
1223
+ "ok": true,
1224
+ "level": 5,
1225
+ "thema": "Geometry",
1226
+ "gegeben": "28",
1227
+ "erwartet": "28",
1228
+ "tps": 18.77850160510578,
1229
+ "tokens": 1441,
1230
+ "denk_zeichen": 0,
1231
+ "abbruch": "stop",
1232
+ "sekunden": 77.9
1233
+ },
1234
+ {
1235
+ "id": "test/intermediate_algebra/1544.json",
1236
+ "ok": false,
1237
+ "level": 5,
1238
+ "thema": "Intermediate Algebra",
1239
+ "gegeben": "",
1240
+ "erwartet": "6",
1241
+ "tps": 18.720138089098615,
1242
+ "tokens": 1600,
1243
+ "denk_zeichen": 0,
1244
+ "abbruch": "length",
1245
+ "sekunden": 85.94
1246
+ },
1247
+ {
1248
+ "id": "test/algebra/1842.json",
1249
+ "ok": true,
1250
+ "level": 2,
1251
+ "thema": "Algebra",
1252
+ "gegeben": "49",
1253
+ "erwartet": "49",
1254
+ "tps": 18.85629220953977,
1255
+ "tokens": 558,
1256
+ "denk_zeichen": 0,
1257
+ "abbruch": "stop",
1258
+ "sekunden": 30.39
1259
+ },
1260
+ {
1261
+ "id": "test/prealgebra/1423.json",
1262
+ "ok": true,
1263
+ "level": 5,
1264
+ "thema": "Prealgebra",
1265
+ "gegeben": "12\\pi",
1266
+ "erwartet": "12\\pi",
1267
+ "tps": 18.353478086732018,
1268
+ "tokens": 456,
1269
+ "denk_zeichen": 0,
1270
+ "abbruch": "stop",
1271
+ "sekunden": 25.5
1272
+ },
1273
+ {
1274
+ "id": "test/algebra/276.json",
1275
+ "ok": true,
1276
+ "level": 2,
1277
+ "thema": "Algebra",
1278
+ "gegeben": "12",
1279
+ "erwartet": "12",
1280
+ "tps": 18.41010276450896,
1281
+ "tokens": 968,
1282
+ "denk_zeichen": 0,
1283
+ "abbruch": "stop",
1284
+ "sekunden": 53.03
1285
+ },
1286
+ {
1287
+ "id": "test/geometry/947.json",
1288
+ "ok": true,
1289
+ "level": 5,
1290
+ "thema": "Geometry",
1291
+ "gegeben": "-\\frac{24}{25}",
1292
+ "erwartet": "-\\frac{24}{25}",
1293
+ "tps": 18.402569016174834,
1294
+ "tokens": 1259,
1295
+ "denk_zeichen": 0,
1296
+ "abbruch": "stop",
1297
+ "sekunden": 68.96
1298
+ },
1299
+ {
1300
+ "id": "test/counting_and_probability/870.json",
1301
+ "ok": true,
1302
+ "level": 5,
1303
+ "thema": "Counting & Probability",
1304
+ "gegeben": "\\frac{1}{3}",
1305
+ "erwartet": "\\frac{1}{3}",
1306
+ "tps": 18.194509848094196,
1307
+ "tokens": 922,
1308
+ "denk_zeichen": 0,
1309
+ "abbruch": "stop",
1310
+ "sekunden": 51.13
1311
+ },
1312
+ {
1313
+ "id": "test/precalculus/742.json",
1314
+ "ok": false,
1315
+ "level": 2,
1316
+ "thema": "Precalculus",
1317
+ "gegeben": "-0.09",
1318
+ "erwartet": "\\frac{9}{100}",
1319
+ "tps": 18.45402728354076,
1320
+ "tokens": 887,
1321
+ "denk_zeichen": 0,
1322
+ "abbruch": "stop",
1323
+ "sekunden": 48.53
1324
+ },
1325
+ {
1326
+ "id": "test/counting_and_probability/216.json",
1327
+ "ok": true,
1328
+ "level": 5,
1329
+ "thema": "Counting & Probability",
1330
+ "gegeben": "1940",
1331
+ "erwartet": "1940",
1332
+ "tps": 18.497474518768918,
1333
+ "tokens": 1108,
1334
+ "denk_zeichen": 0,
1335
+ "abbruch": "stop",
1336
+ "sekunden": 60.53
1337
+ },
1338
+ {
1339
+ "id": "test/intermediate_algebra/776.json",
1340
+ "ok": true,
1341
+ "level": 4,
1342
+ "thema": "Intermediate Algebra",
1343
+ "gegeben": "3",
1344
+ "erwartet": "3",
1345
+ "tps": 18.746318546535875,
1346
+ "tokens": 1130,
1347
+ "denk_zeichen": 0,
1348
+ "abbruch": "stop",
1349
+ "sekunden": 61.2
1350
+ },
1351
+ {
1352
+ "id": "test/algebra/2592.json",
1353
+ "ok": true,
1354
+ "level": 1,
1355
+ "thema": "Algebra",
1356
+ "gegeben": "26000",
1357
+ "erwartet": "26000",
1358
+ "tps": 18.507923402947267,
1359
+ "tokens": 276,
1360
+ "denk_zeichen": 0,
1361
+ "abbruch": "stop",
1362
+ "sekunden": 15.56
1363
+ },
1364
+ {
1365
+ "id": "test/precalculus/801.json",
1366
+ "ok": false,
1367
+ "level": 3,
1368
+ "thema": "Precalculus",
1369
+ "gegeben": "",
1370
+ "erwartet": "55^\\circ",
1371
+ "tps": 18.57102766936876,
1372
+ "tokens": 1600,
1373
+ "denk_zeichen": 0,
1374
+ "abbruch": "length",
1375
+ "sekunden": 86.65
1376
+ },
1377
+ {
1378
+ "id": "test/counting_and_probability/737.json",
1379
+ "ok": true,
1380
+ "level": 2,
1381
+ "thema": "Counting & Probability",
1382
+ "gegeben": "58500",
1383
+ "erwartet": "58,500",
1384
+ "tps": 18.716628153254305,
1385
+ "tokens": 616,
1386
+ "denk_zeichen": 0,
1387
+ "abbruch": "stop",
1388
+ "sekunden": 33.65
1389
+ },
1390
+ {
1391
+ "id": "test/algebra/1338.json",
1392
+ "ok": true,
1393
+ "level": 4,
1394
+ "thema": "Algebra",
1395
+ "gegeben": "66",
1396
+ "erwartet": "66",
1397
+ "tps": 19.336495738042014,
1398
+ "tokens": 806,
1399
+ "denk_zeichen": 0,
1400
+ "abbruch": "stop",
1401
+ "sekunden": 42.31
1402
+ },
1403
+ {
1404
+ "id": "test/number_theory/686.json",
1405
+ "ok": true,
1406
+ "level": 2,
1407
+ "thema": "Number Theory",
1408
+ "gegeben": "4",
1409
+ "erwartet": "4",
1410
+ "tps": 18.336165609674293,
1411
+ "tokens": 513,
1412
+ "denk_zeichen": 0,
1413
+ "abbruch": "stop",
1414
+ "sekunden": 28.92
1415
+ },
1416
+ {
1417
+ "id": "test/counting_and_probability/1014.json",
1418
+ "ok": true,
1419
+ "level": 4,
1420
+ "thema": "Counting & Probability",
1421
+ "gegeben": "480",
1422
+ "erwartet": "480",
1423
+ "tps": 18.564269350780553,
1424
+ "tokens": 930,
1425
+ "denk_zeichen": 0,
1426
+ "abbruch": "stop",
1427
+ "sekunden": 50.8
1428
+ },
1429
+ {
1430
+ "id": "test/algebra/1078.json",
1431
+ "ok": true,
1432
+ "level": 5,
1433
+ "thema": "Algebra",
1434
+ "gegeben": "(-\\sqrt{3}, \\sqrt{3})",
1435
+ "erwartet": "(-\\sqrt{3}, \\sqrt{3})",
1436
+ "tps": 18.683125727747868,
1437
+ "tokens": 943,
1438
+ "denk_zeichen": 0,
1439
+ "abbruch": "stop",
1440
+ "sekunden": 51.2
1441
+ },
1442
+ {
1443
+ "id": "test/precalculus/96.json",
1444
+ "ok": true,
1445
+ "level": 3,
1446
+ "thema": "Precalculus",
1447
+ "gegeben": "1.75",
1448
+ "erwartet": "\\frac{7}{4}",
1449
+ "tps": 18.630950278635254,
1450
+ "tokens": 863,
1451
+ "denk_zeichen": 0,
1452
+ "abbruch": "stop",
1453
+ "sekunden": 47.21
1454
+ },
1455
+ {
1456
+ "id": "test/algebra/251.json",
1457
+ "ok": true,
1458
+ "level": 2,
1459
+ "thema": "Algebra",
1460
+ "gegeben": "2",
1461
+ "erwartet": "2",
1462
+ "tps": 19.007524327420963,
1463
+ "tokens": 430,
1464
+ "denk_zeichen": 0,
1465
+ "abbruch": "stop",
1466
+ "sekunden": 23.36
1467
+ },
1468
+ {
1469
+ "id": "test/number_theory/109.json",
1470
+ "ok": true,
1471
+ "level": 4,
1472
+ "thema": "Number Theory",
1473
+ "gegeben": "4",
1474
+ "erwartet": "4",
1475
+ "tps": 18.649980303229,
1476
+ "tokens": 1232,
1477
+ "denk_zeichen": 0,
1478
+ "abbruch": "stop",
1479
+ "sekunden": 66.5
1480
+ },
1481
+ {
1482
+ "id": "test/precalculus/1289.json",
1483
+ "ok": true,
1484
+ "level": 1,
1485
+ "thema": "Precalculus",
1486
+ "gegeben": "-41",
1487
+ "erwartet": "-41",
1488
+ "tps": 18.46751024859708,
1489
+ "tokens": 318,
1490
+ "denk_zeichen": 0,
1491
+ "abbruch": "stop",
1492
+ "sekunden": 17.86
1493
+ },
1494
+ {
1495
+ "id": "test/algebra/2264.json",
1496
+ "ok": true,
1497
+ "level": 5,
1498
+ "thema": "Algebra",
1499
+ "gegeben": "1+2i",
1500
+ "erwartet": "1+2i",
1501
+ "tps": 17.973783888165322,
1502
+ "tokens": 880,
1503
+ "denk_zeichen": 0,
1504
+ "abbruch": "stop",
1505
+ "sekunden": 49.68
1506
+ },
1507
+ {
1508
+ "id": "test/geometry/538.json",
1509
+ "ok": true,
1510
+ "level": 4,
1511
+ "thema": "Geometry",
1512
+ "gegeben": "(8, -2)",
1513
+ "erwartet": "(8,-2)",
1514
+ "tps": 18.417127146289815,
1515
+ "tokens": 1074,
1516
+ "denk_zeichen": 0,
1517
+ "abbruch": "stop",
1518
+ "sekunden": 58.79
1519
+ },
1520
+ {
1521
+ "id": "test/intermediate_algebra/1992.json",
1522
+ "ok": true,
1523
+ "level": 4,
1524
+ "thema": "Intermediate Algebra",
1525
+ "gegeben": "(0, 9) \\cup (9, 36)",
1526
+ "erwartet": "(0,9) \\cup (9,36)",
1527
+ "tps": 18.79702186494697,
1528
+ "tokens": 1467,
1529
+ "denk_zeichen": 0,
1530
+ "abbruch": "stop",
1531
+ "sekunden": 78.51
1532
+ },
1533
+ {
1534
+ "id": "test/algebra/101.json",
1535
+ "ok": true,
1536
+ "level": 4,
1537
+ "thema": "Algebra",
1538
+ "gegeben": "[-2, 7]",
1539
+ "erwartet": "x \\in [-2,7]",
1540
+ "tps": 19.236339627670446,
1541
+ "tokens": 707,
1542
+ "denk_zeichen": 0,
1543
+ "abbruch": "stop",
1544
+ "sekunden": 37.73,
1545
+ "neubewertet": true
1546
+ },
1547
+ {
1548
+ "id": "test/algebra/170.json",
1549
+ "ok": true,
1550
+ "level": 3,
1551
+ "thema": "Algebra",
1552
+ "gegeben": "11",
1553
+ "erwartet": "11",
1554
+ "tps": 19.447226000954906,
1555
+ "tokens": 566,
1556
+ "denk_zeichen": 0,
1557
+ "abbruch": "stop",
1558
+ "sekunden": 29.53
1559
+ },
1560
+ {
1561
+ "id": "test/algebra/853.json",
1562
+ "ok": true,
1563
+ "level": 5,
1564
+ "thema": "Algebra",
1565
+ "gegeben": "12",
1566
+ "erwartet": "12",
1567
+ "tps": 18.564119924214708,
1568
+ "tokens": 1122,
1569
+ "denk_zeichen": 0,
1570
+ "abbruch": "stop",
1571
+ "sekunden": 61.44
1572
+ },
1573
+ {
1574
+ "id": "test/algebra/518.json",
1575
+ "ok": true,
1576
+ "level": 3,
1577
+ "thema": "Algebra",
1578
+ "gegeben": "\\frac{3}{4}",
1579
+ "erwartet": "\\frac 34",
1580
+ "tps": 18.916968452444742,
1581
+ "tokens": 582,
1582
+ "denk_zeichen": 0,
1583
+ "abbruch": "stop",
1584
+ "sekunden": 31.25,
1585
+ "neubewertet": true
1586
+ },
1587
+ {
1588
+ "id": "test/prealgebra/631.json",
1589
+ "ok": false,
1590
+ "level": 3,
1591
+ "thema": "Prealgebra",
1592
+ "gegeben": "",
1593
+ "erwartet": "2",
1594
+ "tps": 18.699707866151325,
1595
+ "tokens": 1600,
1596
+ "denk_zeichen": 0,
1597
+ "abbruch": "length",
1598
+ "sekunden": 86.45
1599
+ },
1600
+ {
1601
+ "id": "test/geometry/817.json",
1602
+ "ok": false,
1603
+ "level": 5,
1604
+ "thema": "Geometry",
1605
+ "gegeben": "",
1606
+ "erwartet": "\\frac{14}{3}",
1607
+ "tps": 18.62603450014225,
1608
+ "tokens": 1600,
1609
+ "denk_zeichen": 0,
1610
+ "abbruch": "length",
1611
+ "sekunden": 86.38
1612
+ },
1613
+ {
1614
+ "id": "test/number_theory/928.json",
1615
+ "ok": false,
1616
+ "level": 4,
1617
+ "thema": "Number Theory",
1618
+ "gegeben": "",
1619
+ "erwartet": "3",
1620
+ "tps": 18.18839514684054,
1621
+ "tokens": 1600,
1622
+ "denk_zeichen": 0,
1623
+ "abbruch": "length",
1624
+ "sekunden": 88.45
1625
+ },
1626
+ {
1627
+ "id": "test/number_theory/132.json",
1628
+ "ok": true,
1629
+ "level": 1,
1630
+ "thema": "Number Theory",
1631
+ "gegeben": "0",
1632
+ "erwartet": "0",
1633
+ "tps": 18.100530345539124,
1634
+ "tokens": 495,
1635
+ "denk_zeichen": 0,
1636
+ "abbruch": "stop",
1637
+ "sekunden": 27.98
1638
+ },
1639
+ {
1640
+ "id": "test/prealgebra/65.json",
1641
+ "ok": true,
1642
+ "level": 2,
1643
+ "thema": "Prealgebra",
1644
+ "gegeben": "6",
1645
+ "erwartet": "6",
1646
+ "tps": 18.3442975161332,
1647
+ "tokens": 750,
1648
+ "denk_zeichen": 0,
1649
+ "abbruch": "stop",
1650
+ "sekunden": 41.58
1651
+ },
1652
+ {
1653
+ "id": "test/algebra/2680.json",
1654
+ "ok": true,
1655
+ "level": 2,
1656
+ "thema": "Algebra",
1657
+ "gegeben": "5r^5",
1658
+ "erwartet": "5r^5",
1659
+ "tps": 18.544137537060372,
1660
+ "tokens": 324,
1661
+ "denk_zeichen": 0,
1662
+ "abbruch": "stop",
1663
+ "sekunden": 17.91
1664
+ },
1665
+ {
1666
+ "id": "test/precalculus/681.json",
1667
+ "ok": true,
1668
+ "level": 3,
1669
+ "thema": "Precalculus",
1670
+ "gegeben": "\\frac{1}{8}",
1671
+ "erwartet": "\\frac{1}{8}",
1672
+ "tps": 18.241553409324272,
1673
+ "tokens": 1323,
1674
+ "denk_zeichen": 0,
1675
+ "abbruch": "stop",
1676
+ "sekunden": 72.96
1677
+ },
1678
+ {
1679
+ "id": "test/precalculus/625.json",
1680
+ "ok": false,
1681
+ "level": 3,
1682
+ "thema": "Precalculus",
1683
+ "gegeben": "\\begin{pmatrix} \\frac{16}{49} \\\\ \\frac{48}{49} \\\\ \\frac{24}{",
1684
+ "erwartet": "\\begin{pmatrix} 16/49 \\\\ 48/49 \\\\ 24/49 \\end{pmatrix}",
1685
+ "tps": 18.40263210376642,
1686
+ "tokens": 663,
1687
+ "denk_zeichen": 0,
1688
+ "abbruch": "stop",
1689
+ "sekunden": 36.55
1690
+ },
1691
+ {
1692
+ "id": "test/number_theory/1002.json",
1693
+ "ok": true,
1694
+ "level": 5,
1695
+ "thema": "Number Theory",
1696
+ "gegeben": "1440",
1697
+ "erwartet": "1440",
1698
+ "tps": 18.620247944079747,
1699
+ "tokens": 1209,
1700
+ "denk_zeichen": 0,
1701
+ "abbruch": "stop",
1702
+ "sekunden": 65.56
1703
+ },
1704
+ {
1705
+ "id": "test/geometry/843.json",
1706
+ "ok": true,
1707
+ "level": 3,
1708
+ "thema": "Geometry",
1709
+ "gegeben": "6\\sqrt{2}",
1710
+ "erwartet": "6\\sqrt{2}",
1711
+ "tps": 18.9792139034894,
1712
+ "tokens": 556,
1713
+ "denk_zeichen": 0,
1714
+ "abbruch": "stop",
1715
+ "sekunden": 30.12
1716
+ },
1717
+ {
1718
+ "id": "test/prealgebra/2019.json",
1719
+ "ok": true,
1720
+ "level": 2,
1721
+ "thema": "Prealgebra",
1722
+ "gegeben": "4.5",
1723
+ "erwartet": "4.5",
1724
+ "tps": 18.421681903858605,
1725
+ "tokens": 257,
1726
+ "denk_zeichen": 0,
1727
+ "abbruch": "stop",
1728
+ "sekunden": 14.81
1729
+ },
1730
+ {
1731
+ "id": "test/number_theory/410.json",
1732
+ "ok": true,
1733
+ "level": 2,
1734
+ "thema": "Number Theory",
1735
+ "gegeben": "0,35625",
1736
+ "erwartet": ".35625",
1737
+ "tps": 18.759625499890728,
1738
+ "tokens": 880,
1739
+ "denk_zeichen": 0,
1740
+ "abbruch": "stop",
1741
+ "sekunden": 47.34,
1742
+ "neubewertet": true
1743
+ },
1744
+ {
1745
+ "id": "test/counting_and_probability/10.json",
1746
+ "ok": false,
1747
+ "level": 4,
1748
+ "thema": "Counting & Probability",
1749
+ "gegeben": "",
1750
+ "erwartet": "4",
1751
+ "tps": 18.7776174743006,
1752
+ "tokens": 1600,
1753
+ "denk_zeichen": 0,
1754
+ "abbruch": "length",
1755
+ "sekunden": 85.89
1756
+ },
1757
+ {
1758
+ "id": "test/algebra/2080.json",
1759
+ "ok": true,
1760
+ "level": 3,
1761
+ "thema": "Algebra",
1762
+ "gegeben": "14",
1763
+ "erwartet": "14",
1764
+ "tps": 18.855710037504792,
1765
+ "tokens": 553,
1766
+ "denk_zeichen": 0,
1767
+ "abbruch": "stop",
1768
+ "sekunden": 29.96
1769
+ },
1770
+ {
1771
+ "id": "test/algebra/668.json",
1772
+ "ok": true,
1773
+ "level": 4,
1774
+ "thema": "Algebra",
1775
+ "gegeben": "45",
1776
+ "erwartet": "45",
1777
+ "tps": 18.816684084565168,
1778
+ "tokens": 478,
1779
+ "denk_zeichen": 0,
1780
+ "abbruch": "stop",
1781
+ "sekunden": 26.04
1782
+ },
1783
+ {
1784
+ "id": "test/algebra/2430.json",
1785
+ "ok": true,
1786
+ "level": 4,
1787
+ "thema": "Algebra",
1788
+ "gegeben": "8",
1789
+ "erwartet": "8",
1790
+ "tps": 18.474708335830712,
1791
+ "tokens": 1048,
1792
+ "denk_zeichen": 0,
1793
+ "abbruch": "stop",
1794
+ "sekunden": 57.33
1795
+ },
1796
+ {
1797
+ "id": "test/number_theory/13.json",
1798
+ "ok": true,
1799
+ "level": 5,
1800
+ "thema": "Number Theory",
1801
+ "gegeben": "64",
1802
+ "erwartet": "64",
1803
+ "tps": 18.396692997779343,
1804
+ "tokens": 1160,
1805
+ "denk_zeichen": 0,
1806
+ "abbruch": "stop",
1807
+ "sekunden": 63.68
1808
+ },
1809
+ {
1810
+ "id": "test/algebra/2476.json",
1811
+ "ok": true,
1812
+ "level": 2,
1813
+ "thema": "Algebra",
1814
+ "gegeben": "10",
1815
+ "erwartet": "10",
1816
+ "tps": 18.728514464265825,
1817
+ "tokens": 504,
1818
+ "denk_zeichen": 0,
1819
+ "abbruch": "stop",
1820
+ "sekunden": 27.54
1821
+ },
1822
+ {
1823
+ "id": "test/intermediate_algebra/1102.json",
1824
+ "ok": false,
1825
+ "level": 1,
1826
+ "thema": "Intermediate Algebra",
1827
+ "gegeben": "",
1828
+ "erwartet": "-2,1",
1829
+ "tps": 19.06285844131013,
1830
+ "tokens": 1600,
1831
+ "denk_zeichen": 0,
1832
+ "abbruch": "length",
1833
+ "sekunden": 84.38
1834
+ },
1835
+ {
1836
+ "id": "test/prealgebra/914.json",
1837
+ "ok": true,
1838
+ "level": 4,
1839
+ "thema": "Prealgebra",
1840
+ "gegeben": "75",
1841
+ "erwartet": "75^\\circ",
1842
+ "tps": 19.119337693560826,
1843
+ "tokens": 851,
1844
+ "denk_zeichen": 0,
1845
+ "abbruch": "stop",
1846
+ "sekunden": 45.37
1847
+ },
1848
+ {
1849
+ "id": "test/algebra/1425.json",
1850
+ "ok": true,
1851
+ "level": 2,
1852
+ "thema": "Algebra",
1853
+ "gegeben": "2",
1854
+ "erwartet": "2",
1855
+ "tps": 19.729316666083697,
1856
+ "tokens": 273,
1857
+ "denk_zeichen": 0,
1858
+ "abbruch": "stop",
1859
+ "sekunden": 14.65
1860
+ },
1861
+ {
1862
+ "id": "test/precalculus/703.json",
1863
+ "ok": false,
1864
+ "level": 5,
1865
+ "thema": "Precalculus",
1866
+ "gegeben": "",
1867
+ "erwartet": "8 \\pi",
1868
+ "tps": 18.240889852626037,
1869
+ "tokens": 1600,
1870
+ "denk_zeichen": 0,
1871
+ "abbruch": "length",
1872
+ "sekunden": 88.7
1873
+ },
1874
+ {
1875
+ "id": "test/intermediate_algebra/158.json",
1876
+ "ok": true,
1877
+ "level": 5,
1878
+ "thema": "Intermediate Algebra",
1879
+ "gegeben": "27648",
1880
+ "erwartet": "27648",
1881
+ "tps": 18.73493776018128,
1882
+ "tokens": 1376,
1883
+ "denk_zeichen": 0,
1884
+ "abbruch": "stop",
1885
+ "sekunden": 73.93
1886
+ },
1887
+ {
1888
+ "id": "test/prealgebra/1930.json",
1889
+ "ok": true,
1890
+ "level": 5,
1891
+ "thema": "Prealgebra",
1892
+ "gegeben": "7",
1893
+ "erwartet": "7",
1894
+ "tps": 18.720610922668612,
1895
+ "tokens": 964,
1896
+ "denk_zeichen": 0,
1897
+ "abbruch": "stop",
1898
+ "sekunden": 52.14
1899
+ },
1900
+ {
1901
+ "id": "test/prealgebra/1252.json",
1902
+ "ok": true,
1903
+ "level": 2,
1904
+ "thema": "Prealgebra",
1905
+ "gegeben": "200",
1906
+ "erwartet": "200",
1907
+ "tps": 18.311135464006075,
1908
+ "tokens": 578,
1909
+ "denk_zeichen": 0,
1910
+ "abbruch": "stop",
1911
+ "sekunden": 32.16
1912
+ },
1913
+ {
1914
+ "id": "test/precalculus/1252.json",
1915
+ "ok": true,
1916
+ "level": 2,
1917
+ "thema": "Precalculus",
1918
+ "gegeben": "1",
1919
+ "erwartet": "1",
1920
+ "tps": 18.592225970580838,
1921
+ "tokens": 837,
1922
+ "denk_zeichen": 0,
1923
+ "abbruch": "stop",
1924
+ "sekunden": 45.65
1925
+ },
1926
+ {
1927
+ "id": "test/precalculus/1082.json",
1928
+ "ok": true,
1929
+ "level": 3,
1930
+ "thema": "Precalculus",
1931
+ "gegeben": "\\frac{8}{15}",
1932
+ "erwartet": "\\frac{8}{15}",
1933
+ "tps": 18.91045058562924,
1934
+ "tokens": 1283,
1935
+ "denk_zeichen": 0,
1936
+ "abbruch": "stop",
1937
+ "sekunden": 68.31
1938
+ },
1939
+ {
1940
+ "id": "test/geometry/477.json",
1941
+ "ok": true,
1942
+ "level": 3,
1943
+ "thema": "Geometry",
1944
+ "gegeben": "216",
1945
+ "erwartet": "216",
1946
+ "tps": 18.698394705166788,
1947
+ "tokens": 596,
1948
+ "denk_zeichen": 0,
1949
+ "abbruch": "stop",
1950
+ "sekunden": 32.34
1951
+ },
1952
+ {
1953
+ "id": "test/intermediate_algebra/1350.json",
1954
+ "ok": false,
1955
+ "level": 5,
1956
+ "thema": "Intermediate Algebra",
1957
+ "gegeben": "",
1958
+ "erwartet": "14",
1959
+ "tps": 18.239287482234506,
1960
+ "tokens": 1600,
1961
+ "denk_zeichen": 0,
1962
+ "abbruch": "length",
1963
+ "sekunden": 88.4
1964
+ },
1965
+ {
1966
+ "id": "test/algebra/2779.json",
1967
+ "ok": true,
1968
+ "level": 5,
1969
+ "thema": "Algebra",
1970
+ "gegeben": "20",
1971
+ "erwartet": "20",
1972
+ "tps": 18.413862815718936,
1973
+ "tokens": 771,
1974
+ "denk_zeichen": 0,
1975
+ "abbruch": "stop",
1976
+ "sekunden": 42.44
1977
+ },
1978
+ {
1979
+ "id": "test/intermediate_algebra/1232.json",
1980
+ "ok": true,
1981
+ "level": 3,
1982
+ "thema": "Intermediate Algebra",
1983
+ "gegeben": "\\frac{5}{13}",
1984
+ "erwartet": "\\frac{5}{13}",
1985
+ "tps": 18.939428429903174,
1986
+ "tokens": 416,
1987
+ "denk_zeichen": 0,
1988
+ "abbruch": "stop",
1989
+ "sekunden": 22.61
1990
+ }
1991
+ ],
1992
+ "quote_vor_neubewertung": 72.0,
1993
+ "neubewertet": 6
1994
+ }