Instructions to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
# Run inference directly in the terminal:
llama cli -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
# Run inference directly in the terminal:
llama cli -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Use Docker

docker model run hf.co/Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

LM Studio
Jan

vLLM

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Davidmg0815/Qwen3.8-27B-MTP-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Davidmg0815/Qwen3.8-27B-MTP-GGUF",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Ollama
How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Ollama:
```
ollama run hf.co/Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
```

Unsloth Studio

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Davidmg0815/Qwen3.8-27B-MTP-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Davidmg0815/Qwen3.8-27B-MTP-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for Davidmg0815/Qwen3.8-27B-MTP-GGUF to start chatting

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Docker Model Runner:
```
docker model run hf.co/Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0
```

Lemonade

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Run and chat with the model

lemonade run user.Qwen3.8-27B-MTP-GGUF-Q8_0

List all available models

lemonade list

Hermes Agent

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use Davidmg0815/Qwen3.8-27B-MTP-GGUF with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "Davidmg0815/Qwen3.8-27B-MTP-GGUF:Q8_0" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Qwen3.8-27B-MTP-GGUF / bench /math500 /neubewertet /q38-q8.json

Davidmg0815

Omega-Messung: MATH-500 mit vollem Reasoning, Fehleranalyse, korrigierter Antwortvergleich

52467f4 verified 9 days ago

Raw

History Blame

41 kB

	{
	"modell": "Qwen3.8-27B Q8_0",
	"satz": "math500",
	"reasoning": false,
	"n": 150,
	"bestanden": 114,
	"quote": 76.0,
	"tps_median": 18.6,
	"tokens_je_aufgabe": 935.2,
	"am_limit": 34,
	"nach_level": {
	"1": [
	7,
	8
	],
	"2": [
	31,
	33
	],
	"3": [
	30,
	36
	],
	"4": [
	25,
	35
	],
	"5": [
	21,
	38
	]
	},
	"dauer_s": 7779.8,
	"aufgaben": [
	{
	"id": "test/precalculus/807.json",
	"ok": true,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "(3, \\frac{\\pi}{2})",
	"erwartet": "\\left( 3, \\frac{\\pi}{2} \\right)",
	"tps": 18.246701385253676,
	"tokens": 366,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 20.35
	},
	{
	"id": "test/number_theory/572.json",
	"ok": true,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "9",
	"erwartet": "9",
	"tps": 17.688830353252907,
	"tokens": 635,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 36.56
	},
	{
	"id": "test/number_theory/515.json",
	"ok": true,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "27",
	"erwartet": "27",
	"tps": 17.862779163494228,
	"tokens": 830,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 46.87
	},
	{
	"id": "test/number_theory/1032.json",
	"ok": false,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "",
	"erwartet": "2220",
	"tps": 18.612660017255102,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.38
	},
	{
	"id": "test/geometry/248.json",
	"ok": true,
	"level": 2,
	"thema": "Geometry",
	"gegeben": "5",
	"erwartet": "5",
	"tps": 19.0335138909541,
	"tokens": 309,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 16.92
	},
	{
	"id": "test/intermediate_algebra/134.json",
	"ok": true,
	"level": 1,
	"thema": "Intermediate Algebra",
	"gegeben": "-50",
	"erwartet": "-50",
	"tps": 18.128252980260292,
	"tokens": 518,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 28.98
	},
	{
	"id": "test/algebra/1098.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "6+9i",
	"erwartet": "6+9i",
	"tps": 18.852093705832235,
	"tokens": 245,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 13.41
	},
	{
	"id": "test/algebra/2193.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "5",
	"erwartet": "x=5",
	"tps": 18.841275610601453,
	"tokens": 804,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 43.27,
	"neubewertet": true
	},
	{
	"id": "test/counting_and_probability/525.json",
	"ok": false,
	"level": 5,
	"thema": "Counting & Probability",
	"gegeben": "",
	"erwartet": "144",
	"tps": 18.789640195653234,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 85.58
	},
	{
	"id": "test/number_theory/864.json",
	"ok": true,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "52_8",
	"erwartet": "52_8",
	"tps": 17.466000978383324,
	"tokens": 608,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 35.5
	},
	{
	"id": "test/algebra/1072.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "\\frac{243}{625}",
	"erwartet": "\\frac{243}{625}",
	"tps": 17.48507061782896,
	"tokens": 1076,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 61.95
	},
	{
	"id": "test/intermediate_algebra/428.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "3, 5, 7",
	"erwartet": "3, 5, 7",
	"tps": 17.875274070010963,
	"tokens": 1105,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 62.23
	},
	{
	"id": "test/prealgebra/930.json",
	"ok": true,
	"level": 2,
	"thema": "Prealgebra",
	"gegeben": "12",
	"erwartet": "12",
	"tps": 19.039280961796734,
	"tokens": 371,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 20.16
	},
	{
	"id": "test/intermediate_algebra/1454.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "70 \\sqrt{2}",
	"tps": 18.615381631553735,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.57
	},
	{
	"id": "test/precalculus/285.json",
	"ok": false,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "",
	"erwartet": "6",
	"tps": 17.59745141390408,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 91.36
	},
	{
	"id": "test/number_theory/1055.json",
	"ok": true,
	"level": 5,
	"thema": "Number Theory",
	"gegeben": "203",
	"erwartet": "203",
	"tps": 18.612226291576608,
	"tokens": 1235,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 67.09
	},
	{
	"id": "test/precalculus/1105.json",
	"ok": true,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "-\\frac{\\pi}{6}",
	"erwartet": "-\\frac{\\pi}{6}",
	"tps": 19.022645865445128,
	"tokens": 608,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 32.56
	},
	{
	"id": "test/algebra/769.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "11",
	"erwartet": "11",
	"tps": 19.23023972679074,
	"tokens": 396,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 20.99
	},
	{
	"id": "test/intermediate_algebra/956.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "(6,31,-1)",
	"tps": 18.178699915054345,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.43
	},
	{
	"id": "test/intermediate_algebra/279.json",
	"ok": true,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "10",
	"erwartet": "10",
	"tps": 17.47481665339154,
	"tokens": 1575,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 90.82
	},
	{
	"id": "test/algebra/2046.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "x^3 + 3x - 6",
	"erwartet": "x^3+3x-6",
	"tps": 18.64128652822877,
	"tokens": 579,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 31.51
	},
	{
	"id": "test/number_theory/46.json",
	"ok": true,
	"level": 2,
	"thema": "Number Theory",
	"gegeben": "40_9",
	"erwartet": "40_9",
	"tps": 18.832804116938576,
	"tokens": 516,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 27.99
	},
	{
	"id": "test/algebra/2253.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "\\frac{3\\sqrt{3}}{4}",
	"erwartet": "\\frac{3\\sqrt{3}}{4}",
	"tps": 18.71537298652032,
	"tokens": 491,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 26.83
	},
	{
	"id": "test/intermediate_algebra/623.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "0",
	"erwartet": "0",
	"tps": 18.05361715409941,
	"tokens": 363,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 20.69
	},
	{
	"id": "test/intermediate_algebra/1849.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "501",
	"tps": 18.458090064358515,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.1
	},
	{
	"id": "test/intermediate_algebra/2046.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "2",
	"erwartet": "2",
	"tps": 17.45756996797487,
	"tokens": 826,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 48.01
	},
	{
	"id": "test/prealgebra/307.json",
	"ok": true,
	"level": 1,
	"thema": "Prealgebra",
	"gegeben": "240",
	"erwartet": "240",
	"tps": 17.674684321585747,
	"tokens": 248,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 14.75
	},
	{
	"id": "test/prealgebra/1761.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "\\frac{3}{2}",
	"erwartet": "\\frac{3}{2}",
	"tps": 17.380362940176788,
	"tokens": 273,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 16.15
	},
	{
	"id": "test/algebra/873.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "33",
	"erwartet": "33",
	"tps": 18.426654855870673,
	"tokens": 748,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 41.05
	},
	{
	"id": "test/intermediate_algebra/662.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "1 \\pm \\sqrt{19}",
	"tps": 18.769437658966872,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.04
	},
	{
	"id": "test/geometry/183.json",
	"ok": false,
	"level": 5,
	"thema": "Geometry",
	"gegeben": "",
	"erwartet": "145^\\circ",
	"tps": 17.386758655370244,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 92.75
	},
	{
	"id": "test/intermediate_algebra/558.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "(3,4]",
	"tps": 18.178638779210786,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.57
	},
	{
	"id": "test/intermediate_algebra/515.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "\\frac{4}{3}",
	"erwartet": "\\frac43",
	"tps": 18.77320183366981,
	"tokens": 700,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 37.94,
	"neubewertet": true
	},
	{
	"id": "test/intermediate_algebra/345.json",
	"ok": false,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "504",
	"tps": 18.53301481104103,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.02
	},
	{
	"id": "test/algebra/2593.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "8000",
	"erwartet": "8000",
	"tps": 18.449755634550158,
	"tokens": 531,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.42
	},
	{
	"id": "test/algebra/2157.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "2",
	"erwartet": "2",
	"tps": 18.684866036492405,
	"tokens": 562,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 30.53
	},
	{
	"id": "test/intermediate_algebra/128.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "even",
	"erwartet": "\\text{even}",
	"tps": 18.612117075594814,
	"tokens": 1578,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 85.4
	},
	{
	"id": "test/geometry/283.json",
	"ok": false,
	"level": 4,
	"thema": "Geometry",
	"gegeben": "",
	"erwartet": "8",
	"tps": 18.681858941176223,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.31
	},
	{
	"id": "test/intermediate_algebra/1063.json",
	"ok": false,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "1+274i",
	"tps": 18.643680841484397,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.32
	},
	{
	"id": "test/number_theory/753.json",
	"ok": true,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "13",
	"erwartet": "13",
	"tps": 18.49881115911556,
	"tokens": 1076,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 58.8
	},
	{
	"id": "test/prealgebra/1807.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "120",
	"erwartet": "120",
	"tps": 18.49112745588527,
	"tokens": 535,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.55
	},
	{
	"id": "test/intermediate_algebra/2022.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "64",
	"tps": 18.66090184756341,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.23
	},
	{
	"id": "test/number_theory/156.json",
	"ok": true,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "13",
	"erwartet": "13",
	"tps": 18.27015256741804,
	"tokens": 659,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 36.52
	},
	{
	"id": "test/precalculus/477.json",
	"ok": true,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "3\\sqrt{5}",
	"erwartet": "3 \\sqrt{5}",
	"tps": 18.10574066801964,
	"tokens": 749,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 42.02
	},
	{
	"id": "test/algebra/1519.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "\\frac{\\sqrt{3}}{3}",
	"erwartet": "\\frac{\\sqrt{3}}{3}",
	"tps": 17.710948837223746,
	"tokens": 422,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 24.52
	},
	{
	"id": "test/intermediate_algebra/964.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "1",
	"tps": 18.71549520650549,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.25
	},
	{
	"id": "test/counting_and_probability/230.json",
	"ok": true,
	"level": 4,
	"thema": "Counting & Probability",
	"gegeben": "\\frac{2}{21}",
	"erwartet": "\\frac{2}{21}",
	"tps": 18.140092720046578,
	"tokens": 863,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 48.61
	},
	{
	"id": "test/precalculus/117.json",
	"ok": false,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "",
	"erwartet": "30^\\circ",
	"tps": 18.43267728439568,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.38
	},
	{
	"id": "test/number_theory/521.json",
	"ok": true,
	"level": 2,
	"thema": "Number Theory",
	"gegeben": "18",
	"erwartet": "18",
	"tps": 18.906703985579195,
	"tokens": 781,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 42.24
	},
	{
	"id": "test/algebra/2517.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "-\\frac{35}{9}",
	"erwartet": "-\\frac{35}{9}",
	"tps": 18.465120594794765,
	"tokens": 1078,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 59.01
	},
	{
	"id": "test/prealgebra/1003.json",
	"ok": false,
	"level": 5,
	"thema": "Prealgebra",
	"gegeben": "",
	"erwartet": "\\frac{270}7\\text{ degrees}",
	"tps": 17.808601895304943,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 90.69
	},
	{
	"id": "test/algebra/297.json",
	"ok": false,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "",
	"erwartet": "1736",
	"tps": 18.58923873849104,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.78
	},
	{
	"id": "test/algebra/686.json",
	"ok": false,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "",
	"erwartet": "4",
	"tps": 18.52351836772979,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.5
	},
	{
	"id": "test/number_theory/598.json",
	"ok": true,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "0.0000672",
	"erwartet": ".0000672",
	"tps": 18.881146905084602,
	"tokens": 588,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 31.88
	},
	{
	"id": "test/prealgebra/1908.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "3",
	"erwartet": "3",
	"tps": 18.759942421216987,
	"tokens": 606,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 32.94
	},
	{
	"id": "test/algebra/1082.json",
	"ok": false,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "",
	"erwartet": "23",
	"tps": 18.362185548576665,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.97
	},
	{
	"id": "test/number_theory/978.json",
	"ok": true,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "7",
	"erwartet": "7",
	"tps": 17.9628427553167,
	"tokens": 862,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 48.78
	},
	{
	"id": "test/counting_and_probability/51.json",
	"ok": true,
	"level": 5,
	"thema": "Counting & Probability",
	"gegeben": "\\frac{13}{18}",
	"erwartet": "\\frac{13}{18}",
	"tps": 18.578332564295604,
	"tokens": 612,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 33.4
	},
	{
	"id": "test/intermediate_algebra/1422.json",
	"ok": false,
	"level": 3,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "4",
	"tps": 18.418774247380966,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.59
	},
	{
	"id": "test/algebra/1937.json",
	"ok": true,
	"level": 1,
	"thema": "Algebra",
	"gegeben": "1600",
	"erwartet": "1600",
	"tps": 17.78336623598338,
	"tokens": 433,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 24.81
	},
	{
	"id": "test/prealgebra/2086.json",
	"ok": true,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "40",
	"erwartet": "40",
	"tps": 18.375900193558792,
	"tokens": 886,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 48.65
	},
	{
	"id": "test/intermediate_algebra/1555.json",
	"ok": true,
	"level": 3,
	"thema": "Intermediate Algebra",
	"gegeben": "12",
	"erwartet": "12",
	"tps": 18.678749275369526,
	"tokens": 845,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 46.25
	},
	{
	"id": "test/precalculus/541.json",
	"ok": true,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "\\left(\\frac{3}{2}, -13\\right)",
	"erwartet": "\\left( \\frac{3}{2}, -13 \\right)",
	"tps": 18.24443942368786,
	"tokens": 516,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 28.76
	},
	{
	"id": "test/prealgebra/378.json",
	"ok": false,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "",
	"erwartet": "10",
	"tps": 8.948005327709483,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 179.63
	},
	{
	"id": "test/intermediate_algebra/102.json",
	"ok": false,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "2",
	"tps": 18.806248018585464,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.0
	},
	{
	"id": "test/prealgebra/1436.json",
	"ok": true,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "6",
	"erwartet": "6",
	"tps": 19.035231366549205,
	"tokens": 555,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.89
	},
	{
	"id": "test/prealgebra/1961.json",
	"ok": true,
	"level": 5,
	"thema": "Prealgebra",
	"gegeben": "\\frac{16}{27}",
	"erwartet": "\\frac{16}{27}",
	"tps": 18.79127117686664,
	"tokens": 582,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 31.84
	},
	{
	"id": "test/number_theory/183.json",
	"ok": true,
	"level": 3,
	"thema": "Number Theory",
	"gegeben": "14",
	"erwartet": "14",
	"tps": 18.33965250097663,
	"tokens": 824,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 45.36
	},
	{
	"id": "test/counting_and_probability/71.json",
	"ok": true,
	"level": 3,
	"thema": "Counting & Probability",
	"gegeben": "3",
	"erwartet": "3",
	"tps": 18.884739391844285,
	"tokens": 681,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 36.8
	},
	{
	"id": "test/intermediate_algebra/986.json",
	"ok": true,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "\\frac{16}{5}",
	"erwartet": "\\frac{16}{5}",
	"tps": 18.341788982698752,
	"tokens": 939,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 52.06
	},
	{
	"id": "test/precalculus/441.json",
	"ok": true,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "30",
	"erwartet": "30^\\circ",
	"tps": 18.256401477738393,
	"tokens": 677,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 37.78
	},
	{
	"id": "test/precalculus/989.json",
	"ok": false,
	"level": 4,
	"thema": "Precalculus",
	"gegeben": "",
	"erwartet": "12",
	"tps": 18.724559102461665,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.1
	},
	{
	"id": "test/prealgebra/874.json",
	"ok": false,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "",
	"erwartet": "116",
	"tps": 18.282957842515906,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.38
	},
	{
	"id": "test/geometry/254.json",
	"ok": true,
	"level": 2,
	"thema": "Geometry",
	"gegeben": "3",
	"erwartet": "3",
	"tps": 18.410563143569682,
	"tokens": 466,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 25.97
	},
	{
	"id": "test/algebra/1787.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "8",
	"erwartet": "8",
	"tps": 18.475315583733742,
	"tokens": 616,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 33.98
	},
	{
	"id": "test/algebra/1934.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "13",
	"erwartet": "13",
	"tps": 18.65205676358567,
	"tokens": 725,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 39.53
	},
	{
	"id": "test/prealgebra/1458.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "\\frac{1}{8}",
	"erwartet": "\\frac{1}{8}",
	"tps": 18.657976926247073,
	"tokens": 227,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 12.61
	},
	{
	"id": "test/prealgebra/1995.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "\\frac{8}{21}",
	"erwartet": "\\frac{8}{21}",
	"tps": 18.66347542845983,
	"tokens": 547,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.93
	},
	{
	"id": "test/precalculus/580.json",
	"ok": true,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "120",
	"erwartet": "120^\\circ",
	"tps": 17.862253925733537,
	"tokens": 843,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 47.85
	},
	{
	"id": "test/geometry/483.json",
	"ok": true,
	"level": 4,
	"thema": "Geometry",
	"gegeben": "15",
	"erwartet": "15",
	"tps": 18.45395345463625,
	"tokens": 690,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 38.01
	},
	{
	"id": "test/prealgebra/1742.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "\\frac{33}{100}",
	"erwartet": "\\dfrac{33}{100}",
	"tps": 18.522047648179367,
	"tokens": 481,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 26.58
	},
	{
	"id": "test/algebra/2551.json",
	"ok": true,
	"level": 1,
	"thema": "Algebra",
	"gegeben": "10",
	"erwartet": "10",
	"tps": 19.41551124753969,
	"tokens": 536,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 28.08
	},
	{
	"id": "test/prealgebra/993.json",
	"ok": true,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "1250",
	"erwartet": "1250",
	"tps": 18.251111061791107,
	"tokens": 898,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 50.11
	},
	{
	"id": "test/algebra/1282.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "11",
	"erwartet": "11",
	"tps": 18.816777960868013,
	"tokens": 980,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 52.53
	},
	{
	"id": "test/number_theory/1287.json",
	"ok": true,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "8",
	"erwartet": "8",
	"tps": 18.792563787172583,
	"tokens": 806,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 43.73
	},
	{
	"id": "test/prealgebra/1787.json",
	"ok": true,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "1",
	"erwartet": "1",
	"tps": 19.092982711475646,
	"tokens": 501,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 26.95
	},
	{
	"id": "test/intermediate_algebra/960.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "\\frac{17}{21}",
	"tps": 18.354339377654366,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 87.98
	},
	{
	"id": "test/algebra/634.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "4",
	"erwartet": "4",
	"tps": 18.674866284070664,
	"tokens": 1009,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 54.85
	},
	{
	"id": "test/algebra/2486.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "\\left( \\frac{3}{5}, \\frac{8}{3} \\right]",
	"erwartet": "\\left(\\frac{3}{5},\\frac{8}{3}\\right]",
	"tps": 18.0319642502723,
	"tokens": 584,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 32.84
	},
	{
	"id": "test/intermediate_algebra/754.json",
	"ok": true,
	"level": 2,
	"thema": "Intermediate Algebra",
	"gegeben": "B",
	"erwartet": "\\text{(B)}",
	"tps": 18.717626117898945,
	"tokens": 1328,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 71.47,
	"neubewertet": true
	},
	{
	"id": "test/counting_and_probability/339.json",
	"ok": true,
	"level": 4,
	"thema": "Counting & Probability",
	"gegeben": "12",
	"erwartet": "12",
	"tps": 17.62419249465696,
	"tokens": 579,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 33.79
	},
	{
	"id": "test/geometry/965.json",
	"ok": true,
	"level": 5,
	"thema": "Geometry",
	"gegeben": "28",
	"erwartet": "28",
	"tps": 18.77850160510578,
	"tokens": 1441,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 77.9
	},
	{
	"id": "test/intermediate_algebra/1544.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "6",
	"tps": 18.720138089098615,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 85.94
	},
	{
	"id": "test/algebra/1842.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "49",
	"erwartet": "49",
	"tps": 18.85629220953977,
	"tokens": 558,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 30.39
	},
	{
	"id": "test/prealgebra/1423.json",
	"ok": true,
	"level": 5,
	"thema": "Prealgebra",
	"gegeben": "12\\pi",
	"erwartet": "12\\pi",
	"tps": 18.353478086732018,
	"tokens": 456,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 25.5
	},
	{
	"id": "test/algebra/276.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "12",
	"erwartet": "12",
	"tps": 18.41010276450896,
	"tokens": 968,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 53.03
	},
	{
	"id": "test/geometry/947.json",
	"ok": true,
	"level": 5,
	"thema": "Geometry",
	"gegeben": "-\\frac{24}{25}",
	"erwartet": "-\\frac{24}{25}",
	"tps": 18.402569016174834,
	"tokens": 1259,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 68.96
	},
	{
	"id": "test/counting_and_probability/870.json",
	"ok": true,
	"level": 5,
	"thema": "Counting & Probability",
	"gegeben": "\\frac{1}{3}",
	"erwartet": "\\frac{1}{3}",
	"tps": 18.194509848094196,
	"tokens": 922,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 51.13
	},
	{
	"id": "test/precalculus/742.json",
	"ok": false,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "-0.09",
	"erwartet": "\\frac{9}{100}",
	"tps": 18.45402728354076,
	"tokens": 887,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 48.53
	},
	{
	"id": "test/counting_and_probability/216.json",
	"ok": true,
	"level": 5,
	"thema": "Counting & Probability",
	"gegeben": "1940",
	"erwartet": "1940",
	"tps": 18.497474518768918,
	"tokens": 1108,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 60.53
	},
	{
	"id": "test/intermediate_algebra/776.json",
	"ok": true,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "3",
	"erwartet": "3",
	"tps": 18.746318546535875,
	"tokens": 1130,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 61.2
	},
	{
	"id": "test/algebra/2592.json",
	"ok": true,
	"level": 1,
	"thema": "Algebra",
	"gegeben": "26000",
	"erwartet": "26000",
	"tps": 18.507923402947267,
	"tokens": 276,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 15.56
	},
	{
	"id": "test/precalculus/801.json",
	"ok": false,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "",
	"erwartet": "55^\\circ",
	"tps": 18.57102766936876,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.65
	},
	{
	"id": "test/counting_and_probability/737.json",
	"ok": true,
	"level": 2,
	"thema": "Counting & Probability",
	"gegeben": "58500",
	"erwartet": "58,500",
	"tps": 18.716628153254305,
	"tokens": 616,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 33.65
	},
	{
	"id": "test/algebra/1338.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "66",
	"erwartet": "66",
	"tps": 19.336495738042014,
	"tokens": 806,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 42.31
	},
	{
	"id": "test/number_theory/686.json",
	"ok": true,
	"level": 2,
	"thema": "Number Theory",
	"gegeben": "4",
	"erwartet": "4",
	"tps": 18.336165609674293,
	"tokens": 513,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 28.92
	},
	{
	"id": "test/counting_and_probability/1014.json",
	"ok": true,
	"level": 4,
	"thema": "Counting & Probability",
	"gegeben": "480",
	"erwartet": "480",
	"tps": 18.564269350780553,
	"tokens": 930,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 50.8
	},
	{
	"id": "test/algebra/1078.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "(-\\sqrt{3}, \\sqrt{3})",
	"erwartet": "(-\\sqrt{3}, \\sqrt{3})",
	"tps": 18.683125727747868,
	"tokens": 943,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 51.2
	},
	{
	"id": "test/precalculus/96.json",
	"ok": true,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "1.75",
	"erwartet": "\\frac{7}{4}",
	"tps": 18.630950278635254,
	"tokens": 863,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 47.21
	},
	{
	"id": "test/algebra/251.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "2",
	"erwartet": "2",
	"tps": 19.007524327420963,
	"tokens": 430,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 23.36
	},
	{
	"id": "test/number_theory/109.json",
	"ok": true,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "4",
	"erwartet": "4",
	"tps": 18.649980303229,
	"tokens": 1232,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 66.5
	},
	{
	"id": "test/precalculus/1289.json",
	"ok": true,
	"level": 1,
	"thema": "Precalculus",
	"gegeben": "-41",
	"erwartet": "-41",
	"tps": 18.46751024859708,
	"tokens": 318,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 17.86
	},
	{
	"id": "test/algebra/2264.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "1+2i",
	"erwartet": "1+2i",
	"tps": 17.973783888165322,
	"tokens": 880,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 49.68
	},
	{
	"id": "test/geometry/538.json",
	"ok": true,
	"level": 4,
	"thema": "Geometry",
	"gegeben": "(8, -2)",
	"erwartet": "(8,-2)",
	"tps": 18.417127146289815,
	"tokens": 1074,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 58.79
	},
	{
	"id": "test/intermediate_algebra/1992.json",
	"ok": true,
	"level": 4,
	"thema": "Intermediate Algebra",
	"gegeben": "(0, 9) \\cup (9, 36)",
	"erwartet": "(0,9) \\cup (9,36)",
	"tps": 18.79702186494697,
	"tokens": 1467,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 78.51
	},
	{
	"id": "test/algebra/101.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "[-2, 7]",
	"erwartet": "x \\in [-2,7]",
	"tps": 19.236339627670446,
	"tokens": 707,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 37.73,
	"neubewertet": true
	},
	{
	"id": "test/algebra/170.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "11",
	"erwartet": "11",
	"tps": 19.447226000954906,
	"tokens": 566,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.53
	},
	{
	"id": "test/algebra/853.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "12",
	"erwartet": "12",
	"tps": 18.564119924214708,
	"tokens": 1122,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 61.44
	},
	{
	"id": "test/algebra/518.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "\\frac{3}{4}",
	"erwartet": "\\frac 34",
	"tps": 18.916968452444742,
	"tokens": 582,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 31.25,
	"neubewertet": true
	},
	{
	"id": "test/prealgebra/631.json",
	"ok": false,
	"level": 3,
	"thema": "Prealgebra",
	"gegeben": "",
	"erwartet": "2",
	"tps": 18.699707866151325,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.45
	},
	{
	"id": "test/geometry/817.json",
	"ok": false,
	"level": 5,
	"thema": "Geometry",
	"gegeben": "",
	"erwartet": "\\frac{14}{3}",
	"tps": 18.62603450014225,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 86.38
	},
	{
	"id": "test/number_theory/928.json",
	"ok": false,
	"level": 4,
	"thema": "Number Theory",
	"gegeben": "",
	"erwartet": "3",
	"tps": 18.18839514684054,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.45
	},
	{
	"id": "test/number_theory/132.json",
	"ok": true,
	"level": 1,
	"thema": "Number Theory",
	"gegeben": "0",
	"erwartet": "0",
	"tps": 18.100530345539124,
	"tokens": 495,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 27.98
	},
	{
	"id": "test/prealgebra/65.json",
	"ok": true,
	"level": 2,
	"thema": "Prealgebra",
	"gegeben": "6",
	"erwartet": "6",
	"tps": 18.3442975161332,
	"tokens": 750,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 41.58
	},
	{
	"id": "test/algebra/2680.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "5r^5",
	"erwartet": "5r^5",
	"tps": 18.544137537060372,
	"tokens": 324,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 17.91
	},
	{
	"id": "test/precalculus/681.json",
	"ok": true,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "\\frac{1}{8}",
	"erwartet": "\\frac{1}{8}",
	"tps": 18.241553409324272,
	"tokens": 1323,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 72.96
	},
	{
	"id": "test/precalculus/625.json",
	"ok": false,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "\\begin{pmatrix} \\frac{16}{49} \\\\ \\frac{48}{49} \\\\ \\frac{24}{",
	"erwartet": "\\begin{pmatrix} 16/49 \\\\ 48/49 \\\\ 24/49 \\end{pmatrix}",
	"tps": 18.40263210376642,
	"tokens": 663,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 36.55
	},
	{
	"id": "test/number_theory/1002.json",
	"ok": true,
	"level": 5,
	"thema": "Number Theory",
	"gegeben": "1440",
	"erwartet": "1440",
	"tps": 18.620247944079747,
	"tokens": 1209,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 65.56
	},
	{
	"id": "test/geometry/843.json",
	"ok": true,
	"level": 3,
	"thema": "Geometry",
	"gegeben": "6\\sqrt{2}",
	"erwartet": "6\\sqrt{2}",
	"tps": 18.9792139034894,
	"tokens": 556,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 30.12
	},
	{
	"id": "test/prealgebra/2019.json",
	"ok": true,
	"level": 2,
	"thema": "Prealgebra",
	"gegeben": "4.5",
	"erwartet": "4.5",
	"tps": 18.421681903858605,
	"tokens": 257,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 14.81
	},
	{
	"id": "test/number_theory/410.json",
	"ok": true,
	"level": 2,
	"thema": "Number Theory",
	"gegeben": "0,35625",
	"erwartet": ".35625",
	"tps": 18.759625499890728,
	"tokens": 880,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 47.34,
	"neubewertet": true
	},
	{
	"id": "test/counting_and_probability/10.json",
	"ok": false,
	"level": 4,
	"thema": "Counting & Probability",
	"gegeben": "",
	"erwartet": "4",
	"tps": 18.7776174743006,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 85.89
	},
	{
	"id": "test/algebra/2080.json",
	"ok": true,
	"level": 3,
	"thema": "Algebra",
	"gegeben": "14",
	"erwartet": "14",
	"tps": 18.855710037504792,
	"tokens": 553,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 29.96
	},
	{
	"id": "test/algebra/668.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "45",
	"erwartet": "45",
	"tps": 18.816684084565168,
	"tokens": 478,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 26.04
	},
	{
	"id": "test/algebra/2430.json",
	"ok": true,
	"level": 4,
	"thema": "Algebra",
	"gegeben": "8",
	"erwartet": "8",
	"tps": 18.474708335830712,
	"tokens": 1048,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 57.33
	},
	{
	"id": "test/number_theory/13.json",
	"ok": true,
	"level": 5,
	"thema": "Number Theory",
	"gegeben": "64",
	"erwartet": "64",
	"tps": 18.396692997779343,
	"tokens": 1160,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 63.68
	},
	{
	"id": "test/algebra/2476.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "10",
	"erwartet": "10",
	"tps": 18.728514464265825,
	"tokens": 504,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 27.54
	},
	{
	"id": "test/intermediate_algebra/1102.json",
	"ok": false,
	"level": 1,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "-2,1",
	"tps": 19.06285844131013,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 84.38
	},
	{
	"id": "test/prealgebra/914.json",
	"ok": true,
	"level": 4,
	"thema": "Prealgebra",
	"gegeben": "75",
	"erwartet": "75^\\circ",
	"tps": 19.119337693560826,
	"tokens": 851,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 45.37
	},
	{
	"id": "test/algebra/1425.json",
	"ok": true,
	"level": 2,
	"thema": "Algebra",
	"gegeben": "2",
	"erwartet": "2",
	"tps": 19.729316666083697,
	"tokens": 273,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 14.65
	},
	{
	"id": "test/precalculus/703.json",
	"ok": false,
	"level": 5,
	"thema": "Precalculus",
	"gegeben": "",
	"erwartet": "8 \\pi",
	"tps": 18.240889852626037,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.7
	},
	{
	"id": "test/intermediate_algebra/158.json",
	"ok": true,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "27648",
	"erwartet": "27648",
	"tps": 18.73493776018128,
	"tokens": 1376,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 73.93
	},
	{
	"id": "test/prealgebra/1930.json",
	"ok": true,
	"level": 5,
	"thema": "Prealgebra",
	"gegeben": "7",
	"erwartet": "7",
	"tps": 18.720610922668612,
	"tokens": 964,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 52.14
	},
	{
	"id": "test/prealgebra/1252.json",
	"ok": true,
	"level": 2,
	"thema": "Prealgebra",
	"gegeben": "200",
	"erwartet": "200",
	"tps": 18.311135464006075,
	"tokens": 578,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 32.16
	},
	{
	"id": "test/precalculus/1252.json",
	"ok": true,
	"level": 2,
	"thema": "Precalculus",
	"gegeben": "1",
	"erwartet": "1",
	"tps": 18.592225970580838,
	"tokens": 837,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 45.65
	},
	{
	"id": "test/precalculus/1082.json",
	"ok": true,
	"level": 3,
	"thema": "Precalculus",
	"gegeben": "\\frac{8}{15}",
	"erwartet": "\\frac{8}{15}",
	"tps": 18.91045058562924,
	"tokens": 1283,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 68.31
	},
	{
	"id": "test/geometry/477.json",
	"ok": true,
	"level": 3,
	"thema": "Geometry",
	"gegeben": "216",
	"erwartet": "216",
	"tps": 18.698394705166788,
	"tokens": 596,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 32.34
	},
	{
	"id": "test/intermediate_algebra/1350.json",
	"ok": false,
	"level": 5,
	"thema": "Intermediate Algebra",
	"gegeben": "",
	"erwartet": "14",
	"tps": 18.239287482234506,
	"tokens": 1600,
	"denk_zeichen": 0,
	"abbruch": "length",
	"sekunden": 88.4
	},
	{
	"id": "test/algebra/2779.json",
	"ok": true,
	"level": 5,
	"thema": "Algebra",
	"gegeben": "20",
	"erwartet": "20",
	"tps": 18.413862815718936,
	"tokens": 771,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 42.44
	},
	{
	"id": "test/intermediate_algebra/1232.json",
	"ok": true,
	"level": 3,
	"thema": "Intermediate Algebra",
	"gegeben": "\\frac{5}{13}",
	"erwartet": "\\frac{5}{13}",
	"tps": 18.939428429903174,
	"tokens": 416,
	"denk_zeichen": 0,
	"abbruch": "stop",
	"sekunden": 22.61
	}
	],
	"quote_vor_neubewertung": 72.0,
	"neubewertet": 6
	}