category: ocr

prompt: What four digit code is shown? Answer only the four digits.


category: ocr

prompt: What four digit code is shown? Answer only the four digits.


category: ocr

prompt: What four digit code is shown? Answer only the four digits.


category: ocr

prompt: What four digit code is shown? Answer only the four digits.


category: counting

prompt: How many purple circles are visible? Answer only the number.


category: counting

prompt: How many purple circles are visible? Answer only the number.


category: counting

prompt: How many blue circles are visible? Answer only the number.


category: counting

prompt: How many green circles are visible? Answer only the number.


category: spatial

prompt: What color square is directly above the blue square? Answer only the color.

expected: green

raw_response: green


category: spatial

prompt: What color square is directly above the blue square? Answer only the color.

expected: red

raw_response: red


category: spatial

prompt: What color square is directly above the blue square? Answer only the color.

expected: green

raw_response: green


category: spatial

prompt: What color square is directly above the blue square? Answer only the color.

expected: yellow

raw_response: yellow


category: chart

prompt: Which option has the tallest bar? Answer only A, B, C, or D.

expected: A

raw_response: A


category: chart

prompt: Which option has the tallest bar? Answer only A, B, C, or D.

expected: A

raw_response: A


category: chart

prompt: Which option has the tallest bar? Answer only A, B, C, or D.

expected: D

raw_response: D


category: chart

prompt: Which option has the tallest bar? Answer only A, B, C, or D.

expected: B

raw_response: B


category: table

prompt: What is the total for Adapter? Answer only the dollar amount without words.


category: table

prompt: What is the total for Cable? Answer only the dollar amount without words.


category: table

prompt: What is the total for Cable? Answer only the dollar amount without words.


category: table

prompt: What is the total for Sensor? Answer only the dollar amount without words.


category: ui

prompt: What word is written on the red button? Answer only the word.

expected: Delete

raw_response: Delete


category: ui

prompt: What word is written on the red button? Answer only the word.

expected: Cancel

raw_response: Cancel


category: ui

prompt: What word is written on the red button? Answer only the word.

expected: Cancel

raw_response: Cancel


category: ui

prompt: What word is written on the red button? Answer only the word.

expected: Delete

raw_response: Delete