Answer Correctness
Definition:
The rewrite answer must be factually correct based strictly on the image and any constraints in the prompt.
- Re-derive the answer yourself from the image before submitting — don't trust your first read of a value.
- Follow your own prompt's steps literally. If the steps produce a different number than your Rewrite Answer, one of the two is wrong.
- Check the math: rounding, percentages applied consecutively (compounding), and units.
- Match every format constraint your prompt states (decimals, separators, percent signs, bare letter for MCQs).
- Run Check My Work and Verify Submission, then check the answer again yourself.
VQA examples of incorrect answers live in the appendix under Bad Examples → Answer incorrect.
Disagree with an Answer Correctness Return?
If a task comes back for Answer Correctness and you still believe your original answer was right, first check whether the real issue is Prompt Clarity. Your question may support more than one reasonable reading. If the reviewer or auditor interpreted it differently than you did, their rewrite will differ from yours, and your answer will look wrong even though the actual problem is the ambiguous wording. Tighten the prompt so only one interpretation is possible.
Use the validation tools, but don't trust them blindly
Both validation tools — the Handshake Shadow Task quality checker and the SuperAnnotate Check My Work (Verify Submission) feature — are useful for catching mistakes you'd otherwise miss. Run them, but own the answer yourself: a flag is a prompt to look again rather than proof of an error, and a clean pass is not proof your answer is right.
Check it twice, then once more
Whatever you submit is what gets scored, so verify the answer against the image, verify it against your prompt's own instructions, and only then submit.
Knowledge Check
In this picture, a sunflower is made up of a variety of colored shapes. How many green triangles are part of the sunflower (including the leaves and stems)? Answer as an integer (e.g., 2).