Handshake
    Search the playbook
    🦎
    • Welcome
    • Task Overview
    • ☆ Getting Started/Basics
    • Task Workflow
    • Step 0: Task Statuses/Reworks
    • Step 1: Check the Image
    • Step 2: Write a Question
    • Step 3: Generate Model Response
    • Step 4: Evaluate & Rewrite
    • Step 5: Validate your Prompt
    • ⭐ Prompt Writing Strategies
  1. Pre-submission Checklist
  2. Common Errors
  3. Prompt Practice
  4. Training & Updates
    • Recorded Trainings
    • Key Terms
    • Assessment Help
    • Live Meetings + Slack
    • Announcements
    Reference
    • Reviewer Playbook
    • FAQs
    • Appendix
    🦎

    VQA Task Workflow

    The full annotation workflow has a step 0 plus five steps. Each must be followed to produce a high quality annotation.

    Watch Live Workshop - Tasking Walkthrough (November 4th) on Recorded Trainings to follow the thought process of a veteran tasker. It was up to date at the time of recording; future playbook updates and announcements take precedence as they occur.

    1. 0

      0. Task Statuses/Reworks

      Check whether the task is blank or already has work on it.

    2. 1

      1. Check the Image

      Decide if it's usable

    3. 2

      2. Write a Question

      The longest, most important step. Pick skills, write a prompt, follow the guidelines.

    4. 3

      3. Generate Model Response

      Click the button. Wait. Read carefully.

    5. 4

      4. Evaluate and Rewrite

      Thumbs Down + rewrite the correct answer.

    6. 5

      5. Validate your Prompt

      Run "Check My Work" and resolve every flag before submitting.

    ☆ Getting Started/BasicsStep 0: Task Statuses/Reworks