Expert Labeling

For raters

You should have received a unique URL from your task creator. It looks like:

Open that link to start evaluating. Your progress is saved automatically — you can close the tab and resume later using the same URL.

How it works

1. Read the prompt and response on the left pane
2. Answer the evaluation questions on the right pane
3. For decision-tree rubrics, follow the branching questions — your answers determine the next question
4. Use the voice recorder to dictate rationales (Chrome only)
5. Navigate between items with the arrow buttons or keyboard shortcuts (left/right arrows)
6. When all items are complete, you will see a completion screen

Tips

• Click rule chips on questions to see editorial standards
• Use the theme toggle (top right) to switch dark/light mode
• Use the text size selector to adjust readability
• Your answers are saved to the server each time you complete an item — and cached locally as a backup