AI evaluator jobs
AI evaluator jobs — rate the answers that train the models
Compare two AI responses and choose the better one, score answers against a rubric, and explain your reasoning. Perbug matches your skills to real evaluation projects from AI companies — remote, flexible, and paid per verified item.
Response evaluation and A/B preference tasks with clear rubrics
Paid per item — no hourly race to the bottom
Qualification tests unlock higher-paying evaluation projects
Build a public reputation AI companies search to recruit you
Related work
response evaluationpairwise preferencerlhf rankingrubric gradingsearch evaluation
Frequently asked
- What does an AI evaluator do?
- You review AI-generated answers and judge their quality — accuracy, helpfulness, safety, and format — often by comparing two responses or scoring against a rubric.
- Do I need experience?
- You pass a short qualification test per task type. Strong writing, careful reading, and domain knowledge (like math or coding) help you qualify for premium work.
- How am I paid?
- Per verified item, via PayPal, with a $10 minimum payout. Higher accuracy and tier unlock better-paying projects.