AI Evaluation Specialist – Remote Contract

About the role

We are seeking an AI Evaluation Specialist to review AI‑generated content and ensure high quality, clarity and usability. This remote contract role offers flexible hours ranging from 10 to 40 per week.

Key responsibilities

• Review and critically assess AI‑generated outputs across various content types and visual experiences.
• Identify inconsistencies, weaknesses and improvement opportunities.
• Apply structured evaluation guidelines and provide nuanced feedback for model improvement.
• Collaborate with cross‑functional teams to define quality standards, scoring criteria and review processes.
• Maintain high accuracy and consistency in evaluations to deliver reliable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.

Required profile

• Native‑level English proficiency (C1/C2).
• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent aesthetic or editorial judgment.
• Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.

Required skills

What we offer

• Hourly rate between $22 and $70.
• Fully remote work.
• Flexible weekly commitment (10‑40 hours).