AI Evaluation Specialist (Remote Contractor)
YO IT Consulting · Auckland
Job description
About the role
We are looking for an AI Evaluation Specialist to help train next‑generation AI systems. Working remotely as a contractor, you will provide high‑quality, real‑world feedback that shapes how models learn, reason, and perform.
Key responsibilities
- Review AI‑generated outputs for quality, clarity, usability, and overall user experience.
- Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
- Apply structured evaluation guidelines and deliver nuanced feedback to inform model improvements.
- Collaborate with cross‑functional teams to define and refine quality standards, scoring criteria, and review processes.
- Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
- Contribute to the continuous enhancement of evaluation workflows and best practices.
- Support the development of training data that enhances AI system performance and reliability.
Required profile
- Exceptional reading comprehension and acute attention to detail.
- Strong observational skills with excellent aesthetic or editorial judgment.
- Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
- Excellent written and verbal communication skills.
- Comfort working across various content types and evaluation guidelines.
- Strong sense of ownership, reliability, and commitment to delivering high‑quality work.
- Open‑minded approach to learning and quickly adapting to new workflows.
Required skills
Questions fréquentes
Why are you reporting this job?
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 14 hours ago
Expires 1 month from now
5 views · 0 applications
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
YO IT Consulting
Auckland
Related job offers
-
Intermediate Software Engineer - Internal Platform & AI Enablement
Rhapsody Auckland -
Senior Consultant – Digital Transformation
Deloitte Auckland -
Senior Full Stack Developer – Digital Channels
Bank of New Zealand Auckland -
Technical Project Manager
Gallagher Hamilton -
Game Developer – 3D Co‑op Multiplayer (Remote)
Twine Nouvelle-Zélande