This job is no longer available
This job expired on 22/07/2026. It no longer accepts applications.
LLM Response Evaluation Specialist (Remote)
CapitexAI
Job description
About the role
We are seeking a meticulous LLM Response Evaluation Specialist to assess AI‑generated answers. Working remotely, you will apply structured reasoning and evidence‑based judgment to improve model performance.
Key responsibilities
- Evaluate generated responses for reasoning quality, accuracy, nuance, and consistency.
- Write clear, structured rationales that justify your assessments.
- Identify logical gaps, weak assumptions, and incomplete interpretations in model outputs.
- Apply established evaluation frameworks across diverse language and reasoning tasks.
- Maintain high review accuracy while adhering to detailed operational guidelines.
Required profile
- Exceptional critical reading ability with attention to nuance and implicit meaning.
- Strong written communication skills, delivering concise, evidence‑based analysis.
- Consistent decision‑making in subjective evaluation scenarios.
- Ability to work independently without reliance on automated writing tools.
- Native‑level English fluency with polished written expression.
- Academic background from a recognized university and broad intellectual curiosity.
Required skills
What we offer
- Flexible, output‑driven contract engagements.
- Hourly compensation ranging from $60 to $200.
- Remote work with autonomous scheduling.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in New Zealand.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
CapitexAI