LLM Response Evaluation Specialist (Remote)

About the role

We are seeking a meticulous LLM Response Evaluation Specialist to assess AI‑generated answers. Working remotely, you will apply structured reasoning and evidence‑based judgment to improve model performance.

Key responsibilities

• Evaluate generated responses for reasoning quality, accuracy, nuance, and consistency.
• Write clear, structured rationales that justify your assessments.
• Identify logical gaps, weak assumptions, and incomplete interpretations in model outputs.
• Apply established evaluation frameworks across diverse language and reasoning tasks.
• Maintain high review accuracy while adhering to detailed operational guidelines.

Required profile

• Exceptional critical reading ability with attention to nuance and implicit meaning.
• Strong written communication skills, delivering concise, evidence‑based analysis.
• Consistent decision‑making in subjective evaluation scenarios.
• Ability to work independently without reliance on automated writing tools.
• Native‑level English fluency with polished written expression.
• Academic background from a recognized university and broad intellectual curiosity.

Required skills

What we offer

• Flexible, output‑driven contract engagements.
• Hourly compensation ranging from $60 to $200.
• Remote work with autonomous scheduling.