Psychometrician - AI Trainer

About the role

Join DataAnnotation’s DataAnnotation team to help shape cutting‑edge AI systems that perform quantitative reasoning. You will work remotely, evaluating AI‑generated analyses, solving technical problems, and providing feedback that directly improves model performance.

Key responsibilities

• Evaluate AI‑generated quantitative work for technical accuracy and real‑world validity, including statistical analysis, predictive modeling, and scientific reasoning.
• Design and solve quantitative problems used to train and benchmark AI models, covering forecasting, experimental analysis, optimization, and statistical inference.
• Write clear technical explanations and well‑documented analytical code.
• Provide feedback that influences the next generation of AI models built for quantitative reasoning.

Required profile

• 2+ years of hands‑on experience in a quantitative role or research environment (e.g., data science, statistics, economics, physics, biology, epidemiology, operations research).
• Comfort writing and reviewing analytical code end‑to‑end.
• Practical experience with statistical methods, predictive modeling, and experiment design such as A/B testing, hypothesis testing, regression, classification, and time‑series forecasting.
• Fluent English with strong writing skills.
• Bachelor’s degree in a quantitative field is preferred.

Required skills

• Coding (any language)
• Statistical analysis
• Predictive modeling
• Experiment design
• A/B testing
• Hypothesis testing
• Regression
• Classification
• Time‑series forecasting

What we offer

• Fully remote work from anywhere in the US, Canada, UK, Ireland, Australia, or New Zealand.
• Flexible schedule – choose projects and work times.
• Competitive hourly pay starting at $50–$100+ per hour, with bonuses for high‑quality, high‑volume work.
• Opportunity to impact the future of AI systems that reason about data and analytics.