Machine Learning Engineer - Model Evaluation & Experimentation

• Run experiments by implementing changes, executing training experiments, and analyzing results to define correct solutions.
• Explore reinforcement learning concepts such as reward functions and training behavior in task development.
• Evaluate frontier models’ performance on tasks and identify areas of improvement.
• Collaborate with researchers to ensure tasks are consistent, rigorous, and fair.

Must-Have

• MSc or PhD in machine learning, computer science, or a related STEM field.
• 1+ years in a research or research-engineering role.
• Experience in training and evaluating ML models and conducting end-to-end experiments.
• Proficiency in Python and Git.
• Strong understanding of large language models and their evaluation.

Preferred

• Basic knowledge of reinforcement learning.
• Experience in AI training, model evaluation, or benchmark/task authoring.