> Markdown version of [/jobs/ext/4587814-ml-engineer-model-evaluation-expert](https://www.wearedevelopers.com/jobs/ext/4587814-ml-engineer-model-evaluation-expert). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# ML Engineer - Model Evaluation Expert

- **Company:** Mercor, Inc.
- **Location:** San Francisco, CA, United States (Remote available)
- **Salary:** $124,800 - $187,200
- **Contract:** Permanent contract
- **Skills:** Python (Programming Language), Machine Learning, Reinforcement Learning, Large Language Models, Model Validation, Git, Information Technology
- **Published:** November 5, 2026
- **Apply:** https://www.thejobnetwork.com/job/d3b8236a-7d7a-4514-b905-1caed35e9683/ml-engineer-model-evaluation-expert

## About the Role

Must-Have

 * MSc or PhD in machine learning, computer science, or a related STEM field.
 * 1+ years in a research or research-engineering role.
 * Experience in training and evaluating ML models and conducting end-to-end experiments.
 * Proficiency in Python and Git.
 * Strong understanding of large language models and their evaluation.

Preferred

 * Basic knowledge of reinforcement learning.
 * Experience in AI training, model evaluation, or benchmark/task authoring.

## Description

* Run experiments by implementing changes, executing training experiments, and analyzing results to define correct solutions.
 * Explore reinforcement learning concepts such as reward functions and training behavior in task development.
 * Evaluate frontier models' performance on tasks and identify areas of improvement.
 * Collaborate with researchers to ensure tasks are consistent, rigorous, and fair.