> Markdown version of [/jobs/ext/4236282-machine-learning-engineer-model-evaluation-experimentation](https://www.wearedevelopers.com/jobs/ext/4236282-machine-learning-engineer-model-evaluation-experimentation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Machine Learning Engineer - Model Evaluation & Experimentation

- **Company:** Mercor, Inc.
- **Location:** United States (Remote available)
- **Salary:** $124,800.0 - $187,200.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Python (Programming Language), Machine Learning, Reinforcement Learning, Large Language Models, Model Validation, Git, Information Technology
- **Published:** October 3, 2026
- **Apply:** https://www.thejobnetwork.com/job/c2ee2394-0952-4df9-a9ef-a07375f99583/ml-engineer-model-evaluation-expert

## About the Role

Must-Have

 * MSc or PhD in machine learning, computer science, or a related STEM field.
 * 1+ years in a research or research-engineering role.
 * Experience in training and evaluating ML models and conducting end-to-end experiments.
 * Proficiency in Python and Git.
 * Strong understanding of large language models and their evaluation.

Preferred

 * Basic knowledge of reinforcement learning.
 * Experience in AI training, model evaluation, or benchmark/task authoring.

## Description

* Run experiments by implementing changes, executing training experiments, and analyzing results to define correct solutions.
 * Explore reinforcement learning concepts such as reward functions and training behavior in task development.
 * Evaluate frontier models' performance on tasks and identify areas of improvement.
 * Collaborate with researchers to ensure tasks are consistent, rigorous, and fair.