> Markdown version of [/jobs/ext/4466635-machine-learning-engineer-model-evaluation-experimentation](https://www.wearedevelopers.com/jobs/ext/4466635-machine-learning-engineer-model-evaluation-experimentation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Machine Learning Engineer - Model Evaluation & Experimentation

- **Company:** Mercor, Inc.
- **Location:** United States (Remote available)
- **Salary:** $124,800.0 - $187,200.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Python (Programming Language), Machine Learning, Reinforcement Learning, Large Language Models, Model Validation, Git, Information Technology
- **Published:** October 3, 2026
- **Apply:** https://www.thejobnetwork.com/job/f0824d62-85f4-4524-a1ad-cdc02b72c663/ml-engineer-model-evaluation

## About the Role

Must-Have

 * MSc or PhD in machine learning, computer science, or a related STEM field.
 * 1+ years of experience in a research or research-engineering role.
 * Experience in training and evaluating ML models and running experiments end-to-end.
 * Strong familiarity with large language models and their evaluation techniques.
 * Proficiency in Python and Git.

Preferred

 * Basic understanding of reinforcement learning.
 * Experience in AI training, model evaluation, or benchmark/task authoring.

## Description

* Run experiments by implementing changes, running training experiments, and analyzing results.
 * Explore reinforcement learning ideas, focusing on reward functions and training behavior.
 * Evaluate models to identify where frontier models fall short.
 * Collaborate with researchers and experts to maintain task consistency and rigor.