> Markdown version of [/jobs/ext/2937826-machine-learning-evaluator-ai-trainer](https://www.wearedevelopers.com/jobs/ext/2937826-machine-learning-evaluator-ai-trainer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Machine Learning Evaluator - AI Trainer

- **Company:** Mercor, Inc.
- **Location:** Philadelphia, PA, United States (Remote available)
- **Experience:** Expert
- **Salary:** $145,600.0 - $187,200.0
- **Contract:** Contract
- **Skills:** Artificial Intelligence, Machine Learning, Tensorflow, Pytorch, Kaggle, Scikit Learn, Xgboost
- **Published:** September 16, 2026
- **Apply:** https://www.careerjet.com/jobad/usefb6ac1d408c110254d83f8bd88c516d

## About the Role

Must-Have

 * 3+ years hands-on applied/experimental ML experience.
 * Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene.
 * Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost).
 * Ability to critique ML claims against evidence and reproduce results.

Preferred

 * Competition/benchmark experience (e.g., Kaggle).
 * Graduate research or publication record in applied ML.
 * Prior task-grading or peer-review experience.

## Description

* Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks for training and evaluating models.
 * Assess experiment design, model-selection reasoning, and evaluation methodology.
 * Provide clear, rubric-based written feedback to improve AI model performance.
 * Review and critique ML claims against evidence and reproduce results.
 * Work independently and asynchronously to meet deadlines while enhancing model outputs., Principal Machine Learning Engineer to serve as a hands-on technical leader for machine learning, predictive modeling, scoring, decisioning, and applied AI initiatives. This role w…
 + 1 month ago


## Related Videos

- [Machine learning 101: Where to begin?](https://www.wearedevelopers.com/videos/1014-machine-learning-101-where-to-begin)
- [Is my AI alive but brain-dead? How monitoring can tell you if your machine learning stack is still performing](https://www.wearedevelopers.com/videos/262-is-my-ai-alive-but-brain-dead-how-monitoring-can-tell-you-if-your-machine-learning-stack-is-still-performing)
- [TikTok's Privacy Innovation](https://www.wearedevelopers.com/videos/1036-tiktok-s-privacy-innovation)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Explainable machine learning explained](https://www.wearedevelopers.com/videos/589-explainable-machine-learning-explained)
- [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [How to start an AI project for a good cause and boost your career](https://www.wearedevelopers.com/magazine/15-how-to-start-an-ai-project-for-a-good-cause-and-boost-your-career)
- [How machine learning can help us tell fact from fiction](https://www.wearedevelopers.com/magazine/509-how-machine-learning-can-help-us-tell-fact-from-fiction)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)