> Markdown version of [/jobs/ext/553150-software-engineer-evaluation-author-ai-trainer](https://www.wearedevelopers.com/jobs/ext/553150-software-engineer-evaluation-author-ai-trainer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - Evaluation Author - AI Trainer

- **Company:** Mercor, Inc.
- **Location:** Miami, FL, United States (Remote available)
- **Experience:** Expert
- **Salary:** $72,800.0 - $249,600.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Software Quality, Software Debugging, Machine Learning, Software Engineering
- **Published:** June 14, 2026
- **Apply:** https://www.careerjet.com/jobad/usd108f026d6f3e7f8b0dcccce8f3f459c

## About the Role

Must-Have

 * 5+ years of software engineering at a real product organization (big tech or venture-backed startup).
 * Strong code quality, systems design, debugging, and testing discipline.
 * Clear written communication (you write instructions others follow).

Preferred

 * Familiarity with AI coding tools and evals.

## Description

* Author non-trivial coding tasks with golden solutions and automated verifiers.
 * Design rubrics and grade agent trajectories and model outputs.
 * Improve task and rubric quality through structured review.
 * Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
 * Work independently and asynchronously to meet deadlines while improving AI model performance., Audio engineers apply their technical expertise with tools such as Audacity, Ardour, and LMMS to enhance AI research projects. This role involves contributing to the improvement of…
 + 7 days ago
 + Apply easily, As an Audio Engineer specializing in native English language, you will play a crucial role in shaping the development of next-generation AI systems. Your expertise will directly in…
 + 15 days ago
 + Apply easily
+


## Related Videos

- [Let's Talk Quality! - Lilia Gargouri](https://www.wearedevelopers.com/videos/1815-let-s-talk-quality-lilia-gargouri)
- [Using AI Without Losing Your Skills](https://www.wearedevelopers.com/videos/2045-using-ai-without-losing-your-skills)
- [Evals vs. Evil - AI and Package Security - Laurie Voss](https://www.wearedevelopers.com/videos/2131-evals-vs-evil-ai-and-package-security-laurie-voss)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [Designing high quality software with AI](https://www.wearedevelopers.com/videos/100136-designing-high-quality-software-with-ai)
- [Let’s Talk Quality!](https://www.wearedevelopers.com/videos/100012-let-s-talk-quality)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Top AI Tools for Developers in 2025](https://www.wearedevelopers.com/magazine/560-top-ai-tools-for-developers-in-2025)