> Markdown version of [/jobs/ext/2198640-test-engineer-fully-remote](https://www.wearedevelopers.com/jobs/ext/2198640-test-engineer-fully-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Test Engineer - Fully Remote

- **Company:** Mercor, Inc.
- **Location:** New York, NY, United States (Remote available)
- **Experience:** Expert
- **Salary:** $124,800.0 - $187,200.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Software Debugging, Python (Programming Language), Model Validation, Git, Virtual Agents
- **Published:** August 23, 2026
- **Apply:** https://www.careerjet.com/jobad/us7c4e5b6d4675c7a81f4aca667e7319a8

## About the Role

* MSc or PhD in a STEM field or equivalent practical experience.
 * 1+ years in test engineering, quality assurance, or a related role.
 * Experience designing test cases and debugging complex systems.
 * Proficiency in Python and Git.
 * Exceptional attention to detail and clear documentation habits.

Preferred

 * Experience in AI training, model evaluation, or quality review of AI-generated work.
 * A perfectionist mindset and ability to work independently through ambiguous problems.

## Description

* Design test cases to confirm task functionality, including edge cases.
 * Review tasks and reference solutions to catch ambiguities and gaps early.
 * Debug using Python when tasks or checks misbehave.
 * Build quality checklists and provide actionable feedback to authors.
 * Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity., Senior Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader …
 + 4 days ago
+


## Related Videos

- [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Guiding Agentic AI with Vue](https://www.wearedevelopers.com/videos/2033-guiding-agentic-ai-with-vue)
- [Introduction to Responsible AI: Balancing Value and Risk](https://www.wearedevelopers.com/videos/1972-introduction-to-responsible-ai-balancing-value-and-risk)
- [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)