> Markdown version of [/jobs/ext/3402015-data-scientist-ai-evaluation](https://www.wearedevelopers.com/jobs/ext/3402015-data-scientist-ai-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Scientist - AI Evaluation

- **Company:** Mercor, Inc.
- **Location:** New York, NY, United States (Remote available)
- **Experience:** Expert
- **Salary:** $208,000.0 - $312,000.0
- **Contract:** Contract
- **Skills:** Artificial Intelligence, Data Analysis, Python (Programming Language), Machine Learning, SQL Databases, Machine Learning Operations
- **Published:** September 2, 2026
- **Apply:** https://www.careerjet.com/jobad/us537853b89fdc89fd613e69800508f98d

## About the Role

Must-Have

 * 1+ years of professional data science experience.
 * Experience at a leading technology, research, or quantitative firm.
 * Strong command of Python, SQL, statistical modeling, and machine learning.
 * Exceptional written communication skills for conveying technical findings.
 * Detail-oriented and consistent approach to evaluating complex work.

## Description

* Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
 * Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
 * Provide detailed written justifications for evaluations and scores to maintain transparency.
 * Apply consistent, evidence-based judgment for reproducible and defensible assessments.
 * Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


## Related Videos

- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases)
- [Secure and Private AI - DeepMask](https://www.wearedevelopers.com/videos/1665-secure-and-private-ai-deepmask)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1520-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to start an AI project for a good cause and boost your career](https://www.wearedevelopers.com/magazine/15-how-to-start-an-ai-project-for-a-good-cause-and-boost-your-career)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)