> Markdown version of [/jobs/ext/1273940-data-scientist-for-ai-evaluation](https://www.wearedevelopers.com/jobs/ext/1273940-data-scientist-for-ai-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Scientist for AI Evaluation

- **Company:** Mantech International Corporation
- **Location:** Washington, DC, United States
- **Experience:** Expert
- **Salary:** $41,600.0 - $83,200.0
- **Contract:** Permanent contract
- **Skills:** A/B Testing, Artificial Intelligence, Python (Programming Language), SQL Databases, Information Technology
- **Published:** July 15, 2026
- **Apply:** https://www.careerjet.com/job/register/us383b1ed02cba1d1d196d801eb9d52c64

## About the Role

* 5+ years of professional data science experience in industry.
 * Background in business operations, product, or growth data science at top-tier technology companies.
 * Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
 * Exceptionally strong written communication skills.
 * Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
 * Prior experience with AI training, evaluation, or human-data projects is a strong plus.

## Description

Join a leading AI research organization as a Data Science Expert, where you will play a crucial role in evaluating the performance of AI systems in real-world data science tasks. This position focuses on defining excellence in data science work by creating task-specific grading criteria and rigorously scoring completed work samples with well-reasoned justifications. Key Responsibilities

 * Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, experiment readouts, and written recommendations.
 * Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
 * Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
 * Incorporate structured feedback from senior reviewers and iterate quickly on your work., Role Overview As a Computer Science Specialist, you will leverage your advanced expertise to support projects that train next-generation AI systems. Your contributions will direc…
 + 3 days ago


## Related Videos

- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Bringing the power of AI to your application.](https://www.wearedevelopers.com/videos/1010-bringing-the-power-of-ai-to-your-application)
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases)
- [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post)
- [How AI Models Get Smarter](https://www.wearedevelopers.com/videos/1374-how-ai-models-get-smarter)
- [Beyond Autocomplete: Local AI Code Completion Demystified](https://www.wearedevelopers.com/videos/961-beyond-autocomplete-local-ai-code-completion-demystified)

## Related Articles

- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)