> Markdown version of [/jobs/ext/4266579-competitive-data-scientist-ai-evaluation-remote](https://www.wearedevelopers.com/jobs/ext/4266579-competitive-data-scientist-ai-evaluation-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Competitive Data Scientist - AI Evaluation (Remote)

- **Company:** AuraOne Human Data
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** AI Evaluation, Artificial Intelligence, Model Validation
- **Published:** October 12, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=35ad939253151252

## About the Role

* Graduate-level training or equivalent applied experience in research science or a closely related field for Competitive Data Scientist - AI Evaluation (Remote) work.
 * Hands-on experience publishing, teaching, or advising on the topic at a professional level.
 * Comfort applying multi-page rubrics consistently across long batches.
 * Clear written reasoning that cites methods, papers, or worked examples.
 * Reliable async availability for at least 10 hours per week., * PhD, postdoc, or industry research experience in the topic area.
 * Prior work reviewing AI-assisted research tooling and its failure modes.
 * Multilingual fluency for non-English papers and corpora., * Scientific reasoning
 * Method validation
 * Citation review
 * Quantitative analysis
 * Research science

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

Research science models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would - checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one., * Review AI outputs against current research science methods, conventions, and prior work for Competitive Data Scientist - AI Evaluation (Remote) assignments.

 * Reproduce or sanity-check key derivations, calculations, or experimental claims.
 * Flag dimensional, methodological, and citation errors with structured severity tags.
 * Capture the corrected reasoning or worked example so the modeling team can train on it.
 * Adjudicate disputed answers against textbooks, papers, or community standards.
 * Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a model's literature summary against the cited papers and rate the citation quality.
 * Adjudicate a disputed answer between two reviewers using textbook methods.
 * Audit a 25-row batch for rubric consistency and report drift to the program lead.