> Markdown version of [/jobs/ext/4395413-senior-data-analyst-remote-ai-evaluation-reviewer](https://www.wearedevelopers.com/jobs/ext/4395413-senior-data-analyst-remote-ai-evaluation-reviewer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Analyst - Remote AI Evaluation Reviewer

- **Company:** AuraOne Human Data
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** AI Evaluation, Artificial Intelligence
- **Published:** October 9, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=cb59746f47051bfb

## About the Role

* Direct working experience in senior data analyst specialist operations on real teams for Senior Data Analyst - Remote AI Evaluation Reviewer work.
 * Comfort applying multi-page rubrics consistently across long batches.
 * Clear written reasoning that names the policy or workflow being applied.
 * Strong attention to detail and the ability to flag when a prompt itself is the problem.
 * Reliable async availability for at least 10 hours per week., * Prior experience training, calibrating, or QA-ing operations teams.
 * Familiarity with AI-assisted workflow tooling and its failure modes.
 * Bilingual experience for cross-region operations.

Skills

 * Operational review
 * Policy adherence
 * Workflow judgment
 * Stakeholder communication
 * Senior Data Analyst specialist operations

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

* Review AI outputs against current senior data analyst specialist operations workflows, playbooks, and firm policy for Senior Data Analyst - Remote AI Evaluation Reviewer assignments.
 * Grade tone, escalation logic, and stakeholder fit on a structured rubric.
 * Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
 * Capture the right next step so the modeling team can train on it.
 * Adjudicate disputed treatments against published playbooks or firm guidance.
 * Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a model's response to a real senior data analyst specialist operations ticket and rate workflow, tone, and escalation.
 * Flag a missed escalation with the right severity tag and corrected next step.
 * Adjudicate a disputed playbook call between two reviewers using firm guidance.
 * Audit a 25-row batch for rubric consistency and report drift to the program lead.