> Markdown version of [/jobs/ext/4662569-data-analyst-ai-evaluation](https://www.wearedevelopers.com/jobs/ext/4662569-data-analyst-ai-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Analyst (AI Evaluation)

- **Company:** RECRUITER LLC
- **Location:** United States (Remote available)
- **Experience:** Experienced
- **Salary:** $62,400 - $124,800
- **Contract:** Permanent contract
- **Skills:** AI Evaluation, Artificial Intelligence, Data Analysis, Big Data, Spreadsheets, Data Validation, Data Files, Database Queries, SQL Databases
- **Published:** November 10, 2026
- **Apply:** https://www.careerbuilder.com/job-details/data-analyst-ai-evaluation--2d929200-f6de-4b2a-b7a0-2cdd6f6543ac

## About the Role

Data Analysis, Artificial Intelligence (AI), Data Analysis, Artificial Intelligence (AI), Data Sets, Documentation, Data Quality, Analysis Skills, Detail Oriented, Quality Assurance, * 3-5+ years of experience in data review, data quality, quality assurance, analytics, or a related field.

 * Proven experience reviewing, validating, and critiquing data or deliverables against defined criteria.
 * Ability to follow detailed written instructions and apply complex evaluation rubrics consistently.
 * Strong judgment and comfort working with ambiguity.
 * Excellent error-spotting and attention-to-detail skills, particularly across high-volume or repetitive work.
 * Strong written and verbal communication skills.
 * Ability to clearly document findings and explain evaluation decisions.
 * Baseline spreadsheet proficiency, including sorting, filtering, and simple formulas.

Preferred Experience

 * Experience with SQL or hands-on data querying.
 * Data annotation, data labeling, or rubric-based evaluation.
 * Quality assurance or data validation workflows.
 * Experience identifying recurring data-quality patterns and escalating systemic issues.

Engagement & Compensation

 * Contractor engagement.
 * Remote work, U.S. based.

## Description

We are looking for experienced Data Analysts to review datasets and task outputs for accuracy, completeness, consistency, and adherence to defined evaluation criteria.

You'll apply structured rubrics across large volumes of data, identify errors and inconsistencies, handle ambiguous cases using sound judgment, and provide clear documentation explaining your decisions. No prior AI experience is required.

What You'll Do

 * Review datasets and task outputs for accuracy, completeness, consistency, and adherence to guidelines.
 * Identify and flag inconsistencies, errors, and outputs that deviate from defined instructions.
 * Apply structured rubrics and evaluation criteria consistently across large datasets.
 * Make well-reasoned decisions in ambiguous situations where guidelines may not fully address a scenario.
 * Document the rationale behind evaluation decisions clearly and consistently.
 * Identify recurring patterns or systemic data-quality issues and escalate them for further analysis.
 * Provide clear, actionable written and verbal feedback, including recommended resolution paths.
 * Maintain high levels of accuracy and attention to detail across repetitive and high-volume data review work.