> Markdown version of [/jobs/ext/1483505-deep-research-task-evaluator](https://www.wearedevelopers.com/jobs/ext/1483505-deep-research-task-evaluator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Deep Research Task Evaluator

- **Company:** Human Union Data, Inc.
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Model Validation
- **Published:** July 29, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=a9a970b450a2df35

## About the Role

* Graduate-level training or equivalent applied experience in deep research task research review or a closely related field for Deep Research Task Evaluator work.
 * Hands-on experience publishing, teaching, or advising on the topic at a professional level.
 * Comfort applying multi-page rubrics consistently across long batches.
 * Clear written reasoning that cites methods, papers, or worked examples.
 * Reliable async availability for at least 10 hours per week., * PhD, postdoc, or industry research experience in the topic area.
 * Prior work reviewing AI-assisted research tooling and its failure modes.
 * Multilingual fluency for non-English papers and corpora., * Scientific reasoning
 * Method validation
 * Citation review
 * Quantitative analysis
 * Deep Research Task research review
 * Web research
 * Source grounding
 * Browser automation
 * Deep
 * Research

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

Deep Research Task Evaluator is a remote review track for evaluating AI outputs across deep research task research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Deep Research Task research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would - checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one., * Review AI outputs against current deep research task research review methods, conventions, and prior work for Deep Research Task Evaluator assignments.

 * Reproduce or sanity-check key derivations, calculations, or experimental claims.
 * Flag dimensional, methodological, and citation errors with structured severity tags.
 * Capture the corrected reasoning or worked example so the modeling team can train on it.
 * Adjudicate disputed answers against textbooks, papers, or community standards.
 * Maintain reviewer-quality scores in inter-rater calibration cycles., * Reproduce a deep research task research review derivation from a model output and flag any algebraic or dimensional errors.
 * Grade a model's literature summary against the cited papers and rate the citation quality.
 * Adjudicate a disputed answer between two reviewers using textbook methods.
 * Audit a 25-row batch for rubric consistency and report drift to the program lead.


## Related Videos

- [Introduction to Responsible AI: Balancing Value and Risk](https://www.wearedevelopers.com/videos/1972-introduction-to-responsible-ai-balancing-value-and-risk)
- [AI for decision-making in Tech Recruiting](https://www.wearedevelopers.com/videos/1074-ai-for-decision-making-in-tech-recruiting)
- [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai)
- [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents)
- [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak)
- [Building Trustworthy AI in Industry: Beyond Traditional Cybersecurity](https://www.wearedevelopers.com/videos/1948-building-trustworthy-ai-in-industry-beyond-traditional-cybersecurity)

## Related Articles

- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)
- [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Prompt Engineering is a Job of the Past](https://www.wearedevelopers.com/magazine/342-prompt-engineering-is-a-job-of-the-past)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)