> Markdown version of [/jobs/ext/1911685-computer-science-assessment-specialist](https://www.wearedevelopers.com/jobs/ext/1911685-computer-science-assessment-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Computer Science Assessment Specialist - **Company:** AuraOne Human Data - **Location:** United States (Remote available) - **Salary:** $72,800.0 - $156,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Information Technology - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=59b44b67fc7ca652 ## About the Role * Direct working experience in computer science assessment specialist operations on real teams for Computer Science Assessment Specialist work. * Comfort applying multi-page rubrics consistently across long batches. * Clear written reasoning that names the policy or workflow being applied. * Strong attention to detail and the ability to flag when a prompt itself is the problem. * Reliable async availability for at least 10 hours per week., * Prior experience training, calibrating, or QA-ing operations teams. * Familiarity with AI-assisted workflow tooling and its failure modes. * Bilingual experience for cross-region operations. Skills * Operational review * Policy adherence * Workflow judgment * Stakeholder communication * Computer Science Assessment specialist operations Work model Remote - US-eligible. Remote ยท Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. ## Description Computer Science Assessment Specialist is a remote review track for evaluating AI outputs across computer science assessment specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it., * Review AI outputs against current computer science assessment specialist operations workflows, playbooks, and firm policy for Computer Science Assessment Specialist assignments. * Grade tone, escalation logic, and stakeholder fit on a structured rubric. * Flag operational risk, missed escalations, and policy-adherence gaps with severity tags. * Capture the right next step so the modeling team can train on it. * Adjudicate disputed treatments against published playbooks or firm guidance. * Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a model's response to a real computer science assessment specialist operations ticket and rate workflow, tone, and escalation. * Flag a missed escalation with the right severity tag and corrected next step. * Adjudicate a disputed playbook call between two reviewers using firm guidance. * Audit a 25-row batch for rubric consistency and report drift to the program lead. ## Related Videos - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post) - [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents) - [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak) - [It's not easy being green](https://www.wearedevelopers.com/videos/558-it-s-not-easy-being-green) - [How to Assess and Hire Talent: The Skills-Based Hiring Playbook for the AI Age](https://www.wearedevelopers.com/videos/1488-how-to-assess-and-hire-talent-the-skills-based-hiring-playbook-for-the-ai-age) ## Related Articles - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [The Best Job Search Websites of 2025](https://www.wearedevelopers.com/magazine/368-the-best-job-search-websites-of-2025) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Mastering Remote Work: Tips for Developers](https://www.wearedevelopers.com/magazine/558-mastering-remote-work-tips-for-developers)