> Markdown version of [/jobs/ext/1922019-infrastructure-as-code-evaluation-specialist](https://www.wearedevelopers.com/jobs/ext/1922019-infrastructure-as-code-evaluation-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Infrastructure as Code Evaluation Specialist

- **Company:** AuraOne Human Data
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Testing (Software), Artificial Intelligence, Code Review
- **Published:** August 4, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=f46ed8c99d3443b6

## About the Role

* Direct working experience in infrastructure as code evaluation specialist operations on real teams for Infrastructure as Code Evaluation Specialist work.
 * Comfort applying multi-page rubrics consistently across long batches.
 * Clear written reasoning that names the policy or workflow being applied.
 * Strong attention to detail and the ability to flag when a prompt itself is the problem.
 * Reliable async availability for at least 10 hours per week., * Prior experience training, calibrating, or QA-ing operations teams.
 * Familiarity with AI-assisted workflow tooling and its failure modes.
 * Bilingual experience for cross-region operations.

Skills

 * Operational review
 * Policy adherence
 * Workflow judgment
 * Stakeholder communication
 * Infrastructure as Code Evaluation specialist operations
 * Code review
 * Software testing
 * Agent evaluation
 * Infrastructure
 * Code

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

Infrastructure as Code Evaluation Specialist is a remote review track for evaluating AI outputs across infrastructure as code evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it., * Review AI outputs against current infrastructure as code evaluation specialist operations workflows, playbooks, and firm policy for Infrastructure as Code Evaluation Specialist assignments.

 * Grade tone, escalation logic, and stakeholder fit on a structured rubric.
 * Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
 * Capture the right next step so the modeling team can train on it.
 * Adjudicate disputed treatments against published playbooks or firm guidance.
 * Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a model's response to a real infrastructure as code evaluation specialist operations ticket and rate workflow, tone, and escalation.
 * Flag a missed escalation with the right severity tag and corrected next step.
 * Adjudicate a disputed playbook call between two reviewers using firm guidance.
 * Audit a 25-row batch for rubric consistency and report drift to the program lead.


## Related Videos

- [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data)
- [Excellent Software Testing](https://www.wearedevelopers.com/videos/87-excellent-software-testing)
- [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Build a CI/CD pipeline to automate code reviews and ensure code quality](https://www.wearedevelopers.com/videos/349-build-a-ci-cd-pipeline-to-automate-code-reviews-and-ensure-code-quality)
- [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Mastering Remote Work: Tips for Developers](https://www.wearedevelopers.com/magazine/558-mastering-remote-work-tips-for-developers)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [13 AI Tools for Developers](https://www.wearedevelopers.com/magazine/302-13-ai-tools-for-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)