> Markdown version of [/jobs/ext/1481063-devops-and-sre-evaluation-specialist](https://www.wearedevelopers.com/jobs/ext/1481063-devops-and-sre-evaluation-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# DevOps and SRE Evaluation Specialist

- **Company:** Human Union Data, Inc.
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** JavaScript (Programming Language), Test Suite, Unit Testing, Cloud Computing, Code Review, Software Debugging, DevOps, Junit, Open Web Application Security, Software Engineering, Rspec, Software Security, Pytest, Free and Open-Source Software, Golang
- **Published:** July 29, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=eed64486a136bfda

## About the Role

* Strong day-job engineering experience - you can read, run, and debug unfamiliar code for DevOps and SRE Evaluation Specialist work.
 * Comfort writing concise unit tests that capture a single failure mode.
 * Familiarity with at least one of: pytest, Jest, JUnit, Go test, RSpec, or equivalent.
 * Clear written reasoning - your review note has to convince another senior engineer.
 * Reliable async availability for at least 10 hours per week.
 * Prior code-review or technical-interview-grading experience is a plus., * Open-source contributions or a public portfolio that demonstrates production-quality code.
 * Experience with the target language's standard tooling, linters, and idiomatic style guides.
 * Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns., * Code review
 * Debugging
 * Unit testing
 * Software engineering judgment
 * Cloud & platform engineering

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

* Run and reproduce candidate code outputs in a sandboxed environment for DevOps and SRE Evaluation Specialist assignments.
 * Grade cloud & platform engineering solutions for correctness, complexity, idiomatic style, and edge-case handling.
 * Write minimal failing tests that demonstrate the bug a model output missed.
 * Compare paired solutions and rank them with a written rationale tied to the rubric.
 * Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
 * Document recurring code-generation failures so the modeling team can target them.
 * Calibrate against gold-standard reviews to keep inter-rater agreement above target., * Reproduce a generated engineering solution to a coding task, run the test suite, and grade it.
 * Write the smallest failing test that demonstrates a model's edge-case bug.
 * Compare two paired solutions and rank them with a written rationale tied to the rubric.
 * Triage a security issue surfaced by a model and document the patch the model should have produced.


## Related Videos

- [How Unit Testing Saved My Career](https://www.wearedevelopers.com/videos/1642-how-unit-testing-saved-my-career)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)
- [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey)
- [From boy scouting to redrawing the landscape](https://www.wearedevelopers.com/videos/1140-from-boy-scouting-to-redrawing-the-landscape)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)
- [Dev Digest 131 - AI'm not sure about OSS](https://www.wearedevelopers.com/magazine/472-dev-digest-131-ai-m-not-sure-about-oss)