> Markdown version of [/jobs/ext/1840855-software-engineering-evaluation-specialist](https://www.wearedevelopers.com/jobs/ext/1840855-software-engineering-evaluation-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineering Evaluation Specialist

- **Company:** Human Union Data, Inc.
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** JavaScript (Programming Language), Test Suite, Unit Testing, Code Review, Software Debugging, Junit, Open Web Application Security, Software Engineering, Rspec, Software Security, Pytest, Free and Open-Source Software, Golang
- **Published:** July 31, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=6126bac9db8800c7

## About the Role

* Strong day-job engineering experience - you can read, run, and debug unfamiliar code for Software Engineering Evaluation Specialist work.
 * Comfort writing concise unit tests that capture a single failure mode.
 * Familiarity with at least one of: pytest, Jest, JUnit, Go test, RSpec, or equivalent.
 * Clear written reasoning - your review note has to convince another senior engineer.
 * Reliable async availability for at least 10 hours per week.
 * Prior code-review or technical-interview-grading experience is a plus., * Open-source contributions or a public portfolio that demonstrates production-quality code.
 * Experience with the target language's standard tooling, linters, and idiomatic style guides.
 * Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns., * Code review
 * Debugging
 * Unit testing
 * Software engineering judgment
 * Software Engineering Evaluation engineering review

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

* Run and reproduce candidate code outputs in a sandboxed environment for Software Engineering Evaluation Specialist assignments.
 * Grade software engineering evaluation engineering review solutions for correctness, complexity, idiomatic style, and edge-case handling.
 * Write minimal failing tests that demonstrate the bug a model output missed.
 * Compare paired solutions and rank them with a written rationale tied to the rubric.
 * Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
 * Document recurring code-generation failures so the modeling team can target them.
 * Calibrate against gold-standard reviews to keep inter-rater agreement above target., * Reproduce a generated engineering solution to a coding task, run the test suite, and grade it.
 * Write the smallest failing test that demonstrates a model's edge-case bug.
 * Compare two paired solutions and rank them with a written rationale tied to the rubric.
 * Triage a security issue surfaced by a model and document the patch the model should have produced.


## Related Videos

- [Psychological Safety in Software Engineering - Jenny-Margrethe Vej & Alexandra Hou Aldershaab](https://www.wearedevelopers.com/videos/2142-psychological-safety-in-software-engineering-jenny-margrethe-vej-alexandra-hou-aldershaab)
- [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python)
- [How Unit Testing Saved My Career](https://www.wearedevelopers.com/videos/1642-how-unit-testing-saved-my-career)
- [Automagic Configuration in Python](https://www.wearedevelopers.com/videos/363-automagic-configuration-in-python)
- [From boy scouting to redrawing the landscape](https://www.wearedevelopers.com/videos/1140-from-boy-scouting-to-redrawing-the-landscape)
- [Emergency Discussion: Can’t Hire the Right Developers? Here’s What Everyone Else Misses](https://www.wearedevelopers.com/videos/1748-emergency-discussion-can-t-hire-the-right-developers-here-s-what-everyone-else-misses)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers)
- [Is Software Engineering Hard?](https://www.wearedevelopers.com/magazine/448-is-software-engineering-hard)
- [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)