> Markdown version of [/jobs/ext/1502875-software-engineer-ai-quality-testing-2nd-round-interview](https://www.wearedevelopers.com/jobs/ext/1502875-software-engineer-ai-quality-testing-2nd-round-interview). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - AI Quality & Testing [2nd Round Interview]

- **Company:** Human Union Data, Inc.
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Testing (Software), JavaScript (Programming Language), Test Suite, Artificial Intelligence, Unit Testing, Code Review, Software Debugging, Junit, Open Web Application Security, Software Engineering, Rspec, Software Security, Pytest, Free and Open-Source Software, Golang
- **Published:** July 30, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=890c55bce6702ecd

## About the Role

* Strong day-job engineering experience - you can read, run, and debug unfamiliar code for Software Engineer - AI Quality & Testing [2nd Round Interview] work.
 * Comfort writing concise unit tests that capture a single failure mode.
 * Familiarity with at least one of: pytest, Jest, JUnit, Go test, RSpec, or equivalent.
 * Clear written reasoning - your review note has to convince another senior engineer.
 * Reliable async availability for at least 10 hours per week.
 * Prior code-review or technical-interview-grading experience is a plus., * Open-source contributions or a public portfolio that demonstrates production-quality code.
 * Experience with the target language's standard tooling, linters, and idiomatic style guides.
 * Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns., * Code review
 * Debugging
 * Unit testing
 * Software engineering judgment
 * Software Engineer AI Quality Testing 2nd Round Interview engineering review
 * Software engineering
 * AI model evaluation

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

## Description

* Run and reproduce candidate code outputs in a sandboxed environment for Software Engineer - AI Quality & Testing [2nd Round Interview] assignments.
 * Grade software engineer ai quality testing 2nd round interview engineering review solutions for correctness, complexity, idiomatic style, and edge-case handling.
 * Write minimal failing tests that demonstrate the bug a model output missed.
 * Compare paired solutions and rank them with a written rationale tied to the rubric.
 * Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
 * Document recurring code-generation failures so the modeling team can target them.
 * Calibrate against gold-standard reviews to keep inter-rater agreement above target., * Reproduce a generated engineering solution to a coding task, run the test suite, and grade it.
 * Write the smallest failing test that demonstrates a model's edge-case bug.
 * Compare two paired solutions and rank them with a written rationale tied to the rubric.
 * Triage a security issue surfaced by a model and document the patch the model should have produced.


## Related Videos

- [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents)
- [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python)
- [How Unit Testing Saved My Career](https://www.wearedevelopers.com/videos/1642-how-unit-testing-saved-my-career)
- [Automagic Configuration in Python](https://www.wearedevelopers.com/videos/363-automagic-configuration-in-python)
- [From boy scouting to redrawing the landscape](https://www.wearedevelopers.com/videos/1140-from-boy-scouting-to-redrawing-the-landscape)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)