Senior Software Engineer - AI/ML

• Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation.
• Write clear task proposals explaining task realism, verification, and challenges for current AI models.
• Illustrate “what good looks like” with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope.
• Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure.
• Apply consistent, evidence-based judgment for reproducible and defensible assessments.
• Take structured feedback from senior reviewers and iterate on submitted work.

Must-Have

• 4+ years of professional software engineering experience at leading technology, quantitative, or financial firms.
• Strong command of at least one major language like Python, Java, C++, Go, TypeScript, or Rust.
• Proven ability to work in large, complex production codebases and judge code quality.
• Excellent written English for explaining technical decisions and trade-offs.
• Bachelor’s degree from an English-speaking country.
• Detail-oriented and consistent in evaluating complex work.
• Comfortable receiving feedback and calibrating judgment against set standards.

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.