Python Engineer - Codebase Specialist
Mercor, Inc.
New York, NY, United States
10 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$161,800.0 - $184,600.0
Working hours
Regular working hours
Languages
English
Job source
Tech stack
Artificial Intelligence
Programming Tools
Python (Programming Language)
Software Engineering
Web Application Frameworks
Git
Containerization
Codebase
Job description
- Select tasks from a pre-validated pool of Python repositories, each pinned to a specific git commit and arriving with an engineering question, positive and negative rubrics, foils, and a golden solution.
- Explore the repository until you genuinely understand the subsystem in question, including the relevant PR or issue history.
- Rewrite the task’s question so it defeats frontier coding agents while remaining well-defined and fairly answerable.
- Adjust rubrics and foils so they reward correct reasoning and reject plausible-but-wrong answers.
- Run the full validation loop in Studio - Check, Golden, Run, Analyze - and iterate until every stage passes.
- Document your work in the task README and submit for expert review, addressing reviewer feedback on returned tasks., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Requirements
- 3+ years of professional software engineering experience, with substantial production Python.
- Demonstrated ability to navigate a large, unfamiliar Python codebase and explain how it behaves at runtime.
- Fluency in Python internals that matter in real systems: import machinery, descriptors and metaclasses, async and event loops, packaging, and C-extension boundaries.
- Precise written English: the questions and rubrics you write are the product.
- Comfortable with git at commit level, containerized environments, and command-line tooling.
Preferred
- Experience with web frameworks, developer tooling, type checkers, or scientific/numeric libraries is highly relevant.
Compensation & Legal
- Payment is per approved task; every task is reviewed by a second engineer and a super reviewer before acceptance.
About the company
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
CH
Chris Heilmann
over 2 years ago
CH
Chris Heilmann
Dev Digest 137 - AI'm not sure about this
almost 2 years ago
CH
Chris Heilmann
Dev Digest 121 - AI goes offline
over 2 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
over 2 years ago
EM
Eli McGarvie
Find a Developer Job: 12 Best Job Sites For Developers
over 3 years ago
LM
Luis Minvielle
13 AI Tools for Developers
almost 3 years ago