Software Domain Expert - Fully Remote | Upto $105/hr

• Evaluate the quality of engineering knowledge work tasks and AI model outputs. Identify missing behaviors, thin reasoning, and code errors.
• Develop high-quality instruction specs and golden solutions for engineering problems. Define new tasks reflecting practical engineering work.
• Design challenging engineering tasks and evaluation sets. Build domain-specific skills and tools with the research team.
• Collaborate with client researchers and specialists to maintain consistent standards. Translate tacit engineering judgment into explicit criteria.
• Work independently and asynchronously to meet deadlines while improving AI model performance., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Must-Have

• Bachelor’s degree or higher in computer science, software engineering, or a related field. MS or PhD preferred.
• 4+ years of professional engineering practice, building and shipping production software or systems.
• Specialization in areas like distributed systems, security, embedded systems, or machine learning.
• Progression to a senior level, such as Senior, Staff, Principal, or Engineering Lead.
• Hands-on use of large language models in professional work.

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.