Senior Machine Learning Engineer in New York

• Guide research and engineering teams to close knowledge gaps in AI and data science domains. Surface nuances that distinguish expert-level work from surface-level reasoning.
• Design challenging agentic tasks rooted in real-world ML, data science, data engineering, and software workflows. Write accurate, well-documented solutions that serve as ground truth.
• Evaluate AI agent outputs against your solutions. Provide detailed written feedback capturing correctness, efficiency, and reasoning quality.
• Develop and refine evaluation frameworks and rubrics for assessing agentic behavior on AI and data science tasks.
• Collaborate with other subject matter experts to ensure consistency and accuracy in training data., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Must-Have

• 3+ years of research, academic, or industry experience in Machine Learning, Data Science, Software Engineering, Computer Science, Statistics, Biology, Electrical/Mechanical/Civil Engineering, Physics, Chemistry, Mathematics, Materials Science, or other STEM background.
• Demonstrated technical expertise in programming, data analysis, ML modeling, statistical methods, or computational methods.
• Ability to commit to 40 hours per week during weekdays for the duration of the engagement.

• Strong written communication skills and the ability to explain technical decisions clearly.

• Prior experience with data annotation, labeling, evaluation, or human feedback collection.
• Experience with LLMs, AI systems, or agentic workflows; familiarity with agentic frameworks.

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.