Data Scientist - AI Evaluation
Mercor, Inc.
New York, NY, United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
1 year minimum
Compensation
$208,000.0 - $312,000.0
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Data Analysis
Python (Programming Language)
Machine Learning
SQL Databases
Machine Learning Operations
Job description
- Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
- Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
- Provide detailed written justifications for evaluations and scores to maintain transparency.
- Apply consistent, evidence-based judgment for reproducible and defensible assessments.
- Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Requirements
Must-Have
- 1+ years of professional data science experience.
- Experience at a leading technology, research, or quantitative firm.
- Strong command of Python, SQL, statistical modeling, and machine learning.
- Exceptional written communication skills for conveying technical findings.
- Detail-oriented and consistent approach to evaluating complex work.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
almost 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
about 2 years ago
PP
Prashant Pujara
What Industries Outside of AI Are Hiring The Most AI Experts?
over 4 years ago
BR
Benjamin Ruschin
Navigating the AI Shift
about 1 year ago
OL
Or Levi
How to start an AI project for a good cause and boost your career
almost 6 years ago
BB
Benedikt Bischof
MLOps – What’s the deal behind it?
about 4 years ago