Data Scientist - AI Evaluation

Mercor, Inc.
New York, NY, United States
about 1 month ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
1 year minimum
Compensation
$208,000.0 - $312,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Python (Programming Language) Machine Learning SQL Databases Machine Learning Operations

Job description

  • Design precise, task-specific grading criteria for data science deliverables. This includes exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
  • Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy.
  • Provide detailed written justifications for evaluations and scores to maintain transparency.
  • Apply consistent, evidence-based judgment for reproducible and defensible assessments.
  • Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Requirements

Must-Have

  • 1+ years of professional data science experience.
  • Experience at a leading technology, research, or quantitative firm.
  • Strong command of Python, SQL, statistical modeling, and machine learning.
  • Exceptional written communication skills for conveying technical findings.
  • Detail-oriented and consistent approach to evaluating complex work.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

40 sec

Evaluating safety and data privacy in new software tools

Yewande Oyebo Yewande Oyebo · Europe 2026 Virtual

1:48 min

Automating exploratory data analysis within training pipelines

Dora Petrella · World Congress 2023

1:14 min

Evolution of distributed SQL database architectures

Wei Hu Wei Hu · World Congress 2024

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

53 sec

Moving beyond fuzzy keyword matching in recruitment platforms

Mina Golesorkhi Mina Golesorkhi · World Congress 2026 Europe

1:36 min

Performing exploratory data analysis to uncover underlying patterns

Julian Joseph · LIVE

Videos

See all

Related articles

See all