Machine Learning Evaluator - AI Trainer

Mercor, Inc.
Philadelphia, PA, United States
13 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Contract
Employment type
Part-time / full-time
Experience level
Expert
Experience required
3 years minimum
Compensation
$145,600.0 - $187,200.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Machine Learning Tensorflow Pytorch Kaggle Scikit Learn Xgboost

Job description

  • Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks for training and evaluating models.
  • Assess experiment design, model-selection reasoning, and evaluation methodology.
  • Provide clear, rubric-based written feedback to improve AI model performance.
  • Review and critique ML claims against evidence and reproduce results.
  • Work independently and asynchronously to meet deadlines while enhancing model outputs., Principal Machine Learning Engineer to serve as a hands-on technical leader for machine learning, predictive modeling, scoring, decisioning, and applied AI initiatives. This role w…
  • 1 month ago

Requirements

Must-Have

  • 3+ years hands-on applied/experimental ML experience.
  • Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene.
  • Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost).
  • Ability to critique ML claims against evidence and reproduce results.

Preferred

  • Competition/benchmark experience (e.g., Kaggle).
  • Graduate research or publication record in applied ML.
  • Prior task-grading or peer-review experience.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:22 min

Evaluating advanced artificial intelligence platforms for daily recruitment

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

1:09 min

Configuring synthetic data for safe interactive programming

Mingshen Sun Mingshen Sun · World Congress 2024

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:22 min

Downloading and inspecting data frames via the Kaggle API

Lutske van der Meer Lutske van der Meer · World Congress 2024

9:47 min

Transforming tabular metrics into meaningful business value dashboards

Boris Krumrey +2 · LIVE

1:06 min

Compiling PyTorch environments for advanced time forecasting

Christoph Lohrmann Christoph Lohrmann +1 · World Congress 2026 Europe

Videos

See all

Related articles

See all