AI Model Evaluator / AI Trainer

DRAFT LAB LLC
Miami, FL, United States
6 days ago
Apply on www.wayup.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Compensation
$41,600.0
Working hours
Shift work
Languages
English
Job source

Tech stack

Artificial Intelligence Desktop Computing Model Validation Information Technology

Job description

We are hiring remote AI Model Evaluators and AI Trainers to support multiple ongoing AI training projects. We are building an in-house contributor team for work across AI model evaluations, computer-use tasks, response ranking, red teaming, tool-use evaluation, and other AI training workflows. In this role, you may review AI-generated responses, compare outputs, test whether an AI followed instructions, complete browser-based computer-use tasks, or provide feedback that helps improve model performance. This is flexible remote work for detail-oriented students, recent graduates, and early-career professionals who can follow instructions carefully and produce high-quality work. Responsibilities:

  • Compare AI-generated responses and select the stronger answer
  • Write clear explanations for why one response is better
  • Complete computer-use tasks in browser-based environments
  • Evaluate AI outputs for accuracy, reasoning, clarity, tone, and instruction following
  • Follow detailed project-specific rubrics and guidelines
  • Complete benchmark tasks before unlocking paid projects
  • Maintain high-quality work across assigned tasks Ideal candidates

Requirements

  • Current undergraduate student, graduate student, recent graduate, or early-career professional
  • Strong attention to detail
  • Clear written communication
  • Comfortable following detailed instructions
  • Interest in AI, model evaluation, computer-use agents, language, reasoning, or technology
  • Strong fit for students in Computer Science, Data Science, Business, Economics, Finance, English, Linguistics, Philosophy, or related fields, + Must be based in the United States
  • Must complete a short benchmark before receiving paid tasks
  • Must be able to follow detailed instructions without relying on AI to complete the work
  • Must have reliable internet access and a laptop or desktop computer Type of position: Part-time contractor / remote Work experience: No prior professional experience required Current students and recent graduates welcome

Benefits & conditions

  • $20-$200/hour depending on project type, difficulty, and required expertise
  • Flexible remote work
  • Paid work becomes available after completing project benchmarks

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com
Prepare application

Good distractions

Loading talks and stories from around this role…