Software Engineer - Evaluation Author - AI Trainer

Mercor, Inc.

Miami, FL, United States

about 2 months ago

Role details

Contract type

Permanent contract

Employment type

Part-time (≤ 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$72,800.0 - $249,600.0

Working hours

Regular working hours

Languages

English

Job source

careerjet.com

Tech stack

Artificial Intelligence Software Quality Software Debugging Machine Learning Software Engineering

Job description

Author non-trivial coding tasks with golden solutions and automated verifiers.
Design rubrics and grade agent trajectories and model outputs.
Improve task and rubric quality through structured review.
Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
Work independently and asynchronously to meet deadlines while improving AI model performance., Audio engineers apply their technical expertise with tools such as Audacity, Ardour, and LMMS to enhance AI research projects. This role involves contributing to the improvement of…
7 days ago
Apply easily, As an Audio Engineer specializing in native English language, you will play a crucial role in shaping the development of next-generation AI systems. Your expertise will directly in…
15 days ago
Apply easily +

Requirements

Must-Have

5+ years of software engineering at a real product organization (big tech or venture-backed startup).
Strong code quality, systems design, debugging, and testing discipline.
Clear written communication (you write instructions others follow).

Preferred

Familiarity with AI coding tools and evals.

Benefits & conditions

Short Mercor Technical Screen.
Live Code Review Session.
Domain Expert Interview.
You’re paid $200 for completing all three, regardless of outcome., + $60.00 per hour Join a dynamic team as an Image Generation Expert & Prompt Engineer, where your skills will directly contribute to the advancement of AI research. In this role, you will craft prec…
11 days ago

About the company

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.