Finance Expert - AI Model Evaluator

Mercor, Inc.
New York, NY, United States
15 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$135,200.0 - $187,200.0
Working hours
Regular working hours

Tech stack

Training Data Artificial Intelligence Large Language Models

Job description

  • Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making.
  • Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice.
  • Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
  • Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks.
  • Collaborate with other subject matter experts to ensure consistency and accuracy in training data., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Requirements

Must-Have

  • 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent).
  • Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria.
  • Demonstrable career progression (e.g., Analyst * Associate * VP/Director).
  • Ability to engage reliably for at least 35 hours/week during weekdays.
  • Verbal and written communication skills, problem-solving skills, and interpersonal skills.

Benefits & conditions

  • $140,000-175,000 per year

About the company

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:05 min

Building a compliant AI wealth advisor in-house

Mike Butcher Mike Butcher +1 · World Congress 2024

2:20 min

Architecting language translation with focused training data

Jaroslaw Kutylowski Jaroslaw Kutylowski +1 · World Congress 2023

3:32 min

Fundamentals and limitations of large language models

Krzystof Czieslak · LIVE

3:46 min

Core terminology and audiences for interpretable artificial intelligence

Karol Przystalski · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:25 min

Meta's investment in Scale AI and training data

Damandeep Kochhar Damandeep Kochhar +4 · World Congress 2026 Europe

Videos

See all

Related articles

See all