Finance Expert - AI Model Evaluator
Mercor, Inc.
New York, NY, United States
15 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$135,200.0 - $187,200.0
Working hours
Regular working hours
Job source
Tech stack
Training Data
Artificial Intelligence
Large Language Models
Job description
- Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making.
- Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice.
- Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
- Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks.
- Collaborate with other subject matter experts to ensure consistency and accuracy in training data., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Requirements
Must-Have
- 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent).
- Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria.
- Demonstrable career progression (e.g., Analyst * Associate * VP/Director).
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Verbal and written communication skills, problem-solving skills, and interpersonal skills.
Benefits & conditions
- $140,000-175,000 per year
About the company
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
almost 3 years ago
LM
Luis Minvielle
How to Become an AI Engineer
almost 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago
OL
Or Levi
How to start an AI project for a good cause and boost your career
almost 6 years ago
EM
Eli McGarvie
13 AI Tools You Have to Try
over 3 years ago
ER
Erin Rifkin
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud
about 1 year ago