> Markdown version of [/jobs/ext/2185455-finance-expert-ai-model-evaluator](https://www.wearedevelopers.com/jobs/ext/2185455-finance-expert-ai-model-evaluator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Finance Expert - AI Model Evaluator

- **Company:** Mercor, Inc.
- **Location:** New York, NY, United States (Remote available)
- **Experience:** Expert
- **Salary:** $135,200.0 - $187,200.0
- **Contract:** Permanent contract
- **Skills:** Training Data, Artificial Intelligence, Large Language Models
- **Published:** August 22, 2026
- **Apply:** https://www.careerjet.com/jobad/us960debf29c2ce66207a22bc62944c768

## About the Role

Must-Have

 * 8+ years of dedicated professional experience in finance (e.g., investment banking, asset management, corporate finance, financial advisory) at a recognized, top-tier organization (e.g., Goldman Sachs, JPMorgan, Morgan Stanley, BlackRock, Fidelity, Deloitte, PwC, EY, KPMG, or equivalent).
 * Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria.
 * Demonstrable career progression (e.g., Analyst * Associate * VP/Director).
 * Ability to engage reliably for at least 35 hours/week during weekdays.
 * Verbal and written communication skills, problem-solving skills, and interpersonal skills.

## Description

* Guide research and engineering teams to close knowledge gaps in financial reasoning, analysis, and decision-making.
 * Design challenging, domain-relevant finance tasks and write accurate, well-reasoned solutions grounded in real financial practice.
 * Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
 * Develop and refine evaluation guidelines and scoring rubrics specific to finance tasks.
 * Collaborate with other subject matter experts to ensure consistency and accuracy in training data., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


## Related Videos

- [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models)
- [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai)
- [Fireside Chat: Deep Learning, Deep Impact: Harnessing AI for Language Innovation](https://www.wearedevelopers.com/videos/612-fireside-chat-deep-learning-deep-impact-harnessing-ai-for-language-innovation)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Exploring 5 Key Applications of AI Abundance with Blockchain Assurance](https://www.wearedevelopers.com/videos/971-exploring-5-key-applications-of-ai-abundance-with-blockchain-assurance)
- [Outclassing Frontier LLMs at Extracting Information](https://www.wearedevelopers.com/videos/100303-outclassing-frontier-llms-at-extracting-information)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to start an AI project for a good cause and boost your career](https://www.wearedevelopers.com/magazine/15-how-to-start-an-ai-project-for-a-good-cause-and-boost-your-career)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)