Product Data Scientist - Ai Evaluation & Quality (Remote)

About FinomFinom is a European tech startup headquartered in Amsterdam, and we’re on a journey towards revolutionizing the financial landscape for entrepreneurs worldwide. Our mission is to develop an all-in-one financial B2B solution that integrates banking functions, accounting, financial management, and invoicing into a seamless, mobile-first platform. We recently closed a€115 million Series C equity round(around $133 million), bringing our total funding to approximately $346 million. This significant investment follows a $105 million growth funding round from General Catalyst, a long-term backer since ** known for supporting companies like Airbnb, HubSpot, KAYAK, and Stripe. Finom’s platform goes beyond traditional banking, offering invoicing and a growing suite of features, including AI-enabled accounting, aiming to simplify financial management for entrepreneurs. We’re actively expanding our reach across key EU markets like Germany, France, the Netherlands, Italy, and Spain. At Finom, we’re not just redefining the entrepreneurial experience - we’re empowering our employees to make a real difference. Your work matters, and your impact extends far beyond product metrics. We nurture innovation and an inspiring work environment where bold ideas thrive, prioritizing thorough research, swift implementation of solutions, and ensuring that every effort we make benefits our users, employees, partners, and our business as a whole. Maintaining our start-up spirit, we prioritize thorough research, swift implementation of solutions, and ensuring that every effort we make benefits our users, employees, partners, and, of course, our business.You’ll join theAI Team- the group driving all AI products and technology at Finom.We build and ship AI across the company: AI financial co-pilot, voice agent, and internal AI-powered processes.Our belief: your AI agent is only as good as your eval loop - we can build AI as good as the evals we run on it.Your mission: own that eval loop across every AI product we ship - pre-launch quality gates, post-launch monitoring, continuous improvement.You’ll work directly with our AI Quality lead, Igor Kolodkin.Close collaboration with AI engineers, Product, and domain experts across the company.Core stack: Databricks, DeepEval, Claude Code.What You Will Be DoingOwn and extend our offline eval suite across products - datasets (capability + regression), judges, metricsBuild and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latencyClose the production feedback loop: mine failure patterns from real traffic ? turn them into regression cases ? propose fixes to Product and domain expertsHarden methodology: judge stability, non-determinism handlingTranslate numbers into decisions - weekly syncs, clear trade-offs, no dashboards for their own sakeMust-HavesPython and SQL - you can build an analysis end-to-endSolid foundation in statistics - sampling, hypothesis testing, variance, understanding what a noisy metric isAnalytical mindset - you start from the business question, not from the tool3+ years in analyst / data scientist roles, at least one in a product contextNice-to-HavesExperience in quality analytics for ML systems - ranking, recommendations, classification, etc.Hands-on experience evaluating LLM applications (RAG, agents, tool use, judges)Experience building LLM agents - side projects, toy builds, personal experiments all countHow We Work - One Thing We Mean SeriouslyAI-assisted coding is our default authoring environment, not a bonusClaude Code is our main tool - you’ll reach for it for SQL, Python, analyses, dashboards, and internal scriptsWe’re looking for analysts who are already curious and fluent with AI coding - or genuinely excited to become fluent fastWe care about what you ship and how clearly you thinkIf this idea excites you rather than worries you, you’ll feel at homeWhat You Will Get In ReturnMake a genuine impact on the productJoin our upward trajectory, and grow with us. We provide the resources and opportunities for continuous personal and professional development, empowering you to make a genuine impact on our evolving product.Work in the EUEmbark on this exciting journey with us and enjoy the flexibility of traveling and working remotely or in a hybrid model across Europe.Become a stock options holderUnlock your inner entrepreneur and align your aspirations with ours through our Stock Options Program. This exciting opportunity is available to every team member, from junior team members to our founders.Receive unwavering support and careFinom stands by you at every step, embodying our commitment to your well?being and success reflected in our modern, friendly, and eco-conscious corporate culture. We offer constant support and care to ensure your Finom experience is successful and fulfilling.Work & Swim programImmerse yourself in our exclusive Work & Swim Program. Spend one month in a comfortable corporate apartment in enchanting Cyprus. It’s the ideal opportunity to strike the perfect work-life balance while enjoying breathtaking Mediterranean views.Equal Opportunity StatementAt Finom, we’re an equal opportunity employer and value diversity at our company. We embrace diversity and invite applications from all walks of life. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, disability status, or other applicable legally protected characteristics.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.#J-***-Ljbffr

Solid foundation in statistics - sampling, hypothesis testing, variance, understanding what a noisy metric is Analytical mindset - you start from the business question, not from the tool 3+ years in analyst / data scientist roles, at least one in a product context Nice-to-Haves Experience in quality analytics for ML systems - ranking, recommendations, classification, etc. Hands-on experience evaluating LLM applications (RAG, agents, tool use, judges) Experience building LLM agents - side projects, toy builds, personal experiments all count

Claude Code is our main tool - you’ll reach for it for SQL, Python, analyses, dashboards, and internal scripts We’re looking for analysts who are already curious and fluent with AI coding - or genuinely excited to become fluent fast We care about what you ship and how clearly you think If this idea excites you rather than worries you, you’ll feel at home What You Will Get In Return Make a genuine impact on the product Join our upward trajectory, and grow with us. We provide the resources and opportunities for continuous personal and professional development, empowering you to make a genuine impact on our evolving product. Work in the EU Embark on this exciting journey with us and enjoy the flexibility of traveling and working remotely or in a hybrid model across Europe. Become a stock options holder Unlock your inner entrepreneur and align your aspirations with ours through our Stock Options Program. This exciting opportunity is available to every team member, from junior team members to our founders. Receive unwavering support and care Finom stands by you at every step, embodying our commitment to your well?being and success reflected in our modern, friendly, and eco-conscious corporate culture. We offer constant support and care to ensure your Finom experience is successful and fulfilling. Work & Swim program Immerse yourself in our exclusive Work & Swim Program. Spend one month in a comfortable corporate apartment in enchanting Cyprus. It’s the ideal opportunity to strike the perfect work-life balance while enjoying breathtaking Mediterranean views. Equal Opportunity Statement At Finom, we’re an equal opportunity employer and value diversity at our company. We embrace diversity and invite applications from all walks of life. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, disability status, or other applicable legally protected characteristics. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. #J-*****-Ljbffr