AI Evaluation Data Scientist
Role details
Job location
Tech stack
Job description
We are looking to fill this role immediately and are reviewing applications daily. Expect a fast, transparent process with quick feedback. Why join us? We are a European deep-tech leader in quantum and AI, backed by major global strategic investors and strong EU support. Our groundbreaking technology is already transforming how AI is deployed worldwide - compressing large language models by up to 95% without losing accuracy and cutting inference costs by 50-80%. Joining us means working on cutting-edge solutions that make AI faster, greener, and more accessible - and being part of a company often described as a "quantum-AI unicorn in the making.", Build robust evaluation pipelines that accurately mirror real production use cases for AI agentic systems and SML components. Define and track success metrics for both agentic workflows and key model components, focusing on measurement aligned with practical production performance rather than pure benchmarks. Design annotation frameworks and automated evaluation tools to conduct rigorous, repeatable analysis of model/system output. Execute deep-dive data investigations, monitor success and failure cases, and deliver actionable feedback loops to guide model/system improvements. Collaborate with engineers and researchers to shape experiments, validate hypotheses, and iterate toward higher performing model deployments. Communicate evaluation methodologies, results, and insights to technical and non-technical stakeholders, supporting ongoing improvement and transparency.
Requirements
Master's degree in Computer Science, Data Science, Mathematics, Engineering, or related field. 2+ years of experience in AI/ML model evaluation or large-scale data analysis. Strong proficiency in Python, and evaluation/data analysis libraries (NumPy, Pandas, scikit-learn, etc.). Direct experience creating evaluation pipelines for AI or data-driven systems, with a track record in metric definition and performance analysis. Familiarity with ML infrastructure (experiment tracking, model versioning, continuous evaluation). Experience working with large unstructured datasets and data visualization/reporting to communicate findings., Experience evaluating generative AI agents, LLMs, or advanced SML components in production or R&D settings. Exposure to human annotation workflows and automated labeling tools. Knowledge of statistical analysis, fairness, bias, and robust metric development for model evaluation. Familiarity with ML experimentation platforms, cloud-based AI infrastructure, and advanced model validation techniques.
Benefits & conditions
Competitive annual salary Two unique bonuses: signing bonus at incorporation and retention bonus at contract completion. Relocation package (if applicable). Up to 9-month contract, ending on June 2026. Hybrid role and flexible working hours. Be part of a fast-scaling Series B company at the forefront of deep tech. Equal pay guaranteed. International exposure in a multicultural, cutting-edge environment.
About the company
Multiverse is a well-funded and fast-growing deep-tech company founded in 2019. We are one of the few companies working with Quantum Computing and the biggest Quantum Software company in the EU.
We provide hyper-efficient software to companies wanting to gain an edge with quantum computing and artificial intelligence. Our product, Singularity, is a software platform that contains quantum and quantum-inspired algorithms developed and patented through proof-of-concept trials we have been performing for industrial and service clients. We work in finance, energy, manufacturing, cybersecurity and many more industries.
Digital methods usually fail at efficiently tackling these problems. Quantum computing, however, provides us with a powerful toolbox to tackle these complex problems, such as outstanding optimization methods, software for quantum machine learning, and quantum enhanced Monte Carlo algorithms.
Multiverse Computing applies these cutting edge methods to provide software which is customized to your needs, giving companies a chance to derive value from the second quantum revolution.