Data Scientist - AI Booster Team

At idealo, Generative AI (GenAI) is becoming a multiplier across every team. The AI Booster Team is our internal technical competence center: we pair with product teams, build reusable GenAI building blocks and share best practices company-wide. We validate AI business cases through data and ship evaluation frameworks that turn pilots into production. As a Data Scientist you will translate ideas into evidence: designing experiments, measuring LLM quality, and unlocking the full value of idealo's data assets to guide today's and tomorrow's GenAI initiatives., * Quantify opportunities & run experiments - perform causal analyses using experiments and observational methods to evaluate the business impact of GenAI features.

• Own model evaluation pipelines - create metrics dashboards and human / AI-assisted reviews that benchmark LLM quality, cost and safety.
• Guide model selection - compare foundation models, fine-tunes and RAG setups, recommending the right balance of performance vs. cost.
• Champion data strategy - surface high-value datasets (product, pricing, behaviour) and advocate their use in current and future AI products.
• Pair & coach - work embedded with engineers and analysts, sharing best practices in experimentation, metrics, and GenAI evaluation.
• Harvest patterns - document reusable evaluation playbooks so every team can measure GenAI success consistently.

• 3 + years in data science / analytics, including A/B testing or causal inference at scale.
• Expert SQL and Python (pandas, StatsModels / SciPy, scikit-learn); comfortable with notebooks and BI tools for storytelling.
• Hands-on with LLM assessment - prompt / temperature sweeps, embedding similarity metrics, human-in-the-loop studies, and LLM-as-a-judge tools (e.g. Bedrock model evaluation, OpenAI Evals).
• Familiar with Generative AI stacks (Hugging Face, LangChain/LlamaIndex, vector DBs like Pinecone/Qdrant) and retrieval-augmented generation concepts.
• Proficiency in AWS analytics & MLOps: SageMaker Experiments / Pipelines, Bedrock, Athena, Lambda, Step Functions; able to automate evaluation workflows and cost dashboards.
• Strong communication: can turn complex findings into clear, actionable insights and coach cross-functional teams.
• We're keen to see evidence of exceptional achievement - perhaps you've scaled a personal project to thousands of users, published influential research, ranked highly in competitive arenas (e.g. sports, Kaggle, hackathons) or maintain widely-used open-source libraries. Tell us what makes you stand out!

You don't tick every single box? No worries! We hire people, not checklists, and value motivation to grow.

idealo is a Berlin-based internet success story. Founded in 2000, we started with the mission of helping our users to make the best online buying decisions. 
Today, we are one of the leading product and price comparison platforms in Europe and one of the largest portals in the German e-commerce market. We achieved this by obtaining more than 2.5 million page impressions per day, 50.000 connected Online-Shops, and over 560 million product offers. With a strong focus on convenience, transparency, and technological expertise, we enable our partners to grow their business on idealo as a high-quality traffic and sales driver. 

As a member of our team, you can look forward to working with a large degree of freedom in an international and inspirational environment. We are located in the heart of Berlin but believe that we are happier and can work more effectively when the job fits our individual lives. That's why we offer our employees the freedom to choose their workplace. At idealo, we are convinced that flexibility is fundamental for hybrid working and offer permanent work from anywhere in Germany as well as temporary from abroad. 

We offer a unique idealo spirit. Your ideas are the driving force that moves our business forward. Not only our product portfolio is diverse, but also the people who work on it. We want you just as you are – regardless of origin, religion, gender, sexual orientation, or a degree of disability.