(Senior) Data Scientist - AI Booster Team (f|m|d)

At idealo, Generative AI (GenAI) is becoming a multiplier across every team. The AI Booster Team is our internal technical competence center: we pair with product teams, build reusable GenAI building blocks and share best practices company-wide. We validate AI business cases through data and ship evaluation frameworks that turn pilots into production. As a Data Scientist you will translate ideas into evidence: designing experiments, measuring LLM quality, and unlocking the full value of idealo's data assets to guide today's and tomorrow's GenAI initiatives., * Quantify opportunities & run experiments - perform causal analyses using experiments and observational methods to evaluate the business impact of GenAI features.

• Own model evaluation pipelines - create metrics dashboards and human / AI-assisted reviews that benchmark LLM quality, cost and safety.
• Guide model selection - compare foundation models, fine-tunes and RAG setups, recommending the right balance of performance vs. cost.
• Champion data strategy - surface high-value datasets (product, pricing, behaviour) and advocate their use in current and future AI products.
• Pair & coach - work embedded with engineers and analysts, sharing best practices in experimentation, metrics, and GenAI evaluation.
• Harvest patterns - document reusable evaluation playbooks so every team can measure GenAI success consistently., * And what about the office? Our office in the heart of Berlin offers free organic breakfast, excellent free lunch (vegan and vegetarian), as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.
• In need of additional support in any areas of your life? We offer free counseling and support in all areas of life (professional, private, family, health, etc.) in cooperation with the pme-Familienservice.
• You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket - and it's environmentally friendly, too!
• Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.
• And what else is there? Of course, success must be celebrated! In addition to team events, you can also expect big company events and other moments of organized connection with others in the company and your team throughout the year!

Do you have experience in SciPy?, Do you have a Master's degree?, * 3 + years in data science / analytics, including A/B testing or causal inference at scale.

• Expert SQL and Python (pandas, StatsModels / SciPy, scikit-learn); comfortable with notebooks and BI tools for storytelling.
• Hands-on with LLM assessment - prompt / temperature sweeps, embedding similarity metrics, human-in-the-loop studies, and LLM-as-a-judge tools (e.g. Bedrock model evaluation, OpenAI Evals).
• Familiar with Generative AI stacks (Hugging Face, LangChain/LlamaIndex, vector DBs like Pinecone/Qdrant) and retrieval-augmented generation concepts.
• Proficiency in AWS analytics & MLOps: SageMaker Experiments / Pipelines, Bedrock, Athena, Lambda, Step Functions; able to automate evaluation workflows and cost dashboards.
• Strong communication: can turn complex findings into clear, actionable insights and coach cross-functional teams.
• We're keen to see evidence of exceptional achievement - perhaps you've scaled a personal project to thousands of users, published influential research, ranked highly in competitive arenas (e.g. sports, Kaggle, hackathons) or maintain widely-used open-source libraries. Tell us what makes you stand out!

You don't tick every single box? No worries! We hire people, not checklists, and value motivation to grow.

idealo is a Berlin-based internet success story. Founded in 2000, we started with the mission of helping our users to make the best online buying decisions. 
Today, we are one of the leading product and price comparison platforms in Europe and one of the largest portals in the German e-commerce market. We achieved this by obtaining more than 2.5 million page impressions per day, 50.000 connected Online-Shops, and over 560 million product offers. With a strong focus on convenience, transparency, and technological expertise, we enable our partners to grow their business on idealo as a high-quality traffic and sales driver. 

As a member of our team, you can look forward to working with a large degree of freedom in an international and inspirational environment. We are located in the heart of Berlin but believe that we are happier and can work more effectively when the job fits our individual lives. That's why we offer our employees the freedom to choose their workplace. At idealo, we are convinced that flexibility is fundamental for hybrid working and offer permanent work from anywhere in Germany as well as temporary from abroad. 

We offer a unique idealo spirit. Your ideas are the driving force that moves our business forward. Not only our product portfolio is diverse, but also the people who work on it. We want you just as you are – regardless of origin, religion, gender, sexual orientation, or a degree of disability.