Senior Data Engineer - ML Platform
Role details
Job location
Tech stack
Job description
- Work in a modern, cloud-only AWS stack - EMR, EKS, S3, Athena/Glue, SageMaker, DynamoDB - orchestrated with Airflow and managed as code with Terraform, with a clear path to bringing every remaining piece fully onto this stack.
- Shape the Kafka backbone that carries user-journey events from upstream services to the data lake, ML training, and analytics consumers.
- Move data at scale with Spark SQL on Delta Lake and Apache Iceberg - ACID storage, time-travel, and concurrent-write reliability on top of S3.
- Build the data layer for our recommendation engine - Athena schemas and views for model training, plus the real-time data assets (Redis, DynamoDB) that the recommendation service reads at request time.
- Push AI-assisted development and operations further - we invest heavily in AI tooling for development, code review, documentation and operations, and we're actively deepening that. You'll help shape how the team works.
- Steward the platform's long-term health - drive version upgrades, reduce tech debt, and keep the stack on the leading edge.
Requirements
Do you have experience in Terraform?, * 5+ years of experience in data engineering or ML platform work in production environments
- You write strong Python code, focused on production-grade applications (not just notebooks or scripts)
- Advanced SQL (Athena / Spark SQL; SQL-first data transformations)
- Kafka experience (producers, consumers, stream processing)
- Solid Cloud experience (AWS preferred, or GCP/Azure)
- Fluent English for daily collaboration within an international team.
- Based in Spain with valid work authorization
It´s a plus if you have :
- Spark & data lake ecosystem - Spark/PySpark (job structuring & tuning), plus lakehouse formats like Delta Lake or Iceberg
- Orchestration & MLOps - Airflow, SageMaker or similar tools
- ML data workflows - experience with feature pipelines, training datasets, and online serving
About the company
Herzlich willkommen beim führenden Netzwerk für Gutscheine und Vorteilsangebote. An unserem Sitz in der Technologieregion Karlsruhe entwickeln wir hochwertige E-Commerce-Lösungen, um mit 130 Mitarbeiter*innen das Business unserer über 1.100 europäischen Partner-Shops immer weiter zu verbessern. Wie? Mit Leuten wie Dir, die uns mit Power und Persönlichkeit bereichern. Als Arbeitgeber sorgen wir dafür, dass Du Deinen Job liebst und Dich mit Freude bei uns einbringst. Das gelingt uns mit spannenden Aufgaben in einer positiven Arbeitsatmosphäre und vielen Benefits.