Senior Data Engineer - ML Platform

Sovendus GmbH
Frankfurt am Main, Germany
30 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Frankfurt am Main, Germany

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Apache HTTP Server
Azure
Cloud Computing
Code Review
Information Engineering
Amazon DynamoDB
Hive
Python
Machine Learning
Redis
Azure
SQL Databases
Sql Optimization
Spark
Technical Debt
Data Layers
Data Lake
PySpark
Real Time Data
Kafka
Machine Learning Operations
Terraform
Stream Processing

Job description

  • Work in a modern, cloud-only AWS stack - EMR, EKS, S3, Athena/Glue, SageMaker, DynamoDB - orchestrated with Airflow and managed as code with Terraform, with a clear path to bringing every remaining piece fully onto this stack.
  • Shape the Kafka backbone that carries user-journey events from upstream services to the data lake, ML training, and analytics consumers.
  • Move data at scale with Spark SQL on Delta Lake and Apache Iceberg - ACID storage, time-travel, and concurrent-write reliability on top of S3.
  • Build the data layer for our recommendation engine - Athena schemas and views for model training, plus the real-time data assets (Redis, DynamoDB) that the recommendation service reads at request time.
  • Push AI-assisted development and operations further - we invest heavily in AI tooling for development, code review, documentation and operations, and we're actively deepening that. You'll help shape how the team works.
  • Steward the platform's long-term health - drive version upgrades, reduce tech debt, and keep the stack on the leading edge.

Requirements

Do you have experience in Terraform?, * 5+ years of experience in data engineering or ML platform work in production environments

  • You write strong Python code, focused on production-grade applications (not just notebooks or scripts)
  • Advanced SQL (Athena / Spark SQL; SQL-first data transformations)
  • Kafka experience (producers, consumers, stream processing)
  • Solid Cloud experience (AWS preferred, or GCP/Azure)
  • Fluent English for daily collaboration within an international team.
  • Based in Spain with valid work authorization

It´s a plus if you have :

  • Spark & data lake ecosystem - Spark/PySpark (job structuring & tuning), plus lakehouse formats like Delta Lake or Iceberg
  • Orchestration & MLOps - Airflow, SageMaker or similar tools
  • ML data workflows - experience with feature pipelines, training datasets, and online serving

About the company

Herzlich willkommen beim führenden Netzwerk für Gutscheine und Vorteilsangebote. An unserem Sitz in der Technologieregion Karlsruhe entwickeln wir hochwertige E-Commerce-Lösungen, um mit 130 Mitarbeiter*innen das Business unserer über 1.100 europäischen Partner-Shops immer weiter zu verbessern. Wie? Mit Leuten wie Dir, die uns mit Power und Persönlichkeit bereichern. Als Arbeitgeber sorgen wir dafür, dass Du Deinen Job liebst und Dich mit Freude bei uns einbringst. Das gelingt uns mit spannenden Aufgaben in einer positiven Arbeitsatmosphäre und vielen Benefits.

Apply for this position