> Markdown version of [/jobs/ext/390426-senior-data-engineer-ml-platform](https://www.wearedevelopers.com/jobs/ext/390426-senior-data-engineer-ml-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - ML Platform - **Company:** Sovendus GmbH - **Location:** Frankfurt am Main, Germany (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Data Analysis, Apache HTTP Server, Microsoft Azure, Cloud Computing, Code Review, Information Engineering, Amazon DynamoDB, Apache Hive, Python (Programming Language), Machine Learning, Redis, Azure Machine Learning, SQL Databases, Sql Optimization, Apache Spark, Technical Debt, Data Layers, Data Lakes, Pyspark, Real Time Data, Apache Kafka, Machine Learning Operations, Terraform, Stream Processing - **Published:** June 11, 2026 - **Apply:** https://de.indeed.com/viewjob?jk=9451666e522f43ec ## About the Role Do you have experience in Terraform?, * 5+ years of experience in data engineering or ML platform work in production environments * You write strong Python code, focused on production-grade applications (not just notebooks or scripts) * Advanced SQL (Athena / Spark SQL; SQL-first data transformations) * Kafka experience (producers, consumers, stream processing) * Solid Cloud experience (AWS preferred, or GCP/Azure) * Fluent English for daily collaboration within an international team. * Based in Spain with valid work authorization It´s a plus if you have : * Spark & data lake ecosystem - Spark/PySpark (job structuring & tuning), plus lakehouse formats like Delta Lake or Iceberg * Orchestration & MLOps - Airflow, SageMaker or similar tools * ML data workflows - experience with feature pipelines, training datasets, and online serving ## Description * Work in a modern, cloud-only AWS stack - EMR, EKS, S3, Athena/Glue, SageMaker, DynamoDB - orchestrated with Airflow and managed as code with Terraform, with a clear path to bringing every remaining piece fully onto this stack. * Shape the Kafka backbone that carries user-journey events from upstream services to the data lake, ML training, and analytics consumers. * Move data at scale with Spark SQL on Delta Lake and Apache Iceberg - ACID storage, time-travel, and concurrent-write reliability on top of S3. * Build the data layer for our recommendation engine - Athena schemas and views for model training, plus the real-time data assets (Redis, DynamoDB) that the recommendation service reads at request time. * Push AI-assisted development and operations further - we invest heavily in AI tooling for development, code review, documentation and operations, and we're actively deepening that. You'll help shape how the team works. * Steward the platform's long-term health - drive version upgrades, reduce tech debt, and keep the stack on the leading edge. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)