> Markdown version of [/jobs/ext/3173861-data-engineer-mid-level](https://www.wearedevelopers.com/jobs/ext/3173861-data-engineer-mid-level). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer Mid-Level - **Company:** Octopus Energy - **Location:** Berlin, Germany - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Airflow, Business Analytics Applications, Data Analysis, Databases, Continuous Integration, Directed Acyclic Graph (Directed Graphs), Information Engineering, Python (Programming Language), Machine Learning, Performance Tuning, SQL Databases, Git, Pandas, Data Lakes, Pyspark, Scikit Learn, Data Lineage, Star Schema, Machine Learning Operations, Streamlit Framework, Databricks - **Published:** September 9, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e2ec080859e91f5f ## About the Role * Berufserfahrung: + Mindestens 2-4 Jahre Praxis im Data Engineering, Analytics Engineering oder einer vergleichbaren Rolle. * Core Engineering Stack: + Fundierte Praxis mit Databricks (Delta Lake, Unity Catalog), dbt und Apache Airflow. * BI & Data Apps: + Erfahrung mit Lightdash (oder Interesse an code-basierter BI) sowie mit Streamlit. * Code & Datenbanksprachen: + Exzellentes SQL (Performance-Tuning, komplexe Joins) und sehr gutes Python (pandas, PySpark, scikit-learn). * Methodik & Best Practices: + Routinierter Umgang mit Git / CI/CD und modernen Modellierungskonzepten (Star-Schema). * Mindset & Sprachen: + Pragmatische Hands-on-Mentalität, starke Kommunikationsfähigkeit und sehr gutes Deutsch & Englisch. ## Description Du begleitest Daten entlang ihres gesamten Lebenszyklus - von der Rohdatenaufnahme im Lakehouse über automatisierte Datenmodelle bis hin zu interaktiven Dashboards und Machine-Learning-gestützten Datenanwendungen. * Lakehouse & Data Engineering (ca. 50%): + Konzeption, Aufbau und Tuning performanter Pipelines auf Basis von Databricks. + Datenmodellierung mit dbt sowie Orchestrierung robuster DAGs via Apache Airflow. * Governance & Performance: + Etablierung automatisierter Data-Quality-Prüfungen, Data Lineage und Cluster-Optimierung. * Analytics & Data Apps (ca. 25%): + Aufbau einer semantischen Metriken-Schicht und Self-Service-BI in Lightdash. + Entwicklung interaktiver Analyse-Tools und Data Apps in Python (Streamlit). * Data Science & ML (ca. 25%): + Explorative Analysen, Prototyping und Training von ML-Modellen (z. B. Prognosen, Anomalien). * MLOps & Business-Integration: + Experiment-Tracking auf Databricks und Bereitstellung der Ergebnisse für Fachbereiche. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) ## Related Articles - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary Germany](https://www.wearedevelopers.com/magazine/277-data-analyst-salary-germany) - [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Backend Developer Salary in Germany [2023]](https://www.wearedevelopers.com/magazine/196-backend-developer-salary-in-germany-2023)