Databricks Platform Engineer

Deutsche Börse AG
14 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote

Tech stack

Airflow
Azure
Big Data
Information Engineering
Github
Python
Scrum
Spark
Data Lake
Information Technology
Apache Flink
Kafka
Data Management
Terraform
Data Pipelines
Apache Beam
Databricks

Job description

controls. Define and maintain catalogs, schemas, and tables across workspaces using Unity Catalog. Ensure the data platform is secure, scalable, and highly available. Contribute to the implementation of the Data Mesh paradigm across domains. Act as a technical advisor to data scientists, analysts, and business users. Drive onboarding, training, and enablement programs to scale platform adoption. Maintain technical documentation and contribute to Agile ceremonies and sprint planning. Your profile: Bachelor's degree in Computer Science, Data Engineering, or a related field. 5+ years of experience in cloud big data platforms, preferably Azure or GCP. Hands-on experience with Databricks, Delta Lake, and Spark; familiarity with Kafka, Flink, or similar frameworks is a plus. Experience building data pipelines using tools like Apache Airflow, Data Factory, or Apache Beam. Proficiency in Terraform, Python and CI/CD tools such as GitHub Actions. Strong understanding of data management

Requirements

monitoring, security, and privacy. Excellent communication and collaboration skills across cross-functional teams. Fluent in English; additional language skills are a plus. Why Deutsche Börse Group? We are committed to providing a work environment where everyone feels welcome and can reach their full potential. Our standards go far beyond simply matching candidates with the right position. Mobility We enable you to move freely with our job tickets, job (e-)bikes and free parking opportunities. Work environment Collaboration, communication, or deep focus - in our modern office buildings you will find the perfect work environment. Free drinks and food and meal allowances included. Health and wellbeing We care for your health and wellbeing and besides various health promotion measures we offer you a group accident insurance and additional insurance offers at discounted rates. Financial stability We provide financial stability by offering attractive salaries, company pension schemes

About the company

Frankfurt am Main Your career at Deutsche Börse Group Your area of work: As part of Deutsche Börse Group's digital transformation and cloud migration journey, the Big Data & Advanced Analytics (BDAA) team is seeking a skilled and forward-thinking Databricks Platform Engineer. This role is central to designing, building, and optimizing our enterprise-grade data platform on Databricks, enabling scalable data product development across the value chain from BI to AI. You will join a dynamic team of data & automation engineers and architects, contributing to the definition and deployment of cloud data architecture, platform automation, and operational excellence. Your work will directly support business use cases in big data and advanced analytics across one of the world's leading financial exchanges. Your responsibilities: Provision and configure Databricks workspaces using Terraform, CLI, and SDK. Manage workspace-level settings including clusters, libraries, compute policies, and access

Apply for this position