Platform Developer

Vertrag Über Cp
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English, German

Job location

Tech stack

Azure
Computer Networks
Continuous Integration
Information Engineering
Github
Python
Scrum
Role-Based Access Control
SQL Databases
Spark
Data Lake
Terraform
Databricks

Job description

I am looking for a Platform Developer to take ownership of a production Databricks platform on Azure. You will operate and evolve core platform components, build secure and scalable data engineering solutions, and automate infrastructure using Terraform and CI/CD pipelines. The role offers close collaboration with data engineering teams and the opportunity to shape a robust, secure, and cost-efficient data platform.

Project

  • own and operate Databricks platform components including workspace lifecycle, cluster and job policies, secret management, Unity Catalog enablement, and cost controls
  • design and implement cloud and data engineering solutions on Azure Databricks using Spark, SQL, Python, and Delta Lake
  • provision and maintain Azure and Databricks resources using Terraform, including the Databricks provider
  • ensure secure integration with Azure services such as Key Vault and networking components
  • implement and maintain CI/CD pipelines for notebooks, jobs, and Terraform modules using Azure DevOps or GitHub Actions
  • apply security and compliance by design principles including RBAC, SCIM, least privilege, and policy hardening
  • work in a Scrum environment, contribute to platform runbooks and documentation
  • represent the internal Data Engineering customer perspective and collaborate with distributed stakeholders

Requirements

proven experience with Databricks platform administration in production environments beyond notebook development

  • strong data engineering skills on Databricks, including Spark, SQL, Python, and Delta Lake best practices
  • solid hands-on experience with Azure services such as identity, networking, storage, Key Vault, and monitoring
  • strong knowledge of Terraform, including module design, state management, multi-environment patterns, and the Databricks provider
  • experience with CI/CD for Databricks and infrastructure as code using Azure DevOps or GitHub Actions
  • strong security mindset and excellent communication skills for collaboration with distributed teams

Nice to have

  • German language skills
  • experience with Unity Catalog rollout or migrations
  • knowledge of cost governance, including policy controls, right-sizing, and spot instance pools
  • understanding of Data Mesh principles such as domains and data products
  • experience with monitoring, observability, or relevant certifications

Apply for this position