> Markdown version of [/jobs/ext/2811541-databricks-platform-engineer](https://www.wearedevelopers.com/jobs/ext/2811541-databricks-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Platform Engineer - **Company:** Zurich Insurance - **Location:** Barcelona, Spain (Remote available) - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, User Authentication, Automation of Tests, Big Data, Cloud Database, Information Engineering, Data Governance, Data Hub, Data Infrastructure, Dataspaces, DevOps, Identity and Access Management, Python (Programming Language), Key Management, Performance Tuning, Data Streaming, Cloud Platform System, Data Classification, Data Ingestion, Grafana, Change Data Capture, Amazon Virtual Private Cloud (VPC), Git, Cloudformation, Data Lakes, Pyspark, Data Lineage, Apache Kafka, Cloudwatch, Data Pipelines, Databricks - **Published:** September 9, 2026 - **Apply:** https://www.careers.zurich.com/talentcommunity/apply/1371248157/?locale=en_US ## About the Role * 5-8 years of experience in Data Engineering, Data Platform Engineering, or Cloud Data Architecture. * Minimum 3 years of hands-on experience owning and managing Databricks platforms in enterprise environments. * Strong expertise in Databricks services, including Unity Catalog, Delta Lake, Delta Live Tables, Workflows, and Asset Bundles. * Proven experience designing and supporting batch, streaming, API, and CDC data ingestion frameworks. * Advanced proficiency in PySpark, Python, and Databricks SQL for scalable data pipeline development. * Solid knowledge of DevOps practices, including Git-based development, CI/CD pipelines, automated testing, and Infrastructure as Code (CloudFormation or CDK). * Strong AWS experience covering S3, IAM, networking, security controls, and secrets management. * Experience working with large-scale data platforms in regulated industries; financial services experience is highly desirable. Preferred: * Databricks and/or AWS certifications. * Experience with Airflow, Kafka/MSK, and enterprise data governance frameworks. ## Description As a Databricks Platform Engineer you will have the opportunity to: * Own and evolve the Databricks platform that underpins the Zurich Global Finance Data Hub, ensuring scalability, reliability, security, and cost efficiency. * Design, build, and maintain data ingestion frameworks supporting batch, streaming, API, and CDC data integration patterns across multiple source systems. * Develop and manage Delta Live Tables (DLT) pipelines, implementing data quality controls, expectations, schema enforcement, and change data capture processes. * Administer and optimise Delta Lake environments, including performance tuning, schema evolution, time travel, VACUUM, and OPTIMIZE operations. * Implement and manage Unity Catalog governance practices, including access controls, data lineage, data classification, and namespace management. * Build, deploy, and support Databricks Workflows for orchestration of complex multi-task pipelines, dependency management, retries, and event-driven processing. * Establish and maintain CI/CD pipelines using Git-based development practices and Databricks Asset Bundles to promote code across development, testing, and production environments. * Collaborate with cloud and infrastructure teams to implement Infrastructure as Code solutions using AWS CloudFormation or CDK. * Manage authentication and authorisation mechanisms, including AWS IAM roles, instance profiles, service principals, secret management, and credential rotation processes. * Monitor platform health, performance, operational metrics, and costs using Databricks system tables, CloudWatch, Grafana, and related observability tools. * Define and enforce cluster policies, compute strategies, and DBU governance controls to optimise platform utilisation and expenditure. * Ensure platform security through the implementation of PrivateLink, VPC endpoints, row-level security, and column-level security controls. * Partner with data engineering, finance, architecture, and product teams to deliver a robust and scalable enterprise data platform. * Drive platform best practices, technical standards, automation, and continuous improvement initiatives across the data ecosystem. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in Switzerland](https://www.wearedevelopers.com/magazine/276-data-analyst-salary-in-switzerland) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Software Developer Salary in Switzerland [2023]](https://www.wearedevelopers.com/magazine/215-software-developer-salary-in-switzerland-2023) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)