Databricks Platform Engineer
Role details
Job location
Tech stack
Job description
Schuberg Philis is looking for a Databricks Platform Engineer to design and build a modern enterprise-grade data platform on Azure: from account setup through DR and private cloud fallback, using Terraform modules. The strongpoint here is Databricks on Azure with Unity Catalog. AWS Experience is a plus for dual-cloud engagements.
This role will lead the implementation of a Databricks-centric platform that enables users across multiple teams to collaborate effectively while maintaining proper governance, security, and compliance. This requires both architectural thinking and strong hands-on engineering skills. This role Is also part of a growing internal Databricks practice - a community where knowledge is shared, experiences are exchanged and engineers support one another.
What are your responsibilities?
- Deploy and maintain a mission-critical Databricks platform across three service tiers (Foundation, DR, Ultimate Recovery)
- Develop and maintain Terraform modules to reduce per-customer delivery time
- Run customer assessments, gap analyses, and architecture design sessions
- Build and operate CI/CD pipelines for infrastructure deployment and validation
- Implement cross-region replication, metadata sync, and failover automation
- Set up Apache Polaris/Iceberg-based fallback platforms
- Design and implement monitoring, logging and alerting for Databricks workspaces and Azure data services
- Implement data governance: lineage, quality tooling, metadata management, and access control policies
- Translate business and stakeholder requirements into secure, compliant, and operable platform architecture
- Create operational runbooks and handover documentation
- Collaborate with network engineers, security specialists, and customer teams.
Requirements
- 5 years of experience in cloud infrastructure (Azure primary, AWS is a plus)
- 3+ years of hands-on Terraform in production
- 2+ years Databricks platform administration experience on Azure, preferably in multi-team environments
- Experience with Unity Catalog
- Experience in financial services or another regulated industry is a strong plus
- Exposure to DR architecture and failover testing