Senior Databricks Platform Engineer
Role details
Job location
Tech stack
Job description
We are seeking a Senior Databricks Platform SME responsible for architecting, administering, and optimizing enterprise Databricks environments. This is a hands-on platform engineering role focused on governance, performance, security, automation, cost control, and reliability of the Databricks platform.
Requirements
-
7+ years in Data Engineering / Platform Engineering
-
4+ years hands-on experience with Databricks administration & architecture
-
Strong expertise in:
-
Unity Catalog
-
Delta Lake / Delta Live Tables
-
Databricks Workflows
-
SQL Warehouses
-
Strong Linux/Unix administration skills
-
Proficiency in Python & PySpark
-
Strong Bash/Shell scripting experience
-
Cloud experience (AWS / Azure / GCP)
-
Experience with CI/CD and Git workflows
-
Experience with cost optimization (DBU usage, compute efficiency)
-
Exposure to Jira and ServiceNow
Important Notes:
- This is a true platform ownership role, not just pipeline development
- Candidate must be able to manage Databricks across governance, performance, security, and cost
- Strong preference for hands-on Databricks administrators with production-scale experience
- This is a challenging and high-ownership requirement