> Markdown version of [/jobs/ext/2188772-databricks-platform-manager-engineer](https://www.wearedevelopers.com/jobs/ext/2188772-databricks-platform-manager-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Platform Manager/Engineer - **Company:** PRIVATE INNOVATION LLC - **Location:** New York, NY, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Audit Trail, Microsoft Azure, Cloud Computing, Continuous Integration, Data Architecture, Information Engineering, DevOps, Github, Identity and Access Management, Role-Based Access Control, Datadog, Apache Spark, Amazon Virtual Private Cloud (VPC), Git, Data Lakes, Deployment Automation, Cloudwatch, Terraform, Splunk, Jenkins, Databricks - **Published:** August 22, 2026 - **Apply:** https://www.dice.com/job-detail/4cbd5b2b-a968-407e-a0a6-1b7c90a27387 ## About the Role * Strong hands-on Databricks Platform Administration * Databricks Workspace Management * Cluster Management & Cluster Policies * Unity Catalog * Databricks Runtime * Service Principals, Secrets & PATs * AWS IAM * AWS S3, VPC, EC2, KMS, Security Groups * Terraform / Infrastructure as Code * Git and CI/CD * Azure DevOps, GitHub Actions, or Jenkins * Platform Monitoring & Troubleshooting * Production Support * Cost Optimization Preferred * Experience supporting enterprise Databricks environments with 100+ users * Experience with AWS PrivateLink / VPC Endpoints * AWS Organizations / Control Tower * CloudWatch, Datadog, or Splunk * Delta Lake / Lakehouse architecture * Exposure to Spark internals * Experience supporting Databricks AI/ML workloads * Databricks or AWS certifications ## Description We are looking for a Databricks Platform Manager/Engineer with strong hands-on experience administering enterprise Databricks environments on AWS. The role focuses on platform administration, workspace and cluster management, Unity Catalog, AWS IAM, security/governance, Terraform/IaC, CI/CD, monitoring, and cost optimization. Ideal candidates will have 3-5+ years of production Databricks platform administration experience and a strong AWS/cloud infrastructure background. Key Responsibilities * Administer and support Databricks workspaces across Dev, Test, UAT, and Production. * Manage clusters, cluster policies, instance pools, job clusters, and Databricks Runtime upgrades. * Administer Unity Catalog, catalogs, schemas, permissions, and RBAC. * Manage AWS IAM integration, SSO, service principals, secrets, and access controls. * Implement and support Terraform/IaC and CI/CD for Databricks platform deployments. * Manage Git/Databricks Repos and automated deployment processes. * Monitor platform health, performance, jobs, clusters, and production environments. * Troubleshoot platform issues, incidents, and performance problems. * Support audit logging, security, governance, and compliance requirements. * Identify opportunities for Databricks and AWS cost optimization. * Partner with Data Engineering, DevOps, Cloud, Security, and Infrastructure teams. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)