> Markdown version of [/jobs/ext/1321248-databricks-administrator](https://www.wearedevelopers.com/jobs/ext/1321248-databricks-administrator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Administrator - **Company:** Virtualan Software LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Program Optimization, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Systems, Github, Apache Hive, Identity and Access Management, Python (Programming Language), Operational Databases, Performance Tuning, Role-Based Access Control, Standard Sql, SQL Databases, Apache Spark, Infrastructure as Code (IaC), Data Lakes, Pyspark, Infrastructure Automation Frameworks, Machine Learning Operations, Cloud Optimization, Cloudwatch, Terraform, Data Pipelines, Amazon Redshift, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.dice.com/job-detail/40265fce-5124-4dc4-ae62-9fa904f520c1 ## About the Role * 5+ years of Data Engineering experience in AWS. * Strong hands-on experience with Databricks, PySpark, Spark SQL, and Delta Lake. * Experience creating and managing Databricks clusters and platform administration. * Hands-on experience with Unity Catalog, Metastore, and Databricks governance. * Experience with Delta Sharing. * Strong Spark performance tuning and memory optimization skills. * Experience with AWS services including S3, Glue, EMR, Lambda, Athena, Redshift, IAM, and CloudWatch. * Strong Python and SQL skills. * Experience with cloud cost optimization (FinOps) and Databricks DBU optimization. * Experience with Terraform, Infrastructure as Code (IaC), GitHub Actions, or similar CI/CD tools. * Strong troubleshooting skills with experience supporting production data pipelines. Preferred Skills * Databricks or AWS certifications. * Experience with MLflow, Delta Live Tables, or Databricks Asset Bundles. * Experience with AI-driven automation for platform operations. * Knowledge of modern Lakehouse architecture and cloud data governance., Candidates should be able to explain real-world experience with: * Databricks cluster creation and optimization. * Unity Catalog and Metastore setup. * Delta Sharing implementation. * Spark performance tuning and memory optimization. * Databricks cost (DBU) optimization and FinOps practices. * Terraform and CI/CD automation. * Resolving slow-running Databricks jobs. * Troubleshooting and resolving production data pipeline failures with root cause analysis. ## Description We are looking for a Databricks Admin with strong hands-on experience in Databricks, AWS, and modern data platforms. The ideal candidate should have experience designing and supporting scalable data pipelines, administering the Databricks platform, optimizing performance and cloud costs, implementing governance, and troubleshooting production issues., * Design, build, and maintain scalable data pipelines using AWS and Databricks. * Develop ETL/ELT solutions using PySpark, Spark SQL, Delta Lake, Python, and SQL. * Create and manage Databricks clusters, SQL Warehouses, and cluster policies. * Configure and manage Unity Catalog, Metastore, RBAC, and data governance. * Implement Delta Sharing and support secure data access across teams. * Monitor and optimize Spark jobs, cluster performance, and Databricks workloads. * Drive cloud cost optimization (FinOps), including DBU optimization, tagging, budgets, and resource utilization. * Automate infrastructure and deployments using Terraform, Databricks Asset Bundles, GitHub Actions, or other CI/CD tools. * Work with AWS services such as S3, Glue, EMR, Lambda, Athena, Redshift, IAM, and CloudWatch. * Investigate and resolve production issues, perform root cause analysis, and improve platform reliability. * Collaborate with architects, developers, and business teams to deliver reliable data solutions. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)