> Markdown version of [/jobs/ext/1892826-databricks-administrator](https://www.wearedevelopers.com/jobs/ext/1892826-databricks-administrator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Administrator - **Company:** Avnet, Inc. - **Location:** Phoenix, AZ, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Unity 3d, Airflow, Amazon Web Services, Component-Based Software Engineering, Microsoft Azure, Business Software, Cloud Computing, Cloud Database, Cloud Engineering, Continuous Integration, Information Engineering, Data Infrastructure, DevOps, Github, Identity and Access Management, Job Scheduling, Performance Tuning, Release Management, Cloud Services, Software Engineering, SQL Databases, Workflow Management Systems, Data Processing, Cloud Platform System, Apache Spark, Git, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Data Lineage, Data Management, Machine Learning Operations, Terraform, Software Version Control, Data Pipelines, Databricks, Programming Languages - **Published:** August 2, 2026 - **Apply:** https://www.juju.com/job/00000000gl3jqr ## About the Role + Typically 8+ years with bachelor's or equivalent. Education and Certification(s): + Bachelor's degree or equivalent experience from which comparable knowledge and job skills can be obtained. Distinguishing Characteristics This role is focused on the design, administration, automation, optimization, and operational support of Databricks-based data platforms. The position requires strong hands-on experience with Databricks workspace administration, cluster management, job scheduling, Spark performance tuning, Delta Lake, SQL, data modeling concepts, and cloud-based data engineering practices. The role is distinguished by its combination of platform engineering, data engineering, governance, automation, and production support responsibilities. Successful performance requires the ability to support multiple user groups, including data engineers, analysts, and data scientists, while ensuring that the platform remains scalable, secure, reliable, cost-efficient, and aligned with enterprise standards. Preferred experience includes Unity Catalog, Databricks Asset Bundles, Apache Airflow or Databricks Workflows, MLflow, Great Expectations, dbt, Terraform, GitHub Actions, Azure DevOps, and other tools supporting modern data platform development and operations. Typically requires 3-5 years of experience in data engineering, platform engineering, cloud data platforms, application development, or a related technology role. Experience should include hands-on work with Databricks, Apache Spark, data pipelines, cloud platforms, SQL, version control, and collaborative development workflows. Preferred certifications or training may include: + Databricks Certified Associate or Professional certification + Cloud platform certification in AWS, Azure, or GCP + Related certifications in data engineering, DevOps, infrastructure-as-code, or cloud architecture ## Description Develops, maintains, and enhances cloud-based data platform solutions and business applications with a focus on Databricks, Apache Spark, Delta Lake, and modern data engineering practices. Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology teams to validate requirements, assess available technologies, and recommend scalable, secure, and cost-effective platform solutions. Designs and supports Databricks workspaces, clusters, job workflows, data pipelines, governance controls, and automation capabilities to meet business and technical objectives. Principal Responsibilities + Designs, deploys, configures, and manages Databricks workspaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP. + Builds, maintains, and optimizes scalable data pipelines using Apache Spark, PySpark or Scala Spark, Delta Lake, SQL, and medallion architecture patterns including Bronze, Silver, and Gold layers. + Uses data engineering methodologies, programming languages, infrastructure tools, and solution design techniques to develop reliable, secure, and performant data platform solutions that meet business specifications. + Implements and enforces data platform governance standards, including workspace administration, access controls, Unity Catalog, data lineage, security policies, and platform best practices. + Validates functional requirements, builds technical specifications, and develops application, platform, architecture, and operational documentation. + Performs analysis, design, development, testing, deployment, and support of data pipelines, platform workflows, and application components to solve business and technical requirements. + Integrates new or enhanced Databricks platform capabilities, data processing components, orchestration tools, CI/CD pipelines, and cloud services into existing data environments. + Optimizes Spark jobs, cluster configurations, storage patterns, and workflow designs for performance, reliability, scalability, and cost efficiency. + Monitors platform health, troubleshoots production issues, supports incident resolution, and recommends corrective actions to improve platform stability and operational performance. + Automates infrastructure provisioning and platform configuration using Terraform or similar infrastructure-as-code tools. + Contributes to CI/CD processes for data workflows and platform deployments using tools such as GitHub Actions, Azure DevOps, Git, or similar development workflow technologies. + Collaborates with data engineers, data scientists, analysts, architects, and business stakeholders to understand platform needs and deliver appropriate solutions. + Develops conversion, migration, and system implementation plans for new or enhanced data platform capabilities. + Supports change readiness initiatives, release planning, platform adoption, and communication of standards or best practices as needed. + Other duties as assigned. Job Level Specifications + Applies advanced knowledge of data engineering, cloud platforms, Databricks administration, Spark-based processing, Delta Lake, and platform engineering practices. May serve as a subject matter resource for Databricks platform capabilities, standards, and best practices. + Develops solutions to complex technical and business problems involving data pipelines, cloud infrastructure, platform governance, access management, workflow orchestration, performance optimization, and operational support. + Works independently on assigned projects and platform initiatives, using judgment and discretion to evaluate alternatives, recommend solutions, and implement improvements. + Collaborates across technical and business teams to define requirements, resolve issues, improve platform reliability, and support scalable data engineering practices. + May provide technical guidance, coaching, or informal leadership to less experienced team members, especially in areas such as Databricks administration, Spark optimization, CI/CD, infrastructure-as-code, and data pipeline design. + Contributes to standards, documentation, procedures, and best practices related to Databricks platform architecture, governance, development workflows, deployment patterns, and operational support. + Decisions may impact data platform performance, security, reliability, cost efficiency, and the ability of business and analytics teams to access trusted data. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)