Databricks Platform Administrator - Azure & AWS

VIBHU TECH INC
United States
19 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Audit Trail User Authentication Microsoft Azure Bash Shell Command-Line Interface System Configuration Data Architecture Data Governance DevOps Identity and Access Management
+19 more
Job Scheduling Python (Programming Language) Key Management Windows PowerShell Role-Based Access Control Azure Active Directory Cloud Services Azure Data Lake Systems Integration Scripting Cloud Platform System System Availability Apache Spark Git Infrastructure Automation Frameworks Data Management Restful APIs Terraform Databricks

Job description

We are seeking an experienced Databricks Platform Administrator to configure, deploy, manage, and maintain the Databricks platform across both Microsoft Azure and AWS cloud environments. The ideal candidate will have strong expertise in Databricks administration, workspace configuration, security, access management, cluster management, monitoring, and cloud platform integrations., * Configure, deploy, and administer Databricks workspaces across Azure and AWS environments.

  • Manage Databricks clusters, compute resources, pools, and job execution settings.
  • Configure user access, groups, permissions, service principals, and role-based access control (RBAC).
  • Administer Unity Catalog, data governance, access policies, and data permissions.
  • Integrate Databricks with Azure services such as Azure Data Lake Storage (ADLS), Azure Key Vault, and Microsoft Entra ID.
  • Integrate Databricks with AWS services such as Amazon S3, IAM, AWS Secrets Manager, and related cloud services.
  • Additionally, configure networking, private connectivity, authentication, and security controls.
  • Additionally, monitor platform performance, troubleshoot issues, and optimize resource utilization and costs.
  • Additionally, oversee workspace configurations, audit logs, platform upgrades, and operational maintenance.
  • Implement automation using Terraform, Databricks CLI, REST APIs, and scripting tools.
  • Additionally, collaborate with data engineers, cloud engineers, security teams, and DevOps teams to ensure platform reliability and availability.

Requirements

  • Strong hands-on experience administering the Databricks platform.
  • Experience configuring and managing Databricks in both Azure and AWS environments.
  • Knowledge of Databricks workspace administration, cluster policies, compute management, and job scheduling.
  • Experience with Unity Catalog, data access controls, and governance.
  • Strong understanding of cloud IAM, authentication, authorization, networking, and security.
  • Experience integrating Databricks with Azure Data Lake Storage and Amazon S3.
  • Knowledge of Terraform or other Infrastructure as Code (IaC) tools.
  • Experience with Python, Bash, or PowerShell scripting.
  • Familiarity with Git, CI/CD pipelines, monitoring, and troubleshooting.
  • Strong problem-solving and communication skills., * Databricks Certified professional or administrator-level certification.
  • Experience with Terraform-based Databricks deployments and configuration automation.
  • Knowledge of Apache Spark and the Lakehouse architecture.
  • Experience supporting enterprise-scale data platforms and production environments., A hands-on Databricks Platform Administrator with strong cloud administration skills and practical experience configuring and managing Databricks across both Azure and AWS, with a focus on security, governance, automation, reliability, and cost optimization.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…