AWS Databricks DevOps Lead / Cloud Data Platform DevOps Lead

Montek System

Plano, TX, United States

21 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Cloud Computing Continuous Integration Data Infrastructure DevOps Github Identity and Access Management Python (Programming Language) Release Management

+16 more

Power BI Shell Script SQL Databases Tableau (Software) Cloud Platform System System Availability Amazon Virtual Private Cloud (VPC) Infrastructure Automation Frameworks Collibra AWS Fargate Apache Kafka Functional Programming Cloudwatch Terraform Alteryx Databricks

Job description

The AWS Databricks DevOps Lead / Cloud Data Platform DevOps Lead is responsible for leading operations, support, automation, and continuous improvement of cloud-based data platforms, with mandatory expertise in AWS, Databricks, DevOps, and Terraform., Lead day-to-day operations of AWS and Databricks platforms with hands-on

Manage platform reliability, monitoring, incident resolution, and SLA compliance

Administer Databricks workspaces, jobs, compute, access controls, and governance

Drive DevOps practices including CI/CD, automation, release management, and operational support

Build and maintain infrastructure as code using Terraform

Collaborate with engineering, security, governance, and business teams

Create operational documentation, standards, and support processes

Requirements

Strong hands-on experience with AWS cloud platform (S3, IAM, EC2, CloudWatch, Lambda, VPC, ECS Fargate, and Athena)

Strong experience administering and supporting Databricks on AWS (Unity Catalog, SQL Warehouses, Delta Sharing, Jobs, Genie and APIs)

Solid DevOps experience in CI/CD, automation, and release operations (Preferred: GitHub Actions, Python or Shell scripting)

Hands-on Terraform experience for infrastructure automation

Nice-to-Have Skills

Exposure to data platform tools like Denodo, Atscale, Kafka, Collibra, and Genrocket

Experience in compliance, governance, and cost optimization

Exposure to BI tools such as PowerBI, Tableau, Alteryx.

Preferred Profile

A hands-on operations lead who can manage production support, automate infrastructure, improve platform reliability, and ensure secure, scalable cloud operations.