AWS Databricks Platform Support Architect

Diamondpick, Inc.
Raritan, NJ, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Unity 3d Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Microsoft Azure Cloud Computing Continuous Integration Data Architecture Information Engineering Github Identity and Access Management Python (Programming Language)
+21 more
Role-Based Access Control Standard Sql Shell Script System Availability Apache Spark Software Troubleshooting Infrastructure as Code (IaC) Amazon Virtual Private Cloud (VPC) Data Lakes Pyspark Information Technology Deployment Automation AWS Glue AWS Data Analytics Functional Programming Cloudwatch Terraform Cisco Amazon Elastic Mapreduce (EMR) Jenkins Databricks

Job description

  • Lead the administration, support, governance, and optimization of enterprise Databricks platforms on AWS.
  • Responsible for platform reliability, security, automation, performance, and production support across enterprise environments., * Architect and support AWS Databricks environments across Dev, QA, UAT, and Production.
  • Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog, and access controls.
  • Provide L2/L3 production support, incident management, troubleshooting, and root cause analysis.
  • Implement governance, security, IAM, RBAC, monitoring, and compliance controls.
  • Optimize platform performance, scalability, and cloud costs.
  • Automate deployments using Terraform, CI/CD, and Infrastructure as Code (IaC).
  • Collaborate with Data Engineering, Cloud, and Security teams on platform enhancements.

Requirements

Amazon Web Services (AWS), Amazon Web Services (AWS), Administrative Skills, Automation, Production Support, Acceptance Testing, Quality Assurance, Access Control, Cisco Unity, Incident Management, * Databricks Workspace Administration

  • Unity Catalog
  • Delta Lake
  • Cluster Management
  • Jobs & Workflows
  • AWS Services: S3, IAM, EC2, Lambda, Glue, CloudWatch, VPC, Secrets Manager
  • Apache Spark
  • PySpark
  • SQL
  • Data Lake / Lakehouse Architecture
  • Terraform
  • GitHub
  • Jenkins
  • Azure DevOps
  • CI/CD
  • Python
  • Shell Scripting

Preferred Skills

  • AWS EMR
  • AWS Glue
  • AWS S3
  • Databricks, * 10+ years of IT experience with at least 4+ years of Databricks administration and support experience.
  • Hands-on experience with AWS cloud platforms and enterprise production support environments.
  • Strong troubleshooting, stakeholder management, and leadership skills.

Preferred Certifications

  • AWS Solutions Architect - Professional
  • AWS Data Engineer - Associate
  • Databricks Certified Professional Admin
  • Terraform Associate

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…