Databricks Architect

EXPERT RECRUITING SOLUTIONS, LLC
New York, NY, United States
5 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Cloud Computing Data Infrastructure Identity and Access Management Routing Cloud Platform System IT Architecture Software Troubleshooting Amazon Virtual Private Cloud (VPC) Infrastructure Automation Frameworks Terraform
+2 more
Serverless Computing Databricks

Job description

Our client is seeking an experienced Databricks Platform Architect to design, deploy, configure, and secure enterprise Databricks environments on AWS. This role is primarily focused on Databricks platform architecture, Infrastructure-as-Code (Terraform), and enterprise platform engineering. Strong AWS networking expertise is beneficial but is not the primary focus of the role., * Design, configure, deploy, and secure Databricks platforms on AWS, including both Classic and Serverless Workspaces

  • Architect enterprise Databricks environments, including workspace configuration, identity integration, cluster policies, secret management, and platform governance
  • Author and maintain Terraform modules to provision and manage Databricks and AWS infrastructure using Infrastructure-as-Code (IaC)
  • Implement secure platform architecture, including workspace isolation, IAM/SSO integration, cluster access controls, secret scopes, and secure connectivity patterns
  • Partner with cloud, security, and platform engineering teams to design, validate, and deploy scalable Databricks solutions
  • Produce architecture documentation, diagrams, standards, and operational runbooks
  • Provide technical leadership, architecture guidance, and best practices for enterprise Databricks platform deployments

Requirements

  • 10 years of experience in Cloud Platform Engineering, Data Platform Architecture, Infrastructure Engineering, or similar roles
  • Deep hands-on experience with Databricks Platform Architecture, including deployment, configuration, security, and administration
  • Experience designing and supporting both Classic and Serverless Databricks Workspaces
  • Strong experience with Terraform and Infrastructure-as-Code (IaC)
  • Experience with Databricks platform security, including:
  • Workspace architecture
  • Identity & SSO integration
  • IAM integration
  • Cluster policies
  • Secret management / Secret Scopes
  • Workspace isolation and governance
  • Working knowledge of AWS infrastructure, including IAM, VPC, S3, PrivateLink, networking, routing, and identity integration required to deploy and support Databricks environments
  • Strong troubleshooting, architecture, and technical documentation skills
  • Excellent communication skills with the ability to work directly with customers, architects, and cross-functional engineering teams

Nice to Have

  • Advanced AWS networking experience (VPC design, PrivateLink, Security Groups, NACLs, routing, etc.)
  • Experience with Databricks security accreditation, governance, and compliance initiatives
  • Experience building reusable Terraform modules and enterprise platform automation
  • Experience leading architecture workshops and customer enablement sessions

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…