AWS Databricks Architect

HMG America
United States
29 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Data Analysis Cluster Analysis Information Technology Consulting Continuous Integration Data Architecture Data Warehousing DevOps Apache Hadoop High-Level Architecture Identity and Access Management
+14 more
Migration Manager Teradata SQL Autoscaling Netezza Snowflake Apache Spark Cloudformation Data Lakes Infrastructure Automation Frameworks AWS Data Analytics Data Management Terraform Data Pipelines Databricks

Job description

We are seeking a senior AWS Databricks Architect with a strong background in IT consulting and professional services to lead end-to-end cloud data enterprise initiatives. In this role, you will act as a trusted technical advisor to client stakeholders while leading the architecture, design, and execution of scalable Lakehouse platforms on AWS using Databricks., 1. Solution Architecture & Technical Delivery

  • Architect, design, and implement scalable, enterprise-grade data platforms on AWS using Databricks Lakehouse.
  • Establish data architecture patterns using the Medallion Architecture (Bronze, Silver, Gold layers) for real-time and batch data pipelines.
  • Implement robust governance, security, and access control models across datasets using Databricks Unity Catalog, AWS IAM, and KMS.
  • Optimize workspace configurations, cluster sizing, auto-scaling, and Delta Lake optimizations (Z-Ordering, Liquid Clustering) for high performance and cost efficiency.
  • Integrate AWS-native services (S3, Glue, Lambda, EventBridge, Redshift, Athena, Secrets Manager) seamlessly with Databricks.
  1. Client Engagement & Advisory (Consulting) * Lead discovery workshops, technical assessments, and architecture reviews with C-level executives, VPs of Data, and Enterprise Architects. * Translate complex business requirements into high-level architecture diagrams, technical roadmaps, and Statements of Work (SOWs). * Educate clients on cloud data best practices, cost-optimization strategies, and modern Lakehouse paradigms. * Drive client migration strategy from legacy data warehouses (e.g., Teradata, Netezza, Snowflake, On-Prem Hadoop) to AWS Databricks.

  2. Leadership & DevOps * Mentor and lead cross-functional delivery teams of Data Engineers, Analytics Engineers, and DevOps Engineers. * Enforce Infrastructure-as-Code (IaC) practices using Terraform or CloudFormation for enterprise workspace deployments. * Build CI/CD automation pipelines for Databricks notebooks, Delta Live Tables (DLT), and Spark jobs.

Requirements

The ideal candidate possesses exceptional client engagement abilities, deep hands-on expertise with the Databricks Medallion Architecture and Unity Catalog, and proven experience migrating legacy data warehouses to modern AWS data ecosystems.

About the company

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for AWS Databricks Architect in Remote. Below is the detailed job description.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…