Databricks Solution Architect

Delta Dental Insurance Company
Atlanta, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Atlanta, United States of America

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Data analysis
Azure
Continuous Integration
Data Architecture
Information Engineering
Data Governance
ETL
Data Transformation
DevOps
Python
Machine Learning
Meta-Data Management
Power BI
Cloud Services
SQL Databases
Data Streaming
Tableau
Google Cloud Platform
Snowflake
Spark
Generative AI
Microsoft Fabric
Data Lake
PySpark
Infrastructure Automation Frameworks
Machine Learning Operations
Databricks

Job description

Delta Dental is seeking a Senior Databricks Solution Architect to design and deliver enterprise-scale data and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will lead data modernization initiatives, define scalable architectures, and work closely with business stakeholders and technical teams to deliver secure, high-performing cloud data platforms., * Architect and implement enterprise Databricks Lakehouse solutions.

  • Design scalable batch and streaming data pipelines using Spark and Databricks.
  • Lead data modernization and cloud migration initiatives.
  • Implement Delta Lake, Delta Live Tables, Unity Catalog, Databricks SQL, and Workflows.
  • Define data governance, security, metadata management, and best practices.
  • Collaborate with business, enterprise architecture, and development teams.
  • Mentor technical teams and provide architectural leadership throughout project delivery.

Requirements

  • 12+ years of experience in Data Engineering, Data Architecture, or Analytics.
  • 3+ years of hands-on Databricks Solution Architecture experience.
  • Strong expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, and MLflow.
  • Advanced knowledge of Apache Spark, PySpark, SQL, and Python.
  • Experience with Azure Databricks (AWS/Google Cloud Platform is a plus).
  • Strong understanding of ETL/ELT, data governance, CI/CD, DevOps, and Infrastructure as Code.
  • Excellent communication, stakeholder management, and consulting skills., * Databricks Certified Data Engineer or Solution Architect.
  • Azure Solutions Architect or equivalent cloud certification.
  • Experience with Healthcare/Payer domain (preferred).
  • Exposure to AI/ML, Generative AI, Microsoft Fabric, Snowflake, Power BI, or Tableau.

Apply for this position