Databricks Solution Architect

Delta Dental Insurance Company

Atlanta, GA, United States

26 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Artificial Intelligence Amazon Web Services Data Analysis Microsoft Azure Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation DevOps Python (Programming Language)

+17 more

Machine Learning Meta-Data Management Power BI Cloud Services SQL Databases Data Streaming Tableau (Software) Google Cloud Snowflake Apache Spark Generative AI Microsoft Fabric Data Lakes Pyspark Infrastructure Automation Frameworks Machine Learning Operations Databricks

Job description

Delta Dental is seeking a Senior Databricks Solution Architect to design and deliver enterprise-scale data and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will lead data modernization initiatives, define scalable architectures, and work closely with business stakeholders and technical teams to deliver secure, high-performing cloud data platforms., * Architect and implement enterprise Databricks Lakehouse solutions.

Design scalable batch and streaming data pipelines using Spark and Databricks.
Lead data modernization and cloud migration initiatives.
Implement Delta Lake, Delta Live Tables, Unity Catalog, Databricks SQL, and Workflows.
Define data governance, security, metadata management, and best practices.
Collaborate with business, enterprise architecture, and development teams.
Mentor technical teams and provide architectural leadership throughout project delivery.

Requirements

12+ years of experience in Data Engineering, Data Architecture, or Analytics.
3+ years of hands-on Databricks Solution Architecture experience.
Strong expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, and MLflow.
Advanced knowledge of Apache Spark, PySpark, SQL, and Python.
Experience with Azure Databricks (AWS/Google Cloud Platform is a plus).
Strong understanding of ETL/ELT, data governance, CI/CD, DevOps, and Infrastructure as Code.
Excellent communication, stakeholder management, and consulting skills., * Databricks Certified Data Engineer or Solution Architect.
Azure Solutions Architect or equivalent cloud certification.
Experience with Healthcare/Payer domain (preferred).
Exposure to AI/ML, Generative AI, Microsoft Fabric, Snowflake, Power BI, or Tableau.