Solution Architect - Data Engineering (Azure Databricks)

We are seeking a Solution Architect (Contractor) to design and drive enterprise-scale data engineering architectures on Azure Databricks and cloud platforms. This role will define end-to-end data solutions, architecture patterns, and engineering standards to support analytics, AI/ML, and operational use cases. The ideal candidate will combine deep technical expertise with strong business alignment, enabling scalable, secure, and high-performing data platforms. Solution architecture is critical to ensuring standardized, scalable, and governed data ecosystems across domains and use cases [NextGen Da…quirements | Meeting], 1. Architecture & Solution Design

• Define and implement end-to-end data architecture (ingestion * transformation * consumption)
• Design scalable Lakehouse architectures (Databricks, Delta Lake)
• Develop reference architectures, reusable frameworks, and design patterns
• Align architecture with performance, scalability, security, and cost optimization goals

1. Data Modeling & Domain Architecture * Define canonical data models, dimensional schemas, and semantic layers * Architect enterprise data across domains: + Claims, Member, Provider, Eligibility * Ensure data consistency, interoperability, and reuse across teams

2. Azure Databricks & Cloud Enablement * Architect solutions using: + Azure Databricks (Mandatory) + Azure Data Services (ADF, ADLS, Synapse) * Guide engineering teams on: + Spark optimization, Delta Lake design, and data pipeline best practices * Enable multi-cloud integrations when required

3. Governance, Security & Compliance * Define and enforce: + Data governance frameworks (lineage, quality, metadata) + Access control, RBAC, and data security policies * Ensure compliance with: + HIPAA, HITRUST, and enterprise regulatory standards * Establish data quality SLAs and auditability mechanisms

4. Engineering & Platform Alignment * Work closely with: + Data Engineering teams + Platform Engineering teams + AI/ML Engineering teams * Provide architectural oversight for pipelines, workflows, and platform capabilities * Drive standardization across CI/CD, DataOps, and MLOps practices

5. Stakeholder & Business Engagement * Collaborate with business, product, and analytics teams to: + Translate requirements into scalable technical solutions * Lead architecture reviews, design approvals, and governance forums (ARB) * Communicate architecture decisions and trade-offs to leadership

• Strong experience in:
• Azure Databricks (Mandatory) - PySpark, Delta Lake
• Cloud Architecture (Azure preferred)
• Deep expertise in:
• Data Architecture & Data Modeling (OLTP, OLAP, Dimensional)
• Lakehouse / Data Warehouse design patterns
• Hands-on experience with:
• ETL/ELT pipelines and orchestration frameworks
• CI/CD and DevOps practices (Azure DevOps, Git)