Solution Architect data engineering- Azure Databricks and cloud platform

Yoh Services LLC
Philadelphia, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 166K

Job location

Remote
Philadelphia, United States of America

Tech stack

Artificial Intelligence
Application Frameworks
Architectural Patterns
Azure
Cloud Engineering
Continuous Integration
Data Architecture
Information Engineering
Data Governance
ETL
Data Systems
Data Warehousing
Software Design Patterns
DevOps
Machine Learning
Metadata
Online Analytical Processing
Online Transaction Processing
Role-Based Access Control
DataOps
Enterprise Data Management
Cloud Platform System
Azure
Fast Healthcare Interoperability Resources
Snowflake
Spark
Multi-Cloud
GIT
Data Layers
Data Lake
PySpark
Information Technology
Health Level Seven International
Data Management
Machine Learning Operations
Data Pipelines
Databricks

Job description

We are seeking a Solution Architect (Contractor) to design and drive enterprise-scale data engineering architectures on Azure Databricks and cloud platforms. This role will define end-to-end data solutions, architecture patterns, and engineering standards to support analytics, AI/ML, and operational use cases. The ideal candidate will combine deep technical expertise with strong business alignment, enabling scalable, secure, and high-performing data platforms. Solution architecture is critical to ensuring standardized, scalable, and governed data ecosystems across domains and use cases Key Responsibilities

  1. Architecture & Solution Design
  • Define and implement end-to-end data architecture(ingestion ? transformation ? consumption)
  • Design scalable Lakehouse architectures (Databricks, Delta Lake)
  • Develop reference architectures, reusable frameworks, and design patterns
  • Align architecture with performance, scalability, security, and cost optimization goals
    1. Data Modeling & Domain Architecture
  • Define canonical data models, dimensional schemas, and semantic layers
  • Architect enterprise data across domains:
  • Claims, Member, Provider, Eligibility
  • Ensure data consistency, interoperability, and reuse across teams
    1. Azure Databricks & Cloud Enablement
  • Architect solutions using:
  • Azure Databricks (Mandatory)
  • Azure Data Services (ADF, ADLS, Synapse)
  • Guide engineering teams on:
  • Spark optimization, Delta Lake design, and data pipeline best practices
  • Enable multi-cloud integrations when required
    1. Governance, Security & Compliance
  • Define and enforce:
  • Data governance frameworks (lineage, quality, metadata)
  • Access control, RBAC, and data security policies
  • Ensure compliance with:
  • HIPAA, HITRUST, and enterprise regulatory standards
  • Establish data quality SLAs and auditability mechanisms
    1. Engineering & Platform Alignment
  • Work closely with:
  • Data Engineering teams
  • Platform Engineering teams
  • AI/ML Engineering teams
  • Provide architectural oversight for pipelines, workflows, and platform capabilities
  • Drive standardization across CI/CD, DataOps, and MLOps practices
    1. Stakeholder & Business Engagement
  • Collaborate with business, product, and analytics teams to:
  • Translate requirements into scalable technical solutions
  • Lead architecture reviews, design approvals, and governance forums (ARB)
  • Communicate architecture decisions and trade-offs to leadership
  • Required Skills
  • Strong experience in:
  • Azure Databricks (Mandatory) - PySpark, Delta Lake
  • Cloud Architecture (Azure preferred)
  • Deep expertise in:
  • Data Architecture & Data Modeling (OLTP, OLAP, Dimensional)
  • Lakehouse / Data Warehouse design patterns
  • Hands-on experience with:
  • ETL/ELT pipelines and orchestration frameworks
  • CI/CD and DevOps practices (Azure DevOps, Git)
  • Metadata, lineage, and governance tools (Unity Catalog, Purview)
  • Preferred Skills

Requirements

Experience: 10+ Years Education: Bachelor's Degree (4-year) - Computer Science / Engineering / Related Field Domain: US Healthcare (Preferred), * Experience with:

  • AI/ML data architectures (feature stores, model pipelines)
  • Multi-cloud environments (Azure + GCP/Snowflake)
  • Strong understanding of:
  • Medallion architecture (Bronze-Silver-Gold)
  • Domain Experience (Good to Have)
  • US Healthcare ecosystem:
  • Claims, Member, Provider datasets
  • Familiarity with:
  • FHIR / HL7 / EMR data models
  • Payment Integrity / Risk Adjustment use cases

Benefits & conditions

Estimated Min Rate: $56.00 Estimated Max Rate: $80.00

What's In It for You? We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh's network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh's extensive talent community that will provide you with access to Yoh's vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:

  • Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
  • Health Savings Account (HSA) (for employees working 20+ hours per week)
  • Life & Disability Insurance (for employees working 20+ hours per week)
  • MetLife Voluntary Benefits
  • Employee Assistance Program (EAP)
  • 401K Retirement Savings Plan
  • Direct Deposit & weekly epayroll
  • Referral Bonus Programs
  • Certification and training opportunities

Apply for this position