Data Engineer / Senior Data Engineer / Lead / Architect

E-Solutions
Irving, TX, United States
26 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Microsoft Azure Continuous Integration Data Architecture Information Engineering Data Infrastructure Data Integration Extract Transform Load (ETL) Data Systems Data Warehousing Python (Programming Language) Scrum Methodology
+15 more
Power BI Standard Sql Azure Data Lake SQL Databases Unstructured Data Data Processing Data Ingestion Azure Data Factory Fast Healthcare Interoperability Resources Git Data Lakes Pyspark Health Level Seven International Data Pipelines Databricks

Job description

  • Design, develop, and optimize scalable ETL/ELT data pipelines
  • Build data ingestion and transformation frameworks using Azure data services
  • Develop scalable data processing solutions using Azure Databricks and PySpark
  • Implement and maintain Delta Lake and Lakehouse architectures
  • Develop data models to support analytics and business requirements
  • Ensure data quality, governance, monitoring, security, and performance
  • Troubleshoot and optimize data pipelines and processing workloads
  • Support cloud migration, modernization, and data platform transformation initiatives
  • Implement CI/CD practices for data engineering workflows
  • Collaborate with business, analytics, product, and technology teams in Agile/Scrum environments

Requirements

  • Azure Databricks
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Data Factory (ADF)
  • PySpark
  • Python
  • SQL
  • Delta Lake / Lakehouse Architecture
  • ETL/ELT Development
  • Data Modeling
  • Azure Cloud Platform
  • Git & CI/CD
  • Agile/Scrum

Key Requirements

  • 7+ years of experience in Data Engineering
  • 5+ years of hands-on experience with Azure Data technologies
  • 2+ years of experience in the Healthcare, Managed Care, or Payer domain
  • Proven experience building enterprise-scale data pipelines and data integration solutions
  • Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures
  • Hands-on experience processing large-scale structured and unstructured datasets
  • Strong experience designing scalable and high-performance data solutions, * Experience working with healthcare data, including:
  • Claims
  • Membership
  • Provider
  • Care Management
  • Power BI
  • FHIR / HL7
  • Azure DevOps & Infrastructure as Code (IaC)
  • AI/ML data pipelines, We are looking for a Senior Data Engineer / Lead / Architect with strong hands-on experience in Azure Databricks, ADF, ADLS Gen2, PySpark, Python, SQL, Delta Lake, and Lakehouse architecture, along with proven experience in the Healthcare/Managed Care/Payer domain. Data Engineer/Senior Data Engineer/Lead/Architect1Snowflake,Azure,Data Engineer,adf,health OR Healthcare,DBT,Azure Data FacoryN/AC2CUnited States

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…