Senior Azure Data Engineer

McClure Engineering Co.
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$124,800.0 - $135,200.0
Working hours
Regular working hours
Job source

Tech stack

Microsoft Azure Health Informatics Continuous Delivery Data Architecture Data Infrastructure Extract Transform Load (ETL) Data Security Data Systems Data Warehousing DevOps Machine Learning SQL Azure
+15 more
Power BI DataOps Azure Data Lake Software Technical Review Unstructured Data Data Storage Technologies Azure Data Factory Fast Healthcare Interoperability Resources Data Lakes Pyspark Data Analytics Health Level Seven International Azure Synapse Analytics Data Pipelines Databricks

Job description

  • We are seeking an experienced Senior Data Engineer with strong expertise in Azure Databricks, Spark, and Azure data services to design and deliver scalable, cloud-based data solutions for healthcare analytics.
  • The ideal candidate will have hands-on experience in building modern data platforms, implementing CI/CD pipelines, and enabling advanced analytics and machine learning initiatives while ensuring data security and regulatory compliance., * Design, develop, and maintain scalable, secure, and high-performance ETL/ELT pipelines using Azure Databricks, PySpark, Synapse Analytics,
  • Work with structured and unstructured data from various healthcare sources (EHR, claims data, etc.).
  • Implement and optimize data storage solutions using Azure technologies such as Databricks ,Azure Data Lake, Azure SQL, Synapse Analytics.
  • Develop and deploy machine learning models and predictive analytics solutions to support healthcare analytics.
  • Ensure data quality, integrity, and security in compliance with HIPAA and other healthcare regulations.
  • Collaborate with data scientists, analysts, and software engineers to deliver high-performance data solutions.
  • Automate data workflows using cicd, and other cloud tools.
  • Monitor and troubleshoot data pipelines to ensure optimal performance and reliability.
  • Participate in technical design reviews and contribute to data platform architecture decisions.
  • Promote data engineering best practices across the organization.

Requirements

  • 13+ years of experience as a Data Engineer with a focus on Azure cloud services.
  • Strong understanding of Delta Lake, Lakehouse Architecture, and data warehousing concepts.
  • Strong expertise in SQL, Python, Spark, and Databricks.
  • Azure/Databricks certifications such as Microsoft Certified: Azure Data Engineer Associate.
  • Hands-on experience with Azure Data Factory, Azure Synapse, Azure Data Lake, and Power BI.
  • Knowledge of machine learning models and data science techniques in a healthcare setting.
  • Experience working with FHIR, HL7, and other healthcare data standards.
  • Familiarity with DevOps and CI/CD pipelines for data workflows.
  • Strong problem-solving skills and ability to work in an agile environment.

Pay: $60.00 - $65.00 per hour

Experience:

  • Azure cloud services: 10 years (Required)
  • Azure Data Factory (ADF): 6 years (Required)
  • FHIR & HL7: 5 years (Required)

License/Certification:

  • Databricks Certified Data Engineer Professional (Required)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all