Senior Data Engineer

Insight Global
Columbus, OH, United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$156,000.0 - $187,200.0
Working hours
Regular working hours
Job source

Tech stack

Business Analytics Applications Data Analysis Microsoft Azure Clinical Data Repository Data Governance Data Transformation Data Systems Data Warehousing Management of Software Versions Cloud Platform System Feature Engineering Fast Healthcare Interoperability Resources
+8 more
Apache Spark Electronic Medical Records Data Lakes Health Level Seven International Epic Clarity Epic Caboodle Data Pipelines Databricks

Job description

We are seeking a Senior Data Engineer with deep experience working with clinical and real-world healthcare data. This role will focus on building and scaling data pipelines that support analytics, research, and downstream machine learning use cases. The ideal candidate has hands-on experience with OMOP, Databricks, and modern data stacks, and understands the real-world challenges of clinical data harmonization across disparate healthcare sources.

Day-to-Day Responsibilities

  • Design, build, and maintain scalable data pipelines for large, complex clinical datasets (EHR, pathology, genomics, etc.)
  • Implement and manage data transformations and analytics workflows using Databricks (Spark, Delta Lake)
  • Ingest, standardize, and harmonize healthcare data into OMOP Common Data Model
  • Partner with clinical, analytics, and ML teams to ensure data is reliable, well-documented, and fit for downstream use
  • Lead data quality, validation, and observability efforts for clinical data pipelines
  • Develop data models and schemas that support analytics, research, and ML use cases
  • Optimize performance, cost, and reliability across the data platform
  • Contribute to best practices around data governance, versioning, lineage, and reproducibility
  • Taking data analysis requirements from commercial customers and mapping to clinical variables from the OMOP, Epic, or other data models

Requirements

  • OMOP Common Data Model (CDM) experience, including clinical data mapping, harmonization, and transformation of healthcare data into OMOP structures.
  • Azure Cloud experience, including hands-on development and support of cloud-based data platforms, services, and analytics solutions.
  • Epic Clarity Certification with demonstrated experience working within Epic Clarity reporting and analytics environments.
  • Epic Caboodle Certification (Epic Cogito) with experience supporting Epic enterprise reporting, data warehousing, and analytics initiatives.
  • Experience working with healthcare, clinical, provider, payer, or life sciences data., * Experience working with real-world evidence (RWE), clinical research, or regulatory-facing datasets
  • Familiarity with ML or feature engineering pipelines built on clinical data
  • Experience supporting downstream LLM, NLP, or ML workloads using healthcare data Knowledge of healthcare data standards beyond OMOP (FHIR, HL7)
  • Experience operating data systems in HIPAA-compliant environments

Benefits & conditions

Pulled from the full job description Health insurance Vision insurance Dental insurance, * Dental insurance

  • Health insurance
  • Vision insurance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all