Data Engineer - Healthcare

Microgreen Technologies Llc
United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Cerner Airflow Amazon Web Services Amazon S3 ASC X12 Standards Microsoft Azure Big Data BigQuery Health Informatics Clinical Data Repository Cloud Computing Databases
+37 more
Continuous Integration Data as a Services Information Engineering Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Apache Hadoop Healthcare Effectiveness Data and Information Set Apache Hive Python (Programming Language) Operational Data Store Data Streaming Parquet Data Logging Google Cloud Cloud Platform System EHR Systems Sql Optimization Fast Healthcare Interoperability Resources Snowflake Apache Spark Git Data Lakes Pyspark Kubernetes Information Technology Health Level Seven International Apache Kafka Spark Streaming Terraform Azure Synapse Analytics Software Version Control Data Pipelines QNXT Docker Allscripts Databricks

Job description

We are seeking an experienced Data Engineer with a healthcare background to design, build, and optimize scalable data pipelines using Python and PySpark. You will ingest, transform, and deliver high-quality clinical, claims, and operational data for analytics, reporting, and downstream applications, while meeting healthcare privacy and compliance standards., * Design, develop, and maintain batch and streaming data pipelines using PySpark and Python

  • Build and optimize ETL/ELT workflows for large healthcare datasets (claims, EHR/EMR, eligibility, provider, pharmacy, and lab data)
  • Ingest and transform healthcare data standards such as HL7, FHIR, X12 (837/835/834), CCDA, and ICD-10/CPT/NDC/LOINC code sets
  • Tune Spark jobs for performance, cost, and reliability (partitioning, caching, join strategies)
  • Develop data models and curated datasets in data lake / lakehouse environments
  • Implement data quality checks, validation, lineage, logging, and monitoring
  • Apply de-identification, masking, and access controls to PHI/PII in line with HIPAA requirements
  • Orchestrate workflows using Airflow or similar schedulers
  • Collaborate with data scientists, analysts, clinical SMEs, and application teams
  • Apply CI/CD, version control, and testing best practices to data code
  • Document pipelines, data flows, and technical designs

Requirements

  • 5+ years of hands-on data engineering experience
  • 3+ years of experience in the healthcare, health insurance, life sciences, or health IT domain
  • Strong proficiency in Python and PySpark (Spark SQL, DataFrames, RDDs)
  • Advanced SQL skills and experience with relational and columnar databases
  • Experience with big data ecosystems (Hadoop, Hive, Delta Lake, Parquet)
  • Experience with at least one major cloud platform (AWS, Azure, or Google Cloud Platform) and its data services (e.g., S3, Glue, EMR, Databricks, Synapse, BigQuery)
  • Working knowledge of HIPAA, PHI/PII handling, and healthcare data security practices
  • Solid understanding of data warehousing, dimensional modeling, and ETL design
  • Experience with Git and CI/CD pipelines
  • U.S. Citizen (native/natural-born or naturalized), able to work 100% remotely from within the U.S., * Experience with EHR platforms (Epic, Cerner, Allscripts) or payer systems (Facets, QNXT)
  • Familiarity with healthcare analytics such as HEDIS, risk adjustment, quality measures, or population health
  • Databricks or Snowflake experience
  • Streaming experience (Kafka, Spark Structured Streaming)
  • Airflow, dbt, Terraform, or Docker/Kubernetes experience
  • Cloud or data certifications (AWS, Azure, Databricks)
  • Experience with federal or state healthcare programs (Medicare, Medicaid, CMS)
  • Bachelor’s degree in Computer Science, Engineering, Health Informatics, or a related field

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…