Data Engineer - Healthcare
Microgreen Technologies Llc
United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Cerner
Airflow
Amazon Web Services
Amazon S3
ASC X12 Standards
Microsoft Azure
Big Data
BigQuery
Health Informatics
Clinical Data Repository
Cloud Computing
Databases
+37 more
Continuous Integration
Data as a Services
Information Engineering
Extract Transform Load (ETL)
Data Warehousing
Dimensional Modeling
Apache Hadoop
Healthcare Effectiveness Data and Information Set
Apache Hive
Python (Programming Language)
Operational Data Store
Data Streaming
Parquet
Data Logging
Google Cloud
Cloud Platform System
EHR Systems
Sql Optimization
Fast Healthcare Interoperability Resources
Snowflake
Apache Spark
Git
Data Lakes
Pyspark
Kubernetes
Information Technology
Health Level Seven International
Apache Kafka
Spark Streaming
Terraform
Azure Synapse Analytics
Software Version Control
Data Pipelines
QNXT
Docker
Allscripts
Databricks
Job description
We are seeking an experienced Data Engineer with a healthcare background to design, build, and optimize scalable data pipelines using Python and PySpark. You will ingest, transform, and deliver high-quality clinical, claims, and operational data for analytics, reporting, and downstream applications, while meeting healthcare privacy and compliance standards., * Design, develop, and maintain batch and streaming data pipelines using PySpark and Python
- Build and optimize ETL/ELT workflows for large healthcare datasets (claims, EHR/EMR, eligibility, provider, pharmacy, and lab data)
- Ingest and transform healthcare data standards such as HL7, FHIR, X12 (837/835/834), CCDA, and ICD-10/CPT/NDC/LOINC code sets
- Tune Spark jobs for performance, cost, and reliability (partitioning, caching, join strategies)
- Develop data models and curated datasets in data lake / lakehouse environments
- Implement data quality checks, validation, lineage, logging, and monitoring
- Apply de-identification, masking, and access controls to PHI/PII in line with HIPAA requirements
- Orchestrate workflows using Airflow or similar schedulers
- Collaborate with data scientists, analysts, clinical SMEs, and application teams
- Apply CI/CD, version control, and testing best practices to data code
- Document pipelines, data flows, and technical designs
Requirements
- 5+ years of hands-on data engineering experience
- 3+ years of experience in the healthcare, health insurance, life sciences, or health IT domain
- Strong proficiency in Python and PySpark (Spark SQL, DataFrames, RDDs)
- Advanced SQL skills and experience with relational and columnar databases
- Experience with big data ecosystems (Hadoop, Hive, Delta Lake, Parquet)
- Experience with at least one major cloud platform (AWS, Azure, or Google Cloud Platform) and its data services (e.g., S3, Glue, EMR, Databricks, Synapse, BigQuery)
- Working knowledge of HIPAA, PHI/PII handling, and healthcare data security practices
- Solid understanding of data warehousing, dimensional modeling, and ETL design
- Experience with Git and CI/CD pipelines
- U.S. Citizen (native/natural-born or naturalized), able to work 100% remotely from within the U.S., * Experience with EHR platforms (Epic, Cerner, Allscripts) or payer systems (Facets, QNXT)
- Familiarity with healthcare analytics such as HEDIS, risk adjustment, quality measures, or population health
- Databricks or Snowflake experience
- Streaming experience (Kafka, Spark Structured Streaming)
- Airflow, dbt, Terraform, or Docker/Kubernetes experience
- Cloud or data certifications (AWS, Azure, Databricks)
- Experience with federal or state healthcare programs (Medicare, Medicaid, CMS)
- Bachelorβs degree in Computer Science, Engineering, Health Informatics, or a related field
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦