Clinical Data Engineering Lead

American IT Systems
Rochester, MN, United States
21 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Software Quality Continuous Integration Data Cleansing Information Engineering Data Flow Control Oracle (Applications) Google Cloud

Job description

Own data-engineering delivery on Google Cloud Platform/DataFlow, including ingestion, transformation, standardisation, reconciliation, publication and operational engineering standards., Define reusable DataFlow/Google Cloud Platform ingestion and transformation patterns.

  • Implement source ingestion from Epic, ELMS, Oracle, terminology and other approved sources.
  • Build raw/source-preserving, standardised/cleansed and curated/mastered processing layers.
  • Implement standardisation, validation, transformation and reference-data enrichment.
  • Build reconciliation controls between source, MDM/RDM and downstream publication.
  • Build publication pipelines to Google Cloud Platform data products, APIs, events and tables/files.
  • Implement replay, restart, idempotency, audit and monitoring; optimise performance and cost.
  • Establish CI/CD, code quality and production support procedures.

Primary Deliverables

  • Data engineering architecture / design
  • Ingestion and transformation pipelines
  • Reconciliation framework
  • Publication pipelines
  • Operational monitoring and runbooks
  • CI/CD and engineering standards

Requirements

8+ years in data engineering, hands-on with Google Cloud Platform and DataFlow (or equivalent).

  • Large-scale batch, incremental and event-driven pipeline experience.
  • Experience feeding and reconciling MDM/RDM data.
  • Strong on operationalisation: monitoring, replay, CI/CD.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:48 min

Balancing code generation velocity with software quality standards

Lilia Gargouri Lilia Gargouri · Coffee With Developers

2:17 min

Balancing model training with data preparation realities

Lukas Kölbl · LIVE

6:10 min

Unlocking free learning credits via Google Cloud Innovators

Asrar Asrar · World Congress 2024

1:57 min

Building a holistic system for software quality

Serge Baumberger Serge Baumberger · Europe 2026 Virtual

3:24 min

Harmonizing federal data records with automated software robots

Clemens Schwaiger · LIVE

Videos

See all

Related articles

See all