Senior Data Engineer

LabCorp
Durham, NC, United States
3 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours
Job source

Tech stack

Active Directory Agile Methodology Application Lifecycle Management Continuous Integration Information Engineering Data Governance Data Mapping Data Systems Data Warehousing Relational Databases Apache Hive Python (Programming Language)
+14 more
Performance Tuning Scrum Methodology Role-Based Access Control Software Requirements Analysis SQL Databases Cloud Platform System Apache Spark Git Microsoft Fabric Pyspark Git Flow Stream Analytics Legacy Systems Databricks

Job description

  • Design and implement end-to-end data engineering solutions by leveraging the full suite of Databricks, Fabric tools, including data ingestion, transformation, and modeling.
  • Design, develop and maintain end-to-end data pipelines by using spark, ensuring scalability, reliability, and cost optimized solutions.
  • Collaborate with internal teams and clients to understand business requirements and translate them into robust technical solutions.
  • Conduct performance tuning and troubleshooting to identify and resolve any issues.
  • Implement data governance and security best practices, including role-based access control, encryption, and auditing.
  • Translate Business requirements into high-quality technical documents including, data mapping, data processes, and operational support guides.
  • Work closely with architects, product managers and reporting team to collect functional and system requirements.
  • Work in fast-paced environment and perform effectively in an agile development environment.

Requirements

  • Bachelor’s Degree
  • 8 years of experience in designing and implementing data solutions with 4 years of experience in data engineering.
  • 4 years experience with Databricks, Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
  • 6 years of experience in Spark, PySpark and Python.
  • 4 years experience in SQL, Spark SQL, data modeling & RDBMS concepts., * Extensive experience with Databricks,Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
  • Strong knowledge of Data Fabric services, particularly Data engineering, Data warehouse, Data factory, and Real- time intelligence.
  • Solid experience with Git, CI/CD, branching strategies.
  • Experience building ingestion frameworks for legacy systems.
  • Strong problem-solving skills, with ability to perform multi-tasking.
  • Familiarity with security best practices in cloud environments, Active Directory, encryption, and data privacy compliance.
  • Communicate effectively in both oral and written.
  • Experience in AGILE development, SCRUM and Application Lifecycle Management (ALM).
  • Preference given to current or former Labcorp employees.

Benefits & conditions

Tuition reimbursement, Employee stock purchase plan, 401(k), Health insurance, Paid time off, Vision insurance, Dental insurance, Disability insurance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:02 min

Mapping Git flow branches to application tester segments

Majid Hajian Ā· LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer Ā· Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy Ā· LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon Ā· WWC Europe 2026

5:19 min

Audience Q&A on future tools and Git commands

PJ Hagerty PJ Hagerty Ā· WWC Europe 2026

3:53 min

Introduction to git flow and clean feature branches

Johannes Haux Ā· WWC 2022

Videos

See all

Related articles

See all