Senior Data Engineer

LabCorp
Durham, United States of America
14 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Durham, United States of America

Tech stack

Microsoft Active Directory
Agile Methodologies
Application Lifecycle Management
Continuous Integration
Information Engineering
Data Governance
Data Mapping
Data Systems
Data Warehousing
Relational Databases
Hive
Python
Performance Tuning
Scrum
Role-Based Access Control
Software Requirements Analysis
SQL Databases
Cloud Platform System
Spark
GIT
Microsoft Fabric
PySpark
Git Flow
Stream Analytics
Legacy Systems
Databricks

Job description

  • Design and implement end-to-end data engineering solutions by leveraging the full suite of Databricks, Fabric tools, including data ingestion, transformation, and modeling.
  • Design, develop and maintain end-to-end data pipelines by using spark, ensuring scalability, reliability, and cost optimized solutions.
  • Collaborate with internal teams and clients to understand business requirements and translate them into robust technical solutions.
  • Conduct performance tuning and troubleshooting to identify and resolve any issues.
  • Implement data governance and security best practices, including role-based access control, encryption, and auditing.
  • Translate Business requirements into high-quality technical documents including, data mapping, data processes, and operational support guides.
  • Work closely with architects, product managers and reporting team to collect functional and system requirements.
  • Work in fast-paced environment and perform effectively in an agile development environment.

Requirements

  • Bachelor's Degree
  • 8 years of experience in designing and implementing data solutions with 4 years of experience in data engineering.
  • 4 years experience with Databricks, Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
  • 6 years of experience in Spark, PySpark and Python.
  • 4 years experience in SQL, Spark SQL, data modeling & RDBMS concepts., * Extensive experience with Databricks,Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
  • Strong knowledge of Data Fabric services, particularly Data engineering, Data warehouse, Data factory, and Real- time intelligence.
  • Solid experience with Git, CI/CD, branching strategies.
  • Experience building ingestion frameworks for legacy systems.
  • Strong problem-solving skills, with ability to perform multi-tasking.
  • Familiarity with security best practices in cloud environments, Active Directory, encryption, and data privacy compliance.
  • Communicate effectively in both oral and written.
  • Experience in AGILE development, SCRUM and Application Lifecycle Management (ALM).
  • Preference given to current or former Labcorp employees.

Benefits & conditions

Tuition reimbursement, Employee stock purchase plan, 401(k), Health insurance, Paid time off, Vision insurance, Dental insurance, Disability insurance

Apply for this position