Senior Data Engineer
LabCorp
Durham, NC, United States
3 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours
Job source
Tech stack
Active Directory
Agile Methodology
Application Lifecycle Management
Continuous Integration
Information Engineering
Data Governance
Data Mapping
Data Systems
Data Warehousing
Relational Databases
Apache Hive
Python (Programming Language)
+14 more
Performance Tuning
Scrum Methodology
Role-Based Access Control
Software Requirements Analysis
SQL Databases
Cloud Platform System
Apache Spark
Git
Microsoft Fabric
Pyspark
Git Flow
Stream Analytics
Legacy Systems
Databricks
Job description
- Design and implement end-to-end data engineering solutions by leveraging the full suite of Databricks, Fabric tools, including data ingestion, transformation, and modeling.
- Design, develop and maintain end-to-end data pipelines by using spark, ensuring scalability, reliability, and cost optimized solutions.
- Collaborate with internal teams and clients to understand business requirements and translate them into robust technical solutions.
- Conduct performance tuning and troubleshooting to identify and resolve any issues.
- Implement data governance and security best practices, including role-based access control, encryption, and auditing.
- Translate Business requirements into high-quality technical documents including, data mapping, data processes, and operational support guides.
- Work closely with architects, product managers and reporting team to collect functional and system requirements.
- Work in fast-paced environment and perform effectively in an agile development environment.
Requirements
- Bachelorās Degree
- 8 years of experience in designing and implementing data solutions with 4 years of experience in data engineering.
- 4 years experience with Databricks, Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
- 6 years of experience in Spark, PySpark and Python.
- 4 years experience in SQL, Spark SQL, data modeling & RDBMS concepts., * Extensive experience with Databricks,Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
- Strong knowledge of Data Fabric services, particularly Data engineering, Data warehouse, Data factory, and Real- time intelligence.
- Solid experience with Git, CI/CD, branching strategies.
- Experience building ingestion frameworks for legacy systems.
- Strong problem-solving skills, with ability to perform multi-tasking.
- Familiarity with security best practices in cloud environments, Active Directory, encryption, and data privacy compliance.
- Communicate effectively in both oral and written.
- Experience in AGILE development, SCRUM and Application Lifecycle Management (ALM).
- Preference given to current or former Labcorp employees.
Benefits & conditions
Tuition reimbursement, Employee stock purchase plan, 401(k), Health insurance, Paid time off, Vision insurance, Dental insurance, Disability insurance
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role ā technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developerās Story
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
EM
Eli McGarvie
Software Engineer Salary London
about 3 years ago