Data Pipeline Engineer / Irving / Charlotte...

Kelly Services Inc.

Irving, TX, United States

3 months ago

Apply on juju.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Compensation

$111,405.0 - $125,528.0

Working hours

Regular working hours

Job source

juju.com

Tech stack

Airflow Data Analysis Big Data Cloud Computing Cloud Database Databases Extract Transform Load (ETL) Data Systems Data Warehousing Python (Programming Language) Open Source Technology Performance Tuning

+11 more

Cloud Services DataOps SAS (Software) SQL Databases SQL Server Integration Services Data Processing Google Cloud Apache Spark Ab Initio Data Lakes Data Pipelines

Job description

We are seeking an experienced Data Pipeline Engineer to design, architect, and maintain scalable data pipelines that support reporting and downstream applications. The ideal candidate will bring strong expertise in cloud-based and open-source data technologies, modern data lake architectures, and data engineering best practices., + Design, architect, and implement scalable data pipelines for reporting and downstream applications using open-source tools and cloud platforms.

Build and support cloud-based data lake architectures for both operational and analytical data stores.
Apply strong database, SQL, and reporting concepts to design efficient, high-performance data solutions.
Develop data processing and transformation logic using Python and Spark.
Work with and interpret legacy ETL code and workflows from tools such as SSIS, Ab Initio, SAS, and similar technologies to support modernization and migration initiatives.
Utilize modern data pipelining and orchestration tools to automate, monitor, and optimize data workflows.
Troubleshoot data pipeline issues, ensure data quality, and optimize performance and reliability.

Requirements

Expertise in SQL for data analysis, transformation, and performance tuning.
Strong hands-on experience with Python and Spark for large-scale data processing.
Experience with data pipelining and orchestration tools (e.g., Airflow, Cloud Composer, or equivalent).
Solid understanding of databases, data warehousing, and data lake architectures.
Proven experience designing and architecting data pipelines for analytics and reporting.
Experience working with legacy ETL tools such as SSIS, Ab Initio, SAS, or equivalent.
Strong analytical, critical thinking, and problem-solving skills.
Ability to adapt quickly to evolving technologies and business requirements.

Desired Skills & Experience

Expertise in cloud platforms, with Google Cloud Platform (GCP) strongly preferred.
Experience building cloud-native data lake solutions using open-source technologies.

About the company

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Data Pipeline Engineer in Irving TX or Charlotte NC (Hybrid).