Data Pipeline Engineer / Irving / Charlotte...

Kelly Services Inc.
Irving, United States of America
29 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 126K

Job location

Irving, United States of America

Tech stack

Airflow
Data analysis
Big Data
Cloud Computing
Cloud Database
Databases
ETL
Data Systems
Data Warehousing
Python
Open Source Technology
Performance Tuning
Cloud Services
DataOps
SAS (Software)
SQL Databases
SQL Server Integration Services
Data Processing
Google Cloud Platform
Spark
Ab Initio
Data Lake
Data Pipelines

Job description

We are seeking an experienced Data Pipeline Engineer to design, architect, and maintain scalable data pipelines that support reporting and downstream applications. The ideal candidate will bring strong expertise in cloud-based and open-source data technologies, modern data lake architectures, and data engineering best practices., + Design, architect, and implement scalable data pipelines for reporting and downstream applications using open-source tools and cloud platforms.

  • Build and support cloud-based data lake architectures for both operational and analytical data stores.

  • Apply strong database, SQL, and reporting concepts to design efficient, high-performance data solutions.

  • Develop data processing and transformation logic using Python and Spark.

  • Work with and interpret legacy ETL code and workflows from tools such as SSIS, Ab Initio, SAS, and similar technologies to support modernization and migration initiatives.

  • Utilize modern data pipelining and orchestration tools to automate, monitor, and optimize data workflows.

  • Troubleshoot data pipeline issues, ensure data quality, and optimize performance and reliability.

Requirements

  • Expertise in SQL for data analysis, transformation, and performance tuning.

  • Strong hands-on experience with Python and Spark for large-scale data processing.

  • Experience with data pipelining and orchestration tools (e.g., Airflow, Cloud Composer, or equivalent).

  • Solid understanding of databases, data warehousing, and data lake architectures.

  • Proven experience designing and architecting data pipelines for analytics and reporting.

  • Experience working with legacy ETL tools such as SSIS, Ab Initio, SAS, or equivalent.

  • Strong analytical, critical thinking, and problem-solving skills.

  • Ability to adapt quickly to evolving technologies and business requirements.

Desired Skills & Experience

  • Expertise in cloud platforms, with Google Cloud Platform (GCP) strongly preferred.

  • Experience building cloud-native data lake solutions using open-source technologies.

About the company

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Data Pipeline Engineer in Irving TX or Charlotte NC (Hybrid).

Apply for this position