Data Pipeline Engineer

Everforth Apex
Charlotte, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 168K

Job location

Charlotte, United States of America

Tech stack

Agile Methodologies
Big Data
Google BigQuery
Cloud Database
Information Engineering
ETL
Data Transformation
Hadoop
Python
Cloud Services
Software Deployment
Software Engineering
SQL Databases
Teradata
Google Cloud Platform
Cloud Platform System
Ab Initio
PySpark
Kafka
Data Management
Data Pipelines

Job description

In this contingent resource assignment, you will consult on complex initiatives with broad impact and large-scale planning for Software Engineering. This role supports a Financial Services organization and is focused on enterprise data platform modernization initiatives. The ideal candidate will have strong experience designing, developing, and supporting large-scale data pipelines, ETL processes, and cloud-based data solutions., * Design, build, and maintain large-scale data pipelines and ETL solutions.

  • Support migration of enterprise data assets from Teradata to Google Cloud Platform.
  • Develop and optimize data transformations using PySpark, Python, SQL, and Ab Initio.
  • Work with large-scale datasets supporting Fraud and Claims analytics applications.
  • Build and maintain data processing solutions leveraging Google Cloud Platform BigQuery and related cloud services.
  • Collaborate with business and technical stakeholders to gather requirements and deliver scalable solutions.
  • Troubleshoot and resolve data quality, performance, and integration issues.
  • Support production deployments and operational maintenance activities.
  • Participate in Agile development processes and engineering best practices.
  • Ensure solutions meet security, compliance, and enterprise architecture standards.

Requirements

  • 5+ years of Data Engineering or Software Engineering experience.
  • Strong experience with SQL, ETL Development, PySpark/Python, and Ab Initio.
  • Experience building and supporting data pipelines in Cloud environments (Google Cloud Platform preferred).

Preferred Qualifications

  • Kafka experience.
  • Teradata and Hadoop experience.
  • Google Cloud certifications.
  • Experience supporting fraud, claims, or financial services data platforms.

About the company

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at

Apply for this position