AWS ETL Data Engineer - HYBRID

NTT DATA Corporation
Memphis, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 163K

Job location

Memphis, United States of America

Tech stack

Microsoft Excel
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Apache HTTP Server
Big Data
Code Review
Customer Data Management
Data Architecture
Information Engineering
Data Governance
ETL
Data Transformation
Data Sharing
Data Warehousing
Dimensional Modeling
Distributed Computing Environment
Hive
JSON
Python
MicroStrategy
MySQL
Performance Tuning
Query Optimization
Cloud Services
Shell Script
SQL Stored Procedures
PL-SQL
SQL Databases
XML
Parquet
Data Processing
Spark
AWS Lambda
PySpark
Semi-structured Data
Avro
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Kafka
Data Management
Functional Programming
Data Pipelines
Serverless Computing
Redshift

Job description

  • Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting.
  • Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift.
  • Develop and maintain Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
  • Perform query tuning, performance optimization, and data-sharing implementations.
  • Support ingestion and processing of structured and semi-structured data formats including JSON, CSV, XML, ORC, Parquet, and Avro.
  • Design, enhance, and support solutions that provide a unified view of customer data across systems.
  • Integrate multiple data sources, applications, and business processes to support reporting, analytics, and customer engagement initiatives.
  • Collaborate with business and technical teams to define and implement scalable data solutions.
  • Manage and support Data Subject Requests (DSRs), including customer data erasure requests.
  • Work closely with the DPO team to ensure compliance with privacy regulations and internal policies.
  • Maintain and support the MicroStrategy Privacy Compliance module. (Very infrequent once in year or 2 years)
  • Contribute to data governance initiatives that improve data quality, consistency, and compliance.
  • Analyze and troubleshoot complex data issues using Redshift SQL, MySQL, Python/PySpark, Shell scripting, and Excel.
  • Investigate data mismatches, reporting issues, and business data anomalies.
  • Support business analysis related to customer tiers, loyalty programs, and email marketability.
  • Provide production support and root-cause analysis for critical data platform issues.

Technical Leadership & Collaboration

  • Participate in Customer 360, Privacy, Data Governance, and Phaedon initiatives.
  • Conduct code reviews and design reviews.
  • Provide cross-team technical support and problem resolution.
  • Research, design, and develop next-generation data capabilities and products.
  • Act as a subject matter expert for customer data platforms.

Primary Technologies

  • AWS: S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
  • Spark (Scala/Python)
  • Redshift SQL/PLSQL, MySQL
  • Data Modeling and Query Optimization

Requirements

  • Strong ownership and accountability

  • Strong AWS Data Engineering stack awareness

  • Ability to bridge business and technical teams

  • Expertise across engineering, analytics, compliance, architecture, and operational support

  • Adaptability and willingness to take on diverse data-related challenges, * 12+ years of experience in Data Warehouse / Big Data ecosystems.

  • 5+ years in a lead /SME role

  • 5+ years with AWS architecture and data engineering, including S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg

  • 3+ years with Spark (Scala/Python)

  • 5+ years with SQL/PLSQL, MySQL

  • 5+ years strong understanding of:

  • Data architecture & dimensional modeling

  • ETL/ELT frameworks

  • Distributed data processing

  • Cloud data platforms

  • Data governance and security

Preferred Skills:

  • Experience managing large-scale enterprise data environments.

  • Proven track record of delivering complex data programs.

  • Excellent communication and stakeholder management abilities.

  • Experience in large enterprise or global delivery environments.

  • Exposure to data modernization and cloud transformation programs.

  • Certifications in cloud platforms or data engineering.

  • Experience in regulated industries (Hospitality, Finance, Healthcare, Telecom, etc.).

Benefits & conditions

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $97,725 - 162,875. Actual compensation will depend on a number of factors, including the candidate's relevant experience, technical skills, and other qualifications.

This position may also be eligible for incentive compensation based on individual and/or company performance.

This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.

#LI-NorthAmerica

About the company

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Apply for this position