AWS ETL Data Engineer - HYBRID
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+34 more
Job description
- Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting.
- Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift.
- Develop and maintain Redshift SQL/PLSQL code, stored procedures, and data-processing frameworks.
- Perform query tuning, performance optimization, and data-sharing implementations.
- Support ingestion and processing of structured and semi-structured data formats including JSON, CSV, XML, ORC, Parquet, and Avro.
- Design, enhance, and support solutions that provide a unified view of customer data across systems.
- Integrate multiple data sources, applications, and business processes to support reporting, analytics, and customer engagement initiatives.
- Collaborate with business and technical teams to define and implement scalable data solutions.
- Manage and support Data Subject Requests (DSRs), including customer data erasure requests.
- Work closely with the DPO team to ensure compliance with privacy regulations and internal policies.
- Maintain and support the MicroStrategy Privacy Compliance module. (Very infrequent once in year or 2 years)
- Contribute to data governance initiatives that improve data quality, consistency, and compliance.
- Analyze and troubleshoot complex data issues using Redshift SQL, MySQL, Python/PySpark, Shell scripting, and Excel.
- Investigate data mismatches, reporting issues, and business data anomalies.
- Support business analysis related to customer tiers, loyalty programs, and email marketability.
- Provide production support and root-cause analysis for critical data platform issues.
Technical Leadership & Collaboration
- Participate in Customer 360, Privacy, Data Governance, and Phaedon initiatives.
- Conduct code reviews and design reviews.
- Provide cross-team technical support and problem resolution.
- Research, design, and develop next-generation data capabilities and products.
- Act as a subject matter expert for customer data platforms.
Primary Technologies
- AWS: S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
- Spark (Scala/Python)
- Redshift SQL/PLSQL, MySQL
- Data Modeling and Query Optimization
Requirements
- Strong ownership and accountability
- Strong AWS Data Engineering stack awareness
- Ability to bridge business and technical teams
- Expertise across engineering, analytics, compliance, architecture, and operational support
- Adaptability and willingness to take on diverse data-related challenges, * 12+ years of experience in Data Warehouse / Big Data ecosystems.
-
5+ years in a lead /SME role
- 5+ years with AWS architecture and data engineering, including S3, EC2, Redshift (RA3/Serverless), S3 Tables, S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg
- 3+ years with Spark (Scala/Python)
- 5+ years with SQL/PLSQL, MySQL
-
5+ years strong understanding of:
- Data architecture & dimensional modeling
- ETL/ELT frameworks
- Distributed data processing
- Cloud data platforms
- Data governance and security
Preferred Skills:
- Experience managing large-scale enterprise data environments.
- Proven track record of delivering complex data programs.
-
Excellent communication and stakeholder management abilities.
- Experience in large enterprise or global delivery environments.
- Exposure to data modernization and cloud transformation programs.
- Certifications in cloud platforms or data engineering.
- Experience in regulated industries (Hospitality, Finance, Healthcare, Telecom, etc.).
Benefits & conditions
NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is $97,725 - 162,875. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications.
This position may also be eligible for incentive compensation based on individual and/or company performance.
This position is eligible for company benefits including medical, dental, and vision insurance with an employer contribution, flexible spending or health savings account, life and AD&D insurance, short and long term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally-required benefits.
LI-NorthAmerica
About the company
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world’s leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on careers-inc.nttdata.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story
Data Analyst Salary in the UK