Senior AWS Data Engineer

Capgemini
London, UK
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Business Analytics Applications Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Masking Data Systems Data Vault Modeling Software Design Patterns DevOps
+22 more
Distributed Computing Environment Fraud Prevention and Detection Identity and Access Management Python (Programming Language) Standard Sql Snowflake Apache Spark Git Cloudformation Build Management Containerization Data Lakes Pyspark Kubernetes Deployment Automation AWS Glue AWS Data Analytics Apache Kafka Data Management Terraform Data Pipelines Docker

Job description

We are looking for a Senior AWS Data Engineer with strong experience in financial services (banking, capital markets, insurance, or fintech) to design, build, and scale secure, high-performance data platforms on AWS. In this role, you will develop robust batch and real-time data pipelines, modern data lakes/lakehouses, and analytics solutions supporting critical use cases such as risk analytics, regulatory reporting, fraud detection, and customer insights. You will leverage AWS data services, distributed processing frameworks, and financial domain expertise to deliver scalable, compliant, and enterprise-grade data solutions., * Design and build end-to-end batch and real-time data pipelines using AWS services and Spark

  • Develop scalable ETL/ELT solutions using AWS Glue, PySpark, and distributed frameworks
  • Build and manage data lake/lakehouse architectures on S3, Lake Formation, and Redshift/Snowflake
  • Implement streaming solutions using Kinesis, MSK (Kafka), or EventBridge for real-time analytics
  • Automate deployments with Terraform/CloudFormation and implement CI/CD pipelines Ensure platform scalability, reliability, and security using Docker, Kubernetes, and cloud-native tools

  • Apply data governance, security controls, and regulatory compliance (GDPR, FCA, IAM, encryption)
  • Collaborate with business teams and mentor engineers to deliver high-quality data solutions

Requirements

Do you have experience in Terraform?, * 6-10+ years of experience in data engineering with strong Python and SQL expertise

  • Hands-on experience with Spark/PySpark and distributed data processing frameworks
  • Strong AWS experience with S3, Glue, Lambda, Redshift, Kinesis, and related services
  • Knowledge of data modelling (dimensional, data vault) and ETL/ELT design patterns
  • Familiarity with DevOps tools (Git, CI/CD, Terraform) and containerization (Docker, Kubernetes)
  • Experience in financial services with knowledge of trade data, risk, and regulatory systems
  • Understanding of data governance, security, and compliance (IAM, encryption, data masking)
  • Strong problem-solving, communication, and stakeholder management skills in agile environments

We are a Disability Confident Employer:

Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

  • Declare they have a disability, and
  • Meet the minimum essential criteria for the role.

About the company

  • You’d be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.

  • You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more.
  • You will be joining one of the World’s Most Ethical Companies®, as recognised by Ethisphere® for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping to create a future we can all be proud of.

Why you should consider Capgemini:

Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you’ll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what’s possible. It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

About Capgemini:

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organisations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion. Make it real | www.capgemini.com

You must create an Indeed account before continuing to the company website to apply

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all