Senior AWS Data Engineer

Capgemini
Charing Cross, United Kingdom
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Charing Cross, United Kingdom

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Business Analytics Applications
Continuous Integration
Information Engineering
Data Governance
ETL
Data Masking
Data Systems
Data Vault Modeling
Software Design Patterns
DevOps
Distributed Computing Environment
Fraud Prevention and Detection
Identity and Access Management
Python
Standard Sql
Snowflake
Spark
GIT
Cloudformation
Build Management
Containerization
Data Lake
PySpark
Kubernetes
Deployment Automation
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Kafka
Data Management
Terraform
Data Pipelines
Docker

Job description

We are looking for a Senior AWS Data Engineer with strong experience in financial services (banking, capital markets, insurance, or fintech) to design, build, and scale secure, high-performance data platforms on AWS. In this role, you will develop robust batch and real-time data pipelines, modern data lakes/lakehouses, and analytics solutions supporting critical use cases such as risk analytics, regulatory reporting, fraud detection, and customer insights. You will leverage AWS data services, distributed processing frameworks, and financial domain expertise to deliver scalable, compliant, and enterprise-grade data solutions., * Design and build end-to-end batch and real-time data pipelines using AWS services and Spark

  • Develop scalable ETL/ELT solutions using AWS Glue, PySpark, and distributed frameworks

  • Build and manage data lake/lakehouse architectures on S3, Lake Formation, and Redshift/Snowflake

  • Implement streaming solutions using Kinesis, MSK (Kafka), or EventBridge for real-time analytics

  • Automate deployments with Terraform/CloudFormation and implement CI/CD pipelines Ensure platform scalability, reliability, and security using Docker, Kubernetes, and cloud-native tools

  • Apply data governance, security controls, and regulatory compliance (GDPR, FCA, IAM, encryption)

  • Collaborate with business teams and mentor engineers to deliver high-quality data solutions

Requirements

Do you have experience in Terraform?, * 6-10+ years of experience in data engineering with strong Python and SQL expertise

  • Hands-on experience with Spark/PySpark and distributed data processing frameworks
  • Strong AWS experience with S3, Glue, Lambda, Redshift, Kinesis, and related services
  • Knowledge of data modelling (dimensional, data vault) and ETL/ELT design patterns
  • Familiarity with DevOps tools (Git, CI/CD, Terraform) and containerization (Docker, Kubernetes)
  • Experience in financial services with knowledge of trade data, risk, and regulatory systems
  • Understanding of data governance, security, and compliance (IAM, encryption, data masking)
  • Strong problem-solving, communication, and stakeholder management skills in agile environments

We are a Disability Confident Employer:

Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government's Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

  • Declare they have a disability, and
  • Meet the minimum essential criteria for the role.

About the company

Capgemini ist einer der weltweit führenden Anbieter von Management- und IT-Beratung, Technologie-Services und Digitaler Transformation. Als ein Wegbereiter für Innovation unterstützt das Unternehmen seine Kunden bei deren komplexen Herausforderungen rund um Cloud, Digital und Plattformen.

Apply for this position