Senior Big Data Engineer (Spark / Scala / Python)
Role details
Job location
Tech stack
Job description
We are seeking a highly experienced Senior Big Data Engineer to join our Risk Technology group. This role focuses on building scalable, resilient data platforms supporting Counterparty Credit Risk (CCR), trade processing, analytics, and regulatory reporting. The ideal candidate has deep hands-on expertise in Spark, Scala, Python, and distributed data systems, with strong domain knowledge of financial and risk data. Hybrid working:
The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. Your Role:
- Design and build distributed batch and real-time data pipelines using Spark (Core/SQL/Streaming) in Scala and Python.
- Architect scalable ingestion, transformation, and enrichment frameworks for trade, risk, and regulatory datasets.
- Lead solution design, enforce engineering best practices, and mentor global engineering teams.
- Optimize Spark workloads, ensure production reliability, and implement monitoring for pipeline and data quality.
- Collaborate with Quants, Risk, Regulatory, and Trading teams to deliver high-quality, governed data assets.
Requirements
Do you have experience in Spark?, * 16+ years of data/software engineering experience with deep expertise in Spark, Scala, and Python.
- Strong background in designing large-scale ETL/ELT workflows and distributed compute optimization.
- Solid understanding of trade data, counterparty risk, and market/risk processes within banking.
- Hands-on experience in data governance, quality controls, lineage, and secure engineering practices.
- Excellent communication skills with a proven track record in global banking and cross-functional teams.
We are a Disability Confident Employer:
Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government's Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:
- Declare they have a disability, and
- Meet the minimum essential criteria for the role.
About the company
Capgemini ist einer der weltweit führenden Anbieter von Management- und IT-Beratung, Technologie-Services und Digitaler Transformation. Als ein Wegbereiter für Innovation unterstützt das Unternehmen seine Kunden bei deren komplexen Herausforderungen rund um Cloud, Digital und Plattformen.