DataBricks Engineer -Manchester

Capgemini
London, UK
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Batch Processing Big Data Cloud Database Data Architecture Information Engineering Extract Transform Load (ETL) Data Warehousing Python (Programming Language) Machine Learning Data Storage Technologies Snowflake Pyspark
+3 more
Data Management Data Pipelines Databricks

Job description

Capgemini is seeking a highly skilled Data Engineer with strong Databricks expertise to design, build, and optimize scalable data solutions. This role focuses on modern data engineering practices, including developing high-performance data pipelines and contributing to technical design and architecture discussions. The position plays a key role in enabling analytics, reporting, and business-critical data use cases across the organization., * Design, develop, and maintain scalable data pipelines and processing frameworks using Databricks, Python, and PySpark

  • Build and optimize data workflows to support analytics, reporting, and operational needs
  • Collaborate with cross-functional teams to deliver efficient, reliable, and scalable data solutions
  • Actively contribute to technical discussions, architecture decisions, and design reviews
  • Ensure high standards of data quality, performance, and reliability across platforms
  • Support integration with data storage systems such as cloud data lakes and (optionally) Snowflake

Requirements

Do you have experience in System design?, * Strong hands-on experience with Databricks (must-have)

  • Proficiency in Python and PySpark for large-scale data processing
  • Solid understanding of data engineering fundamentals (ETL/ELT, batch processing, transformations)
  • Proven experience building scalable and efficient data pipelines
  • Exposure to Snowflake or modern cloud data warehouses
  • Understanding of data architecture and system design principles
  • Awareness of agentic AI and machine learning concepts, and how they integrate with data platforms

We are a Disability Confident Employer:

Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

  • Declare they have a disability, and
  • Meet the minimum essential criteria for the role.

About the company

  • You’d be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.

  • You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more.
  • You will be joining one of the World’s Most Ethical Companies®, as recognised by Ethisphere® for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping to create a future we can all be proud of.

About Capgemini

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organisations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion. Make it real | www.capgemini.com

You must create an Indeed account before continuing to the company website to apply

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

Videos

See all

Related articles

See all