Databricks Developer - London, UK

Capgemini
London, UK
12 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Business Analytics Applications Computer Programming Continuous Integration Extract Transform Load (ETL) Data Transformation Data Security Data Warehousing Database Theory DevOps Apache Hive Python (Programming Language) Performance Tuning
+11 more
Cloud Services Azure Data Lake SQL Databases Unstructured Data Data Processing Azure Data Factory Apache Spark Git Pyspark Data Pipelines Databricks

Job description

  • Design develop and maintain scalable ETLELT pipelines using Azure Databricks
  • Develop data processing solutions using PySpark Spark SQL and Python
  • Ingest transform and optimize structured and unstructured data from multiple sources
  • Build and maintain data lakes and medallion architecture Bronze Silver Gold layers
  • Integrate Databricks with Azure Data Factory ADF Azure Data Lake Storage ADLS Synapse and other cloud services
  • Optimize Spark jobs for performance and cost efficiency
  • Implement data quality checks monitoring and troubleshooting processes
  • Collaborate with business stakeholders’ data analysts and architects to understand data requirements Ensure adherence to data governance security and compliance standards *

Requirements

  • Strong experience with Azure Databricks
  • Expertise in PySpark Spark SQL and Python
  • Handson experience with Azure Data Factory ADF
  • Strong SQL programming and database concepts
  • Experience with Azure Data Lake Storage ADLS Gen2
  • Knowledge of ETL Data Warehousing concepts
  • Experience with Git CICD and DevOps practices Understanding of data modelling and performance tuning *

About the company

  • You’d be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions.
  • To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.
  • You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard Manage Mentor, Cybersecurity qualifications and much more. You will be joining one of the World’s Most Ethical Companies®, as recognised by Ethisphere® for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping to create a future we can all be proud of. *

Why you should consider Capgemini: Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you’ll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what’s possible. It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

About Capgemini:

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion. Make it real | www.capgemini.com

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…