Azure Databricks Developer

Atos
London, UK
8 days ago
Apply on uk.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Application Programming Interfaces (APIs) Artificial Intelligence Microsoft Azure Big Data Software as a Service Continuous Integration Extract Transform Load (ETL) Database Development Distributed Systems Apache Hive Python (Programming Language)
+20 more
Machine Learning SQL Azure Performance Tuning Azure Machine Learning Azure Data Lake Software Construction Data Streaming Data Ingestion Azure Data Factory Apache Spark Git Microsoft Fabric Data Lakes Pyspark Apache Kafka Machine Learning Operations Terraform Azure Synapse Analytics Data Pipelines Databricks

Job description

We are seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform.

In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards., * Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.

  • Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads.
  • Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems.
  • Implement data quality, validation, monitoring, and governance controls across the data lifecycle.
  • Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support.

Requirements

  • Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise.
  • Experience building enterprise-scale ETL/ELT pipelines within Azure environments.
  • Strong Python and SQL development skills.
  • Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory.
  • Git version control and software engineering best practices.

Skills we’d like:

  • Experience with Microsoft Fabric, Azure Synapse Analytics, Azure Event Hubs, or Kafka.
  • Knowledge of Azure DevOps, Terraform, Unity Catalog, MLflow, or Azure Machine Learning.

Additional Requirements:

  • Candidates must be eligible to obtain and maintain SC and NPPV3 clearance.
  • Proven experience working with large-scale data processing and distributed computing technologies.
  • Experience working within Agile delivery teams.

Benefits & conditions

  • 25 days paid leave + National Holidays
  • Pension Scheme - contributions matched up to 10%
  • Private Medical Cover
  • Income Protection
  • Life Assurance
  • Flex Benefits Program

About the company

Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements.

With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core IT systems, accelerate cloud and data transformation, strengthen cybersecurity, and deliver secure digital workplace environments to support its clients, its employees and society. Atos also provides consulting and advisory services through its Atos Amplify brand. A trusted partner in operating complex and mission-critical environments, Atos supports organizations across highly regulated and sovereign contexts.

About Atos Group

Atos Group is a global leader in digital transformation with c. 56,000 employees and annual revenue of c. €7.2 billion (at the go-forward perimeter), operating in 54 countries under two brands - Atos for services and Eviden for products and systems. European number one in cybersecurity and a leader in cloud, Atos Group is committed to a secure and decarbonized future and provides tailored AI-powered, end-to-end solutions for all industries. Atos Group is listed on Euronext Paris.

About the practice:

Our Data & AI Practice helps organisations unlock the value of their data through modern cloud platforms, data engineering, analytics, artificial intelligence, and machine learning solutions. We work with clients across the public and private sectors to design and deliver data platforms that drive innovation, improve decision-making, and create measurable business outcomes.

Where purpose meets career:

Join a team that is transforming how organisations use data to solve complex challenges and deliver meaningful outcomes.

  • Work on large-scale, cloud-native data platforms using cutting-edge Azure technologies.
  • Collaborate with experienced architects, engineers, and data specialists on impactful projects.
  • Develop your technical expertise across data engineering, AI, analytics, and modern DevOps practices., Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on uk.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:36 min

Development tools for spatial computing and drones

Zaid Zaim Zaid Zaim · World Congress 2023

1:43 min

AWS infrastructure stack and data flow pipeline overview

Artem Volk Artem Volk +1 · World Congress 2024

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all