> Markdown version of [/jobs/ext/3563274-azure-databricks-developer](https://www.wearedevelopers.com/jobs/ext/3563274-azure-databricks-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Developer

- **Company:** ATOS
- **Location:** Newcastle upon Tyne, UK (Remote available)
- **Contract:** Permanent contract
- **Skills:** Unity 3d, Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Big Data, Software as a Service, Continuous Integration, Extract Transform Load (ETL), Database Development, Distributed Systems, Apache Hive, Python (Programming Language), Machine Learning, SQL Azure, Performance Tuning, Azure Machine Learning, Azure Data Lake, Software Construction, Data Streaming, Data Ingestion, Azure Data Factory, Apache Spark, Git, Microsoft Fabric, Data Lakes, Pyspark, Apache Kafka, Machine Learning Operations, Terraform, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** October 3, 2026
- **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2998694513-2

## About the Role

* Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise.
 * Experience building enterprise scale ETL/ELT pipelines within Azure environments.
 * Strong Python and SQL development skills.
 * Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory.
 * Git version control and software engineering best practices.

Skills We'd Like

 * Experience with Microsoft Fabric, Azure Synapse Analytics, Azure Event Hubs, or Kafka.
 * Knowledge of Azure DevOps, Terraform, Unity Catalog, MLflow, or Azure Machine Learning., * Candidates must be eligible to obtain and maintain SC and NPPV3 clearance.
 * Proven experience working with large-scale data processing and distributed computing technologies.
 * Experience working within Agile delivery teams.

## Description

We are seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform. In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards., * Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.

 * Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads.
 * Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on premise systems.
 * Implement data quality, validation, monitoring, and governance controls across the data lifecycle.
 * Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support.