> Markdown version of [/jobs/ext/2497314-azure-databricks-developer](https://www.wearedevelopers.com/jobs/ext/2497314-azure-databricks-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Databricks Developer - **Company:** Atos - **Location:** London, UK (Remote available) - **Contract:** Permanent contract - **Skills:** Unity 3d, Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Big Data, Software as a Service, Continuous Integration, Extract Transform Load (ETL), Database Development, Distributed Systems, Apache Hive, Python (Programming Language), Machine Learning, SQL Azure, Performance Tuning, Azure Machine Learning, Azure Data Lake, Software Construction, Data Streaming, Data Ingestion, Azure Data Factory, Apache Spark, Git, Microsoft Fabric, Data Lakes, Pyspark, Apache Kafka, Machine Learning Operations, Terraform, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** August 28, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=b19a441913ff852d ## About the Role * Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. * Experience building enterprise-scale ETL/ELT pipelines within Azure environments. * Strong Python and SQL development skills. * Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory. * Git version control and software engineering best practices. Skills we'd like: * Experience with Microsoft Fabric, Azure Synapse Analytics, Azure Event Hubs, or Kafka. * Knowledge of Azure DevOps, Terraform, Unity Catalog, MLflow, or Azure Machine Learning. Additional Requirements: * Candidates must be eligible to obtain and maintain SC and NPPV3 clearance. * Proven experience working with large-scale data processing and distributed computing technologies. * Experience working within Agile delivery teams. ## Description We are seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform. In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards., * Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake. * Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. * Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems. * Implement data quality, validation, monitoring, and governance controls across the data lifecycle. * Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)