> Markdown version of [/jobs/ext/3861639-azure-databricks-developer-sc-nppv3](https://www.wearedevelopers.com/jobs/ext/3861639-azure-databricks-developer-sc-nppv3). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Developer (SC / NPPv3)

- **Company:** Hays plc
- **Location:** London, UK
- **Contract:** Temporary contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Big Data, Software as a Service, Data Architecture, Data Validation, Information Engineering, Data Integration, Extract Transform Load (ETL), Database Development, Apache Hive, Python (Programming Language), Machine Learning, Meta-Data Management, SQL Azure, Azure Data Lake, Data Streaming, Data Ingestion, Azure Data Factory, Apache Spark, Git, Microsoft Fabric, Data Lakes, Pyspark, Data Pipelines, Databricks
- **Published:** October 22, 2026
- **Apply:** https://www.reed.co.uk/jobs/azure-databricks-developer-sc-nppv3/57479211

## About the Role

Candidates should demonstrate experience in:
Developing enterprise-scale data pipelines.

Working with large data volumes and distributed processing technologies.

Building ETL/ELT solutions within Azure environments.Implementing data quality and monitoring controls.

Working within Agile delivery teams., Analytical problem solvingPerformance optimisationData architecture awarenessSoftware engineering practicesTesting and quality assurance

## Description

The Azure Databricks Developer is responsible for designing, developing, testing and supporting scalable data engineering solutions using Azure Databricks and the wider Azure data platform. The role focuses on building robust data ingestion, transformation and processing pipelines that enable advanced analytics, AI, machine learning and business intelligence solutions.

Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, the Azure Databricks Developer helps deliver trusted, high-quality data products while ensuring adherence to security, governance and operational standards., Data Engineering & Development
Design and develop data pipelines using Azure Databricks.

Build scalable ETL/ELT solutions using PySpark, Spark SQL and Delta Lake.

Develop ingestion frameworks for batch and streaming data.

Develop outbound pipelines that interface with APIs

Optimise large-scale data processing workloads for performance and cost efficiency.

Data Integration
Integrate data from:Azure SQL DatabaseAzure Data Lake Storage Gen2

Microsoft Fabric

APIs and third-party SaaS platforms

On-premise systems

Event streaming platforms

Implement automated data validation and reconciliation processes.

Data Modelling
Implement bronze, silver and gold data architectures.

Optimise storage structures using Delta Lake best practices.

Platform Engineering
Configure and maintain Databricks workspaces, clusters and compute resources.

Implement CI/CD pipelines for Databricks code deployments.Support environment promotion across development, test and production environments.Monitor and troubleshoot platform performance issues.Data Quality & Governance
Implement data quality controls.Support metadata management and lineage requirements.

Ensure compliance with security, privacy and governance standards.Contribute to data catalogue and documentation activities.Collaboration
Work with business stakeholders to understand data requirements.Support Data Architects in implementing target-state architectures.

Technical Skills

Essential
Azure Databricks

Apache Spark

PySpark

Spark SQL

Delta Lake

Azure Data Lake Storage Gen2

Azure Data Factory or Microsoft Fabric Data Factory

Git version control

SQL development

Python programming

Desirable
Microsoft FabricAzure Synapse AnalyticsAzure Event HubsKafkaPower BIDatabricks WorkflowsAzure DevOpsTerraformUnity CatalogMLflowAzure Machine Learning