> Markdown version of [/jobs/ext/3226298-azure-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/3226298-azure-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Databricks Engineer

- **Company:** Capgemini Sogeti
- **Location:** London, UK (Remote available)
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, User Authentication, Microsoft Azure, Software as a Service, Cloud Storage, Databases, Information Engineering, Extract Transform Load (ETL), Database Development, Python (Programming Language), Performance Tuning, RStudio, Software Deployment, Business Intelligence Development Studio, Enterprise Software Applications, Autoscaling, Large Language Models, Change Data Capture, Build Management, Data Lakes, Pyspark, Enterprise Integration, Restful APIs, Serverless Computing, Key Vault, Databricks
- **Published:** September 11, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=9e7e8fa2f0aab1d9

## About the Role

* Hands-on implementation and troubleshooting of Azure Databricks
 * Databricks Serverless configuration and workload optimisation
 * Databricks SQL and Delta Lake development
 * Cluster management, compute policies, autoscaling, and workload monitoring

Data Engineering

 * Strong Python, PySpark, and SQL development skills
 * Design and build ingestion and transformation pipelines
 * Full and incremental data loading
 * CDC (Change Data Capture) implementation
 * Data quality controls, schema evolution, reconciliation, and error handling

Integration Development

 * REST API integration experience
 * Integration with databases, SaaS applications, cloud storage, and enterprise systems
 * Secure authentication and credential management

Azure Platform Services

 * Azure Identity and Access Management
 * Azure Networking and Private Endpoints
 * Azure Security and Key Vault
 * Azure Monitoring and Operational Support

FinOps & Cost Optimisation

 * Resource tagging implementation
 * Cost monitoring and reporting
 * Budget controls and usage optimisation, * Experience supporting production Azure Databricks environments
 * Monitoring, incident management, troubleshooting, and performance tuning
 * Operational governance and platform standards implementation

Discovery Zone & Migration Support

 * Experience enabling application deployment within Databricks
 * BI tooling integration and scheduling
 * Support for POSIT/RStudio migration activities

Collaboration

 * Working with Data Engineers, Data Scientists, and Platform Teams
 * Technical documentation and knowledge transfer
 * Agile delivery experience

Desirable Skills

 * POSIT/RStudio migration experience
 * AI/ML and LLM integration
 * RAG and Vector Database exposure
 * Regulated industry experience

## Description

You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements.


## Related Videos

- [Industrializing your Data Science capabilities](https://www.wearedevelopers.com/videos/178-industrializing-your-data-science-capabilities)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Best Practices for Using GitHub Secrets](https://www.wearedevelopers.com/videos/1214-best-practices-for-using-github-secrets)
- [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)