> Markdown version of [/jobs/ext/3032335-data-engineer-sc-cleared](https://www.wearedevelopers.com/jobs/ext/3032335-data-engineer-sc-cleared). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - SC Cleared

- **Company:** Shareforce Ltd
- **Location:** North East, UK
- **Salary:** £130,000.0 - £143,000.0
- **Contract:** Temporary contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Code Reuse, Continuous Integration, Data Architecture, Information Engineering, Data Systems, Data Warehousing, Python (Programming Language), Machine Learning, SQL Databases, Data Processing, Azure Data Factory, SC Clearance, Microsoft Fabric, Data Lakes, Data Management, Software Coding, Stream Processing, Azure Synapse Analytics, Databricks
- **Published:** September 23, 2026
- **Apply:** https://www.shareforce.co.uk/jobs/apply/ats-redirect/?id=1382-1

## About the Role

* Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
 * Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
 * Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
 * Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.
 * Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
 * Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
 * Good knowledge on how to leverage AI to increase deployment productivity and quality.
 * Excellent communication skills.
 * Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus.

## Description

This is an exciting contract opportunity for an SC Cleared Data Engineer to join an experienced team delivering a crtitical public sector engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem., * Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.

 * Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
 * Drive best practices for data engineering.
 * Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
 * Mentor junior engineers and support their personal development.
 * Take ownership for the delivery of core solution components.
 * Support with planning, requirements refinements, and work estimation.


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Introduction to sCrypt - a smart contract language for Bitcoin SV](https://www.wearedevelopers.com/videos/24-introduction-to-scrypt-a-smart-contract-language-for-bitcoin-sv)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)