Databricks Data Engineer

We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks on Azure.
• Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse).
• Work with large datasets to enable advanced analytics and reporting.
• Collaborate with stakeholders to deliver high-quality data solutions aligned with project objectives.
• Ensure compliance with public sector security and governance standards.

• Proven experience in Data Engineering within complex environments.
• Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.).
• Solid understanding of cloud-based data platforms and ETL processes.
• Active SC Clearance (must be in place before starting).
• Ability to work onsite in Newcastle 2-3 days per week.

Nice to Have

• Experience in Public Sector projects.
• Knowledge of data governance and security frameworks., * Python
• SQL
• Azure
• SC
• Security Cleared
• PySpark
• Databricks