Databricks Engineer

We are seeking an experienced Senior Databricks Engineer to join a high-profile client project. This is an excellent opportunity for a skilled data engineering professional with strong expertise in Azure technologies and Microsoft Fabric to design and deliver modern cloud-based data platforms.

Working as part of an experienced delivery team, you will build scalable, high-performance data solutions that support business intelligence, analytics, and enterprise reporting., * Design, develop, and maintain enterprise-scale data pipelines using Azure Databricks.

• Build robust ETL/ELT solutions using Azure Data Factory and Microsoft Fabric.

• Develop high-performance data processing solutions using Python, PySpark, and SQL.

• Implement Delta Lake and Lakehouse architectures following industry best practices.

• Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale datasets.

• Optimise Spark workloads for performance, scalability, and cost efficiency.

• Design and implement data models to support reporting and analytics.

• Integrate datasets with Power BI for business reporting and visualisation.

• Implement CI/CD pipelines using Azure DevOps and Git.

• Collaborate with architects, business analysts, and stakeholders to deliver technical solutions.

• Troubleshoot production issues and continuously improve platform performance.

Why Join Us?

• Outside IR35 contract

• Opportunity to work on enterprise-scale Azure data projects

• Flexible remote/hybrid working

• Latest Microsoft Azure and Fabric technologies

• Collaborative and supportive delivery team