Data Engineer (contract)

This role is for a hands-on Data Engineer focused on building and improving data pipelines using SQL, Python, Spark, and Azure tools like Databricks and ADF. The individual will work under senior guidance to deliver reliable, high-quality ETL/ELT pipelines and support ongoing modernization efforts. They will also handle pipeline optimisation, data quality checks, and production issue troubleshooting. The role involves contributing to workflow improvements, implementing governance changes like Unity Catalog, and maintaining clear technical documentation. Overall, it requires strong coding skills, problem-solving ability, and experience working in agile, production environments., * Build and maintain data pipelines (ETL/ELT) using SQL, Python, Spark

• Work on Databricks and Azure Data Factory (ADF) pipelines
• Support Unity Catalog migration tasks
• Improve existing pipelines (performance, reliability, efficiency)
• Add data quality checks and monitoring alerts
• Troubleshoot pipeline failures and production issues
• Follow existing workflow/orchestration standards
• Write documentation, runbooks, and operational notes

Do you have experience in Unity?, * Strong SQL + Python hands-on experience

• Working experience with Apache Spark
• Experience in Azure Databricks + Azure Data Factory (ADF)
• Experience building and maintaining data pipelines
• Experience with Git (code reviews, PRs, collaboration)
• Ability to debug pipeline failures and data issues
• Experience working in Agile delivery teams

Desired Qualifications:

• Exposure to Unity Catalog / data governance frameworks
• Experience with Azure DevOps
• Exposure to event-driven / telemetry data systems

• Duration: 12 months
• Shift Timings: Hybrid (Hours minimum 10-4pm; 3 days / week onsite)
• Pay Range: £180/day to £195/day (PAYE)
• Weekly Schedule: 40 hours

As a workplace, Allegis Global Solutions focuses on relationships - with each other, our clients and our candidates. In fact, serving others is one of our core values. We support open communication and recognize that giving constructive criticism can be even harder than receiving it. We appreciate the fearless and the passionate, who force us to be better. Everything we do sits on a pillar of diversity, equity and inclusion - diverse perspectives, backgrounds and ideas achieve innovation and make us successful.

Please note that we may use artificial intelligence (AI) tools to screen, assess, or select applicants for this position. These tools may analyze application materials and assist our team in identifying candidates whose qualifications best match the requirements of the role. If you have questions about our use of AI in the hiring process, or would like more information, please contact us.

Pay Rate Range

180 - 195 GBP daily

Microsoft is a global technology company headquartered in Redmond, Washington. Our mission is to empower every person and every organization on the planet to achieve more. We develop, license, and support a wide range of software products, services, and devices that help individuals and businesses realize their full potential.

Our flagship products include the Microsoft 365 productivity cloud, Windows operating system, Azure cloud platform, and Dynamics 365 business applications. We are also a leader in areas such as artificial intelligence, cybersecurity, developer tools, and gaming through Xbox and Game Pass.

With operations in more than 190 countries and over 220,000 employees worldwide, Microsoft is committed to responsible innovation, inclusive economic growth, and sustainability. We work closely with governments, industries, and communities to ensure that technology serves the public good and helps address some of the world’s most pressing challenges.

As we celebrate our 50th anniversary in 2025, we continue to look forward—investing in AI, cloud, and quantum computing to shape the future of work, education, and society at large scale.