Data Engineer

We are seeking an experienced SC Cleared Data Engineer to join a critical data transformation programme. The successful candidate will be responsible for designing, building, and maintaining robust data integration solutions across both on-premises and cloud environments. Working closely with business, analytics, and technology teams, you will enable reliable data movement, modernise existing data processes, and support the organisation’s data and AI ambitions.

This role requires strong expertise in SQL Server technologies, ETL development, Azure data services, and data warehouse solutions, with a focus on delivering scalable and automated data pipelines. Key Responsibilities

• Understand existing business application databases and current BI/Data Warehouse environments.
• Design, build, and maintain data pipelines and ETL processes to support operational and analytical workloads.
• Implement and manage data flows between operational systems, data warehouses, analytics platforms, and BI solutions.
• Re-engineer and automate manual data processes to improve efficiency, scalability, and reliability.
• Develop and integrate data products and services into business systems and enterprise processes.
• Support the migration and integration of data from on-premises environments into Azure-based platforms.
• Ensure data quality, integrity, governance, and consistency across multiple systems.
• Enable data alignment and optimisation to support current and future AI initiatives.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Contribute to CI/CD processes and DevOps practices for data engineering deployments.

Technical Responsibilities On-Premises Data Engineering

• Develop solutions to ingest and manage data within SQL Server 2022 environments.
• Build and maintain ETL processes using:
• SQL
• T-SQL
• SSIS (SQL Server Integration Services)
• Manage and support SQL Server environments used as:
• A landing and staging area for enterprise data.
• The underlying platform for existing Qlik and SSRS reporting solutions.

Cloud Data Engineering

• Design and implement data movement from on-premises SQL Server environments into Azure.
• Develop and maintain Azure-based data pipelines using:
• Azure Data Factory (ADF)
• Azure SQL Database
• Python Notebooks
• Azure Databricks
• Support modern cloud-based data architecture and analytics initiatives.

• Active SC Clearance (mandatory).
• Strong Experience with SQL Server 2022.
• Advanced SQL and T-SQL development skills.
• Hands-on ETL development Experience using SSIS.
• Experience with data modelling and schema design.
• Proven expertise in data integration and data migration projects.
• Experience working with Azure Data Factory (ADF).
• Experience with Azure Databricks and cloud-based data processing.
• Knowledge of Azure SQL Database.
• Familiarity with Qlik and SSRS reporting environments.
• Experience using Azure DevOps, CI/CD pipelines, and Git source control.
• Strong troubleshooting, optimisation, and performance tuning skills.

Desirable Skills

• Experience with TOAD Data Modeler.
• Python scripting and notebook development.
• Experience working within secure government, defence, or regulated environments.
• Exposure to data governance, master data management, and AI-enabled data platforms.
• Knowledge of modern data architecture and cloud migration best practices.

Technology Stack

• Azure DevOps
• Git
• TOAD Data Modeler
• SQL Server 2022
• T-SQL
• SSIS
• Qlik
• SSRS
• Azure SQL Database
• Azure Data Factory (ADF)
• Azure Databricks
• Python Notebooks

Fully Remote, and SC clearance is a MUST

We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the “Contacting Us” section of our Online Privacy Notice at https://www.allegisgroup.com/en-gb/privacy-notices for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. If you are resident in the UK, EEA or Switzerland, we will process any access request you make in accordance with our commitments under