Data Engineer

We are looking for an experienced Azure Data Engineer to join a major data transformation programme, delivering modern cloud-based data solutions using the Microsoft Azure platform.

You’ll play a key role in designing and building scalable data pipelines, supporting enterprise reporting and analytics, and migrating Legacy data into a modern Azure Lakehouse environment., * Develop and maintain data pipelines using Azure Data Factory, Databricks and Azure Lakehouse.

• Design ETL/ELT solutions supporting Bronze, Silver and Gold layers using Medallion Architecture.
• Build and optimise data models for Power BI and enterprise reporting.
• Support migration of Legacy data into Azure cloud services.
• Ensure data quality, integrity and governance through automated validation and monitoring.
• Optimise data processing performance and troubleshoot production data pipelines.
• Collaborate with architecture and governance teams to implement security, metadata and data lineage.
• Contribute to CI/CD, Infrastructure as Code, automated testing and DevOps best practices.

• Proven experience as an Azure Data Engineer.
• Strong Azure Data Factory (ADF) and Azure Databricks experience.
• Experience building ETL/ELT pipelines within Azure Lakehouse environments.
• Knowledge of Medallion Architecture and Delta Lake.
• Strong SQL and Python skills.
• Experience with Power BI datasets and data modelling.
• Familiarity with Azure DevOps, Git, CI/CD and Infrastructure as Code.
• Understanding of data governance, security and cloud best practices.

Skills:

• Azure
• Data Engineering
• Data Engineering
• Databricks
• Data Analysis