Senior Azure Data Engineer

Role and Responsibilities for the Azure Data Engineer, Azure, ADLS, ADF, MS Fabric, CI/CD

• Supporting analysis and design activities for project delivery and ongoing data platform improvements.
• Actively contributing to key business programmes, advising on and supporting the continued adoption of data platform foundations.
• Coordinating changes across business change, technology change management, incident management, and problem management processes.
• Communicating effectively with project managers and technical and business change teams to build strong working relationships and trust.
• Ensuring end-to-end traceability of requirements from data through design, build, testing, and scope changes.

Experience and skills required for the Azure Data Engineer, Azure, ADLS, ADF, MS Fabric, CI/CD

• Proven record working with Azure relational and NoSQL databases, data warehouses, query authoring (SQL) as well as working familiarity with a variety of databases.
• Highly experienced in working with data engineering technologies including ADLS, ADF, Microsoft Fabric, Azure SQL, PowerBI and can create E2E data processing pipelines.
• Highly experiences creating or enhancing CI/CD build and release pipelines using Azure DevOps and GIT.
• Experienced in building and optimizing data queries, manipulating, transforming, preparing and processing datasets.
• Experienced in working with Infrastructure as Code and scripting languages such as YAML, PowerShell, Terraform etc.
• Experienced in working with test tools and testing processes as they relate to a data platform.
• Good working knowledge of scripting languages such as Python/PySpark.
• A good understanding of data foundation concepts, such as data modelling, data quality management and data governance.

A leading financial services company is hiring an Azure Data Engineer who has extensive Azure, ADLS, ADF, MS Fabric, CI/CD. Hybrid position based in London. Paying up to £100,000 per annum.