Data Engineer

• Pipeline Engineering: Design, build, and optimise scalable Azure data pipelines using Azure Data Lake, Synapse Analytics, and Logic Apps.
• Framework Development: Build metadata-driven, reusable ingestion frameworks for structured, semi-structured, and unstructured data using Azure Synapse and Python.
• Data Transformation: Develop robust transformation pipelines using SQL and Spark within Azure Synapse, utilizing Delta Lake for incremental loading, versioning, and schema evolution.
• D365 Finance Integration: Own the integration between the data platform and our D365 ERP system to secure consistent, daily processing of financial store sales data.
• Engineering Standards: Embed strong data quality, validation, lineage, error handling, automated testing, and CI/CD deployment workflows.
• Collaborative Delivery: Partner with senior engineers, finance analysts, and external providers to translate integration requirements into scalable, well-documented cloud-native solutions.

We are looking for a driven, hands-on Senior Data Engineer to take ownership of developing our Azure-based data platform. You will build end-to-end ingestion, transformation, and modelling pipelines that deliver reliable, high-quality data for analytics., * 3+ years of professional Data Engineering experience within a cloud or enterprise environment.

• Deep Azure Expertise: Hands-on mastery of Azure Synapse, Azure Data Factory (ADF), and Azure Data Lake.
• Strong Coding Skills: Advanced SQL, Python, and PySpark skills for complex transformations, automation, and query optimisation.
• Modern Data Architecture: Solid understanding of Delta Lake concepts and scalable cloud data design.
• Integration Experience: Proven history of connecting APIs, cloud platforms, and file-based systems; D365 or ERP data integration experience is a massive plus.
• DevOps Practice: Familiarity with Git, Azure DevOps, CI/CD pipelines, and data quality testing frameworks

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates “, “industry”: “IT”, “baseSalary”: {“@type”: “MonetaryAmount”, “currency”: “GBP”, “value”: {“@type”: “QuantitativeValue”, “maxValue”: “550”, “minValue”: “500”, “unitText”: “DAY”, “value”: “\u00a3500 - \u00a3550 per day + Outside IR35 - REMOTE”}}, “identifier”: {“@type”: “PropertyValue”, “name”: “[[BRANDNAME]]”, “value”: “[[IDENTIFIER]]”}, “datePosted”: “2026-09-18T15:01+00:00”, “validThrough”: “2026-10-02T15:01+00:00”, “hiringOrganization”: {“@type”: “Organization”, “name”: “Robert Walters”, “logo”: “https://cjassets-fabkerfbaaayfhdm.z02.azurefd.net/images/jobbranding/8c1168f1911cf0ae/images/8c1168f1911cf0ae_detail.png”}, “jobLocation”: {“@type”: “Place”, “address”: {“@type”: “PostalAddress”, “addressRegion”: “England”, “addressLocality”: null, “addressCountry”: “United Kingdom”}, “geo”: {“@type”: “GeoCoordinates”, “latitude”: “0.000”, “longitude”: “0.000”}}, “url”