> Markdown version of [/jobs/ext/3009687-data-engineer](https://www.wearedevelopers.com/jobs/ext/3009687-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Robert Walters plc
- **Location:** United States
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Application Programming Interfaces (APIs), Automation of Tests, Microsoft Azure, Cloud Computing, Continuous Integration, Data Architecture, Information Engineering, Data Infrastructure, Data Transformation, DevOps, Python (Programming Language), Query Optimization, Azure Data Lake, SQL Databases, Systems Integration, Unstructured Data, Management of Software Versions, Microsoft Power Automate, Azure Data Factory, Sql Optimization, Delivery Pipeline, Apache Spark, Git, Data Lakes, Pyspark, Microsoft Dynamics 365 Finance & Operations, Software Coding, Azure Synapse Analytics
- **Published:** September 20, 2026
- **Apply:** https://computerjobs.com/us/en/mob/job/961A55E92E127A047E

## About the Role

We are looking for a driven, hands-on Senior Data Engineer to take ownership of developing our Azure-based data platform. You will build end-to-end ingestion, transformation, and modelling pipelines that deliver reliable, high-quality data for analytics., * 3+ years of professional Data Engineering experience within a cloud or enterprise environment.

 * Deep Azure Expertise: Hands-on mastery of Azure Synapse, Azure Data Factory (ADF), and Azure Data Lake.
 * Strong Coding Skills: Advanced SQL, Python, and PySpark skills for complex transformations, automation, and query optimisation.
 * Modern Data Architecture: Solid understanding of Delta Lake concepts and scalable cloud data design.
 * Integration Experience: Proven history of connecting APIs, cloud platforms, and file-based systems; D365 or ERP data integration experience is a massive plus.
 * DevOps Practice: Familiarity with Git, Azure DevOps, CI/CD pipelines, and data quality testing frameworks

## Description

* Pipeline Engineering: Design, build, and optimise scalable Azure data pipelines using Azure Data Lake, Synapse Analytics, and Logic Apps.
 * Framework Development: Build metadata-driven, reusable ingestion frameworks for structured, semi-structured, and unstructured data using Azure Synapse and Python.
 * Data Transformation: Develop robust transformation pipelines using SQL and Spark within Azure Synapse, utilizing Delta Lake for incremental loading, versioning, and schema evolution.
 * D365 Finance Integration: Own the integration between the data platform and our D365 ERP system to secure consistent, daily processing of financial store sales data.
 * Engineering Standards: Embed strong data quality, validation, lineage, error handling, automated testing, and CI/CD deployment workflows.
 * Collaborative Delivery: Partner with senior engineers, finance analysts, and external providers to translate integration requirements into scalable, well-documented cloud-native solutions.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)