> Markdown version of [/jobs/ext/2308355-data-engineer](https://www.wearedevelopers.com/jobs/ext/2308355-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Peoples Partnership - **Location:** Crawley, UK - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Microsoft Azure, Batch Processing, Databases, Data Dictionary, Data Integration, Extract Transform Load (ETL), Database Queries, Database Schema, Metadata, Meta-Data Management, Reverse Engineering, SQL Stored Procedures, Data Streaming, Systems Integration, Unstructured Data, Data Lakes, Data Lineage, Data Pipelines, Api Management, Legacy Systems, Databricks - **Published:** August 30, 2026 - **Apply:** https://www.collegerecruiter.com/job/2815444874-data-engineer ## About the Role * Strong SQL skills, with experience reverse engineering stored procedures and database objects. * Proven background in data pipelines, ETL/ELT processes, and data integration technologies. * Experience mapping complex data flows across heterogeneous systems. * Ability to interpret and document technical metadata with precision. * Experience with data catalogue or metadata management tools, such as Purview. * Familiarity with API integrations, workflow automation, or legacy systems. * Experience with Microsoft Azure (Data Factory, Databricks, Data Lake, Lakehouse) ## Description The Data Lineage Engineer will play a critical role in delivering the organisation's data lineage work. This role is responsible for the technical discovery, mapping, and documentation of data flows across systems, integrations, and databases. The engineer will reverse engineer existing technical assets, surface metadata, and create clear, maintainable technical documentation that supports governance, audit readiness, and operational improvements. * Inventory all systems and data sources, including structured, semi-structured, and unstructured data environments. * Document technical metadata, ownership, and system interfaces in collaboration with system owners and SMEs. * Map end-to-end data flows, including ETL pipelines, APIs, integrations, and batch processes. * Develop visual models of data movement from source to consumption destinations (BI tools, apps, warehouses). * Contribute technical definitions and lineage insights to the Data Dictionary. * Produce high quality, standardised documentation suitable for inclusion in governance platforms. ## Related Videos - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata](https://www.wearedevelopers.com/videos/1616-bringing-clarity-to-event-streams-enabling-analytics-and-ai-through-rich-metadata) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)