> Markdown version of [/jobs/ext/2801197-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2801197-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Stark Group - **Location:** Huddersfield, UK (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Business Analytics Applications, Data Analysis, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Mart, Data Structures, Data Warehousing, DevOps, Knowledge Management, Power BI, DataOps, Azure Data Lake, SQL Databases, Systems Integration, Business Intelligence Development Studio, Informatica Powercenter, Technical Debt, Data Layers, Operational Systems, Data Management, Tools for Reporting, Data Lakehouse, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** September 9, 2026 - **Apply:** https://www.collegerecruiter.com/job/2858099253-lead-data-engineer ## About the Role * Significant experience in Data Engineering, Data Platform or Data Warehouse roles. * Experience leading and developing Data Engineering teams. * Demonstrable experience leading teams through technology or organisational change. * Hands-on expert experience with Databricks and modern cloud-based data platforms. * SQL and data modelling skills. * Experience designing and building scalable data pipelines and data products. * Experience delivering or supporting data platform modernisation and migration programmes. * Experience working alongside consultancies, System Integrators or third-party delivery partners. * Proven understanding of data warehousing, Lakehouse architectures and modern engineering practices. * Excellent stakeholder management and communication skills. * Ability to balance strategic delivery responsibilities with hands-on technical leadership. * We are not able to offer sponsorship therefore you must have the right to work permanently in the UK * Experience with Azure Data Lake, Azure Synapse and Informatica. * Experience migrating from legacy ETL and reporting platforms. * Experience developing semantic layers, business data marts and analytics-ready datasets. * Knowledge of Power BI semantic models and analytics engineering concepts. * Experience implementing DataOps, CI/CD and automated testing frameworks. * Experience working within retail, distribution, manufacturing or supply chain environments. * Familiarity with ERP data structures and commercial domains including sales, pricing, margin, inventory and customer analytics. ## Description Reporting to the Head of Data Engineering, you will play a pivotal role in delivering our transition from Informatica and Azure Synapse-based solutions to a modern Databricks-centric platform. You will lead a team of Data Engineers while working closely with Data Analysts, business stakeholders and System Integration partners to build scalable, trusted and reusable data products. This role combines technical leadership, people leadership and delivery management. You will inherit an established team with deep business knowledge and support their development into a modern Data Engineering capability, helping them adopt new technologies, practices and responsibilities. As part of our transformation, Data Engineering is evolving from a traditional focus on ingestion and transformation into ownership of the full data product lifecycle. This includes Bronze, Silver, Gold and Platinum data assets, semantic models, business-facing datasets and the engineering foundations that enable trusted analytics across STARK UK. This is an opportunity to make a lasting impact on a growing function while helping shape how data is engineered, governed and consumed across the business., Data Engineering Leadership & Transformation Delivery * Deliver the Data Engineering roadmap in partnership with the Head of Data Engineering. * Lead the engineering team through the transition from Informatica and Synapse-based solutions to Databricks. * Establish and embed modern engineering practices that improve quality, scalability, maintainability and operational resilience. * Support the adoption of DataOps practices, automation, testing, monitoring and deployment standards. * Work closely with System Integrators and third-party partners, ensuring effective delivery while developing internal capability and reducing long-term dependency on external resources. * Drive continuous improvement across engineering processes, tooling, governance and ways of working. * Support the successful delivery of change across people, technology and process. Data Platform and Data Product Delivery * Lead the design, development and maintenance of scalable data pipelines and data products. * Oversee ingestion, transformation and curation of data from multiple operational systems and external sources. * Ensure data products are reliable, performant and fit for business consumption. * Support the evolution of the Data Lakehouse architecture across Bronze, Silver, Gold and Platinum layers. * Improve data quality, lineage, documentation and discoverability across the platform. * Partner with the Insight and Analytics team to ensure data products effectively support reporting, self-service analytics and future AI initiatives. * Contribute to the development and improvement of semantic models, business data marts and reusable datasets. * Support the migration from legacy BI tooling through the creation of trusted data structures and business-ready data products. Team Leadership and Capability Development * Lead, coach and develop a team of Data Engineers through a period of significant technology and organisational change. * Build a culture of ownership, accountability, continuous improvement and knowledge sharing. * Develop capability plans that align individual growth with the future requirements of the platform. * Support engineers in developing expertise in Databricks, modern cloud data engineering and contemporary engineering practices. * Establish clear standards, responsibilities and performance expectations across the team. * Manage performance, development and career progression of team members. * Support recruitment, onboarding and team expansion where required. Collaboration and Stakeholder Engagement * Develop strong relationships across technology and business functions. * Translate technical concepts into clear business outcomes for non-technical stakeholders. * Facilitate effective collaboration between engineering, analytics, architecture and operational teams. * Contribute to planning and prioritisation activities across the data function. Operational Excellence * Ensure the ongoing reliability, stability and supportability of data platform services. * Drive improvements in monitoring, alerting and operational processes. * Reduce key-person dependencies through effective documentation and knowledge management. * Identify and address technical debt within existing solutions. * Ensure engineering activities comply with security, governance and data management standards. * Balance transformation initiatives alongside ongoing operational and delivery commitments. What Success Looks Like * A highly engaged and capable Data Engineering team with clear ownership, accountability and development plans. * Successful adoption of Databricks and modern cloud-based engineering practices within the team. * Strong collaboration with System Integrators, resulting in effective knowledge transfer and growing internal capability. * Delivery of reliable, scalable and well-documented data pipelines and data products. * Expansion of Engineering ownership from ingestion-focused delivery to end-to-end business-ready data products. * Improved quality, consistency and trust in datasets used for reporting and analytics. * Significant improvements in documentation, governance and platform supportability. * Reduced operational risk through automation and the removal of manual processes. * A strong foundation for scalable data marts, semantic models, self-service analytics and future AI initiatives. * Positive relationships across Engineering, Analytics and business teams, with Data Engineering recognised as a trusted delivery partner. ## Related Videos - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)