Head of Data Engineering

Careerwise
London, UK
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£149,500.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Microsoft Azure Continuous Integration Data as a Services Data Architecture Data Control Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Security
+15 more
Data Systems DevOps Python (Programming Language) Machine Learning Meta-Data Management Cloud Services Standard Sql DataOps Azure Data Factory Microsoft Fabric Infrastructure Automation Frameworks Data Management Azure Synapse Analytics Data Pipelines Databricks

Job description

We are seeking an experienced Head of Data Engineering to lead the development and delivery of a modern enterprise data platform. This role will be responsible for defining and executing the data engineering strategy, ensuring scalable, secure, and reliable data solutions that support reporting, analytics, machine learning, and AI initiatives.

The successful candidate will combine strong technical leadership with hands-on knowledge of modern cloud-based data platforms, data architecture, and engineering best practices. You will work closely with senior stakeholders, architects, analysts, data scientists, and technology teams to deliver business value through high-quality data products and services.

Key Responsibilities

Data Engineering Leadership

  • Lead, mentor, and develop a high-performing team of data engineers.
  • Establish engineering standards, best practices, and ways of working.
  • Drive a culture of collaboration, accountability, innovation, and continuous improvement.
  • Support recruitment, onboarding, capability development, and succession planning.

Data Platform Strategy & Delivery

  • Define and execute the data engineering roadmap and platform strategy.
  • Oversee the design, development, testing, deployment, and support of data pipelines and integrations.
  • Ensure delivery of scalable, resilient, and secure data solutions aligned with business priorities.
  • Drive Agile delivery practices and effective backlog management.
  • Collaborate with business and technical stakeholders to translate requirements into robust technical solutions.

Platform Ownership & Operations

  • Act as the technical owner of the data platform.
  • Ensure platform availability, scalability, performance, and reliability.
  • Implement monitoring, alerting, and observability capabilities across data services.
  • Lead incident management, root cause analysis, and service improvements.
  • Drive platform optimisation initiatives focused on performance, resilience, and cost efficiency.

Data Governance & Quality

  • Embed data quality controls throughout data pipelines and engineering processes.
  • Support data governance, security, compliance, and metadata management initiatives.
  • Ensure appropriate lineage, documentation, and operational standards are maintained.
  • Partner with business stakeholders to resolve data quality issues and improve data trust.

Stakeholder Management

  • Build strong relationships with senior business and technology stakeholders.
  • Communicate progress, risks, dependencies, and delivery outcomes effectively.
  • Provide technical leadership and strategic guidance across data-related initiatives.
  • Manage relationships with external suppliers and delivery partners where required.

Engineering Excellence

  • Promote automation, reusability, and operational efficiency.
  • Champion DataOps, DevOps, CI/CD, and infrastructure automation practices.
  • Contribute to the evolution of enterprise data architecture and engineering standards.
  • Identify opportunities to improve delivery velocity, platform resilience, and operational effectiveness.

Requirements

  • Significant experience in Data Engineering, Data Platform Engineering, or Data Architecture leadership roles.
  • Proven experience leading and developing engineering teams.
  • Strong track record delivering enterprise-scale data platform and data engineering initiatives.
  • Experience operating within Agile delivery environments.
  • Excellent stakeholder management and communication skills.
  • Experience managing multiple priorities within complex organisations.

Technical Skills

  • Microsoft Azure Data Platform technologies, including:
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Microsoft Fabric
  • Databricks
  • Strong SQL and data modelling expertise.
  • Python and modern data engineering frameworks.
  • ETL/ELT development and orchestration.
  • CI/CD pipelines and DevOps practices.
  • Data monitoring, observability, and operational support.
  • Cloud-native data architecture and modern data platform design.

Desired Attributes

  • Strong leadership and people management capabilities.
  • Strategic thinker with a delivery-focused mindset.
  • Excellent problem-solving and decision-making skills.
  • Ability to influence senior stakeholders and drive change.
  • Passion for engineering excellence and continuous improvement.
  • Strong commercial awareness and business acumen.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all