Lead Data Engineer

As a Lead Data Engineer in Data Platform Services (DPS), you will play a critical role in shaping and operating the data platforms that enable analytics, insight, and decision making across HMRC. You will lead engineering activity across large scale data services, ensuring they are reliable, secure, and fit for future demand., You will lead the engineering and operation of an area within HMRC’s strategic data analytics platforms, ensuring high availability and performance at national scale.

Working across multiple product oriented delivery teams, you will provide technical leadership for data ingestion, transformation, and exploitation services. You will collaborate with engineers, analysts, architects, and business stakeholders to evolve platforms that support advanced analytics, reporting, and data science. You will also led these teams in capability and their technical and strategic direction

This is a hands on leadership role requiring strong technical expertise alongside the ability to lead teams of Data Engineers, influence stakeholders, and drive continuous improvement in a DevOps environment.

A requirement of this role is that candidates either have, or willing to acquire, SC clearance. Please review GOV.uk guidance , if candidates are unable to meet requirements of SC clearance, you maybe be rejected from the process.’, * Lead the operation, support, and continuous improvement of enterprise data platforms and services.

• Provide technical leadership across multiple delivery teams, supporting agile ways of working.
• Expertise and experience in a technical area responsible for delivering outcomes to challenging timescales
• Ensure appropriate security controls and data governance are embedded in platform services.
• Engage with internal users and stakeholders to improve self-service data capabilities.
• Work with suppliers and partners to design, build, and run data services at scale.
• Contribute to out-of-hours support and on-call rotas where required., During the panel interview, you will be asked a Behaviour-based question to explore in detail what you are capable of as well as Technical questions to assess your expertise in data engineering approaches and technologies, including at least one of the following:
• Distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.
• Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.
• Front end user tooling such as reporting and dashboarding, advanced analytics, machine learning and A.I.
• AWS and Azure Cloud Native products e.g. Glue, Dataflow, Databricks

Interviews will take place via video link. Sift and interview dates to be confirmed. Please note that circumstances may arise that require the planned interview format to change. We will endeavour to provide you with as much notice of any change as possible.

• Strong experience delivering and operating data platforms at scale, including data ingestion, transformation, and modelling in complex environments.
• Technical expertise in data engineering approaches and technologies, including at least one of the following:
• distributed data platforms (e.g. Hadoop), relational or NoSQL databases, and data warehousing and data lake concepts.
• Experience building and maintaining data pipelines using ETL/ELT tooling, with a focus on performance, data quality, and reliability, incorporating virtualization.
• Front end user tooling such as reporting and dashboarding, advanced analytics, machine learning and A.I.
• AWS and Azure Cloud Native products e.g. Glue, Dataflow, Databricks
• Demonstrable leadership experience, including leading engineers or technical teams and guiding delivery in an agile/DevOps environment.
• Ability to apply security, governance, and best practice engineering standards within data platforms.
• Strong stakeholder engagement skills, including supporting business users and translating technical concepts into business outcomes.

Desirable Criteria

• A cloud (AWS/Azure) delivery background.
• Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMS

Alongside your salary of £58,541, HM Revenue and Customs contributes £16,959 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).

HMRC operates both Flexible and Hybrid Working policies, allowing you to balance your work and personal commitments. We welcome applications from those who need to work a more flexible arrangement and will agree to requests where possible, considering our operational and customer service needs.

We offer a generous leave allowance, starting at 25 days and increasing by a day for every year of qualifying service up to a maximum of 30 days.

• Pension - We make contributions to our colleagues’ Alpha pension equal to at least 28.97% of their salary.
• Family friendly policies.
• Personal support.
• Coaching and development.

To find out more about HMRC benefits and find out what it’s really like to work for HMRC hear from our insiders or visit Thinking of joining the Civil Service

Discover a career in your hands at HMRC. Whether you’re seeking purpose, growth, or a workplace that gives you a true sense of belonging, hear from some of our employees as they share their story about what it’s really like to work at HMRC.

Visit our YouTube channel to watch the full series and come and discover your potential.

HMRC is delivering one of the largest and most complex digital transformations in the UK public sector. We provide services to over 45 million individuals and 4.9 million businesses, underpinned by a modern, secure, and scalable data platform.