Senior Data Engineer

• Identify opportunities to reuse and optimise data flows, including building streaming systems, managing databases, and improving code performance.
• Lead the development and maintenance of data engineering solutions, advising teams as a subject matter expert and ensuring alignment with HMLR standards and approved technologies.
• Collaborate with senior colleagues to understand where data engineering adds value, supporting strategic and operational decision-making.
• Support and guide junior team members, contribute to the data engineering community, and advocate for data quality, maintainability, and reusable components.
• Continuously improve data systems and maintain awareness of best practice and emerging approaches.

Technologies:

• Cloud
• DevOps
• Fabric
• IBM
• IBM Db2
• Support
• Python
• PySpark
• Scala
• Spark
• Talend
• Terraform
• ETL

• Experience with large-scale analytics engines (e.g., Spark/PySpark) and scripting languages such as Python or Scala.
• Hands-on use of cloud data stacks (e.g., SageMaker Notebooks, S3, Glue, Athena) and modern storage formats or frameworks (e.g., Parquet, Delta Lake, Fabric).
• Experience with DevOps/DataOps tooling and practices (e.g., Terraform) and testing data pipelines, including end-to-end, data quality, monitoring, unit and contract testing.
• Experience managing the full data lifecycle, including development, analysis, modelling, integration and metadata management.
• Ability to communicate clearly with technical and non-technical stakeholders, leading discussions in multidisciplinary teams and managing differing viewpoints.
• Experience profiling data, analysing source systems, and creating data models that suit different organisational needs.
• Experience in leadership is desirable.
• Familiarity with IBM DB2/QREP BMC Control-M and Talend Data Integration is considered a plus.

We are HM Land Registry (HMLR), undertaking one of the largest transformation programmes in government to modernise the digital systems supporting over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity, and value across our organisation. We offer a salary up to £60,800, a 29% employer pension contribution, and full Civil Service benefits, along with flexible, hybrid working options from Plymouth, Croydon, or Coventry. Join us to play a crucial role in developing the data capabilities that support property ownership and public services across England and Wales.