Lead Data Engineer

Lead Data Engineerwrk Digital Ltd
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 62K

Job location

Tech stack

Java
Amazon Web Services (AWS)
Data analysis
Azure
Big Data
Data Architecture
Data Dictionary
Information Engineering
Data Security
Data Systems
Hadoop
Python
Google Cloud Platform
Data Storage Technologies
Snowflake
Data Lake
Dynamic Data
Data Pipelines
Legacy Systems
Programming Languages

Job description

WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you'll play a key role in shaping how data powers every decision being made. As the Lead Data Platform Engineer, you will lead the design, development, and optimisation of the organisation's enterprise data platform and its pipelines, enabling data-driven decision-making and innovation. You will act as the technical lead for a team of skilled data engineers and align the data engineering strategy with business objectives. This role is pivotal in ensuring the availability, security, and scalability of data systems to support the organisation's digital transformation. Responsibilities:

  • Oversee the design, development, and maintenance of robust, scalable, and secure data pipelines.
  • Implement best practices for data pipelines, modelling, and governance to ensure high-quality, consistent, and compliant data.
  • Lead initiatives to modernise legacy systems, migrate data to the cloud, and optimise data storage and processing costs.
  • Ensure the integrity of datasets within the data lake aligns with logical models and that data is well documented in wikis, data dictionaries, etc.
  • Participate in data engineering sprints, develop data pipelines, and peer-review code.
  • Mentor a high-performing team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement.
  • Define and execute the organisation's data engineering strategy, aligned with overall business objectives and technology roadmaps.
  • Ensure data engineering processes adhere to relevant regulatory standards (e.g. GDPR, HIPAA) and organisational security policies.

Requirements

You're a technical expert who thrives on the importance of clean, scalable data - solving problems, driving better decisions, and supporting innovation. You'll bring:

  • Significant experience in data engineering, including leading or mentoring technical teams.
  • Deep understanding of cloud environments such as Azure, AWS, or Google Cloud Platform, and tools like Synapse, Hadoop, or Snowflake.
  • Hands-on experience with programming languages such as Python, Java, or Scala.
  • Strong knowledge of data architecture, modelling, and governance.
  • A track record of delivering complex data projects - from cloud migrations to big data solutions.

About the company

An organisation with a proud history and a bold future - connecting communities, driving innovation, and enabling sustainable growth. As the company continues it's digital transformation journey, this is an exciting opportunity to shape the future of how data is used across the business. Join now and play your part in building smarter, data-driven solutions that make a real difference.

Apply for this position