Lead Data Engineer

CRU
London, UK
6 days ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
£57,038.0
Working hours
Regular working hours

Tech stack

Clean Code Principles Airflow Microsoft Azure Cloud Engineering Information Engineering Data Infrastructure Data Warehousing Github Monitoring of Systems Data Processing Snowflake Kubernetes
+5 more
Information Technology Free and Open-Source Software Data Management Terraform Data Pipelines

Job description

We are looking for a Lead Data Engineer to take ownership of a business domain within our modern Snowflake, Airflow, and dbt data platform. This role will combine hands-on technical leadership with team coordination, helping ensure stable platform operations, strong data quality, and efficient delivery of the product roadmap. You will play a key part in shaping how data products are designed, built, and improved, supporting the delivery of reliable analytics for the commodity industry.

ResponsibilitiesKey Responsibilities:

  • Lead a small team of data engineers responsible for a specific business domain within the data platform.
  • Own the design, development, and ongoing maintenance of scalable data pipelines that support new and existing data products.
  • Work closely with internal stakeholders to understand data requirements, translate needs into technical solutions, and communicate delivery plans clearly.
  • Ensure data quality, consistency, and reliability through the use of modern testing, validation, and monitoring tools.
  • Design and implement new pipelines using best-in-class tools such as Airflow, dbt, and Snowflake.
  • Contribute to the development of scalable cloud infrastructure on Azure, including infrastructure as code using Terraform.
  • Promote engineering best practices, including clean code, maintainability, testing, and strong documentation.
  • Support continuous improvement across the team by identifying opportunities to improve delivery, reliability, and operational efficiency.
  • Stay current with emerging data engineering tools, techniques, and approaches, bringing fresh ideas and a continuous improvement mindset.
  • Encourage a collaborative, delivery-focused team culture that values quality, innovation, and accountability.

Requirements

  • Degree-level education in a technology-focused subject such as Computer Science, Information Technology, or equivalent experience through professional qualifications and industry background.
  • Strong academic or professional track record in a relevant technical discipline.

Skills & Experience:

  • 10+ years of experience in data-related roles, with the majority in data engineering.
  • Strong hands-on experience with Snowflake, ideally 3+ years.
  • Strong hands-on experience with dbt, ideally 3+ years.
  • Experience leading small data engineering teams, ideally 2-3 engineers.
  • Experience designing, building, and maintaining data processing systems at scale.
  • Experience with Azure cloud services, Airflow, dbt, Kubernetes, GitHub, and Terraform.
  • Experience working in fast-moving, high-growth, or startup-like environments is preferred.
  • Strong communication skills with the ability to explain data warehouse plans and technical decisions to internal clients and stakeholders.
  • A curious, delivery-focused mindset with a strong commitment to quality, innovation, and continuous improvement.
  • Hands-on problem-solving ability and a practical approach to getting things working reliably.
  • Contributions to open-source software or an active GitHub profile would be an advantage.

Benefits & conditions

  • Competitive salary and flexible benefits package.
  • Opportunities for professional growth and development as part of a global company.
  • A collaborative and supportive work environment.
  • The chance to work with industry-leading experts and over a diverse range of topics and projects.

About the company

CRU International is a leading provider of business intelligence and consulting services in the metals, mining, and fertilizer industries. With over 50 years of experience, we offer valuable insights and analysis that help our clients make informed decisions in an ever-changing global market.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:32 min

Overview of Terraform and Terraform Cloud features

Devlin Duldulao · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all