Lead Data Engineer

Anson McCade
Charing Cross, United Kingdom
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 110K

Job location

Charing Cross, United Kingdom

Tech stack

Java
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Computing
Data as a Services
ETL
Data Warehousing
Distributed Data Store
Python
Open Source Technology
Software Engineering
SQL Databases
Data Processing
Google Cloud Platform
Deployment Automation
Databricks

Job description

  • Lead the development of complex data components and subsystems, taking ownership from design through to testing and defect resolution.
  • Provide hands-on design and development using open source and commercial platforms.
  • Define and enforce development best practices, coaching team members to maintain high-quality code and consistency.
  • Collaborate with architects and stakeholders to ensure non-functional requirements such as performance, robustness, and security are met.
  • Ensure operational readiness in collaboration with Operations teams, including deployment automation and monitoring.
  • Advise clients and managers on technical implications, estimates, and solutions.
  • Contribute to technical proposals and solution design during client engagements.
  • Manage, mentor, and develop a small team of engineers, supporting performance management and career growth.

Requirements

We are seeking an experienced Lead Data Engineer with a strong consulting and public sector background to join a high-performing team delivering data-intensive solutions at scale. You will play a key role in designing, developing, and optimising data processing pipelines and software components, while providing technical leadership and coaching to engineers., * Experience leading teams of engineers in implementing data-intensive systems.

  • Proficient in Java, Scala, or Python for software development.
  • Experience with ETL/data-processing platforms (e.g., Informatica, Azure Databricks) and advanced SQL.
  • Strong understanding of distributed data stores, frameworks, and data modelling for analytical and operational use cases.
  • Ability to communicate complex technical designs clearly, both written and verbally.
  • Proven track record in consulting or public sector projects.
  • Interest in emerging technologies, including AI.

Desirable Skills:

  • Familiarity with data warehouse methodologies.
  • Cloud certifications (AWS, Azure, GCP) in data services.
  • Experience contributing to technology communities or driving continuous improvement initiatives.
  • Practical exposure to AI tools, processes, or delivery.

Who You Are: You are a collaborative, determined, and creative engineer who thrives on solving complex problems. You take pride in mentoring your team and delivering high-quality solutions that make a tangible impact for clients.

Apply for this position