Lead Data Engineer

The Source
London, UK
1 day ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Microsoft Azure BigQuery Code Review Computer Programming Continuous Integration Information Engineering Data Governance Data Warehousing Python (Programming Language) SQL Databases
+11 more
Data Streaming Snowflake Cloudformation Containerization Kubernetes Information Technology Apache Kafka Terraform Docker Amazon Redshift Databricks

Requirements

practices.Collaborate with analytics, software and platform teams to deliver reusable data products and APIs.Mentor engineers, conduct code reviews, and contribute to hiring and capability development.Required Skills & Experience Significant experience in data engineering, including leading teams or major technical SQL and strong programming skills in Python and/or Scala.Cloud data engineering experience (AWS, Azure or GCP), including object storage, compute and managed data services.Strong experience with modern data warehousing/lakehouse tools (e.g., Snowflake, BigQuery, Redshift, Databricks).Hands-on orchestration experience (e.g., Airflow, Dagster, Prefect) and CI/CD for data pipelines.Experience with streaming and event-driven data (e.g., Kafka, Kinesis, Pub/Sub) is highly desirable.Proficiency with infrastructure as code (e.g., Terraform, CloudFormation) and containerisation (Docker; Kubernetes beneficial).Strong understanding of data quality frameworks, testing (unit/integration), and observability.Excellent stakeholder management and communication skills, able to translate requirements into technical solutions.Qualifications Bachelor’s degree in Computer Science, Engineering, Mathematics or a related discipline (or equivalent experience).Relevant cloud or data certifications are advantageous.What You’ll Bring A pragmatic, delivery-focused mindset with a commitment to high standards.Ability to lead by example, coach others and build effective engineering practices.Curiosity, accountability and a continuous improvement approach.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…