Lead Data Engineer (Azure)

OpenSource
Charing Cross, United Kingdom
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 95K

Job location

Remote
Charing Cross, United Kingdom

Tech stack

API
Airflow
Data analysis
Automation of Tests
Azure
Software as a Service
Cloud Computing
Information Engineering
Data Visualization
Python
Power BI
SQL Databases
Tableau
Cloud Platform System
Delivery Pipeline
Spark
Data Lake
Terraform
Data Pipelines
Databricks

Job description

This is a hands-on leadership role, ideal for someone who enjoys remaining close to the technology while guiding a small team and influencing platform architecture. You'll have real ownership, the chance to set standards, and the opportunity to build a modern data platform that supports both internal teams and customer-facing use cases.

  • Leading, mentoring, and developing a small team of data engineers and analysts, setting technical direction and best practices
  • Owning the end-to-end data lifecycle, from ingestion through to analytics delivery
  • Building and operating robust data pipelines using Databricks, Spark, and Delta Lake
  • Working closely with product, engineering, and other stakeholders to deliver the data roadmap
  • Creating trusted datasets, dashboards, and APIs for internal and external customers
  • Improving data quality, reliability, governance, and observability across the platform
  • Supporting and enhancing CI/CD pipelines, automated testing, and cloud operations to ensure scalability and resilience

Requirements

  • Experience leading or mentoring data engineers in a SaaS or product-led environment
  • Strong hands-on experience with Databricks, including Spark and Delta Lake
  • Advanced Python and SQL skills for data engineering and analytics use cases
  • Solid experience working with a major cloud platform, with Azure strongly preferred
  • Strong communication skills and the ability to collaborate effectively across teams

Nice to have

  • Experience with data orchestration tools such as Airflow or Dagster
  • Familiarity with Infrastructure as Code tools (e.g. Terraform)
  • Exposure to BI and data visualisation tools such as Power BI or Tableau

Benefits & conditions

Competitive salary + 10% Bonus.

Apply for this position