Lead Data Engineer (Azure)
OpenSource
Charing Cross, United Kingdom
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 95KJob location
Remote
Charing Cross, United Kingdom
Tech stack
API
Airflow
Data analysis
Automation of Tests
Azure
Software as a Service
Cloud Computing
Information Engineering
Data Visualization
Python
Power BI
SQL Databases
Tableau
Cloud Platform System
Delivery Pipeline
Spark
Data Lake
Terraform
Data Pipelines
Databricks
Job description
This is a hands-on leadership role, ideal for someone who enjoys remaining close to the technology while guiding a small team and influencing platform architecture. You'll have real ownership, the chance to set standards, and the opportunity to build a modern data platform that supports both internal teams and customer-facing use cases.
- Leading, mentoring, and developing a small team of data engineers and analysts, setting technical direction and best practices
- Owning the end-to-end data lifecycle, from ingestion through to analytics delivery
- Building and operating robust data pipelines using Databricks, Spark, and Delta Lake
- Working closely with product, engineering, and other stakeholders to deliver the data roadmap
- Creating trusted datasets, dashboards, and APIs for internal and external customers
- Improving data quality, reliability, governance, and observability across the platform
- Supporting and enhancing CI/CD pipelines, automated testing, and cloud operations to ensure scalability and resilience
Requirements
- Experience leading or mentoring data engineers in a SaaS or product-led environment
- Strong hands-on experience with Databricks, including Spark and Delta Lake
- Advanced Python and SQL skills for data engineering and analytics use cases
- Solid experience working with a major cloud platform, with Azure strongly preferred
- Strong communication skills and the ability to collaborate effectively across teams
Nice to have
- Experience with data orchestration tools such as Airflow or Dagster
- Familiarity with Infrastructure as Code tools (e.g. Terraform)
- Exposure to BI and data visualisation tools such as Power BI or Tableau
Benefits & conditions
Competitive salary + 10% Bonus.