Technical Delivery Lead Python, Databricks - CER Financial
cer Financial Limited
yesterday
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 232KJob location
Tech stack
Airflow
Amazon Web Services (AWS)
Azure
Continuous Integration
Data Architecture
Information Engineering
ETL
Distributed Data Store
Python
Scrum
Software Engineering
SQL Databases
Cloud Platform System
Spark
PySpark
Kubernetes
Kafka
Software Coding
Data Pipelines
Docker
Databricks
Job description
- Lead the end-to-end delivery of data engineering projects.
- Design, develop and optimise data pipelines using Python, Databricks and PySpark.
- Build scalable ETL/ELT solutions and Lakehouse architectures.
- Manage Agile delivery, sprint planning and stakeholder communication.
- Mentor engineers and promote engineering best practices.
- Ensure data quality, governance, monitoring and CI/CD standards.
Requirements
- 10+ years' experience in Data Engineering or Software Engineering.
- Previous experience in a Technical Lead or Delivery Lead role with hands-on coding.
- Strong expertise in Python, Databricks, Spark/PySpark and SQL.
- Experience building large-scale ETL pipelines and cloud-based data platforms (AWS, Azure or GCP).
- Strong understanding of Lakehouse architecture and distributed data systems.
- Experience with Agile delivery and stakeholder management.
- Databricks certifications and experience with Kafka, Airflow, Docker, Kubernetes or CI/CD are advantageous.
About the company
cer Financial are working alongside an international bank who are looking for a Technical Delivery Lead to join their team on an initial 6-month contract . This is a hybrid role , requiring 3 days per week in the London office.
This is a hands-on leadership position, combining technical delivery with active development (approximately 30-50% coding ) using Python, Databricks and PySpark .