Senior Data Engineer

Lloyds Banking Group
London, UK
1 day ago
Apply on lbg.wd3.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
£84,051.0 - £93,390.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Cyber Security Computer Programming Information Engineering Data Infrastructure Data Warehousing Distributed Computing Environment Distributed Systems Python (Programming Language) Machine Learning Operational Databases
+13 more
Query Optimization Standard Sql Large Language Models Apache Spark Database Performance Event Driven Architecture Kubernetes Apache Kafka Data Management Video Streaming Terraform Data Pipelines Apache Beam

Job description

We’re looking for a Senior Data Engineer to join our Data Platform team and help build the foundations that power Curve’s data-driven culture. Working across both real-time and batch data platforms, you’ll design, build and operate scalable data infrastructure that collects, processes and serves data from a wide range of internal and external sources. You’ll play a key role in ensuring the reliability, performance and availability of our data warehouse and data pipelines, enabling cutting-edge analytics, machine learning, real-time decisioning and operational reporting. Collaborating closely with engineers, data scientists, machine learning researchers and business stakeholders, you’ll help shape the future of our data platform while promoting best practice in data engineering, architecture and quality.

Requirements

  • At least 5 years’ experience as a Data Engineer working with real-time and batch data in production environments
  • Strong experience with streaming technologies such as Kafka, Pub/Sub or Kinesis
  • Solid understanding of data warehousing principles including relational modelling, query optimisation and administration
  • Strong programming experience with Python, Go and/or SQL
  • Experience using dbt for data modelling and transformation
  • Experience working with Apache Airflow or similar orchestration tooling
  • Proven experience designing and building production systems on GCP and/or AWS
  • Strong understanding of event-driven architectures and distributed systems
  • Experience deploying and supporting batch and real-time machine learning workloads
  • Experience working with distributed processing technologies such as Spark or Apache Beam
  • Strong understanding of data quality principles and engineering best practices
  • Experience optimising database performance, troubleshooting issues and maintaining production data systems
  • Ability to learn new technologies quickly and apply them pragmatically in a fast-moving environment

And it would be great if you had any of the following…

  • Experience developing or supporting machine learning solutions
  • Experience with Terraform and Infrastructure as Code
  • Experience with Kubernetes and containerised environments
  • Experience working with LLMs and agentic workflows
  • Experience mentoring or supporting other engineers
  • Strong understanding of large-scale distributed architecture patterns
  • Knowledge of security and information security considerations within data engineering
  • Experience within Fintech, Financial Services, Payments or Retail Banking

Benefits & conditions

Our ambition is to be the leading UK business for diversity, equity and inclusion, supporting our customers, colleagues and communities. We are committed to creating an environment in which everyone can thrive, learn and develop. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and launch a dedicated Working with Cancer initiative.

We offer reasonable workplace adjustments for colleagues with disabilities, including flexibility in office attendance, location and working patterns. As a Disability Confident Leader, we guarantee interviews for a fair and proportionate number of applicants who meet the minimum criteria for the role and have a disability, long-term health or neurodivergent condition, through the Disability Confident Scheme.

We provide reasonable adjustments throughout the recruitment process to reduce or remove barriers - just let us know what you need.

We also offer a wide-ranging benefits package, which includes…

  • A generous pension contribution of up to 15%
  • An annual bonus award, subject to Group performance
  • Share schemes including free shares
  • Benefits you can adapt to your lifestyle, such as discounted shopping
  • 30 days’ holiday, with bank holidays on top
  • A range of wellbeing initiatives and generous parental leave policies

About the company

At Lloyds Banking Group, we’re driven by a clear purpose; to help Britain prosper. Across the Group, our colleagues are focused on making a difference to customers, businesses and communities. With us you’ll have a key role to play in shaping the financial services of the future, whilst the scale and reach of our Group means you’ll have many opportunities to learn, grow and develop.

We keep your data safe. So, we’ll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview or accepted a verbal offer to join us which is when we run our background checks. We’ll always explain what we need and why, with any request coming from a trusted Lloyds Banking Group person.

We’re focused on creating a values-led culture and are committed to building a workforce which reflects the diversity of the customers and communities we serve. Together we’re building a truly inclusive workplace where all of our colleagues have the opportunity to make a real difference.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on lbg.wd3.myworkdayjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all