Principal Data Engineer

Lloyds Banking Group
Bristol, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 109K

Job location

Bristol, United Kingdom

Tech stack

Java
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Cloud Storage
Computer Programming
Continuous Integration
Information Engineering
Data Integrity
Data Structures
Data Systems
Data Warehousing
Software Design Patterns
Distributed Systems
Hadoop
Python
Operational Data Store
Scala
Software Engineering
SQL Databases
Data Streaming
Scripting (Bash/Python/Go/Ruby)
Spark
Data Lake
Kubernetes
Apache Flink
Kafka
Data Management
Data Pipelines
Docker

Job description

Join our Personalised Experiences and Communications Platform as a Principal Data Engineer. You'll work within multi-functional product engineering teams to deliver top-quality data capabilities, demonstrating your engineering expertise and cloud opportunities

What you'll be doing:

  • Architect and implement scalable, resilient, low-latency data systems.

  • Ensure systems meet performance and reliability standards.

  • Collaborate with engineering leadership and stakeholders.

  • Set technical strategy and best practices for data engineering.

  • Deliver solutions for multiple entities within the group.

  • Ensure alignment with business needs and cloud opportunities.

  • Promote secure, high-quality data pipelines.

  • Implement standards for data integrity and compliance.

  • Identify and eliminate recurring issues through automation.

  • Improve operational efficiency and reduce manual intervention.

  • Provide guidance and technical leadership.

Requirements

  • Extensive industry experience in designing, building and supporting distributed systems and large-scale data processing systems in production with a proven track record

  • Proven experience and knowledge of automation and CI/CD.

  • Best practice coding/scripting experience developed in a commercial/industry setting (Python, SQL, Java, Scala or Go).

  • Strong working experience with operational data stores, data warehouse, big data technologies and data lakes

  • Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)

  • Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS.

  • Strong experience working with (Real Time streaming), such as Kafka technologies

  • Clear understanding of data structures, algorithms, software design, design patterns and core programming concepts.

  • Good understating of cloud storage, networking, and resource provisioning

And any experience of these would be really useful:

  • Certification in GCP "Cloud Architect", "Cloud Developer", "Professional Data Engineer"

  • Certification in Apache Kafka (CCDAK)

Benefits & conditions

We're on an exciting journey and there couldn't be a better time to join us. The investments we're making in our people, data, and technology are leading to innovative projects, fresh possibilities, and countless new ways for our people to work, learn, and thrive.

About working for us:

Our focus is to ensure we're inclusive every day, building an organisation that reflects modern society and celebrates diversity in all its forms. We want our people to feel that they belong and can be their best, regardless of background, identity or culture. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and a dedicated Working with Cancer initiative. And it's why we especially welcome applications from under-represented groups. We're disability confident. So if you'd like reasonable adjustments to be made to our recruitment processes, just let us know

We also offer a wide-ranging benefits package, which includes:

  • A generous pension contribution of up to 15%

  • An annual performance-related bonus

  • Share schemes including free shares

  • Benefits you can adapt to your lifestyle, such as discounted shopping

  • 30 days' holiday, with bank holidays on top

  • A range of wellbeing initiatives and generous parental leave policies

Apply for this position