Senior Data Engineer
Role details
Job location
Tech stack
Job description
Are you passionate about building scalable, cloud-native data solutions that drive real-world impact? We're looking for a Senior Data Engineer to join our Data Engineering team and help shape the Bank's strategic cloud-first data platform. You'll design and deliver robust, scalable data solutions that support the Bank's core responsibilities around monetary policy, financial stability, and regulatory supervision.
Flexible Working Options
This role is open to flexible working patterns, which may include:
- Flexible start and end times
- Ability to adapt your calendar to fit in the school run, gym, or appointments
- 50% in-office attendance spread across the month
- Compressed hours (subject to approval and team policy)
- Working from abroad (subject to approval and team policy), Your day begins with a team stand-up - a quick check-in to share updates on sprint tasks, surface any blockers, and align on priorities. From there, you'll move into hands-on engineering: designing and building data pipelines using Databricks, Python, and Spark, reviewing documentation, and contributing to code reviews.
You'll also collaborate with stakeholders such as data scientists, analysts, and delivery managers - gathering technical requirements, providing updates, or helping clarify data-related queries. Support duties are shared across the team, and you'll take turns running daily checks and resolving any issues to keep our data infrastructure running smoothly.
You'll also be part of Agile ceremonies like backlog refinements and sprint plannings, which help shape the team's priorities and keep delivery on track. Mentoring is a shared responsibility, and as a senior engineer, you'll support others when needed - offering guidance, sharing knowledge, and contributing to a collaborative team culture.
And finally, there's space to grow. Whether it's exploring new tools, deepening your cloud expertise, or attending internal workshops, upskilling is part of the journey - not just a perk.
Role Requirements
This role is ideal for someone who enjoys solving complex data challenges and wants to make a meaningful impact through engineering excellence. If you're someone who thrives in collaborative environments, enjoys mentoring and learning from others, and is excited by the idea of shaping modern data infrastructure - this could be the perfect next step in your career., This role sits within the Data Services team, part of the Bank's Technology Directorate. As a Senior Data Engineer, you'll contribute to the Bank's strategic objectives around monetary policy, financial stability, and regulatory supervision. Your work will help modernize legacy systems, enhance data accessibility, and empower colleagues across the Bank to make data-driven decisions with confidence.
Further Info
We're not looking for a 100% match across every skill listed. If you bring strong core experience and are excited to grow into the rest, we'd love to hear from you. We'll support you in developing new skills and filling any gaps. Diverse perspectives and backgrounds help us build better solutions, and we welcome applicants who share our passion for learning and collaboration.
Our Approach to Inclusion
The Bank values diversity, equity and inclusion. We play a key role in maintaining monetary and financial stability, and to do that effectively, we believe we need a workforce that reflects the society we serve.
At the Bank of England, we want all colleagues to feel valued and respected, so we're working hard to build an inclusive culture which supports people from all backgrounds and communities to be at their best at work. We celebrate all forms of diversity, including (but not limited to) age, disability, ethnicity, gender, gender identity, race, religion, sexual orientation and socioeconomic status. We believe that it's by drawing on different perspectives and experiences that we'll continue to make the best decisions for the public.
We welcome applications from individuals who work flexibly, including job shares and part time working patterns. We've also partnered with external organisations to support us in making adjustments for candidates and employees in the recruitment process where they're needed.
For most roles where work can be carried out at home, we aim for colleagues to spend half of their time in the office, with a minimum of 40% per month. Subject to that minimum requirement, individuals and managers should work together to find what works best for them, their team and stakeholders.
Requirements
- Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
- Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing.
- Proven experience in CI/CD practices using industry-standard tools (e.g., GitHub Actions, Azure DevOps).
- Strong understanding of data architecture principles and cloud-native design patterns., * Demonstrated ability to lead technical delivery, mentor engineering teams and collaborate with stakeholders to ensure alignment between data solutions and business strategy.
- Proficiency in Linux/Unix environments and shell scripting.
- Deep understanding of source control, testing strategies, and agile development practices.
- Self-motivated with a strategic mindset and a passion for driving innovation in data engineering., * Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives.
- Familiarity with:
- Apache Airflow
- Data modelling and metadata management
- Experience influencing enterprise data strategy and contributing to architectural governance.
Benefits & conditions
We encourage flexible working, part time working and job share arrangements. Part time salary and benefits will be on a pro-rated basis as appropriate.
We offer a salary as follows:
Leeds circa £55,280 - £62,190
In addition, we also offer a comprehensive benefits package as detailed below:
- Currently a non-contributory, career average pension giving you a guaranteed retirement benefit of 1/80th of your annual salary for every year worked. There is the option to increase your pension (to 1/65th) or decrease (to 1/105th) in exchange for salary through our flexible benefits programme each year. The Bank has the discretion to vary standard accrual rates and dial up and dial down rates at any time and to withdraw dial up and dial down options at any time.
- A discretionary performance award based on a current award pool.
- An 8% benefits allowance with the option to take as salary or purchase a wide range of flexible benefits.
- 26 days' annual leave with option to buy up to 12 additional days through flexible benefits.
- Private medical insurance and income protection.
