Lead Data Engineer (Cloud)
Role details
Job location
Tech stack
Job description
- Developing Spark transformation jobs and reusable pipeline patterns
- Orchestrating workflows in Airflow (raw > bronze > silver > gold)
- Implementing manifest-driven transformation using JSON configuration stored in MongoDB or CosmosDB
- Maintaining Delta Lake tables and trouble shoot pipeline reliability/performance
Requirements
- Deep understanding of modern data engineering principles, data lifecycle, and enterprise-scale architecture.
- Strong knowledge of data governance, metadata management, and quality frameworks, with ability to enforce standards.
- Extensive experience managing and scaling data across hybrid environments (on-prem and cloud), particularly Azure and Databricks.
Benefits & conditions
Salary: £55,000 depending on skills and experience, As well as a competitive pension scheme, BAE Systems also offers employee share plans, an extensive range of flexible discounted health, wellbeing and lifestyle benefits, including a green car scheme, private health plans and shopping discounts - you may also be eligible for an annual incentive.
The Data team:
This is an opportunity to join a new part of the business, undertaking a new piece of work, introducing new technology into the wider BAE Business. Joining from the ground up, this is a chance to make your mark and the role your own. This role will provide the opportunity to grow the role & your responsibility into a wider scope or even specialise within a specific area.
Why BAE Systems?
This is a place where you'll be able to make a real difference. You'll be part of an inclusive culture that values diversity of thought, rewards integrity, and merit, and where you'll be empowered to fulfil your potential. We welcome people from all backgrounds and want to make sure that our recruitment processes are as inclusive as possible. If you have a disability or health condition (for example dyslexia, autism, an anxiety disorder etc.) that may affect your performance in certain assessment types, please speak to your recruiter about potential reasonable adjustments.