Lead Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+3 more
Job description
The Lead Data Engineer will help the BBC make practical use of AI tools and systems to solve business problems and help our internal teams work effectively and efficiently. The role is in the BBCâs Generative AI Programme and will collaborate closely with project managers, data scientists, analysts, domain experts, and the BBCâs technical teams. Working with Programme Leadership, the postholder will design and help build the data pipelines and solutions that enable AI projects to move effectively through piloting to successful handover to the business for scaling. WHY JOIN THE TEAM The Generative AI Programme, part of the Strategy & Transformation team, helps the BBC realise value from rapidly evolving AI capabilities in a way that is practical, responsible and aligned to the BBCâs public service mission. The teamâs activities include enabling adoption of AI tools across the organisation; fostering innovation; finding opportunities to use AI to work more efficiently as an organisation, and leading the BBCâs engagement on the wider AI issues that shape our operating environment. YOUR KEY RESPONSIBILITIES AND IMPACT
- Develop secure, reliable and well-designed solutions that support high-quality AI piloting and transition to successful handover to the business for scaling.
- Design and build robust data pipelines, models and supporting data structures that enable AI projects to move effectively from piloting to successful handover into the business for scaling.
- Work closely with data scientists, analysts, project managers, business partners, researchers and designers to understand requirements and translate them into valuable solutions.
- Establish and promote strong engineering practices for data quality, resilience, maintainability and operational performance across the teamâs work.
- Help shape data approaches to architecture, integration and pilot design, ensuring solutions are appropriate for AI experimentation and future scaling.
- Provide technical leadership to others, mentoring, code review and setting standards, contributing to a culture of learning and continuous improvement.
- Ensure data used within AI projects is managed in line with the BBCâs organisational values, security requirements and responsible approach to AI.
Requirements
- Significant experience of designing, delivering and operating data engineering solutions, including pipelines, models and platform components, with the engineering discipline to build secure, resilient and maintainable systems in complex organisational environments.
- Experience of working collaboratively in multidisciplinary teams, translating a range of user, product and research needs into practical engineering solutions.
- Demonstrable experience of providing technical leadership to other engineers, mentoring, reviewing code, setting standards and improving engineering practices.
- Sound understanding of data governance, security and quality considerations, with the judgement to apply these appropriately in innovative or experimental contexts.
- Strong engineering practices including security by design, proficiency in Python, experience with Cloud platforms (AWS preferred) and Infrastructure as Code (Terraform preferred), CI/CD pipelines, and demonstrable use of AI-assisted development tools to improve code quality and delivery pace., * Experience working in broadcast, media, start-up or research environments.
- Contributions to published technical documents or thought leadership in your area of expertise.
- Familiarity with API development frameworks (FastAPI or equivalent).
- Experience building with Generative AI frameworks (e.g. LangChain, LangGraph, PydanticAI) and managed AI services (e.g. Bedrock, Azure).
Benefits & conditions
Disclaimer This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved. Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory. Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Recruitment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer. For any general queries, please contact: Redeployment The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk. Information at a Glance This is your BBC At the BBC you can create and innovate in an inclusive environment while contributing to some of the worldâs best loved content, and the BBCâs mission to inform, educate and entertain. Life at BBC Here you will benefit from:
- Fair pay and flexible benefits including a competitive salary package, a flexible 35-hour working week, 25 days annual leave with the option to buy an extra 5 days, a defined pension scheme and discounted dental, health care and gym.
- Excellent career and professional development.
- Support in your working life, including flexible working which you can discuss with us at any point during the application, selection or offer.
- A values-based organisation where the way we do things is important as what we do.
Benefits may vary if you are joining on an FTC basis or on an orchestra conditions contract. Learn more about life at the BBC and our values in our candidate pack. You belong We have a working environment where we value and respect every individualâs unique contribution, so all our employees feel that they can belong, thrive and achieve their full potential. We want to attract the broadest range of talented people to join us. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity. We welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief. Find out more about diversity, inclusion and belonging in our strategy below. Disability confident
About the company
BBC Group and Public Services, Broadcasting House, Portland Place, London, United Kingdom, W1A 1AA. BBC Studios Distribution Limited, company no: 01420028, registered address: 1 Television Centre, 101 Wood Lane, London, United Kingdom W12 7FA. Ă Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and canât be turned off. Required Cookies Show More Details Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function:
- ârouteâ is used for session stickiness
- âcareerSiteCompanyIdâ is used to send the request to the correct data centre
- âJSESSIONIDâ is placed on the visitorâs device during the session so the server can identify the visitor
- âLoad balancer cookieâ (actual cookie name may vary) prevents a visitor from bouncing from one instance to another
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on careerjet.co.ukGood distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
How to Become an AI Engineer
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
Dev Digest 132 - Binging WADFlix?