Senior Data Engineer
Role details
Job location
Tech stack
Job description
At British Gas Energy, our ambition is to be Britain's favourite energy supplier.
We've been powering the UK's homes and businesses for over 200 years - but supplying energy is just part of what we do. We're making the UK greener and more energy efficient, getting closer to Net Zero. By using clever tech like thermostats, heat pumps, solar panels and EV chargers, we're making it cheaper and easier for our customers to reduce their carbon-footprint.
Are you passionate about Data & AI and eager to make a significant impact? We are growing our Data & Analytics department to drive value and innovation within our business. Through the development of Data & AI products, we aim to enhance decision-making, improve performance, and make a valuable difference in our business and for our customers.
Why Join Us?
- Innovative Environment: Stay ahead in the Data & AI field through use of cutting-edge technologies and creative thinking
- Collaborative Culture: Work with talented professionals in a supportive environment where best practices are shared and continuous improvement is encouraged
- Career Growth: We will invest in our team's development through continuous learning opportunities and career advancement programs
- Impactful Work: Directly contribute to our mission to drive business growth and operational efficiency
- Personal Development: We will provide an environment for you to learn and develop, with access to resources and support to help you grow both professionally and personally
About your role:
Join us as a Senior Data Engineering Leader and Shape the Future of British Gas Business's Data-Driven Success!
Step into a pivotal role within our Data Engineering function, where you'll lead transformative Data Engineering Science projects to drive growth, create efficiencies, and revolutionise BGB's decision-making capabilities. As a senior member of the team, you'll take charge of designing, building, and maintaining scalable data pipelines and data models that empower Data Analysts, Management Information, and Data Science initiatives. Alongside advancing our data integrity and availability, you'll also inspire and develop Associate Data Engineers, while mentoring peers to elevate the entire team's expertise.
Key aspects of this role are:
- Data Pipeline Development: Build and maintain robust Extract, Transform and Load data pipelines, ensuring seamless integration of large datasets into BGB's Data Estate
- Data Quality: Implement data quality audits and validation processes to maintain data accuracy
- Data Product Engineering: Collaborate with Analysts and Scientists to create data products for advanced analytics and machine learning
- Data Architecture: Design and refine data architecture to meet organizational needs
- Optimisation: Enhance data extraction and storage efficiency for cost and performance gains
- Technical Support: Troubleshoot data-related issues with a hands-on approach
- Documentation: Establish and maintain thorough documentation of processes and best practices
- Innovation: Stay at the forefront of emerging technologies to propel our data engineering capabilities forward
- Leadership: Grow, develop, and retain top talent while fostering a culture of excellence and ensuring succession planning
- Mentorship: Share your Data Engineering expertise with colleagues across departments, building cross-functional knowledge and collaboration
Requirements
Do you have experience in Spark?, * Extensive expertise in data engineering, with a proven track record of designing and implementing scalable data pipelines and data models. Strong skills in data modelling and data warehousing underpin this expertise
- Proficient in cloud services and cloud-based data engineering tools, such as AWS, Azure, Microsoft Fabric and Databricks, as well as big data technologies like Hadoop and Spark
- Skilled in programming languages, including Python, PySpark and Scala, with extensive experience developing robust ETL pipelines and ensuring scalable deployments
- Experienced in mentoring and developing less experienced Data Engineers, guiding them to grow their technical skills and capabilities
- Capable of delivering and leading complex data engineering projects, ensuring high-quality outputs and timely completion