Lead Data Engineer
Role details
Job location
Tech stack
Job description
We are recruiting for the position of a Lead Data Engineer in SSE's Group Data and Analytics team. This team acts as a Centre for Enablement (CfE) for the SSE organisation and are involved in a variety of activities: practical project development work, advising on best practice, investigation into new capabilities and other activities that further data driven solutions across SSE.
You Will
-
Act as a subject matter expert in the data engineering / data solutions space as a key member of the CfE.
-
Understand business requirements and discuss with stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution.
-
Lead, mentor and advise the CfE data solutions team in their work.
-
Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data engineering activities such as the design, development, implementation and maintenance of efficient, reusable and reliable data pipelines in an Azure environment.
-
Peer review work from team members to ensure quality, consistency, reusability etc. Ensure that appropriate testing for any given solution is considered and applied. Utilise CI/CD techniques for the productionisation of solutions.
Requirements
Do you have experience in SQL?, * Experience of acting in a lead position for a data engineering (data solutions) team in a large and diverse organisation and involvement in the full development lifecycle across varied solutions.
-
Extensive experience of using the Databricks platform for developing and deploying data solutions / data products (including ingestion, transformation and modelling) with high proficiency in Python, PySpark and SQL.
-
Leadership experience in other facets necessary for solution development such as testing, the wider scope of quality assurance, CI/CD etc.
- Experience in related areas of data and analytics - such as data visualisation, advanced analytics and/or AI capabilities (particularly the use of large language models) - would be beneficial.
- The mindset to lead by example; carrying out your own tasks to a high standard as well as leading a team to ensure task allocation and completion and that the quality of their work adheres to agreed patterns and standards.
Benefits & conditions
Pulled from the full job description
- Employee discount
- Gym membership
- Private medical insurance
- Cycle to work scheme
- Discounted gym membership, Salary: £58,100 - £87,100 + performance-related bonus and a range of benefits to support your finances, wellbeing and family.
Working Pattern: Permanent | Full Time | Flexible First options available, Enjoy discounts on private healthcare and gym memberships. Wellbeing benefits like a free online GP and 24/7 counselling service. Interest-free loans on tech and transport season tickets, or a new bike with our Cycle to Work scheme. As well as generous family entitlements such as maternity and adoption pay, and paternity leave.