Lead Data Engineer
Role details
Job location
Tech stack
Job description
The Lead Data Engineer will contribute to the development and delivery of Data Warehousing, Reporting and Analytics output. They will enable data (from NHS data sets e.g. relating to acute activity) to be appropriately shared and disseminated within operational reports, published Management Information or Official Statistics.
The Lead Data Engineer will work closely with colleagues to develop robust processes for managing and automating regular outputs. The Lead Data Engineer must communicate plans and timescales to enable onward management of key stakeholders and should provide regular updates.
The Lead Data Engineer will feed into development priorities to understand potential efficiencies and savings in automated processes, to deploy and manage resources appropriately as the organisation progresses towards its strategic data solution.
The Lead Data Engineer will develop and implement new technologies to support robust and accurate data management and must ensure documentation (such as data dictionaries and data lineage information) is readily available across a range of stakeholders., * Technical lead for departmental work area, and overall data management framework.
Requirements
- Embed improved ways of working with data across the wider team, including automation of manual tasks and data assurance.
- Strong skills in analysing, defining, sourcing and capturing data across strategic business systems, processes and areas of an organisation
- Strong experience of working with data and databases, ideally involving the development of new and existing data sources in a Data Warehouse environment.
- Good understanding of Data Warehouse techniques, including dimensional data modelling and relational database design and concepts (e.g. Kimball).
- Exceptional SQL experience and technical database expertise using relational databases such as Oracle Database & PL/SQL or Microsoft T-SQL.
- Excellent knowledge and experience of R and Python programming
- Experience of code reviews and ensuring coding standards are applied and met.
- Experience of defining and documenting data workflows across systems and operations, including capturing and documenting complex data definitions and business rules.
- Provide expert advice to the Directorate on matters of data platforms, data integration and visualisation tools.