Data Engineer

Are you a Data Engineer with experience in SQL-based data transformation, ETL pipeline development, and building user-facing dashboards and reports?

At DWP Digital, we design and build services that make a real difference to people’s lives. As part of the UK’s largest government department, we support over 22 million people each day, from helping them find work to supporting them through some of life’s most difficult moments. Our work is central to delivering the Government’s “Get Britain Working” vision. Few organisations in the world offer the same opportunity to use technology and design thinking at this scale, with real impact.

Debt Solutions is responsible for DWP’s Debt Management, Compensation Recovery and Management Information systems. Thousands of agents and citizens use these systems to recover approximately £3 billion of debt per annum while protecting the most vulnerable in our society.

Step into a role at the cutting edge of data transformation. This is your chance to help shape the future of MI and data services as we modernise long-standing processes and build innovative solutions on our new, cloud powered MI and data platform.

As a Data Engineer, you will be responsible for development and maintenance activities for the delivery of data products and services that meet customer needs to agreed timescales. You will work within the overall product development lifecycle, learning and applying agreed data architecture and data engineering principles and standards to ensure systems are fit for purpose.

You will design, build, and operate repeatable ETL data pipelines within distributed processing and cloud environments, implementing data flows that connect operational systems to analytics and business intelligence platforms. Working with senior team members, you will integrate a variety of source data, apply data modelling techniques, and contribute to metadata management and technical documentation to ensure data assets are well understood and properly governed.

You will apply your knowledge of SQL and related tooling to deliver production-ready code and data transformation processes that meet organisational standards. You will use Git and related version control tools to manage and collaborate on code effectively across the team. A key part of this role involves developing user-facing dashboards and analytical reports, working with senior colleagues to ensure these meet customer requirements and are kept up to date.

You will work as part of a multidisciplinary agile team, collaborating with data analysts, data scientists, and other technical and non-technical colleagues to understand requirements and deliver high-quality data products. You will support the growth of the team by sharing knowledge and experience, and contribute to a culture of continuous improvement across the data engineering community.

Occasional line management of apprentices or placement students may be required., * Design, build, and operate simple, repeatable ETL data pipelines within distributed processing environments and cloud platforms.

• Implement data flows to connect operational systems, supporting analytics and business intelligence and management information systems, working with senior team members.
• Review business requirements to ensure they are clear and robust, and transform requirements into reusable, production-ready code and effective data models.
• Undertake data analysis for data profiling, quality assurance, and problem resolution, communicating findings clearly to colleagues of different specialisms.
• Conduct proof of concept and discovery work to provide information, advice, and recommended courses of action within your own work area.
• Integrate a variety of source data, using judgement and guidance to determine the appropriate approach, and contribute to metadata management and documentation.
• Support the growth of the team by keeping abreast of market and industry trends and sharing knowledge and experience with colleagues.

As a Data Engineer it would be beneficial to have experience in the following areas, however this is not essential to the role.

• Experience of data profiling and source system analysis, applying a range of profiling techniques, and communicating findings clearly to support data use across the team.
• Familiarity with Power BI for dashboard development and MI/BI reporting, including experience of Power BI development practices.