Senior Data Engineer

• Lead engineers directly and indirectly, providing day-to-day guidance, mentoring, and technical direction.
• Set direction, drive conversations, and influence engineering outcomes across multiple teams.
• Support ongoing platform migrations and transformation activity.
• Design and build new pipelines and services.
• Review and assure the work of other engineers.
• Set standards and patterns that ensure consistency and quality across delivery.
• Build engineering capability by supporting less experienced engineers.
• Embed best practice and help create a culture of continuous improvement.
• Carry out code reviews, provide technical coaching, and define how we approach data engineering at scale.
• Help establish senior data engineering excellence within our enablement space.

Technologies:

• AWS
• Azure
• Big Data
• Cloud
• ETL
• Fabric
• Informatica
• Support
• Kafka
• LESS
• Python
• PySpark
• SQL
• Security
• Spark

• Experience leading the technical delivery of data or ETL projects, ensuring work is high quality, reliable, and fit for purpose.
• Solid, hands-on experience with Informatica PowerCenter, including using it to integrate, transform, and manage data effectively.
• Strong experience building and delivering data pipelines using cloud platforms, preferably AWS, and big data tools such as Kafka or Spark.
• Confident using Python or PySpark and SQL to process, transform, and analyse data, and able to guide others in doing the same.
• Good understanding of modern data platforms such as Azure or Fabric, including how data is ingested, cleaned, structured, and made available to users.
• Experience leading or supporting large-scale platform migrations or transformations, ensuring best practice is followed and risks are managed.
• Ability to lead engineers through line management or technical leadership, coaching, mentoring, and helping others develop their skills.
• Ability to pass Security Check clearance.

We are DWP Digital, one of the UKs largest and most impactful digital environments, and we are looking for a Senior Data Engineer to join our Data Platform and Operations team within Data & Analytics. This is a unique opportunity to help shape our senior data engineering capability as we continue major platform migration and transformation work. We offer a hybrid working model from one of our digital hubs in Blackpool, Birmingham, Leeds, Manchester, Newcastle, or Sheffield. Our package includes pay up to £75,664, a generous civil service pension, flexible working, volunteering time, discounts, development opportunities, and a supportive, award-winning culture that values inclusion, coaching, and career progression.