Senior Data Engineer

The Planning Inspectorate is recruiting Senior Data Engineers to join our growing Digital and Data Unit.

You’ll work as part of the Data Service team, helping to build and maintain the Inspectorate’s Operational Data Warehouse - integrating data from across the planning system to support better decision-making and insight for colleagues, government and the public.

Working within a collaborative, cross-functional team, you’ll contribute to the design and delivery of modern data engineering solutions, applying good engineering practices and supporting the continuous improvement of our data platform.

The Planning Inspectorate has a long and proud history in ensuring a fair planning system for England. The work we do has a significant impact on people’s lives, the communities where they live and the economy.

We want our colleagues to be able to work more flexibly and more collaboratively, exploring new and innovative ways to improve the way we provide services., As a Senior Data Engineer, you will contribute to the design, build and operation of data pipelines and data products that support analytics and operational insight across the organisation.

You will:

• Design, build and maintain data pipelines and integrations across multiple systems
• Develop and support data models that enable reporting and analytics
• Work with stakeholders to understand data requirements and translate them into technical solutions
• Investigate and resolve data quality and performance issues
• Apply good engineering practices, including version control, testing and documentation
• Contribute to shared standards, code quality and continuous improvement within the Data Service
• Communicate effectively with both technical and non-technical stakeholders

This role focuses on delivery within a team environment - working on complex data problems and contributing to reliable, well-governed data solutions.

The position aligns with the Data Service remit to design and implement data flows that connect operational systems, analytics platforms and business intelligence capabilities., If there are many applications, we might use a lead sift. This means we'll first check if you meet the key requirement listed below. If you don't, we won't review the rest of your application

Technical Example: Please provide one 250-word example demonstrating your experience of designing and implementing a data pipeline using Python and PySpark.

All shortlisted candidates will be advised of the outcome shortly afterwards.

Interview

If you are shortlisted, you will:

• Be asked to attend an interview to have a more in-depth discussion about your experience and suitability for the role
• Interviews will be a blend of behaviour, experience and technical questions

Candidates who pass the shortlist stage will receive full assessment details with their interview invitations., The Planning Inspectorate does not fund travel and subsistence for candidates to attend interviews.

Reserve list

A reserve list may be held for a period of 9 months from which further appointments can be made.

Future Matches

Candidates who demonstrate strong potential and future readiness but score just below the required level at interview may be considered for alternative positions. These roles may be at a lower grade but align with their skills and offer opportunities for growth.

We encourage all candidates to make themselves familiar with the role and what we will be assessing you against which is detailed in the Person Specification.

ID and Documents

If the job needs specific qualifications or memberships and you get the job, you'll need to send scanned or photographed images of them before you start.

We must check that any successful candidates are allowed to work for the Civil Service before we employ them. If successful, you will be asked to do a right to work check using identity document validation technology (IDVT) through the services of an Identity Service Provider (IDSP), Civil Service Jobs. If we are unable to confirm your right to work and through the IDVT we will need to do a manual right to work check using original documents with you in person.

Visa Sponsorship

The Planning Inspectorate cannot offer Visa sponsorship to candidates, we do not hold a Visa sponsorship licence., * UK nationals

• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Do you have experience in SQL?, * Experience designing, building and maintaining data pipelines and data integration solutions in cloud environments.

• Strong programming skills in Python and SQL for data engineering, including experience with distributed data processing tools such as PySpark.
• Experience working with cloud-based data platform technologies, ideally Microsoft Azure services such as Azure Synapse and Azure Data Factory.
• Practical understanding of data modelling, transformation, integration and data warehousing principles to support reporting and analytics.
• Understanding of data quality, governance, security and privacy requirements in a regulated environment, including GDPR.
• Experience applying good engineering practices, including version control, testing, CI/CD, troubleshooting and performance optimisation., * Changing and Improving
• Working Together
• Communicating and Influencing
• Managing a Quality Service

Technical skills

We'll assess you against these technical skills during the selection process:

• Designing and implementing data pipelines Data modelling and integration approaches
• Data quality, governance, and security Effective use of cloud technologies in delivery environments
• Please provide one 250-word example demonstrating your experience of designing and implementing a data pipeline using Python and PySpark

We only ask for evidence of these technical skills on your application form:

• Please provide one 250-word example demonstrating your experience of designing and implementing a data pipeline using Python and PySpark, This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills., Successful candidates must undergo a criminal record check. People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Pulled from the full job description

• Annual leave
• Company pension
• Flexible schedule, New entrants to the Civil Service are expected to start on the minimum of the pay band. Internal rules apply to existing Civil Servants, i.e. level transfers move on current salary or the pay range minimum, transfers on promotion move to new pay range minimum or receive 10% increase. Either case is determined by whichever is the highest

This role is being advertised at Senior Executive Officer grade

Salary for the Grade role is £46,689 plus a DDAT allowance of up to up to £10,771 based on Capability and base salary

Working hours:

Standard working week is 37 hours, Part time at 30 hours or above.Flexible working hours policy available

Office Attendance

This role is contractually based at Runway East, Bristol Temple Meads. We recognise and value the mutual benefits of hybrid working and have a flexible approach to in person attendance, which can vary dependent on the requirements of individual business units - the details of which can be discussed with candidates if invited to attend an interview., Alongside your salary of £46,689, Planning Inspectorate contributes £13,525 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides .

• Flexible working options, including flexi-time, part-time, compressed hours and home working if suitable for the role.
• A working culture which encourages inclusion and diversity.
• 25 days annual leave increasing by 1 day per year up to 30 days after 5 years, plus 1 privilege day to mark the King’s birthday. In addition to the normal bank holidays.
• Generous family friendly policies.
• Fast and modern IT kit which utilises Windows 11 and Microsoft 365, enabling seamless working from home and collaboration across teams.