Data Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Engineer, situated within our Digital, Data and Technology (DDaT) Chief Data Office, you will work within a multi-functional delivery team, responsible for the delivery of the robust data services and designs. You will need the appetite to learn new technologies and methodologies for delivering high quality IT services. In this role you will work within a multi-disciplinary squad using several technologies to build enterprise grade services. Specific responsibilities for this role include the development of data systems as required, development and optimisation of ETL layers, maximising opportunities to re-use existing data flows and provide support in relation to data platforms and data integration within our cloud estate. Working Style This role will be carried out in-line with IPO Hybrid working arrangements where staff are currently expected to spend at least 20% of their time working onsite from one of our offices. This role is based in our NewportOffice. The requirement for attendance at an office location can vary by role so we would encourage candidates to discuss working arrangements with the recruiting manager to agree a reasonable balance between working from home and the office., Main duties consist of but are not limited to:
- Be responsible for data enhancements and executing plans that utilise the current toolkit and the skills of the team to deliver these.
- Contribute to the development of a world class Data Engineering capability for IPO IT & Data.
- Work closely with our Data Management and Business Intelligence Teams to drive solutions that ensure ease of access to data and help them to work with data more effectively and efficiently.
- Build IPO data pipelines, owning the data engineering artefacts.
- Build solutions to move data internal & external to IPO.
- Engage with stakeholders to build relationships and to gain a thorough understanding of key IPO user groups and design decisions.
- Work across groups, projects, and products to implement data engineering solutions to solve complex business problems, using the IPO's chosen technology.
- Support the vision for the organisation's use of data in line with corporate goals and vision.
Person specification, Artificial intelligence Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our for more information on appropriate and inappropriate use. Selection process details This vacancy is using , and will assess your Behaviours, Experience and Technical skills. Additional details on security and vetting Successful candidates must pass a disclosure and barring security check and if successful you must also hold, or be willing to obtain, a higher Security Clearance. For meaningful checks to be carried out individuals will need to have lived in the UK for a sufficient period of time, depending on the level of clearance, to enable appropriate checks to be carried out and produce a result which provides the required level of assurance. For this role the successful individual will need to have consistently lived in the UK for a minimum 5 years in order to meet the relevant security clearance. Further information on the vetting process can be found at If you have questions regarding this or are unsure if you meet the eligibility criteria, please contact The assessment process will comprise of the following: Stage 1 - Sift An initial sift of applications will be carried out to create a shortlist. This will be based on the evidence provided for the following Success Profile elements: Experience Your CV will be used to assess your suitability for the role. We will refer to the technical skills and experience in the role profile. Stage 2 - Interviews If invited to interview Behaviours and Technical based questioning will be used. Specific information regarding the Success Profile elements that will be assessed at interview will be contained within the interview invitation. Interviews for this role will be carried out virtually via Microsoft Teams (video). This recruitment campaign will keep a reserve list for 12 months. If you meet the requirements for this role but aren't offered after passing the interview, you'll be placed on the reserve list. If a suitable position opens up during this time, we will reach out to individuals in merit order. Applicants to note: CVs sent direct to the IPO will not be accepted. There may be important information contained within the job role profile candidates may also wish to refer to. We recommend candidates download and save a copy of the role profile for reference. This post is being advertised to Internal, acrossGovernment and external candidates at the same time. Incomplete and/or late submissions will not be accepted or considered. Feedback will only be provided if you attend an interview or assessment. We do not routinely reimburse travel expenses for candidates, however if participating in the selection process would cause you undue financial hardship or if it restricts your ability to participate, please contact the recruitment team for more information. In line with Government guidance, successfully appointed candidates will need to provide documents for our Right to Work checks. Information on this will be sent within the invite to interview text. If you require a reasonable adjustment at any stage of the recruitment process, then please let the recruitment team know via Please be aware that only one application per candidate is permitted for each recruitment campaign. Multiple applications, including those made using different accounts, may result in your application being withdrawn or rejected at any stage of the process. For more information on the IPO's terms and conditions, please review the attached IPO Modernised Terms and Conditions document attached at the bottom of this advert. Feedback will only be provided if you attend an interview or assessment. Security Successful candidates must undergo a criminal record check.Successful candidates must meet the security requirements before they can be appointed. The level of security needed is . .People working with government assets must complete checks. Nationality requirements This job is broadly open to the following groups:
- UK nationals
- nationals of the Republic of Ireland
- nationals of Commonwealth countries who have the right to work in the UK
- nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the
- nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
- individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
- Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Requirements
Essential Technical
- Experience of Azure Data Factory (ADF), Data Bricks, Python and other data tooling.
- Evidence an ability to design, code, test, correct and document simple programs or scripts.
- Experience of cleansing, preparing and formatting data sets.
- Awareness of designing scalable solutions and future-proof data services.
Essential Experience
- Has been a key player in delivering technical solutions as part of large projects.
- Experienced with modern delivery models such as Scrum and other Agile.
- Advocate of DevOps principles.
- Experience with Azure DevOps., * Developing Self and Others
- Delivering at Pace
- Working Together
Technical skills We'll assess you against these technical skills during the selection process:
- Experience of Azure Data Factory (ADF), Data Bricks, Python and other data tooling
- Evidence an ability to design, code, test, correct and document simple programs or scripts.
- Experience of cleansing, preparing and formatting data sets.
- Awareness of designing scalable solutions and future-proof data services.
Benefits & conditions
Benefits Alongside your salary of £47,766, Intellectual Property Office contributes £13,837 towards you being a member of the Civil Service Defined Benefit Pension scheme.
- Unlimited Pluralsight video learning access
- Access to Microsoft's ESI training suite
- Hybrid working with no core hours
- Substantial support for career progression
- 25 days annual leave moving to 30 days in annual increments
- You will also get 8 days public leave and 1 day privilege leave