Lead Data Engineer

HM Revenue & Customs
22 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Working hours
Shift work
Languages
English, Welsh
Experience level
Senior
Compensation
£ 65K

Job location

Remote

Tech stack

API
Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Computer Security
Databases
Continuous Integration
Data as a Services
ETL
Data Warehousing
Relational Databases
DevOps
Hadoop
Identity and Access Management
Network Layer
NoSQL
Pentaho Data Integration
Scrum
Red Hat Enterprise Linux - RHEL
Power BI
Cloudera
SAP Applications
SAP BI Accelerator
SAS (Software)
Talend
Virtualization Technology
Data Ingestion
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data Analytics
Data Management
Cloudwatch
Terraform

Job description

There is an exciting opportunity to join a growing and fast paced delivery team within HMRC's Data Platform Service Delivery Group as a Lead Data Engineer.

The Data Platform Services Group is building an engineering capability to help run, maintain, and evolve its strategic Data Analytics platforms and services.

The Lead Data Engineer will take part in managing the Delivery Groups technical platforms, data exploitation tools, and data ingestion and transformation activities.

The Lead Data Engineer will also support Scrum-based cross-functional Data Studio teams delivering data exploitation work packages.

Deep technical expertise, demonstrable desire to stay ahead of technology trends and real teamwork ethos are key aspects we're looking for in candidates.

The team:

The DPS' operating model is based on coordinating several data capabilities including data acquisition and surfacing, searching, transformation and risking, exploitation and presentation. Each specialist area is run by a dedicated product-oriented delivery (POD) team.

Your role will be cross cutting touching all parts of the Group including Business Operations, Core Product Engineering and Intelligence Product Engineering, working with external teams such as estates and Cyber Security Information & Risk. You will engage with contractors and third-party suppliers designing, building and running industry leading data services on behalf of the department.

We focus on our people, so we have a dedicated Data Academy supporting personal development and creating defined career pathways that are rewarding, fulfilling and achievable. We support our team members in managing their own work/life balance and we have a diverse and inclusive workplace where everyone feels able to bring their whole self to work., As part of the Engineering team, you will be responsible for the running, maintenance and evolution of the Delivery Group's strategic Data Analytics platforms and services.

  • Manage and administer the key components of our analytics platforms, including monitoring, alerting, capacity management, investigation and resolution of technical issues.
  • Manage and administer a range of data exploitation tools.
  • Build, run, and manage data ingestion and transformation feeds.
  • Manage and administer the security components of our analytics platforms, as necessary.
  • Support DevOps-enabled project teams delivering data exploitation work
  • Implement preventative and corrective maintenance activities on platforms, tools, and data jobs/batches
  • Provide batch monitoring and support
  • Provide support to self-serve Data Analytics users through Data Clinics, as appropriate.
  • This role may require the successful candidate to provide support outside of normal working hours and taking part in On Call rotas.
  • Limited travel may also be required as part of this role to work in a geographically distributed Delivery Group as well as engage with customers and suppliers., We want to make sure no one is put at a disadvantage during our recruitment process. To assist you with this, we will reduce or remove any barriers where possible and provide additional support where appropriate., HMRC has a presence in every region of the UK. For more information on where you might be working, review this information on our locations.

The Civil Service values honesty and integrity and expects all candidates to abide by these principles. The evidence you provide in your application must relate to your own experiences.

Any instances of plagiarism or other forms of cheating will be investigated and, if proven, the relevant application(s) will be withdrawn from the process.

Recording of interviews is prohibited unless explicit agreement is sought in line with the UK General Data Protection Regulations.

Questions relating to an individual application must be emailed as detailed later in this advert.

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant's details held on the IFD will be refused employment.

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

New entrants will join on the minimum of the pay band.

Please note that, if you are applying for roles on a part-time basis, the salary agreed will be pro-rata, reflective of the working hours agreed within your contract.

If you experience accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

For more Information for people applying for, or thinking of applying for, roles at HM Revenue and Customs, please see link: Working for HMRC: information for applicants - GOV.UK. Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .

See our vetting charter . People working with government assets must complete baseline personnel security standard (opens in new window) checks., * UK nationals

  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service, Appointment to the Civil Service is governed by the Civil Service Commission's Recruitment Principles. You have the right to complain if you feel there has been a breach of the Recruitment Principles. In the first instance, you should raise the matter directly via ubsrecruitmentcomplaints@hmrc.gov.uk. Please note that we do not accept complaints or appeals regarding scoring of outcomes of campaigns, unless candidates can provide clear evidence that the campaign did not follow the Recruitment Principles. If you are not satisfied with the response, you may bring your complaint to the Commission. For further information on bringing a complaint to the Civil Service Commission please visit their website.

Requirements

Do you have experience in Virtualization?, Do you have a Bachelor's degree?, Experience of implementing and supporting a range of data analytics solutions and platforms, covering data modelling, ETL/ELT, reporting, dash-boarding, complex analytical models/tool. In addition, as this is a leadership role, proven experience in leading a team is required.

  • A demonstrable background in one or more of the following three areas:

Area 1.

Experience of data management technologies and approaches, including some or all of the following: Hadoop (Cloudera), NoSQL databases, relational databases, data warehousing, marts, universes, cubes, virtualization with Denodo.

Area 2.

Experience of data quality, ingestion, and transformation tools, including some or all of the following: Pentaho DI, Talend Data Fabric, SAP BODS, SAS.

Area 3.

Experience of data exploitation tools, including some or all of the following: Pentaho BA, SAS, SAP BI products, Red Hat BRMS, PowerBI.

  • Knowledge of security approaches and tools.
  • A clear understanding of Agile and Continuous Integration environments
  • Experience communicating and supporting business users

Desirable Criteria:

  • A cloud (AWS/Azure) delivery background.
  • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMS, Customer facing roles in HMRC require the ability to converse at ease with members of the public and provide advice in accurate spoken English and/or Welsh where required. Where this is an essential requirement, this will be tested as part of the selection process.

Benefits & conditions

Alongside your salary of £58,541, HM Revenue and Customs contributes £16,959 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

HMRC operates both Flexible and Hybrid Working policies, allowing you to balance your work and personal commitments. We welcome applications from those who need to work a more flexible arrangement and will agree to requests where possible, considering our operational and customer service needs.

We offer a generous leave allowance, starting at 25 days and increasing by a day for every year of qualifying service up to a maximum of 30 days.

  • Pension - We make contributions to our colleagues' Alpha pension equal to at least 28.97% of their salary.
  • Family friendly policies.
  • Personal support.
  • Coaching and development.

To find out more about HMRC benefits and find out what it's really like to work for HMRC hear from our insiders or visit Thinking of joining the Civil Service

About the company

Discover a career in your hands at HMRC. Whether you're seeking purpose, growth, or a workplace that gives you a true sense of belonging, hear from our employees as they share their story about what it's really like to work at HMRC. Visit our YouTube channel to watch the full series and come and discover your potential. At HMRC we are committed to creating a great place to work for all our colleagues; an inclusive and respectful environment that reflects the diversity of the society we serve. We want to maximise the potential of everyone who chooses to work for us and we offer a range of flexible working patterns and support to make a fulfilling career at HMRC accessible to you. Diverse perspectives and experiences are critical to our success and we welcome applications from all people from all backgrounds with the experience and skills needed to perform this role. HMRC is building a modern, digital tax administration and runs the biggest digital operation in Government, providing digital services for 45 million individuals and 4.9 million business customers. Our digital programme is multi-award winning and the envy of other government organisations. Data Platform Services (DPS) within the Chief Digital and Information Officer group (CDIO) function designs, builds and operates the data foundations for all of HMRC's services at a size and scale larger than most other organisations. DPS are responsible for the Department's Warehousing estate and delivering the exploitation requirements (including reporting, risking, advanced analytics and AI/Cognitive services) and services that utilise those warehouses. DPS is leading a major transformation programme encompassing technology, capabilities and data services whilst continuing to deliver high quality and robust services to our internal and external customers. HMRC is made up of Customer Groups which are working independently towards one common goal. Our role sits within HMRC's Chief Digital & Information Office (CDIO) Group that deliver in-house solutions for a broad range of technical and operational issues. CDIO values and empowers the growth of its people and offers the "CDIO University". This is a one stop shop for all things learning and development. The comprehensive offer encompassing academic, personal and career related opportunity and learning, ensuring all receive a consistent approach to technical learning. This includes access to subject matter experts, technical learning, professional communities, academies, apprenticeships, talent schemes as well as providing, delivering, encouraging and supporting activities for personal growth and wellbeing., HMRC is an office-based organisation, and colleagues are expected to spend 60% of their working time in the office. Our offices provide opportunity for interaction, collaboration which aids learning and development and a sense of community. Where the role allows it, and where the home environment is suitable, colleagues can work from home for up to 2 days a week, averaged over a calendar month (or a proportionate amount of time for colleagues who work less than full time).

Apply for this position