CBAS Senior Data Engineer

Department for Energy Security and Net Zero
Aberdeen, United Kingdom
6 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 52K

Job location

Remote
Aberdeen, United Kingdom

Tech stack

Artificial Intelligence
Azure
Cloud Computing
Computer Programming
Databases
Data Architecture
Information Engineering
Data Governance
ETL
R
Python
PostgreSQL
MariaDB
Microsoft SQL Server
MySQL
SQL Databases
Scripting (Bash/Python/Go/Ruby)
Azure
Data Pipelines
Databricks

Job description

We?re looking for a Senior Data Engineer who can work for a fast past and focused team. The Cloud Based Analytical Service (CBAS) is a respected team that supports the Analytical function in DESNZ.

You will work in the CBAS data team with a Lead Data Engineer and support a Junior Data Engineer to deliver high quality pipelines and processes for their users. We use both cutting-edge technology and legacy software to create pipelines, which means you must be flexible in your ability and mindset.

The team is always looking to improve the way we deliver data, we work directly with other teams in the Chief Data Office including the Data Architecture and Data Governance teams.

You will also advise and support users who are also developing pipelines or cleaning data, helping uplift the data capability in the department. Person specification

  • Supporting the DESNZ analytical community deliver analysis by making datasets ready for analysis. ? Developing new automated data pipelines to help reduce data production costs, improve data quality, and scalability. ? Adapt/maintain/optimise existing data pipelines created by the CBAS data engineering team. ? Collaborate with teams across the analytical and data community to promote the benefits of data engineering and help them solve data production issues. ? Manage a Junior Data Engineer to develop their data engineering skills. ? Work with the Central Data Office leads to incorporate DESNZ data standards and governance policies. ? Provide technical support to CBAS user community on data engineering matters. ? Manage and document ETL processes. ? Working with the Lead Data Engineer to explore new data engineering tools and techniques.

As a line manager, you will be responsible for working with your members of staff to define their objectives, as well as managing their development and performance., The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home-based location for 40-60% of the time over the accounting period. Things you need to know Artificial intelligence Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use. Selection process details This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills.

As part of the application process, you will be asked to complete a CV, personal statement and a number of behavioural statements and technical skills examples.

Further details around what this will entail are listed on the application form.

Please use your personal statement (in no more than 750 words) to demonstrate how your personal skills, qualities, and experience align with the Essential criteria of the role.

Applications will be sifted on CV, behavioural statements, personal statement, and any technical skills required.

In the event of a large number of applicants, applications will be sifted on the personal statement.

Candidates who pass the initial sift may be progressed to a full sift, or progressed straight to assessment/interview., Candidates who meet the minimum benchmark may be placed on a Reserve List for consideration for similar roles, including those at a lower grade. Candidates who narrowly miss the benchmark and are not placed on the Reserve List may still be considered for an offer in a similar role at a lower grade.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to the Department for Energy, Security and Net Zero from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare; for further information visit the Childcare Choices website.

DESNZ does not normally offer full home working (i.e., working at home); but we do offer a variety of flexible working options (including occasionally working from home).

DESNZ cannot offer Visa sponsorship to candidates through this campaign.

DESNZ holds a Visa sponsorship licence but this can only be used for certain roles and this campaign does not qualify.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service /Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing stating the job reference number in the subject heading.

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant?s details held on the IFD will be refused employment.

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5-year period following a dismissal for carrying out internal fraud against government.

For further information on National Security Vetting please visit the Demystifying Vetting website.

Feedback Feedback will only be provided if you attend an interview or assessment. Security Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .

See our vetting charter . People working with government assets must complete baseline personnel security standard (opens in new window) checks. Nationality requirements

This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Requirements

? Experience of using following tools to create data pipelines including Databricks and Azure Data factory ? Experience of at least of one following programming/scripting languages: Python, SQL and R. ? Experience of using at least one of following databases, Microsoft SQL Server, PostgreSQL, MySQL or MariaDB. ? Experience of creating automated data pipelines. ? User support experience, demonstrating problem management skills. ? Experience of modelling data. ? Experience of testing data for quality assurance.

Desirable criteria

? Experience using Azure Public cloud, including Azure certification. ? IT/Computing degree. ? Experience of Database administration. ? Working in secure technology environment. Behaviours

We'll assess you against these behaviours during the selection process:

  • Delivering at Pace
  • Working Together

Technical skills

We'll assess you against these technical skills during the selection process:

  • Data development process
  • Programming and build (data and analytics engineering)

Benefits & conditions

Benefits Alongside your salary of £42,385, Department for Energy Security & Net Zero contributes £12,278 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

The Department for Energy Security and Net Zero offers a competitive mix of benefits including:

  • A culture of flexible working, such as job sharing, homeworking and compressed hours.
  • Automatic enrolment into the Civil Service Pension Scheme, with an employer contribution of 28.97%.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel and lifestyle employee discounts.
  • A hybrid office/home based working model where staff will spend a norm of 40-60% of their time in the office (minimum of 40%) over a month with flex dependent on balancing business and individual need.

About the company

Do you want a career where you can make a real difference? Do you want to work at the forefront of current policy making decisions? Do you want to have an impact on the UK and beyond? If yes, then a career at the Department for Energy Security and Net Zero (DESNZ) could be for you. Here at DESNZ we are delivering our mission to make the UK a clean energy superpower, with clean electricity by 2030 and accelerating the UK?s journey to net zero. Our work is helping ensure clean energy for all, keep bills down and seize the opportunities to lead the world in new green industries, taking back control of our energy with Great British Energy and encouraging greater energy efficiency across the UK. The work of the department has never been more timely or relevant, and by joining us you will be part of making that difference. Our work is varied, interesting and most importantly it's impactful. Our DESNZ Values are interwoven into everything we do; we are bold, we are collaborative, we are inclusive, and we learn. As a department we are committed to these values to build a culture where everyone can thrive We offer great working benefits including a world-class pension, flexible working options and a career where your learning and development is taken seriously. We are enormously proud to be a Disability Confident Leader employer. We support candidates with adjustments throughout our recruitment process. Information about disability confidence and just some examples of the adjustments that you can request can be found in the reasonable adjustment section below. The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service D&I Strategy.

Apply for this position