Data Engineer

Competition & Markets Authority
Charing Cross, United Kingdom
3 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Working hours
Shift work
Languages
English
Experience level
Senior
Compensation
£ 53K

Job location

Remote
Charing Cross, United Kingdom

Tech stack

Amazon Web Services (AWS)
Information Engineering
Web Scraping
Data Transformation
Data Systems
Python
Machine Learning
Operational Databases
Data Processing
Infrastructure as Code (IaC)
Core Data
Machine Learning Operations
Software Version Control
Data Pipelines

Job description

As a Data Engineer in the DTI team, you will join a multidisciplinary team of data engineers and data scientists working on the CMA’s data processing and analytical capabilities, where you will spend most of your time on hands-on technical work including:

  • Designing, building and maintaining scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.
  • Implementing data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.
  • Building and maintaining containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.
  • Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
  • Applying Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
  • Designing and maintaining systems for data version control and reproducible machine learning workflows (MLOps).

You will collaborate closely with engineering and analytical colleagues on technical design and implementation, contributing to shared standards and ensuring data systems support the CMA’s mission effectively. Additionally, you will support the Data Engineering Team’s efforts to upskill the wider CMA, helping teams improve their data literacy, coding practices, and use of modern data tools., It is essential that you can provide evidence and examples for each of the following selection criteria in your application. For tips on how to make the most your application, please have a look at our guidance document., * As part of the application process, you will be asked to complete a CV, personal statement, and an online application form. Further details about application requirements are listed on the application form.

  • The selection process will comprise of the sift (CV & application review), technical test and an interview. Arrangements for the technical test and interview will be enclosed in the invitation.
  • Please note that it is essential that your personal statement is aligned to provide evidence that you have the knowledge and experience for each of the essential criteria (as included on the role profile attached and listed above under 'Person Specification') in your application. Your personal statement should be no more than 1250 words.You will first be sifted on the first two criteria points (Lead Criteria). If your application progresses to a full sift, all elements of the essential criteria listed under Person Specification will then be considered.
  • We may raise the score required at sift stage to progress to interview if we receive a high number of applications and take through the highest performing candidates to the next stage.
  • Candidates that pass the initial application sift will be invited to do a technical test – a coding and data engineering test.
  • Candidates that pass the technical test will then be invited to interview, which will include some questions related to your response to the technical test.

Interview stage

  • At the CMA we apply a blended interview technique, allowing us to find out more about you and we use the Success Profiles framework assessing the Behaviours, experience and technical skills listed in the advert and attached role profile.
  • During the interview you will be asked questions based on the Behaviours, Experience and Technical skills outlined in the role profile and will be asked questions related to the technical test.
  • A reserve list may be held for up to 12 months from which further appointments may be made for the same or similar roles.

Timeline (the dates outlined below are indicative and may be subject to change)

  • The advert closing date is 23 February 2026 (23:55). We are not able to accept late applications.
  • The sift is scheduled to take place between 24 and 27 February 2026.
  • The technical test will take place between 06 and 13 March 2026
  • Interviews will be held from the week commencing 23 March 2026,

Reasonable adjustments

Our recruitment process is fully inclusive, and we can make adjustments to provide you with the opportunity and support to bring your best self to the recruitment process. This could include having an interview buddy, extra time at interviews/assessments, or receiving interview questions in advance. We will be happy to discuss any person-centred adjustments you’d like us to make to the process and you can contact us by emailing our dedicated mailbox at adjustments@cma.gov.uk. Feedback will only be provided if you attend an interview or assessment., * UK nationals

  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Requirements

Do you have experience in Python?, Do you have a Bachelor's degree?, Applicants new to the Civil Service will be recruited at the minimum of the pay band for the grade of the position into which they are appointed. Only in exceptional circumstances will a salary above the minimum be considered, based on skills, knowledge, experience and qualifications demonstrated through the recruitment process, and also equity with staff internal to the CMA., * Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)

  • An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)
  • Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)
  • Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
  • Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
  • Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences, * Seeing the Big Picture
  • Communicating and Influencing
  • Working Together
  • Delivering at Pace

Technical skills

We'll assess you against these technical skills during the selection process:

  • Data Engineering knowledge
  • Coding skills, This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills., Successful candidates must undergo a criminal record check. People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Benefits & conditions

£49,400 - £53,200 a DDAT allowance of up to £4750 may be applicable, Alongside your salary of £49,400, Competition & Markets Authority contributes £14,311 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

  • 25 days leave (increasing to 30 days over five years), plus 8 public holidays and an additional day off for the King’s birthday. In addition, you’ll be able to access a wide range of other types of leave as and when you need it, including generous maternity, paternity, shared parental leave and adoption options, as well as paid special leave for volunteering
  • Season ticket loans, cycle to work scheme, flu vaccinations and eye tests
  • Access to the Civil Service Sports & Leisure, giving discounted gym membership, high street discounts, free access to UK wide attractions and a free Tastecard
  • A range of wellbeing benefits, including an employee assistance programme, flexible working options and family friendly policies, regular networking events and professional learning opportunities at work

You can read more about our benefits in our Candidate Information Pack

Any move to the CMA from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax-Free Childcare. Determine your eligibility at https://www.childcarechoices.gov.uk/.

Like many other organisations, we operate a hybrid working model with a mix of office and home working. We believe this supports us to deliver our best work while allowing the flexibility to maintain balanced and healthy lives.

We are fully committed to being an inclusive employer and ensuring equal opportunities. We want a diverse workforce that reflects the consumers we serve. We welcome applications from under-represented groups, including ethnically diverse people, people with a disability, people with diverse gender identities and from people of different ages.

We are an accredited Disability Confident Employer and disabled applicants meeting the minimum criteria for the job will be given the opportunity to demonstrate their abilities at an interview.

Our Values

The CMA delivers impactful outcomes for people, business and the UK economy. We are Ambitious and Evidence-based, and always strive for Excellence. We treat everyone with Respect and are Collaborative and Inclusive.

Everything we do is underpinned by the Civil Service values: Honesty, Integrity, Impartiality and Objectivity.

About the company

If you want to work at the forefront of technology, regulating digital markets and protecting consumers, this role offers the chance to develop cutting-edge data engineering skills within a supportive team and make a real difference in society. The CMA is a world-leading competition authority at the forefront of tackling pressing public policy questions, including the regulation of the biggest digital markets. Our mission is to make markets work well in the interests of consumers, businesses, and the economy. The DTI team is an established multidisciplinary team that brings together data engineers, data scientists, technologists, behavioural scientists and digital forensics and eDiscovery experts.

Apply for this position