Data Engineer

Anson McCade
London, UK
6 days ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Starter
Working hours
Regular working hours

Tech stack

Clean Code Principles Artificial Intelligence Amazon Web Services Automation of Tests Microsoft Azure Big Data Continuous Integration Extract Transform Load (ETL) Data Transformation Data Warehousing Python (Programming Language) Machine Learning
+18 more
NoSQL Scrum Methodology SQL Databases Systems Architecture Test-Driven Development (TDD) Apache Spark Generative AI Build Management Data Lakes Kubernetes Infrastructure Automation Frameworks Performance Monitor Operational Systems Video Streaming Terraform Software Version Control Data Pipelines Docker

Job description

  • Develop and deploy machine learning models into production and monitor performance.
  • Design and build scalable ETL/ELT pipelines using batch and streaming technologies.
  • Work with large-scale datasets, data modelling and data transformation.
  • Connect operational systems with analytics and BI platforms.
  • Identify and resolve data quality and pipeline issues.
  • Develop high-quality code, documentation and automated tests.
  • Work within an Agile/Scrum environment.
  • Collaborate with technical teams, clients and stakeholders.
  • Keep up to date with emerging technologies, particularly Generative AI.

Requirements

We are looking for experience in some of the following:

  • Strong Python skills.
  • AWS, Azure or GCP.
  • Data warehousing and data lake architectures.
  • ETL/ELT, SQL and NoSQL databases.
  • Spark, Kinesis or other distributed/streaming technologies.
  • CI/CD, TDD and version control.
  • Docker, Kubernetes and Infrastructure as Code such as Terraform.
  • Data modelling and system architecture.
  • Experience delivering an AI/ML project.
  • Strong communication, problem-solving and stakeholder management skills.
  • Team leadership and decision-making experience for senior-level roles.

Consultancy experience is beneficial but not essential; client-facing experience from other environments will also be considered.

Benefits & conditions

Salary: Competitive salary and package, dependent on experience Travel: Ad hoc travel to client sites across the UK, * Competitive salary and benefits package.

  • 25 days’ annual leave.
  • Private medical insurance.
  • 3 additional days’ leave for charitable work.
  • Career development and exposure to leading data, cloud and AI technologies.

Important Security Clearance Requirement

Any offer of employment is subject to satisfactory BPSS and DV security clearance.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all

Related articles

See all