Senior Data Engineer - Outside IR35

Xpertise Recruitment
London, UK
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£143,000.0 - £169,000.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Data Analysis Microsoft Azure Big Data Cloud Engineering Continuous Integration Information Engineering Data Infrastructure
+17 more
Data Systems Data Warehousing Distributed Systems Python (Programming Language) Machine Learning Cloud Services SQL Databases Azure Data Factory Snowflake Apache Spark Git Infrastructure Automation Frameworks Apache Kafka Data Management Terraform Data Pipelines Databricks

Job description

We’re looking for a Senior Data Engineer who understands that great data engineering is about building reliable, scalable data products, not simply moving data from A to B. This is an opportunity to shape modern data platforms, solve complex engineering challenges, and deliver data solutions that create genuine business value.

You’ll join an organisation investing heavily in its data capabilities, working alongside architects, analysts, data scientists, and engineering teams to build robust, production-grade data platforms that support analytics, AI, and operational decision-making.

Why join

  • Work on large-scale data and cloud transformation initiatives
  • Influence architecture, engineering standards, and platform strategy
  • Deliver solutions that have measurable business impact
  • Join a collaborative team of experienced data professionals

Responsibilities

  • Design, build, and maintain scalable data products and pipelines
  • Own solutions from requirements gathering through to deployment and monitoring
  • Develop cloud-native data platforms using modern engineering practices
  • Improve platform performance, resilience, security, and cost efficiency
  • Implement data quality, observability, and governance controls
  • Collaborate with stakeholders to translate business requirements into technical solutions
  • Contribute to CI/CD, infrastructure-as-code, and automation initiatives
  • Mentor engineers and champion data engineering best practice

Requirements

  • Strong software engineering fundamentals including Python, Scala or Java, SQL, Git, testing, APIs, and CI/CD
  • Experience building modern cloud-based data platforms within AWS, Azure, or GCP
  • Strong knowledge of technologies such as Databricks, Snowflake, Spark, Kafka, dbt, Airflow, or Azure Data Factory
  • Experience designing and delivering end-to-end data engineering solutions
  • Understanding of distributed computing, data partitioning, optimisation, and large-scale data processing
  • Production mindset with experience in monitoring, security, data quality, resilience, and operational support
  • Ability to balance technical excellence with pragmatic decision-making

Desirable experience

  • Experience developing lakehouse or modern data warehouse architectures
  • Knowledge of infrastructure-as-code tools such as Terraform
  • Exposure to machine learning or advanced analytics environments
  • Relevant cloud or data platform certifications

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all