Senior Data Engineer

Cap Resourcing Ltd
London, UK
6 days ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Continuous Integration Information Engineering Data Governance Data Integration Data Retrieval Database Development DevOps Metadata Operational Data Store Query Optimization Release Management
+12 more
Power BI DataOps Spatial Data Infrastructures SQL Databases Azure Data Factory Apache Spark Indexer Data Lakes Data Management Pagination Azure Synapse Analytics Databricks

Job description

We’re looking for an experienced Senior Data Engineer to join a growing data operations function and take a leading role in shaping data engineering standards, architecture, governance and delivery.

This is an exciting opportunity for someone who wants to go beyond simply building pipelines. You’ll act as a technical authority for data engineering, helping to create a sustainable, scalable and high-performing data environment while mentoring engineers and driving best practice across the function.

Requirements

We’re looking for someone with 6+ years’ experience in data engineering or related data disciplines, including data integration, modelling, optimisation and data quality, with proven experience delivering modern cloud data platforms.

You’ll ideally bring strong experience across:

  • Expert SQL, including query optimisation, indexing and performance diagnosis
  • DevOps and CI/CD, release management and environment strategy
  • Azure Data Factory, including metadata driven and parameterised pipeline design
  • Azure Databricks and Spark
  • Unity Catalog, Delta Lake and medallion architecture
  • Extracting data from APIs, including authentication, pagination, rate limits and schema changes
  • Data governance and orchestration
  • IoT and telemetry data, particularly high-volume operational data
  • Understanding when to apply data engineering versus integration engineering patterns.

Experience with complex or spatial data, as well as exposure to Databricks, Synapse and Power BI, would also be advantageous.

Why this opportunity?

This is a role for a hands-on technical leader who enjoys improving how data engineering is done, not simply delivering individual projects.

You’ll have the opportunity to influence engineering standards, improve performance and automation, mentor junior talent and help shape the future data engineering capability of a large and complex organisation.

If you’re a Senior Data Engineer who enjoys solving complex problems, improving efficiency and setting the technical standard, we’d love to hear from you. Skills

  • Azure Data Factory
  • Azure Databricks Data Engineering
  • DevOps
  • SQL (Database Development)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

2:36 min

Analyzing limitations with PostgreSQL bitmap heap scans

Dharin Shah Dharin Shah · World Congress 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:32 min

Generating functional runtime database columns using indexer properties

Halil İbrahim Kalkan Halil İbrahim Kalkan · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all