Senior Data Engineer

Hireful
London, UK
1 day ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£75,000.0 - £85,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Cloud Computing Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Apache Hive Python (Programming Language) Standard Sql Sql Optimization Apache Spark
+5 more
Data Lakes Pyspark Software Version Control Data Pipelines Databricks

Job description

  • Design, build, and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL, and Delta Lake
  • Develop and optimise ETL/ELT processes to ingest, transform, and curate data from internal and external systems
  • Shape enterprise data architecture, balancing scalability, performance, security, and maintainability
  • Partner with stakeholders across Finance, Product, Sales, Marketing, and Engineering to turn business challenges into technical solutions
  • Embed data quality, governance, and access controls throughout the data lifecycle
  • Mentor a junior engineer and help mature a growing data function

Technologies:

  • AI
  • AWS
  • CI/CD
  • Cloud
  • Databricks
  • ETL
  • Marketing
  • Python
  • PySpark
  • SQL
  • Security
  • Spark

Requirements

  • Senior-level experience in data engineering with strong hands-on Databricks skills, including PySpark, Spark SQL, and Delta Lake
  • Advanced SQL and Python coding skills
  • Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions
  • Solid grounding in data architecture, modelling, and modern data platform design
  • Cloud experience, preferably AWS
  • Familiarity with CI/CD and source control best practice
  • Desirable: data science-leaning background or interest in exploring ML/AI and data/predictive modelling strategies

About the company

We are a UK HQ-based, fast-growing software business with 400+ staff globally, serving hundreds of enterprise customers worldwide. This is a remote role in the UK with very occasional visits to our London office. We offer a salary of up to £85,000 basic, plus a 10% bonus and an extensive benefits package. You will join a small, high-impact team at the heart of our data strategy, with real influence over data architecture and platform direction as we continue to build our Data Ops journey. Our benefits include health insurance, income protection, life assurance, subsidised gym membership, and 25 days holiday plus your birthday off.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

1:59 min

Evolving roles in AI driven software teams

Ignacio Riesgo Ignacio Riesgo +1 · World Congress 2024

Videos

See all

Related articles

See all