Senior Data Engineer

Transforming Learning Group
UK
1 day ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£62,966.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Amazon Web Services Code Review Continuous Integration Data as a Services Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Security Data Structures
+15 more
Data Systems Relational Databases Python (Programming Language) PostgreSQL Machine Learning Operational Data Store Operational Databases Performance Tuning Software Tools Standard Sql Data Processing Cloud Platform System Apache Kafka Machine Learning Operations Data Pipelines

Job description

We’re looking for an experienced Senior Data Engineer to help shape and develop the data platform that powers insight, reporting and innovation across our products and services.

This is an exciting opportunity to play a key role in building reliable, scalable data solutions that support schools and trusts nationwide. Working primarily within AWS and Python-based environments, you’ll develop data pipelines, improve data quality and enable meaningful analytics that drive better decision-making.

You’ll also contribute to emerging machine learning capabilities and modern data engineering practices, working alongside AI-assisted development tools while applying your expertise to ensure data remains accurate, secure and trusted., * Design, build and maintain scalable data pipelines and workflows.

  • Develop data solutions that transform operational data into actionable insights and reporting.
  • Ensure data quality through validation, testing, monitoring and governance processes.
  • Support the development and deployment of machine learning models and feature pipelines.
  • Maintain strong data security, privacy and governance standards across all datasets.
  • Collaborate with engineering teams to ensure data structures and contracts remain consistent and reliable.
  • Optimise data processing, storage and performance within AWS environments.
  • Review and validate solutions developed through AI-assisted engineering tools.
  • Contribute to the ongoing development of data architecture and best practices.

Requirements

You’ll be an experienced data professional who enjoys solving complex problems, building scalable solutions and ensuring data can be trusted by those who rely on it.

Essential Skills & Experience

  • Strong commercial experience in data engineering using Python.
  • Experience designing, building and supporting production data pipelines.
  • Excellent understanding of data modelling, ETL/ELT processes and analytics-ready data structures.
  • Hands-on experience with AWS data services and cloud-based data platforms.
  • Experience working with SQL and relational databases.
  • Knowledge of machine learning deployment or MLOps practices.
  • Strong analytical, troubleshooting and code review skills.
  • A security-conscious approach to handling sensitive and confidential data.

Desirable Skills & Experience

  • Experience working with multi-tenant platforms and data environments.
  • Knowledge of PostgreSQL or Aurora performance optimisation.
  • Experience with Infrastructure as Code and CI/CD practices.
  • Familiarity with tools such as dbt, Airflow, Dagster, Prefect, Kafka or Kinesis.
  • Experience working with AI-assisted software development tools.
  • Understanding of GDPR and data protection requirements, ideally within education or other regulated sectors.

Benefits & conditions

At Transforming Learning Group, you’ll be part of a team committed to helping schools make better use of technology and data. You’ll have the opportunity to work on meaningful products, tackle complex technical challenges and help build data solutions that have a real impact across the education sector.

We foster a collaborative, supportive environment where innovation is encouraged, expertise is valued and everyone works together towards a shared goal.

If you’re passionate about data engineering and want to help shape the future of technology in education, we’d love to hear from you.

A comprehensive benefits package including:

  • Salary sacrifice pension scheme
  • Wellbeing & Benefits Hub
  • Cycle and e-bike scheme
  • Eye care vouchers
  • Employee assistance programme
  • Employee recognition platform
  • Online retail discounts

About the company

Transforming Learning Group is a visionary education group dedicated to helping schools use technology and data more effectively to improve outcomes for learners. Supporting over 5,000 schools nationwide, our family of brands includes turn IT on, School ICT Services, SalamanderSoft, Vital York, GDPR Sentry, Locker and EduFin.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

5:37 min

Extensibility and programmability features of the PostgreSQL database

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

3:39 min

Addressing code review surrender and process exploitation

Laura Tacho Laura Tacho · World Congress 2026 Europe

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all