Senior Data Engineer

Stealth It
Leeds, United Kingdom
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 116K

Job location

Leeds, United Kingdom

Tech stack

API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Automation of Tests
Big Data
Cloud Computing
Cloud Engineering
Code Review
Continuous Integration
Data Validation
Information Engineering
Data Integration
ETL
Data Transformation
Data Security
Data Systems
Data Warehousing
DevOps
Dimensional Modeling
Identity and Access Management
Python
Power BI
SQL Databases
Gitlab
GIT
Event Driven Architecture
PySpark
Git Flow
Atlassian Tools
Cloudwatch
Terraform
Software Version Control
Data Pipelines
Amazon Web Services (AWS)

Job description

We are looking for a Senior Data Engineer with strong Informatica and modern data engineering experience to design, build, and optimise scalable data solutions in a complex public sector environment. You will play a key role in modernising Legacy data estates, building production-grade data pipelines on AWS, and delivering high-quality data that powers critical reporting and analytics., * Design, develop, and maintain production-grade data pipelines using PySpark on Amazon EMR, Python, and SQL.

  • Migrate and modernise Legacy ETL workloads and reporting feeds to cloud-native AWS services.
  • Build scalable, resilient, and observable data solutions with a strong focus on performance, data quality, and reliability.
  • Support Management Information (MI) and reporting use cases, including data transformations and models feeding Power BI.
  • Own CI/CD practices, version control (Git/GitLab), code reviews, and engineering standards.
  • Mentor and coach junior engineers while contributing to architectural decisions.
  • Work collaboratively in an Agile environment using Jira and Confluence.
  • Embed security and compliance by design, working within BPSS/SC and public sector data governance standards.

Requirements

  • Strong hands-on experience with AWS (EMR, S3, Lambda) and PySpark/Python for large-scale data processing.
  • Solid background in Informatica for ETL development and modernisation.
  • Proven data engineering experience in government or complex regulated environments.
  • Strong CI/CD and DevOps practices (Terraform, automated testing, Git workflows).
  • Experience with APIs, data integration, and secure data exchange.
  • Excellent stakeholder communication and documentation skills.
  • BPSS clearance (minimum); SC cleared or SC clearable is highly advantageous.

Desirable Skills

  • Data warehousing and modelling (Redshift, dimensional modelling, dbt).
  • Familiarity with Power BI for end-to-end data validation.
  • Broader AWS ecosystem (Athena, CloudWatch, IAM, event-driven architecture).
  • AWS Certifications (Cloud Practitioner or higher).

Apply for this position