Data Engineer

EG On The Move
Blackburn, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Shift work
Languages
English
Experience level
Intermediate
Compensation
£ 52K

Job location

Blackburn, United Kingdom

Tech stack

API
Automation of Tests
Azure
Cloud Computing
Code Review
Continuous Integration
Data Architecture
Information Engineering
Data Structures
DevOps
Python
Meta-Data Management
Azure
SQL Databases
Unstructured Data
Management of Software Versions
Azure
GIT
Data Lake
PySpark
Azure
Data Pipelines
Databricks

Job description

We are looking for a driven data engineer who can take ownership of developing our Azure-based data platform. You'll build end-to-end ingestion, transformation, and modelling pipelines that deliver reliable, high-quality data for analytics and decision-making. You'll work closely with engineers, analysts, and stakeholders to solve real data engineering challenges and deliver scalable, cloud-native solutions across the business. This is a hands-on role with plenty of responsibility, ideal for someone who wants to deepen their cloud skills and contribute to an evolving Azure data environment. What you'll do:

  • Designing, building, and optimising scalable Azure data pipelines using ADF, Databricks, Data Lake, Synapse, Event Hub, and Logic Apps.
  • Supporting the migration of existing Synapse workloads into a modern Azure Medallion architecture.
  • Ingesting structured, semi-structured, and unstructured data from a wide range of sources, building metadata-driven and reusable ingestion frameworks (ADF, Python).
  • Developing robust transformation pipelines in Databricks (PySpark/SQL), using Delta Lake for incremental loading, versioning, and schema evolution.
  • Embedding strong engineering standards including data quality, validation, lineage, error handling, and automated testing.
  • Collaborating with senior engineers, analysts, business partners, and external providers to define integration requirements and deliver reliable, scalable solutions.
  • Contributing to data modelling, metadata management, and consistent data structures that support analytics and reporting.
  • Working within agile delivery cycles participating in sprints, code reviews, CI/CD deployments, and continuous improvement of pipelines.
  • Maintaining and troubleshooting existing data processes to ensure reliability, performance, and cost efficiency.
  • Documenting pipelines, standards, and processes clearly for both technical and non-technical audiences.

Requirements

Do you have experience in SQL?, * 3+ years' experience in data engineering within a cloud or enterprise environment.

  • Hands-on expertise with Azure Data Factory, Databricks, and Azure Data Lake.
  • Strong Python, PySpark, and advanced SQL skills for transformation, automation, and performance optimisation.
  • Good understanding of Medallion architecture, Delta Lake, and scalable cloud data design.
  • Experience integrating data from APIs, cloud platforms, and file-based systems.
  • Familiarity with Git, DevOps practices, and CI/CD pipelines for data engineering deployments.
  • Knowledge of data testing, validation, and quality frameworks.

Benefits & conditions

Pulled from the full job description

  • Employee discount
  • Life insurance
  • Employee assistance programme
  • Free parking
  • Company pension
  • Flexible schedule
  • On-site parking, Whether you're looking to build a long-term career as we expand across the UK or seeking a job with top benefits, we've got you covered:
  • Bonus Incentive
  • Flexible hours - start anytime between 8-10 AM and work your 8-hour day your way
  • 15% Food to Go Discounts - Greggs, Starbucks, Subway, Popeyes, Chaiiwala & Sbarro
  • Free on-Site Parking
  • Waterside Café - Freshly prepared meals everyday
  • On site Prayer and Ablution Facilities
  • Employee Assistance program
  • Support for mental and financial wellbeing
  • Life Insurance
  • Legal Assistance
  • Retail Discounts
  • Learning & Development Opportunities
  • Salary Sacrifice Pension

Apply for this position