Data Engineer

Sparta Global Limited
Blackpool, United Kingdom
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Blackpool, United Kingdom

Tech stack

Airflow
Big Data
Google BigQuery
Data Architecture
Data Integrity
ETL
Data Warehousing
Database Design
Fault Tolerance
Python
Data Streaming
Data Processing
Sql Optimization
Snowflake
Stream Processing
Data Pipelines
Redshift

Job description

Designing, building, and optimising scalable data pipelines that support analytics, reporting, and operational use cases. You will play a key role in shaping the organisation's data architecture, ensuring data is reliable, accessible, and performant across multiple systems, while helping to manage a team of junior data engineers., * Mentor junior data engineers and support their technical development, while promoting best practices in their coding, testing, and deployment.

  • Design and implement robust, scalable data pipelines (batch and real-time) to ingest, transform, and load data from multiple sources
  • Build and maintain ETL/ELT processes to support analytics and BI platforms
  • Identify and reuse existing data flows where appropriate to improve efficiency and reduce duplication
  • Ensure data pipelines are fault-tolerant, observable, and maintainable
  • Lead the development of streaming data solutions for real-time data processing
  • Design and implement data models optimised for analytics workloads (e.g. star/snowflake schemas)
  • Work with modern data warehouse platforms (e.g. Snowflake, BigQuery, Redshift or similar)
  • Identify bottlenecks and implement improvements across storage, compute, and transformation layers
  • Ensure efficient handling of large-scale datasets
  • Lead work on database design, optimisation, and maintenance
  • Ensure data integrity, security, and governance standards are met

Requirements

  • Previous experience mentoring junior engineers is a must-have
  • Strong experience with Python or Scala for data processing
  • Advanced SQL skills with experience handling large datasets
  • Experience building and maintaining ETL/ELT pipelines in production environments
  • Hands-on experience with workflow orchestration tools (e.g. Airflow)

Apply for this position