Data Engineer - PySpark / Python

Essential Consulting
Sheffield, United Kingdom
4 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 156K

Job location

Sheffield, United Kingdom

Tech stack

Big Data
Continuous Integration
Information Engineering
ETL
Data Systems
Data Warehousing
Distributed Data Store
Distributed Systems
Python
Ansible
Standard Sql
SAS (Software)
Technical Data Management Systems
Cloud Platform System
Sql Optimization
PySpark
Data Management
Data Pipelines
Jenkins

Job description

We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme.

This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment., * Design, develop and maintain scalable data pipelines and ETL processes

  • Develop robust solutions using Python, PySpark and SQL
  • Work with large-scale datasets in distributed data environments
  • Contribute to data modelling and data warehousing initiatives
  • Support CI/CD and automation practices across the data engineering lifecycle
  • Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
  • Ensure data quality, performance and reliability across data platforms

Requirements

  • Strong commercial experience in Data Engineering
  • Excellent Python and PySpark development skills
  • Advanced SQL knowledge
  • Experience building and maintaining data pipelines and ETL solutions
  • Good understanding of data warehousing and data modelling concepts
  • Experience working within large-scale enterprise environments

Desirable Skills

  • CI/CD experience
  • Jenkins
  • Ansible
  • SAS
  • Experience working with distributed systems and cloud-based data platforms
  • Financial services or banking sector experience

The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.

Apply for this position