Data Engineer - AWS / ETL / Python

Gleeson Recruitment Ltd
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 80K

Job location

Tech stack

Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Profiling
Data as a Services
Information Engineering
Data Governance
ETL
Data Mining
Data Structures
Database Queries
Python
PostgreSQL
MySQL
Technical Data Management Systems
Data Processing
Data Ingestion
Indexer
Amazon Web Services (AWS)
Integration Frameworks
Data Management
REST
Api Management
Serverless Computing

Job description

This role is ideal for someone who enjoys building robust data platforms from the ground up and working across large-scale ETL, cloud-native services, API integrations, and data governance initiatives., * Design, build and maintain scalable ETL pipelines and data ingestion processes across a wide variety of structured and unstructured data sources

  • Develop data extraction solutions using RESTful APIs and modern integration techniques
  • Work extensively with AWS-native data and analytics services including Glue, Athena, DataBrew, Lake Formation, EMR, MSK and Kinesis
  • Implement data quality, profiling and validation processes to ensure integrity, accuracy and completeness of datasets
  • Contribute within an Agile delivery environment, supporting the design, development and deployment of Java and REST-based domain data services
  • Support scalable, high-performance systems aligned to modern MACH architectural principles
  • Ensure best practice around data governance, security, privacy and compliance standards
  • Develop and optimise data processing solutions using Python and Java
  • Deliver high-performing, scalable solutions capable of supporting growing business demand

Requirements

  • 5+ years' experience within Data Engineering or related development roles
  • Strong SQL development and optimisation experience
  • Hands-on experience across AWS technologies including S3, Redshift, RDS, MySQL and PostgreSQL
  • Strong understanding of data modelling, data structures, indexing, normalisation and reporting principles
  • Experience tuning and optimising complex queries and large datasets
  • Ability to translate business requirements into scalable technical data solutions
  • Experience implementing and maintaining data governance and data standards
  • Strong analytical and problem-solving capability with a passion for learning new technologies
  • Excellent communication and stakeholder engagement skills, with the ability to present technical concepts clearly to both technical and non-technical audiences

This is an excellent opportunity to join a forward-thinking team working on modern cloud-based data platforms and enterprise-scale transformation projects.

Apply for this position