Data Engineer - AWS / ETL / Python
Gleeson Recruitment Ltd
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 80KJob location
Tech stack
Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Profiling
Data as a Services
Information Engineering
Data Governance
ETL
Data Mining
Data Structures
Database Queries
Python
PostgreSQL
MySQL
Technical Data Management Systems
Data Processing
Data Ingestion
Indexer
Amazon Web Services (AWS)
Integration Frameworks
Data Management
REST
Api Management
Serverless Computing
Job description
This role is ideal for someone who enjoys building robust data platforms from the ground up and working across large-scale ETL, cloud-native services, API integrations, and data governance initiatives., * Design, build and maintain scalable ETL pipelines and data ingestion processes across a wide variety of structured and unstructured data sources
- Develop data extraction solutions using RESTful APIs and modern integration techniques
- Work extensively with AWS-native data and analytics services including Glue, Athena, DataBrew, Lake Formation, EMR, MSK and Kinesis
- Implement data quality, profiling and validation processes to ensure integrity, accuracy and completeness of datasets
- Contribute within an Agile delivery environment, supporting the design, development and deployment of Java and REST-based domain data services
- Support scalable, high-performance systems aligned to modern MACH architectural principles
- Ensure best practice around data governance, security, privacy and compliance standards
- Develop and optimise data processing solutions using Python and Java
- Deliver high-performing, scalable solutions capable of supporting growing business demand
Requirements
- 5+ years' experience within Data Engineering or related development roles
- Strong SQL development and optimisation experience
- Hands-on experience across AWS technologies including S3, Redshift, RDS, MySQL and PostgreSQL
- Strong understanding of data modelling, data structures, indexing, normalisation and reporting principles
- Experience tuning and optimising complex queries and large datasets
- Ability to translate business requirements into scalable technical data solutions
- Experience implementing and maintaining data governance and data standards
- Strong analytical and problem-solving capability with a passion for learning new technologies
- Excellent communication and stakeholder engagement skills, with the ability to present technical concepts clearly to both technical and non-technical audiences
This is an excellent opportunity to join a forward-thinking team working on modern cloud-based data platforms and enterprise-scale transformation projects.