Data Engineer (AWS/Python/Pyspark)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
- Design, develop and maintain data pipelines and ETL processes
- Build scalable data migration and transformation solutions
- Ensure data quality, validation and integrity throughout the migration process
- Work with cloud technologies to deliver secure, reliable data solutions
- Collaborate with architects, developers and stakeholders to deliver successful project outcomes
- Support testing, deployment and ongoing optimisation
Requirements
We’re looking for experience with:
- Python and SQL
- ETL/data migration and transformation
- AWS cloud services
- Data modelling, validation and quality assurance
- Relational databases and large-scale datasets
- Strong analytical and problem-solving skills
Experience working with healthcare or other highly regulated environments would be beneficial but isn’t essential.
About the company
We’re looking for an experienced Data Engineer to join a high-profile digital transformation programme delivering modern cloud-based data solutions for the UK public sector.
Working within a talented technical team, you’ll design and build scalable data pipelines, support complex data migration activities and help deliver secure, high-quality data solutions using modern AWS technologies.
You must have active SC clearance for this role., Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.
Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerboard.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know
Where To Find Software Engineering Jobs