Data Engineer (AWS) - 12-month FTC, Hybrid/London, Manchest

SmartSourcing Ltd
Belfast, United Kingdom
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 49K

Job location

Belfast, United Kingdom

Tech stack

Amazon Web Services (AWS)
Information Engineering
Web Scraping
Data Transformation
Python
Operational Databases
Data Processing
Infrastructure as Code (IaC)
Core Data
Machine Learning Operations
Software Version Control
Data Pipelines

Job description

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington, * Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.

  • Spend most of your time on hands-on technical work with support for learning and professional development.
  • Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.
  • Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.
  • Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.
  • Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
  • Apply Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
  • Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).
  • Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions.

Requirements

  • Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)
  • An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)
  • Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)
  • Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
  • Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
  • Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences

Benefits & conditions

One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension.

Apply for this position