Data Engineer AWS

Data Engineer (AWS) 12-month FTC, Hybrid/London, Manchester, Cardiff, Belfast, Edinburgh or Darlington, This is an exciting opportunity to apply your data engineering skills for the public good in the Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts.

What you’ll do:

• Join a multidisciplinary team of data engineers and data scientists working on the data processing and analytical capabilities.

• Spend most of your time on hands-on technical work with support for learning and professional development.

• Design, build and maintain scalable data pipelines to ingest, transform and process large and complex data sources. This can include automated web scraping and bulk data acquisition workflows.

• Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible and analysis ready.

• Build and maintain containerised data and analytics applications (such as dashboards and data tools) that run scalable workloads.

• Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.

• Apply Infrastructure as Code (IaC) where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.

• Design and maintain systems for data version control and reproducible machine learning workflows (MLOps).

• Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data-solutions.

• Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment. (Lead Criteria)

• An undergraduate degree in a quantitative subject OR equivalent experience working in data engineering, data science, or development in the cloud. (Lead Criteria)

• Experience writing production-quality Python code to work with complex or messy datasets. (Lead Criteria)

• Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.

• Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.

• Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences

SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all

One of our government clients is recruiting for a Data Engineer to join them on a 12-month fixed term contract (FTC). They are offering £49,400 per annum plus excellent pension.