Advanced Data Engineer - NHS

Spinwell Global Limited

Cardiff, UK

9 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Compensation

£64,854.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Airflow Microsoft Azure Big Data BigQuery Code Review Continuous Delivery Data Validation Information Engineering Data Integration Extract Transform Load (ETL) Data Profiling Data Security

+34 more

Data Warehousing Relational Databases DevOps Distributed Computing Environment Github R (Programming Language) Python (Programming Language) Meta-Data Management Cloud Services DataOps Cloudera Software Construction Software Engineering SQL Databases Technical Data Management Systems Workflow Management Systems Google Cloud Cloud Platform System Apache Spark Gitlab Git Information Technology Data Lineage Deployment Automation Production Code Data Analytics Data Management Hardware Infrastructure Api Design Code Restructuring Software Version Control Data Pipelines Docker Programming Languages

Requirements

Proficient in programming languages including R, Python and SQL; experience with R desirable.
Experience with relational databases and data warehousing.
Experience using Git-based version control systems (e.g. GitHub, GitLab, Azure DevOps) and collaborative software development practices.
Experience working within Agile delivery environments.
Experience designing and implementing cloud-native data solutions, preferably on Google Cloud Platform (GCP).
Experience migrating data platforms, pipelines and services from on-premises infrastructure to cloud environments.
Strong understanding of data modelling techniques, including conceptual, logical and physical data models.
Ability to design, build, test and maintain scalable data pipelines and data products.
Experience implementing CI/CD practices and automated deployment pipelines.
Experience using containerisation technologies such as Docker.
Experience designing and implementing ETL/ELT pipelines.
Experience with workflow orchestration tools (e.g. Airflow, Prefect, Dagster, Cloud Composer).
Experience working with large-scale datasets and distributed data processing technologies (e.g. Spark, Dataproc, BigQuery).
Experience monitoring, troubleshooting and optimising data pipelines and platform performance.
Understanding of DevOps and DataOps principles.
Experience working with APIs and data integration techniques.

Data Engineering and Architecture

Understanding of how data platforms integrate with wider organisational systems.
Experience with metadata management, data catalogues and data lineage tools.
Experience implementing data quality assessment, data profiling and data validation frameworks.

Governance and Security

Knowledge of information governance, data protection legislation (including UK GDPR and Data Protection Act 2018), and secure data handling practices.
Understanding of ethical considerations associated with the use of data and analytics.

Software Engineering Practices

Ability to design, develop, test, document and maintain production-quality code and data pipelines.
Experience conducting code reviews and applying software engineering best practices, including refactoring, testing and technical documentation.

Communication and Stakeholder Engagement

Ability to communicate effectively with technical and non-technical stakeholders and work collaboratively within multidisciplinary teams.
Ability to translate business requirements into technical data solutions and communicate technical concepts to diverse audiences.

Qualifications

Undergraduate degree in Computer Science or related technical field. Will also consider equivalent work experience
GCP Data Engineer / Architect certification desirable