> Markdown version of [/jobs/ext/2790850-data-engineer](https://www.wearedevelopers.com/jobs/ext/2790850-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** gb Robert Walters - **Location:** Swansea, UK (Remote available) - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Airflow, Microsoft Azure, Big Data, BigQuery, Profiling, Code Review, Computer Programming, Continuous Integration, Data as a Services, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Data Warehousing, Relational Databases, DevOps, Distributed Computing Environment, Github, Python (Programming Language), Meta-Data Management, Performance Tuning, DataOps, Cloudera, Software Construction, Software Engineering, SQL Databases, Systems Integration, Workflow Management Systems, Google Cloud, Apache Spark, Gitlab, Git, Containerization, Information Technology, Deployment Automation, Data Analytics, Data Management, Software Version Control, Data Pipelines, Docker - **Published:** September 8, 2026 - **Apply:** https://www.totaljobs.com/job/data-engineer/robert-walters-job107952915 ## About the Role * Strong programming skills in Python and SQL (R experience desirable). * Experience with relational databases and data warehousing technologies. * Proven experience building and supporting production-grade ETL/ELT pipelines. * Strong understanding of data modelling principles, including conceptual, logical and physical models. * Experience with Git-based version control systems such as GitHub, GitLab or Azure DevOps. * Experience working in Agile delivery environments. * Experience with cloud platforms, preferably Google Cloud Platform (GCP). * Experience with workflow orchestration tools including Airflow, Prefect, Dagster or Cloud Composer. * Knowledge of containerisation technologies such as Docker. * Experience working with large-scale datasets and distributed processing technologies such as Spark, Dataproc and BigQuery. * Understanding of DevOps and DataOps principles. * Experience integrating systems through APIs and data services. * Strong troubleshooting and performance optimisation skills. Desirable Skills * Experience with metadata management, data catalogues and lineage tools. * Experience implementing data quality, profiling and validation frameworks. * GCP Data Engineer and/or GCP Architect certification. * Experience within highly regulated or data-driven environments., * Degree in Computer Science, Data Engineering, Software Engineering or a related technical discipline, or equivalent commercial experience. ## Description * Design, build, test and maintain scalable data pipelines and data products. * Develop and optimise ETL/ELT processes for integrating data from multiple sources. * Design and implement cloud-native data solutions, preferably within Google Cloud Platform (GCP). * Support migration of data platforms, pipelines and services from on-premises environments to the cloud. * Develop and maintain data models, data warehouses and data integration solutions. * Implement CI/CD processes and automated deployment pipelines. * Use workflow orchestration tools such as Airflow, Prefect, Dagster or Cloud Composer. * Monitor, troubleshoot and optimise platform and pipeline performance. * Collaborate with technical and non-technical stakeholders to translate business requirements into robust technical solutions. * Contribute to code reviews, testing, technical documentation and software engineering best practices. * Ensure compliance with data governance, security and regulatory requirements, including GDPR. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)