> Markdown version of [/jobs/ext/2809083-data-engineer](https://www.wearedevelopers.com/jobs/ext/2809083-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # data engineer. - **Company:** Randstad UK - **Location:** Cardiff, UK - **Salary:** £33,280.0 - £39,520.0 - **Contract:** Temporary to permanent - **Skills:** Application Programming Interfaces (APIs), Airflow, Unit Testing, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Code Review, Continuous Integration, Data Architecture, Data Integration, Extract Transform Load (ETL), Data Security, Data Warehousing, Relational Databases, DevOps, Distributed Systems, Github, R (Programming Language), Revision Control Systems, Python (Programming Language), Meta-Data Management, Metadata Repositories, Cloud Services, DataOps, Cloudera, SQL Databases, Workflow Management Systems, Enterprise Data Management, Data Processing, Google Cloud, Delivery Pipeline, Apache Spark, Gitlab, Git, Containerization, Information Technology, Data Lineage, Production Code, Data Management, Code Restructuring, Data Pipelines, Docker - **Published:** September 9, 2026 - **Apply:** https://www.randstad.co.uk/jobs/data-engineer_cardiff_47404191/ ## About the Role * Strong proficiency in programming languages such as Python, SQL, and R (experience with R is desirable). * Proven experience working with relational database management systems and data warehousing architectures. * Hands-on expertise using Git-based version control tools (e.g., GitHub, GitLab, Azure DevOps) within collaborative software development environments. * Demonstrated experience operating effectively within Agile delivery frameworks. * Background in designing and deploying cloud-native data architectures, with a preference for Google Cloud Platform (GCP). * Proven track record of migrating legacy on-premises data platforms, pipelines, and services to cloud infrastructure. * Solid grasp of data modeling concepts across conceptual, logical, and physical levels. * Proven capability to design, construct, test, and maintain robust, scalable data pipelines and data products. * Experience establishing CI/CD automation and streamlined deployment workflows. * Experience leveraging container technologies such as Docker. * Skilled in architecting and implementing robust ETL and ELT data pipelines. * Familiarity with modern workflow orchestration frameworks (e.g., Airflow, Cloud Composer, Prefect, Dagster). * Experience processing large-scale datasets using distributed computing engines (e.g., BigQuery, Spark, Dataproc). * Proficiency in monitoring, troubleshooting, and optimizing platform performance and data pipelines. * Solid understanding of DataOps and DevOps methodologies. * Experience integrating systems via APIs and standard data integration techniques. Data Architecture and Engineering Practices * Understanding of how enterprise data platforms interoperate with broader organizational systems. * Practical experience utilizing metadata management solutions, data lineage tools, and data catalogs. * Experience implementing comprehensive data quality profiling, assessment, and validation frameworks. * Demonstrated capability to design, develop, test, document, and support production-ready code and end-to-end data pipelines. * Adept at leading code reviews and applying software engineering best practices, including unit testing, refactoring, and comprehensive technical documentation. Governance, Compliance and Ethics * In-depth understanding of information governance, data protection laws (including the Data Protection Act 2018 and UK GDPR), and secure data management standards. * Awareness of ethical standards and considerations related to data processing and analytics. Communication and Stakeholder Collaboration * Strong interpersonal and communication skills for working effectively across cross-functional teams and engaging both technical and non-technical stakeholders. * Proven skill in translating complex business requirements into scalable technical solutions and explaining technical details to non-technical audiences. Qualifications & Experience * Bachelor's degree in Computer Science or a related quantitative field, or equivalent practical industry experience. * Professional certification as a GCP Data Engineer or Cloud Architect is highly desirable., * written communication ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)