> Markdown version of [/jobs/ext/2892557-data-engineer](https://www.wearedevelopers.com/jobs/ext/2892557-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Anson McCade - **Location:** London, UK - **Experience:** Starter - **Contract:** Permanent contract - **Skills:** Clean Code Principles, Artificial Intelligence, Amazon Web Services, Automation of Tests, Microsoft Azure, Big Data, Continuous Integration, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Python (Programming Language), Machine Learning, NoSQL, Scrum Methodology, SQL Databases, Systems Architecture, Test-Driven Development (TDD), Apache Spark, Generative AI, Build Management, Data Lakes, Kubernetes, Infrastructure Automation Frameworks, Performance Monitor, Operational Systems, Video Streaming, Terraform, Software Version Control, Data Pipelines, Docker - **Published:** September 14, 2026 - **Apply:** https://www.totaljobs.com/job/data-engineer/anson-mccade-job107977148 ## About the Role We are looking for experience in some of the following: * Strong Python skills. * AWS, Azure or GCP. * Data warehousing and data lake architectures. * ETL/ELT, SQL and NoSQL databases. * Spark, Kinesis or other distributed/streaming technologies. * CI/CD, TDD and version control. * Docker, Kubernetes and Infrastructure as Code such as Terraform. * Data modelling and system architecture. * Experience delivering an AI/ML project. * Strong communication, problem-solving and stakeholder management skills. * Team leadership and decision-making experience for senior-level roles. Consultancy experience is beneficial but not essential; client-facing experience from other environments will also be considered. ## Description * Develop and deploy machine learning models into production and monitor performance. * Design and build scalable ETL/ELT pipelines using batch and streaming technologies. * Work with large-scale datasets, data modelling and data transformation. * Connect operational systems with analytics and BI platforms. * Identify and resolve data quality and pipeline issues. * Develop high-quality code, documentation and automated tests. * Work within an Agile/Scrum environment. * Collaborate with technical teams, clients and stakeholders. * Keep up to date with emerging technologies, particularly Generative AI. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)