> Markdown version of [/jobs/ext/2838446-cloud-data-engineer-cloud-python](https://www.wearedevelopers.com/jobs/ext/2838446-cloud-data-engineer-cloud-python). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Cloud Data Engineer - Cloud, Python - **Company:** SmartSourcing Ltd - **Location:** Edinburgh, UK - **Experience:** Experienced - **Salary:** £54,150.0 - **Contract:** Temporary contract - **Skills:** Clean Code Principles, Amazon Web Services, Big Data, Cloud Computing, Cloud Database, Cloud Engineering, Information Engineering, Web Scraping, Data Infrastructure, Data Transformation, Data Systems, Python (Programming Language), Operational Databases, DataOps, Infrastructure as Code (IaC), Machine Learning Operations, Software Version Control, Data Pipelines - **Published:** September 11, 2026 - **Apply:** https://www.totaljobs.com/job/data-engineer-python/smartsourcing-plc-job107967782 ## About the Role We're looking for a Data or Software Engineer who has experience delivering production data solutions and enjoys solving complex data problems., * Experience delivering production data pipelines end-to-end, including design, development, implementation and operational maintenance in a cloud environment. * Experience writing production-quality Python to work with complex, messy or large datasets (Minimum 2 years) * An undergraduate degree in a quantitative subject, or equivalent professional experience in data engineering, data science or cloud development. * A strong understanding of data engineering best practices, including data modelling, transformation, validation, testing. * Experience working collaboratively within multidisciplinary teams. * Strong communication skills, with the ability to explain technical work clearly and engage with non-technical audiences., If you're an experienced Data or Software Engineer with strong Python and Cloud experience and want to use your skills in a role with genuine public impact, we'd love to hear from you. ## Description ·As a Data Engineer, you'll help build and operate reliable, scalable data infrastructure and pipelines across an AWS cloud environment. Producing high-quality code in Python (and other languages, as needed). Your responsibilities will include: * Design, build and maintain scalable data pipelines to ingest, transform and process large and complex datasets. * Develop automated web scraping and bulk data acquisition workflows. * Implement data transformation, validation, testing and quality controls to ensure datasets are reliable, reproducible and ready for analysis. * Build and maintain containerised data and analytics applications, including dashboards and data tools. * Implement and manage workflow orchestration and scheduling to ensure data pipelines and jobs are observable, reliable and maintainable. * Apply Infrastructure as Code (IaC) to support data pipelines and processing workflows on AWS. * Design and maintain systems for data version control and reproducible machine learning workflows (MLOps). * Work closely with data scientists, analysts and engineers to translate analytical and operational requirements into effective data solutions. * Contribute to a collaborative, multidisciplinary environment and share knowledge with colleagues. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)