> Markdown version of [/jobs/ext/61553-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/61553-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Arbuthnot Latham - **Location:** London, UK (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Data Analysis, Automation of Tests, Microsoft Azure, Business Systems, Software Quality, Cyber Security, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Data Security, Data Systems, DevOps, Python (Programming Language), Machine Learning, DataOps, Azure Data Factory, Technical Debt, Microsoft Fabric, Pyspark, Machine Learning Operations, Terraform, Data Pipelines - **Published:** May 28, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=44b2b75ed4a7e78d ## About the Role Do you have experience in Test automation?, Knowledge/Experience/Skills: * Strong communicator with both technical and non-technical communities * Experience of mentoring less-experienced developers * Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) * Highly developed python and data pipeline development knowledge, must include substantial PySpark experience * Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery * An understanding of Infrastructure as Code concepts (Demonstrable Terraform experience a plus) * Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance * Demonstrable experience of working within Agile Delivery projects * An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy, and information security Desirable: * Financial services experience * Awareness of data models in a Medalion Architecture * Experience building Semantic, Metric or Analytic models * Experience of building Machine Learning models * Any experience in MLOps or operationalising Machine Learning * Knowledge of Data Quality Frameworks in Python Qualifications: * Industry focused degree or equivalent working experience * Azure certifications are desirable Competencies: * Developing Others * Working Proactively * Creativity and Innovation * Problem Solving and Judgement * Communication and Confidence ## Description To develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with the Technical Lead for Data Engineering to develop innovative solutions that address business needs. As a Senior Data Engineer this person will also play a key role in the development of less experienced members of the team day to day. To place the interests of customers at the centre of all activities, act in a way that is consistent with achieving good outcomes for consumers; and to comply with the FCA and PRA's Conduct Rules., * The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform. * Support for the live platform day to day, resolving issues and meeting business requests as they arise within the team's SLAs. * The enablement and promotion of Data Engineering best practices and DevOps standards, ensuring good code quality and continuous compliance with all relevant standards. * Providing mentorship to junior engineers, helping them enhance their skills and knowledge. Promoting a collaborative environment to deliver and integrate end to end data solutions. * Identifying and addressing technical debt efficiently, continuously improving data processes and workflows for enhanced efficiency. * Working collaboratively with business stakeholders and operational teams to resolve issues and minimise the defect backlog. * Supporting estimation processes to aid in planning and portfolio management. * Keeping abreast of industry technical best practices and new trends, ensuring innovative development of systems to meet organisational immediate and future needs. Risk: * Responsible for managing risks inherent to the role by diligently observing internal policies and procedures. Key Interfaces: * Technical Lead for Data Engineering * Business System Owner * Head of Data Engineering * Application Specialists and Application Support * Information Security Manager * Data Privacy Manager * Infrastructure Engineers, At Arbuthnot Latham, we seek proactive individuals who embrace high standards and bring the energy needed to drive success. In return, you can thrive in a dynamic environment that values your innovative ideas and provides the stability and support for your personal and professional growth. Our human-scale ethos means that everyone is recognised as an individual, not just a number, creating a workplace where you truly belong and thrive. ## Related Videos - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)