> Markdown version of [/jobs/ext/2063195-lead-software-engineer-data-platform](https://www.wearedevelopers.com/jobs/ext/2063195-lead-software-engineer-data-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Software Engineer - Data Platform - **Company:** London Construction Jobs - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Apache HTTP Server, Software Quality, Code Review, Databases, Continuous Integration, Data Infrastructure, Data Systems, Relational Databases, DevOps, Distributed Computing Environment, Python (Programming Language), PostgreSQL, Modular Design, Software Engineering, Apache Spark, Build Management, AWS Data Analytics, Data Management, Functional Programming, Code Restructuring, Data Pipelines, Serverless Computing - **Published:** August 15, 2026 - **Apply:** https://www.totaljobs.com/job/lead-software-engineer/london-stock-exchange-job107848606 ## About the Role * Software engineers first, with experience working on data platforms or data-intensive systems * Comfortable building production-grade systems using Python, databases, and modern engineering practices * Able to make sound architectural decisions, balancing trade-offs pragmatically * Confident engaging stakeholders and shaping solutions from ambiguous requirements * Experienced in improving engineering standards and supporting other engineers * Hands-on technical leaders, not purely managerial or tool-specific specialists We value strong fundamentals and adaptability over experience with any specific tools. Nice to have * Experience with Apache Spark or distributed data processing * Familiarity with AWS data services * Exposure to modern data architectures (lakehouse, Iceberg, etc.) * Interest in financial markets, indices, or data-driven products, If you're a strong software engineer who enjoys working in data and wants to help shape both systems and standards - we'd love to hear from you. ## Description You'll design and build scalable data systems using Python, Spark and AWS, while also shaping engineering standards, guiding other engineers, and helping the team make sound technical and architectural decisions. This is an opportunity to influence how the platform is built, not just contribute to it. What makes this role different This isn't about maintaining pipelines or working within a fixed framework. We're looking for someone who will: * Bring strong software engineering fundamentals into a data platform environment * Improve how engineering is done, not just what is delivered * Work closely with stakeholders to shape solutions, not just implement requirements * Balance hands-on delivery with technical leadership and influence If you enjoy solving real problems, challenging assumptions, and building systems properly - this is the role for you. WHAT YOU'LL BE DOING: Build & deliver * Design and develop scalable, testable data pipelines using Python and Apache Spark * Build and orchestrate data workflows using AWS services (e.g. Glue, EMR Serverless, Lambda, S3) * Contribute to the evolution of a modern lakehouse architecture (e.g. Apache Iceberg) * Work with relational databases, particularly PostgreSQL / Aurora PostgreSQL Drive engineering excellence * Apply and champion strong software engineering practices: testing, CI/CD, modular design, refactoring and code quality * Improve the maintainability, reliability and scalability of systems * Identify and address weak engineering practices across the team Lead technically & influence direction * Lead technical discussions and contribute to architecture decisions * Translate business problems into practical, well-designed technical solutions * Challenge requirements where needed and help define what should (and shouldn't) be built * Coach and support junior and mid-level engineers through code reviews and guidance * Help raise the overall engineering bar across the team Seniority & impact This is a senior individual contributor role with a strong technical leadership component. * ~75% hands-on engineering * ~25% technical leadership, coaching and stakeholder engagement While not a pure people-management role, you may support a small number of engineers and will be expected to: * Set direction * Influence standards * Lead from the front We are looking for a hands-on technical leader, not a delivery manager. ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [Building Systems that Last](https://www.wearedevelopers.com/videos/1389-building-systems-that-last) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)