> Markdown version of [/jobs/ext/2311700-lead-software-engineer](https://www.wearedevelopers.com/jobs/ext/2311700-lead-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Software Engineer - **Company:** Ellipse - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Big Data, Cloud Computing, Continuous Integration, Information Engineering, Data Integrity, Extract Transform Load (ETL), Relational Databases, Cursor (Graphical User Interface Elements), Database Design, DevOps, Disaster Recovery, Distributed Data Store, Graph Database, Identity and Access Management, Python (Programming Language), NoSQL, Performance Tuning, Release Management, Cloud Services, SQL Databases, Data Logging, Data Ingestion, ReactJS, System Availability, Delivery Pipeline, Amazon Virtual Private Cloud (VPC), Cloudformation, Amazon Relational Database Service, Kubernetes, Infrastructure Automation Frameworks, Deployment Automation, Data Management, Functional Programming, Cloudwatch, Terraform, Data Pipelines, Docker - **Published:** August 30, 2026 - **Apply:** https://www.collegerecruiter.com/job/2825796084-lead-software-engineer ## About the Role Data Engineering and Platform Developement * At least 5 years of commercial experience building scalable data pipelines, data platforms, and cloud-native solutions using Python. SQL & AWS Services. * Experience designing and developing ETL/ELT processes, data ingestion frameworks, and large-scale data processing solutions. * Strong understanding of distributed data systems, data modelling, data quality, and performance optimisation. * Strong hands-on experience with AWS services including EC2, S3, RDS, Lambda, VPC, IAM, CloudWatch, and related cloud services. * Experience designing, deploying, and managing secure, scalable, and highly available cloud infrastructure. * Knowledge of infrastructure automation and Infrastructure as Code using EKS (Terraform), CloudFormation, or similar tools. * Strong understanding of networking, security, monitoring, backup, and disaster recovery practices. Databases&Data Management * Solid experience with relational databases, cloud data platforms, and data workflows involving database design, optimisation, performance tuning, and management using RDS/RDBMS and related technologies. * Understanding of metrics generation, data integrity, data migrations, and lifecycle management. * Experience managing large datasets and supporting analytical & operational workloads. Devops & Platform Operations * Experience in containerisation using Docker, Orchestration and scaling with Kubernetes. * Experience building and maintaining automated deployment pipelines and CI/CD workflows. * Experience implementing monitoring, alerting, logging, and operational support processes. * Strong focus on platform reliability, business continuity, support and operational resilience. Leadership and Engineering Practices * Experience leading engineering teams, mentoring engineers, conducting code and design reviews, and driving technical best practices. * Experience designing scalable, maintainable, secure, and production-ready platforms. * Familiarity with best practices around reliability, observability, security, and performance optimisation. * Knowledge of Horse Racing as a Sport, Rules, major Events & its Data would be highly advantageous in the selection process. * Understanding of UI tech stack like React and related technologies. * Exposure to NoSQL, graph databases, and vector databases. * Understanding of AI native engineering processes and usage of AI tools like Cursor or Gemini to develop workflows. ## Description * Lead and oversee the design, development, and operation of our data engineering platforms, AWS infrastructure, and cloud-based product offerings. * Work closely with Product teams, understand business requirements and translate them into scalable data, cloud, and infrastructure solutions. * Develop and implement strategies for ingesting, processing, storing, and delivering data from multiple sources in a secure, reliable, and efficient manner. * Lead and collaborate with Engineering, Data Science, UX and DevOps teams to manage cloud infrastructure, design analysis, deployment pipelines, CI/CD processes, platform reliability, and release management frameworks. * Drive technical delivery, team coordination, and business continuity initiatives, ensuring high availability, disaster recovery readiness, operational resilience, and platform stability. * Be a key contributor to the ideation, planning, execution, and validation of existing and new platform capabilities, with a focus on improving engineering processes, infrastructure automation, data quality, and operational excellence. * Ability to lead and support key operational activities during critical Horse Racing events, ensuring system availability, performance, incident response, and business-as-usual (BAU) continuity under high-demand conditions. ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)