Lead Software Engineer

We're building a modern, cloud-first data platform on Azure, and it's becoming a core part of how L&Q operates and makes decisions. As a Lead Software Engineer, you'll play a central role in that journey. This isn't just about maintaining pipelines. You'll shape the direction of the platform, influence how data is used across the organisation, and lead a team that delivers meaningful, visible impact.

You'll be able to influence decisions, introduce better ways of working, and raise the bar for engineering standards. At the same time, you'll support and grow a team of engineers, creating an environment where people feel trusted, challenged, and able to do their best work.

We use modern Azure technologies like Data Factory, Databricks, and Synapse, but just as important is how we work. We value collaboration, clear thinking, and people who take ownership. You'll work closely with architects, product owners, and stakeholders across the organisation, giving you real influence over both the platform and the outcomes it delivers.

If you're looking for a role where you can lead from the front, shape a growing platform, and see the impact of your work across the organisation, this is a great place to do it.

If this sounds like you, we would love for you to apply!

Your impact in the role:

Technical Leadership & Strategy

• Own the technical vision and roadmap for data engineering, ensuring it aligns with organisational strategy.
• Make informed decisions on tools, design patterns, and approaches, balancing short-term delivery with long-term sustainability.
• Lead the identification and resolution of technical debt, improving platform stability and scalability.
• Define and enforce engineering standards, including coding practices, testing, documentation, and security.
• Ensure solutions are designed with performance, reliability, and cost-efficiency in mind.

Delivery & Collaboration

• Oversee the design and delivery of scalable, automated data pipelines using Azure tools such as Data Factory, Databricks and Synapse
• Work closely with Solution Architects to shape and refine solution designs.
• Partner with Product Owners and stakeholders to translate business needs into clear, achievable technical outcomes.
• Manage delivery risks, remove blockers, and support the team in meeting commitments.
• Communicate progress, challenges, and decisions clearly to both technical and non-technical audiences.
• Encourage strong collaboration across Data, BI, Architecture, and wider technology teams.

Data & Platform Ownership

• Take end-to-end ownership of the data platform from ingestion to consumption.
• Ensure high standards of data quality, governance, and monitoring are embedded into all solutions.
• Drive improvements in data reliability, accessibility, and usability across the organisation.
• Champion a data-driven mindset, helping teams understand and trust the data they use.

Key relationships

• Data Engineering Team - Lead delivery, set standards and build capability.
• Solution Architects - Shape and refine platform and solution design.
• Product Owners - Translate business needs into scalable data solutions.
• Test Analysts - Ensure robust validation and quality assurance.
• BI & Reporting Teams - Enable clean, structured, and accessible data.
• Your work will directly influence how data is used across L&Q, improving decision-making, reducing manual effort, and enabling a more data-driven organisation.

• Relevant degree or equivalent experience in IT, Computer Science, Data Engineering, or a related field (preferred but not mandatory), * Proven experience leading or mentoring engineering teams in a data or cloud environment.
• Strong experience designing and delivering data solutions on Azure (Data Factory, Databricks, Synapse, Data Lake)
• Deep understanding of data warehousing, modelling, and architecture (Kimball or similar)
• Strong SQL and experience with relational databases such as SQL Server.
• Experience with Python, Scala, or PySpark for data processing.
• Experience building and optimising ETL/ELT pipelines at scale.
• Familiarity with DevOps practices, CI/CD pipelines, and agile delivery.

Leadership & Soft Skills:

• Able to build trust and strong working relationships across technical and business teams.
• Comfortable making decisions and taking ownership, even when dealing with ambiguity.
• Strong communicator who can explain complex ideas in a clear and practical way.
• Proactive mindset with the confidence to challenge constructively and suggest better approaches.
• Good at balancing delivery pressure with team wellbeing and sustainable ways of working.
• Strong organisational skills, with the ability to prioritise effectively and manage competing demands.
• A collaborative approach, with a focus on enabling others and getting the best out of the team.

Desirable:

• Exposure to PowerShell Scripting would be advantageous.
• Experience of working in an agile cross-functional delivery squad working with product owners, solution analysts, solution architects and test analysts.
• Awareness and understanding of key DevOps and cloud concepts including CI/CD, Iaas, PaaS and SaaS with enabled multi-disciplined, cross functional capabilities. Containerisation experience highly desirable.
• Experienced in designing and coordinating existing pilots, prototypes, or proof of concepts.
• Experience of the underlying technology to develop data integration layers and associated systems to provide repositories of information.
• Exposure to Semarchy (MDM Solution) would be advantageous.
• Exposure to THT Capita Open Housing would be advantageous.
• Exposure to NEC Housing Management Solution and PL/SQL would be advantageous.
• Exposure to Total Mobile, Total Repairs and Total Connect Repairs, Management Solution would be advantageous.

Benefits include: Excellent pension plan (up to 6% double contribution), 28 days Annual Leave rising to 31 days with length of service + Bank Holidays, Westfield Health Cash Plan, non-contributory life assurance, up to 21 hours volunteering paid days, lifestyle benefits, Employee Assistance Programme and many more ...

We're one of the UK's leading housing associations and developers. We were founded on a simple belief: high quality housing is vital for people's health, happiness and security. Everyone deserves a quality home that gives them the chance to live a better life. 250,000 people call our properties 'home', and we're proud to serve diverse communities across London, the South East and North West of England. People are at the heart of our business and our success depends on employing the best people and getting the best from them. The foundation of everything that we are is built on our corporate values and behavioural framework , which outlines our core expectations and should be demonstrated at all times, and all levels, when representing L&Q. At L&Q, we know that diversity and inclusion make us stronger - and they're at the heart of everything we do. When we recruit, we look at what really matters: your skills, experience, and potential. We're proud to be recognised for creating an inclusive workplace. We're a Disability Confident Leader (Level 3) and we've introduced our own Recruitment Advocate scheme to make sure every step of our hiring process is fair, transparent, and consistent. It's all part of our commitment to ending discrimination and making L&Q a place where everyone feels welcome. Find out more here . Sustainability is also at the heart of what we do. We recognise the responsibility we hold as one of the UK's largest housing associations.