> Markdown version of [/jobs/ext/2909941-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2909941-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** ITV Consumer Limited 2024 - **Location:** London, UK - **Experience:** Expert - **Salary:** £85,000.0 - £100,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), BigQuery, Cloud Computing, Cloud Engineering, Code Review, DevOps, Distributed Data Store, Data Flow Control, High-Level Architecture, Python (Programming Language), Operational Data Store, Prometheus, Software Engineering, Data Streaming, Data Ingestion, Grafana, IT Architecture, Technical Debt, Backend, Event Driven Architecture, Kubernetes, Google Cloud Functions, Performance Monitor, Real Time Data, Terraform, Data Pipelines, Microservices - **Published:** September 15, 2026 - **Apply:** https://fa-euup-saasfaprod1.fa.ocs.oraclecloud.com/hcmUI/CandidateExperience/en/sites/CX/jobs/preview/1158/apply/email?mode=location&utm_campaign=ITVCareers&utm_medium=third+party&utm_source=ITVCareers&utm_content=ITVCareers ## About the Role * Polyglot Engineering Literacy: Strong backend development capability with a willingness to design, challenge, and review logic across Python and Go, with Java or Scala as valuable secondaries. * Cloud Native Expertise: Extensive experience with the GCP Stack (GKE, Pub/Sub, BigQuery, Dataflow, Cloud Functions) and event-driven architectures. * Infrastructure as Code: Deep understanding of automated infrastructure deployment using Terraform and container orchestration via Kubernetes. * Systems Thinking: Ability to map out complex, multi-project data flows and microservices environments, ensuring modularity and resilience. * Strategic Communication: Ability to articulate abstract technical designs clearly to both technical engineers and non-technical stakeholders. * Nice to Have: Familiarity with ESG and/or Sustainable Software Engineering principles to optimise cloud compute efficiency, or experience shifting data capabilities to "Edge" environments., * Demonstrable experience leading technical system designs and defining architecture in a high-scale, cloud-native operational data environment. * Proven hands-on engineering experience handling high-throughput, real-time data ingestion and processing pipelines. * Experience mentoring engineers, managing technical debt, and steering code-first DevOps cultures. ## Description As a Lead Data Engineer, you operate as a technical orchestrator and a guardian of excellence across our real-time operational data ecosystem. You are positioned at the critical intersection of high-level requirement analysis, distributed systems design, and hands-on delivery. You will balance deep data architecture with infrastructure architecture, bridging the gap between data pipelines and cloud-native container platforms. Your time will be balanced across three core pillars: * 40% High-Level Design & Architecture: Reviewing incoming business requirements, driving technical discussions, and mapping out scalable, distributed data architectures. * 40% Hands-On Engineering: Writing clean, testable code alongside the team, implementing core platform features, building reusable components and undertaking support requests. * 20% Mentorship & Technical Governance: Cultivating the engineering squad's capabilities, managing technical debt, and defining quality frameworks., * Technical Orchestration: Translate complex business roadmaps into high-level designs, defining the structures, components, and interactions of event-driven streaming solutions. * Data & Infrastructure Architecture: Architect high-throughput, real-time data ingestion pipelines while partnering with DevOps specialists to ensure alignment with cloud infrastructure frameworks. * People Leadership & Mentoring: Oversee the technical growth and motivation of the engineering squad, running code reviews, sharing knowledge, and embedding engineering best practices. * Delivery Flow: Partner with the Engineering Manager and Product Managers to refine requirements into technical tasks, ensuring iterative delivery and a lean backlog. * Operational Excellence & SLA Management: Guard platform reliability against extreme traffic loads, establishing a proactive monitoring strategy via Grafana/Prometheus. * Escalation & Support: Participate in the team's weekly support rotation as a high-level escalation point, leading Root Cause Analysis when critical operational challenges arise. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)