> Markdown version of [/jobs/ext/1912758-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1912758-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Livescore Group Limited - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Batch Processing, Big Data, BigTable, BigQuery, Cloud Database, Cloud Storage, Databases, Information Engineering, Data Infrastructure, Data Integration, Data Integrity, Data Security, Data Systems, Data Warehousing, Data Flow Control, Python (Programming Language), Performance Tuning, Google Cloud, Data Storage Technologies, Sql Optimization, Reliability of Systems, Data Strategy, Data Management, Terraform, Data Pipelines, Docker - **Published:** August 4, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=596813255416040a ## About the Role * Significant experience in data engineering or data warehousing with large-scale, complex datasets. * Advanced SQL and Python skills, with experience using AI-assisted development tools appropriately. * Strong knowledge of data-modelling techniques. * Deep experience with cloud data services and technologies, ideally within the GCP ecosystem, such as Dataflow, Pub/Sub, BigQuery or Vertex AI. * Proven experience designing and implementing robust ELT pipelines, including real-time and large-scale batch processing. * Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform. * Experience with Airflow environment management and Docker. * Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for use within the development lifecycle. * The ability to explain complex technical concepts clearly and concisely to technical and non-technical stakeholders. * Demonstrable experience applying data-governance, privacy and security best practices in a regulated environment. * A proactive and curious approach, with the ability to anticipate and resolve system inefficiencies. * The ability to lead cross-functional technical work and translate complex or ambiguous requirements into robust data solutions. * A track record of taking end-to-end ownership for the quality, reliability and performance of business-critical data solutions. * Experience mentoring engineers and influencing technical standards across a team. ## Description We are seeking a Senior Data Engineer to join our Data Team, taking a leading role in building the complex, scalable systems that power our data strategy. You will lead architectural discussions, own the design of business-critical data solutions and deliver high-quality systems that bring millions of fans closer to the sports they love. This is a fantastic opportunity to lead the optimisation of our data platforms for real-time AI/ML workloads, mentor engineers and make a significant impact on our business. The Senior Data Engineer leads technical initiatives, maintains data integrity and performance, and works across teams to translate complex business requirements into effective data solutions. The role also uses automation and artificial intelligence to improve efficiency, decision-making and productivity across the organisation., * Lead the design and delivery of robust data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub and Cloud Storage. This includes integrating data from various sources, ensuring data quality and enabling real-time processing capabilities. * Own the design of data models and databases that support business analytics and intelligence, using dimensional data-modelling principles. Select and use GCP database technologies such as Bigtable, Spanner or Firestore to optimise performance and scalability. * Lead the automation of data workflows and optimisation of data storage and processing costs within GCP. Use tools such as Cloud Composer for orchestration and establish best practices in performance tuning. * Ensure data security by implementing GCP security practices. Manage access controls, comply with data-governance policies and safeguard sensitive information. * Work closely with data engineers, business analysts and IT teams to define data requirements and deliver comprehensive data solutions. Provide technical leadership and guidance to team members. * Evaluate new GCP features and data-engineering technologies, setting technical direction where they can enhance data infrastructure or enable new data products. * Lead the resolution of critical pipeline failures and data-quality incidents, performing fault analysis and ensuring that preventative improvements are implemented. * Lead critical system-design and architectural decisions for scalable batch and real-time workloads. * Partner with cross-functional teams to translate complex or ambiguous business needs into effective and innovative data solutions. * Mentor engineers, review technical designs and foster a culture of continuous learning and engineering excellence. * Own improvements to the reliability, performance and cost-effectiveness of data systems. * Lead the design and maintenance of robust, secure integrations with core internal systems and critical third-party platforms. * Define appropriate monitoring and alerting standards to ensure high system reliability and minimal downtime. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)