Senior Data Engineer

This is an opportunity to join a large-scale data transformation programme within a highly data-driven organisation. You'll play a key role in modernising a complex data estate, supporting business-critical analytics and enabling future AI and data science capabilities across the organisation. The Company They are a well-established organisation with a significant digital presence and one of the largest consumer data environments in the UK. As they evolve their data platform, they are investing heavily in cloud technologies, scalable data infrastructure, and modern engineering practices. The Role and Deliverables

• Design, build, and operate high-volume streaming and batch data pipelines across a modern cloud environment.
• Deliver complex migration projects, including the consolidation of real-time analytics platforms onto a scalable architecture.
• Enhance and optimise the lakehouse environment, including schema management, data contracts, partitioning strategy, and performance optimisation.
• Build reliable, production-grade data foundations that support analytics, machine learning, and data science initiatives.
• Establish and promote engineering best practices across infrastructure as code, CI/CD, observability, and code quality.
• Provide technical leadership and mentorship to engineers within the wider data team.

• Strong experience owning and operating production data infrastructure at significant scale.
• Proven capability delivering large-scale streaming data solutions using technologies such as Kafka, Flink, Spark Streaming, Dataflow, or similar.
• Demonstrated success leading end-to-end migrations of live production systems.
• Strong knowledge of cloud platforms and distributed data architectures.
• Experience with Kubernetes and infrastructure as code approaches.
• Ability to partner effectively with data scientists, analysts, and business stakeholders.
• Strong understanding of data platform reliability, performance, scalability, and cost optimisation.
• Experience with technologies such as ClickHouse, Apache Iceberg, BigQuery, dbt, Elasticsearch, Druid, GCP, or AWS is highly desirable.

If you're an experienced Senior Data Engineer looking to lead complex data platform projects in a high-scale environment, apply today to learn more about this contract opportunity.

Skills

• python
• data engineer
• azure
• aws
• spark
• etl
• gcp
• kafka
• bigquery