Data Engineer

Sky UK
18 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 58K

Job location

Remote

Tech stack

API
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Google BigQuery
Cloud Computing
Continuous Integration
Information Engineering
ETL
Data Systems
Digital Content
Python
Machine Learning
SQL Databases
Google Cloud Platform
Concourse
Data Management
Terraform
Data Pipelines

Job description

  • Design, build, and maintain reliable data pipelines that enable advanced analytics, automation, for Sky's Anti-Piracy function.
  • Work across both streaming and batch data environments, integrating multiple data sources to detect piracy patterns and deliver actionable insights.
  • Collaborate with data scientists, analysts, engineers, and anti-piracy specialists to deliver high-quality, trusted data products.
  • Contribute to the design and documentation of data pipeline architecture, ensuring scalability, security, and performance across our GCP infrastructure.
  • Develop and orchestrate data workflows using Airflow (Cloud Composer), Python, and SQL in BigQuery, while working with 3rd-party APIs and other cloud environments.
  • Support and optimise machine learning pipelines built on Google Vertex AI, powering automated detection and classification models.
  • Drive innovation by improving automation, reliability, and real-time analytics capabilities within the anti-piracy data ecosystem.
  • Play an active role in knowledge sharing, mentoring, and shaping best practices across the wider Data, Automation, and Anti-Piracy team.

Requirements

  • Proven experience as a Data Engineer, with solid hands-on skills in Python and SQL.
  • Strong working knowledge of cloud-based data platforms preferably Google Cloud Platform (GCP) or equivalent (e.g. AWS) with exposure to CI/CD and IaC (e.g. Concourse, Terraform).
  • Experience in building and maintaining data pipelines and orchestrations using tools such as Airflow (Cloud Composer).
  • Understanding of data modelling, ETL/ELT processes, and best practices for designing scalable, high-performance data solutions.
  • A collaborative mindset with the ability to work autonomously - taking ownership of tasks while contributing effectively within agile sprints.
  • Excellent communication skills, able to translate complex technical concepts into clear, concise language for non-technical stakeholders.
  • A genuine interest in applying data engineering to meaningful, real-world challenges - learning the ins and outs of digital content protection and anti-piracy along the way.

Benefits & conditions

  • Sky Q, for the TV you love all in one place
  • The magic of Sky Glass at an exclusive rate
  • A generous pension package
  • Private healthcare
  • Discounted mobile and broadband
  • A wide range of Sky VIP rewards and experiences

About the company

Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love. And we do it all right here at Sky. At Sky, data plays a vital role in protecting the content millions of people love. As part of our Data, Automation, and Anti-Piracy team, you'll use your data engineering skills to help safeguard Sky's digital assets and customers around the world. Working alongside talented data engineers, analysts, and anti-piracy specialists, you'll build and optimise data pipelines that power our efforts to detect, monitor, and stop illegal streaming. It's fast-paced, collaborative work with a real sense of purpose - combining big data, automation, and cloud technology to make a measurable impact on one of the most challenging problems in the media industry., Our Osterley Campus is a 10-minute walk from Syon Lane train station. Or you can hop on one of our free shuttle buses that run to and from Osterley, Gunnersbury, Ealing Broadway and South Ealing tube stations. There are also plenty of bike shelters and showers. On campus, you'll find 13 subsidised restaurants, cafes, and a Waitrose. You can keep in shape at our subsidised gym, catch the latest shows and movies at our cinema, get your car washed, and even get pampered at our beauty salon. We'd love to hear from you Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next. But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet. If you believe in better, we'll back you all the way. Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer.

Apply for this position