Senior Data Engineer - Anti-Piracy

We are looking for a Senior Data Engineer to join our Anti-Piracy team who will be responsible for expanding and optimizing our data pipeline as well as optimizing data flow and collection within the Anti-Piracy Team, The Senior Data Engineer will be responsible for designing, building, and scaling the data infrastructure that powers our anti-piracy operations and intelligence capabilities. You'll develop and maintain data pipelines, architect data storage solutions, and help shape data standards and governance across the org. You'll partner closely with data scientists, analysts, and engineering teams to ensure our data is accurate, reliable, secure, and available when needed., * Design, develop, and maintain scalable data pipelines for ingestion, transformation, storage, processing, analysis, and visualisation across multiple sources

• Build and optimize data infrastructure and ETL workflows to support reliable extraction, transformation, and loading of large, complex datasets
• Create and refine SQL queries, data models, and data structures to support reporting, analytics, and business-critical workloads
• Monitor, validate, and troubleshoot data systems to ensure accuracy, performance, security, and scalability, resolving issues proactively
• Automate manual workflows and implement internal process improvements to enhance data delivery efficiency and system reliability
• Contribute to data governance standards, metadata management, and versioning processes while collaborating with data science and cross-functional teams
• Maintain thorough documentation for data pipelines, systems, and processes, and stay current on modern data engineering tools, architecture patterns, and best practices

Do you have experience in Spark?, The successful candidate must have strong technical skills as well as excellent communication skills., * Proven experience designing and scaling data pipelines and architectures in cloud environments (GCP and AWS desirable)

• Deep experience with data modelling, schema design, ETL/ELT, warehousing concepts, and distributed data systems
• Hands-on experience working with large, complex, or messy datasets and making them usable
• Strong SQL and scripting/programming skills (Python required; Java/Scala/C++ a plus)
• Experience with orchestration and workflow tools (Airflow, Cloud Composer, Dagster, etc.)
• Familiarity with modern data stack components (BigQuery, dbt, Kafka/PubSub, Spark, etc.)
• Knowledge of data security, access control, and best practices for handling sensitive data
• Experience collaborating across engineering, analytics, and product teams
• Strong communication skills, especially explaining data concepts to non-technical stakeholders

Sky's Group Anti-Piracy team's purpose is to make our great content unavailable to pirates, and to make pirated content unattractive to consumers. We prevent the theft of Sky's content by making sure our platforms, like Sky Q, are secure and we deploy cutting edge technology, intelligence and investigations to stay one step ahead. We enforce the law and we work with our partners, like the big tech and social media platforms, to make sure that they understand the threat, and take action.

The Rewards:

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster:

• Sky Q, for the TV you love all in one place
• The magic of Sky Glass at an exclusive rate
• A generous pension package
• Private healthcare
• Discounted mobile and broadband
• A wide range of Sky VIP rewards and experiences

How you'll work:

We know the world has changed, and we want to offer our employees the chance to collaborate at our unique office spaces, whilst enjoying the convenience of working from home.

We've adopted a hybrid working approach to give more flexibility on where and how we work. You'll find out more about what this means for this role during the recruitment process.

Your office base:

Osterley:

Our Osterley Campus is a 10-minute walk from Syon Lane train station. Or you can hop on one of our free shuttle buses that run to and from Osterley, Gunnersbury, Ealing Broadway and South Ealing tube stations. There's also plenty of bike shelters and showers.

On campus, you'll find 13 subsidised restaurants, cafes, and a Waitrose. You can keep in shape at our subsidised gym, catch the latest shows and movies at our cinema, get your car washed and even get pampered at our beauty salon.

Want to do the best work of your life? With 24 million customers in 6 countries, make your mark at Europe's leading media and entertainment brand. A workplace where you can proudly be yourself; our people make Sky a truly exciting and inclusive place to work."