Data Engineer (Scala)

Sky UK
Croydon, United Kingdom
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Croydon, United Kingdom

Tech stack

API
Amazon Web Services (AWS)
Cloud Computing
Continuous Delivery
Data Visualization
Distributed Systems
Fault Tolerance
Python
Machine Learning
Software Engineering
Containerization
Real Time Data
gRPC
Docker
Go
Microservices

Job description

  • Design and implement scalable APIs and backend services, primarily in Scala, to integrate ML models into production systems and deliver personalised experiences.
  • Real time data processing and gRPC microservices (Typelevel stack).
  • Take end-to-end ownership of services, from development to production operations
  • Optimising the performance of the application in the cloud environments
  • Creating/improving automated pipelines that support our Continuous Delivery process
  • Build, scale and maintain large scale cloud-based services
  • Work closely with data scientists, ML engineers, and product teams to align technical solutions with business goals.
  • Refining the team processes to continuously integrate and working towards a continuously deliverable application.
  • Championing best practices to develop clean, resilient code that performs at serious scale.
  • Coaching and providing feedback to fellow developers.

Requirements

  • Strong software engineering skills with experience in Scala, ideally the typelevel stack (bonus if you have exposure to Golang and Python).
  • Interest in machine learning, personalisation systems and cloud technology - even if you haven't worked extensively in ML before.
  • Demonstrated experience designing, implementing, deploying, and maintaining production-grade APIs and backend services, including responsibility for reliability, performance, and on-call support.
  • Hands-on experience working with data processing frameworks and distributed systems used to ingest, process, and store large-scale datasets, with an understanding of scalability, fault tolerance, and performance considerations.
  • Practical experience with modern software development practices, including automated CI/CD pipelines, containerisation technologies (e.g., Docker), and deploying applications to cloud environments (e.g., AWS or GCP).
  • Ability to collaborate effectively across teams and communicate technical concepts clearly.
  • A problem-solving mindset and eagerness to learn new technologies and approaches.
  • Ability to challenge technical choices, architecture, tools and processes

About the company

Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate., Our team develops and supports market-leading video streaming services, underpinned by state-of-the-art engineering principles. We do this at huge scale: for over 50 million customers globally, spanning NBCUniversal Peacock in the US and Sky, NOW and SkyShowtime across Europe. No matter the device, the time or the place, we make sure that our diverse audiences can easily find and enjoy whatever they want to watch, choosing from the world's best entertainment, news and sport., Our Osterley Campus is a 10-minute walk from Syon Lane train station. Or you can hop on one of our free shuttle buses that run to and from Osterley, Gunnersbury, Ealing Broadway and South Ealing tube stations. There are also plenty of bike shelters and showers. On campus, you'll find 13 subsidised restaurants, cafes, and a Waitrose. You can keep in shape at our subsidised gym, catch the latest shows and movies at our cinema, get your car washed, and even get pampered at our beauty salon. We'd love to hear from you Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next. But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet. If you believe in better, we'll back you all the way. Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer.

Apply for this position