Data Engineer, Wrapped, Fixed Term

Spotify
New York, NY, United States
3 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Big Data BigQuery Data Security Data Systems Decision Support Systems Distributed Data Store Distributed Systems Data Flow Control Python (Programming Language) Software Engineering
+1 more
Apache Spark

Job description

  • Partner with Data Scientists to evaluate and operationalize new Wrapped story concepts, balancing personalization, scalability, and eligibility requirements.
  • Build scalable systems that process large-scale listening data and generate insights that celebrate users’ unique listening journeys.
  • Develop and optimize pipelines supporting AI-powered personalized playlist experiences and recommendation technologies.
  • Collaborate with partner teams to integrate social and shared listening experiences into Wrapped and adjacent user experiences.
  • Contribute to technical excellence by improving reliability, observability, performance, and development velocity across the squad’s data systems.
  • Support experimentation and iteration on new storytelling concepts beginning early in the product development cycle.
  • Work cross-functionally with engineering, product, design, and music domain experts to bring large-scale personalized experiences to life.

Requirements

Do you have experience in Spark implementation?, * Experience of working in a product-driven engineering environment.

  • You have experience working with high-volume, heterogeneous datasets using distributed systems and big data technologies such as Python, Scala, Scio, Ray, Apache Spark, or similar frameworks.
  • You are proficient in designing and building distributed data pipelines in Python, Scala, or Java, including experience with frameworks such as Scio and platforms like Dataflow.
  • You understand data modeling, data access, and storage techniques across both batch and analytical processing systems.
  • You have experience working with large-scale analytical systems such as BigQuery or similar technologies.
  • You value iterative software development, data-driven decision making, reliability, responsible experimentation, and cost-efficient engineering practices.
  • You thrive in collaborative environments and enjoy working closely with cross-functional teams across engineering, data science, and product.
  • You are a creative problem solver who enjoys building products that create meaningful experiences for millions of users.
  • You are excited by the challenge of turning research ideas and experimental concepts into reliable, scalable production systems.

About the company

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we’re behind some of Spotify’s most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you’ll keep millions of users listening by making great recommendations to each and every one of them.

Wrapped is one of Spotify’s most iconic and beloved user experiences, a cultural moment that helps hundreds of millions of listeners reconnect with the soundtrack to their year. The Timeturners squad, part of Spotify’s Personalization Mission, powers the data behind Wrapped by building the datasets and systems that fuel personalized data stories for more than 300M users globally.

As a Data Engineer on Timeturners, you’ll collaborate with Data Scientists, engineers, music experts, and partner teams to transform listening behavior into meaningful, joyful, and highly personalized user experiences. From evaluating new data story concepts to scaling pipelines that power AI-driven playlist experiences, you’ll help shape how millions of fans experience Wrapped every year.

This is a fixed term contract role running from June through December 2026.

What You’ll Do

  • Design, build, and maintain distributed data pipelines that power Spotify Wrapped data stories and personalized experiences for more than 300M users globally.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

5:00 min

Exploring the specific workplace responsibilities of staff software engineers

Jan Giacomelli · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all