Data Infrastructure Engineer , Data Platform
Role details
Job location
Tech stack
Job description
The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the frameworks, capabilities and tools needed to welcome a billion customers. Join us and help to amplify productivity, quality and innovation across Spotify. We are looking for a Data Infrastructure Engineer to join our team in the Data Collection Product Area. We develop the heart of Spotify's Event Delivery infrastructure, enabling hundreds of other teams to seamlessly collect more than a Trillion events per day and consume this data to empower Spotify's existing products as well as innovation of new products. We are heavy users of Google Cloud Pub/Sub, GKE, Dataflow and many other GCP products and work closely with Google to improve their product offering. We also rely on internal backend and data platform products, built by other squads at Spotify.
What You'll Do
- Work on our infrastructure together with the squad, making it reliable and efficient while delivering value to data producers and consumers within Spotify.
- Build large-scale Java and Apollo based backend systems and batch and real-time data pipelines with data processing frameworks like Scio and Apache Beam.
- Take an active part in the operational responsibilities for our own infrastructure
- Work in an autonomous, multi-functional agile team and collaborate with other squads in our product area to continuously iterate and deliver on new product objectives.
Requirements
Do you have experience in System design?, * You have experience working with backend and data engineering in Java and Scala and have an understanding of that problem space and tooling ecosystem.
- You are curious about solving technical challenges and operating business-critical, huge scale distributed systems and cloud solutions.
- You have a good understanding of quality, system design, data structures, and algorithms.
- You appreciate agile software processes, data-driven development, reliability, and responsible experimentation.
- You use standard methodologies in continuous integration and delivery
- You work well independently and collaboratively, and are open to giving and receiving feedback in order to learn as an individual and as a team.