Machine Learning Infrastructure Engineer

ESAI SOFTWARE INCORPORATED
New York, NY, United States
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Agile Methodology C++ (Programming Language) Information Engineering Data Files Distributed Systems Data Flow Control Apache Hadoop Python (Programming Language) Machine Learning Object-Oriented Software Development
+12 more
Open Source Technology Tensorflow Data Processing Google Cloud Apache Spark Deep Learning Scikit Learn Cassandra Data Analytics Apache Kafka Machine Learning Operations Functional Programming

Job description

We are looking for a Senior Software Engineer to help us define and build the next generation of ML infrastructure at Spotify. Our mission is to enable every team at Spotify to iterate quickly on hypotheses and scale their experiments to data sets with hundreds of billions of data points. In this role you will work closely with many of the ML teams at Spotify across missions including ads targeting, personalization, music recommendations, pricing and more. Above all, your work will impact the way the world experiences music. WHAT YOU’LL DO

  • Build infrastructure to apply machine learning methods to massive data sets in production environments
  • Collaborate with cross functional agile teams of software engineers, data engineers, ML experts, and others in building new product features
  • Contribute to new and existing Spotify open source machine learning and data processing products (scio, featran, zoltar)
  • Leverage your experience to drive best practices in ML and data engineering
  • Gain a deep understanding of various models (collaborative filtering, NLP, deep learning) in order to understand their tradeoffs and bottlenecks
  • Design machine learning platforms and pipelines for training and running machine learning models on distributed systems
  • Determine the feasibility of projects through quick prototyping with respect to performance, quality, time and cost using Agile methodologies

Requirements

  • You have development experience with an object-oriented programming language such as C++ or Java and/or functional programming languages
  • You have previous industry experience with ML systems using frameworks such as Scikit-learn and Tensorflow
  • You have previously built APIs and libraries for Java, Scala or Python
  • You care about agile software processes, data-driven development, reliability, and responsible experimentation
  • You preferably have experience with data processing and storage frameworks like Google Cloud Dataflow, Hadoop, Scalding, Spark, Storm, Cassandra, Kafka, etc.
  • You preferably have machine learning publications or open source contributions to share with us
  • Skilled communicator and have a proven record of leading work across disciplines We are proud to foster a workplace free from discrimination. We strongly believe that diversity of experience, perspectives, and background will lead to a better environment for our employees and a better product for our users and our creators. This is something we value deeply and we encourage everyone to come be a part of changing the way the world listens to music.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:08 min

Scaling semantic search with Astra DB and Apache Cassandra

David Leconte David Leconte +1 ¡ WWC 2024

3:38 min

Reusing email software standards for HTTP file uploads

Imran Nazar ¡ WWC 2023

1:39 min

Fundamentals of tensors and the TensorFlow library

Hükan Silfvernagel ¡ LIVE

7:10 min

Exploring pathways into the machine learning engineering field

Jose Luis Latorre Millas ¡ LIVE

3:22 min

Introduction to building real-time generative agents

Dieter Flick ¡ WWC 2023

2:55 min

Transitioning from traditional software paths to machine learning engineering

Tarek ZiadÊ ¡ Coffee With Developers

Videos

See all

Related articles

See all