Machine Learning Engineer (DevOps/SRE)

Roku, Inc.
San Jose, CA, United States
29 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Compensation
$148,800.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Artificial Intelligence Airflow Amazon Web Services Cloud Computing Computer Programming Continuous Integration Data Stores DevOps Disaster Recovery Distributed Systems Python (Programming Language)
+19 more
Machine Learning NoSQL Prometheus Reinforcement Learning Datadog Aerospike Feature Engineering Grafana Apache Spark Gitlab Kubernetes Infrastructure Automation Frameworks Information Technology Low Latency Apache Flink Apache Kafka Machine Learning Operations Terraform Jenkins

Job description

  • The Advertising Performance group focuses on performance for all participants in the Advertising ecosystem - Advertisers, Publishers, and Roku
  • The systems and solutions span multiple disciplines and technologies to perform real-time multi-objective optimization across distributed systems at large scale and with low latency
  • We use Machine Learning, Reinforcement Learning, AI, Control and Optimization Systems, and Auction Dynamics to solve a large set of complex problems
  • At the core of this is our Machine Learning, Experimentation, and Inference Platform that powers the entire landscape, which we continuously evolve over time
  • We are seeking a talented and experienced Senior Software Engineer, MLOps/DevOps, to join the Advertising Performance team and play a critical role in supporting and scaling our Machine Learning infrastructure
  • You will partner closely with ML Scientists and Engineers to streamline the end-to-end ML lifecycle across training, evaluation, deployment, and monitoring - on top of a modern, cloud-native stack running on GCP and AWS using Kubernetes, Apache Airflow, Spark, Ray, MLflow, Chronon, etc
  • Lead the design and operation of scalable, production-grade cloud infrastructure for ML workloads across AWS and GCP, including GPU/TPU-based training and inference environments
  • Architect and improve CI/CD systems for ML models and platform services to enable fast, reliable, and safe production releases
  • Own and evolve low-latency infrastructure for real-time model inference, including KV store and vector databases
  • Define and enforce observability standards for ML systems, including model performance monitoring, drift detection, capacity planning, and pipeline health metrics
  • Participate in on-call rotation, leading incident response and root-cause analysis for critical ML training and serving infrastructure
  • Partner with data scientists and ML engineers to improve platform usability, accelerate model iteration, and implement strong MLOps and SRE best practices
  • Champion operational excellence across ML infrastructure through automation, resilience engineering, disaster recovery planning, and continuous improvement

Requirements

Communication skills Grafana Java GitLab Kubernetes, * The ideal candidate has a strong background in DevOps/SRE practices, cloud infrastructure management, and MLOps tooling - with a passion for building platforms that accelerate ML experimentation and deployment at internet scale

  • Experience in the Advertising domain is a plus
  • Hands-on experience with data and orchestration technologies such as Apache Spark, Apache Flink, Apache Airflow, and Kafka
  • Experience with observability platforms such as Prometheus, Grafana, and Datadog
  • Expertise with NoSQL or low-latency data stores such as Aerospike or similar technologies
  • Excellent communication and cross-functional collaboration skills
  • Deep experience with Kubernetes and container orchestration on GCP (GKE) and/or AWS (EKS)
  • BS or MS in Computer Science, Engineering, or a related quantitative field
  • 8+ years of experience in DevOps, SRE, or ML infrastructure, including 4+ years supporting large-scale ML or AI systems
  • Strong programming skills in Python, and/or Scala, or Java for platform automation and tooling
  • Experience building and maintaining CI/CD systems using tools such as Jenkins or GitLab Runner
  • Familiarity with feature engineering platforms such as Chronon and model lifecycle tools such as MLflow
  • Strong infrastructure-as-code experience with Terraform or similar tooling

Benefits & conditions

  • Medical, wellness and financial benefits
  • Free snacks and access to the company fitness center
  • Unlimited paid time off policy
  • Work from home opportunities

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.weareroku.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

2:44 min

Defining core roles and responsibilities in MLOps teams

Bas Geerdink · LIVE

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

5:28 min

Defining MLOps and its role in production systems

Hauke Brammer · WWC 2023

Videos

See all

Related articles

See all