Principal Machine Learning Engineer

Amazon.com, Inc.
Seattle, WA, United States
26 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$101,000.0 - $138,600.0
Working hours
Regular working hours

Tech stack

Computer Clusters Distributed Computing Environment Machine Learning Open Source Technology Tensorflow Large Language Models Deep Learning Machine Learning Operations

Job description

We are conducting a confidential search for a Principal Machine Learning Engineer to serve as the senior technical authority for ML systems within a technology organization based in Seattle, working hybrid. This is an individual-contributor role for an engineer who has shipped large-scale ML systems in production and wants to set technical direction without moving into people management. In this role, you will design and build large-scale training and inference systems, own model architecture decisions for high-impact ML products, and drive best practices for experimentation, evaluation, and MLOps across the engineering organization. You will work closely with applied science and platform teams to take models from research prototype to production at scale, optimizing for latency, cost, and reliability. You will mentor senior and staff engineers, set technical standards for model deployment, monitoring, and retraining pipelines, and represent ML engineering in architecture reviews. You will evaluate build-vs-buy decisions for ML infrastructure, stay current on the state of the art in deep learning and LLM systems, and translate emerging techniques into practical, production-grade improvements.

Requirements

  • Experience deploying and scaling large language model inference infrastructure
  • Contributions to open-source ML frameworks or published research
  • Experience with distributed training on GPU clusters at scale
  • Background in feature stores and real-time inference systems
  • Track record of setting technical direction across multiple engineering teams

Nice to have

  • Experience deploying and scaling large language model inference infrastructure
  • Contributions to open-source ML frameworks or published research
  • Experience with distributed training on GPU clusters at scale
  • Background in feature stores and real-time inference systems
  • Track record of setting technical direction across multiple engineering teams

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

1:25 min

Distinguishing artificial intelligence from deep learning

Sam Witteveen · Coffee With Developers

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

1:45 min

Introduction to serving large language models locally

Patrick Koss Patrick Koss · World Congress 2025

3:51 min

Overcoming hardware configuration barriers in machine learning

Jose Luis Latorre Millas · LIVE

3:55 min

Evaluating central server APIs against edge deployment models

Hauke Brammer · World Congress 2021

Videos

See all

Related articles

See all