ML Performance Engineer

TensorWave Inc.
Las Vegas, NV, United States
2 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Computer Clusters Profiling Computer Engineering Linux Distributed Computing Environment Python (Programming Language) Graphics Processing Unit (GPU) Pytorch DeepSpeed Kubernetes Information Technology Slurm
+2 more
Machine Learning Operations Megatron

Job description

We’re looking for an ML Performance Engineer to join our MLOps team. You will validate new clusters by running large-scale training and inference workloads, help improve our managed Kubernetes and Slurm platforms through hands-on use, and produce performance benchmarks for customers and the broader market.

What You’ll Do

  • Validate new cluster deployments by running large-scale training and inference workloads before customer handoff
  • Identify, reproduce, and diagnose performance and reliability issues, working with infrastructure and platform teams to resolve them
  • Use our managed Kubernetes and Slurm platforms the way our customers do, and provide feedback that improves them
  • Run model benchmarks across training and inference, both for internal and external use
  • Build tooling and repeatable workflows for validation and benchmarking
  • Stay current with distributed training and inference frameworks and their performance on AMD Instinct GPUs
  • Work with larger MLOps team to help support customer clusters and workloads

Requirements

  • Bachelor of Science in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
  • 3+ years of experience running ML workloads on GPU clusters
  • Hands-on experience with distributed training using frameworks such as PyTorch FSDP, Megatron-LM, DeepSpeed, or torchtitan
  • Working knowledge of Slurm and Kubernetes from a user and workload perspective
  • Experience profiling and optimizing GPU workloads, including collective communication performance
  • Strong Python skills and solid Linux fundamentals
  • Clear written communication of performance findings to engineering and non-technical audiences

Benefits & conditions

  • Stock Options
  • 100% paid Medical, Dental, and Vision insurance for Employees
  • Company Health Savings Account Contributions
  • 100% paid Short Term and Long Term Disability Insurance for Employees
  • Life and Voluntary Supplemental Insurance Options
  • Other Insurance Options, such as Pet & Legal Insurance
  • Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support
  • Flexible Spending Account
  • 401(k)
  • Employee Assistance Program
  • Flexible PTO
  • Paid Holidays
  • Parental Leave
  • Other In-Office Perks

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…