ML Performance Engineer
TensorWave Inc.
Las Vegas, NV, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Computer Clusters
Profiling
Computer Engineering
Linux
Distributed Computing Environment
Python (Programming Language)
Graphics Processing Unit (GPU)
Pytorch
DeepSpeed
Kubernetes
Information Technology
Slurm
+2 more
Machine Learning Operations
Megatron
Job description
We’re looking for an ML Performance Engineer to join our MLOps team. You will validate new clusters by running large-scale training and inference workloads, help improve our managed Kubernetes and Slurm platforms through hands-on use, and produce performance benchmarks for customers and the broader market.
What You’ll Do
- Validate new cluster deployments by running large-scale training and inference workloads before customer handoff
- Identify, reproduce, and diagnose performance and reliability issues, working with infrastructure and platform teams to resolve them
- Use our managed Kubernetes and Slurm platforms the way our customers do, and provide feedback that improves them
- Run model benchmarks across training and inference, both for internal and external use
- Build tooling and repeatable workflows for validation and benchmarking
- Stay current with distributed training and inference frameworks and their performance on AMD Instinct GPUs
- Work with larger MLOps team to help support customer clusters and workloads
Requirements
- Bachelor of Science in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
- 3+ years of experience running ML workloads on GPU clusters
- Hands-on experience with distributed training using frameworks such as PyTorch FSDP, Megatron-LM, DeepSpeed, or torchtitan
- Working knowledge of Slurm and Kubernetes from a user and workload perspective
- Experience profiling and optimizing GPU workloads, including collective communication performance
- Strong Python skills and solid Linux fundamentals
- Clear written communication of performance findings to engineering and non-technical audiences
Benefits & conditions
- Stock Options
- 100% paid Medical, Dental, and Vision insurance for Employees
- Company Health Savings Account Contributions
- 100% paid Short Term and Long Term Disability Insurance for Employees
- Life and Voluntary Supplemental Insurance Options
- Other Insurance Options, such as Pet & Legal Insurance
- Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support
- Flexible Spending Account
- 401(k)
- Employee Assistance Program
- Flexible PTO
- Paid Holidays
- Parental Leave
- Other In-Office Perks
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…