> Markdown version of [/jobs/ext/4196566-machine-learning-engineer-ii-aws-inference-optimization](https://www.wearedevelopers.com/jobs/ext/4196566-machine-learning-engineer-ii-aws-inference-optimization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Machine learning engineer II, AWS Inference Optimization

- **Company:** Amazon.com, Inc.
- **Location:** Santa Clara, CA, United States
- **Salary:** $165,200.0 - $223,600.0
- **Contract:** Internship / Graduate position
- **Skills:** Java (Programming Language), Amazon Web Services, Software Applications, C Sharp (Programming Language), C++ (Programming Language), Code Review, Nvidia CUDA, Software Design Patterns, Perl (Programming Language), Machine Learning, Inference Optimization, Software Engineering, Multithreading, Large Language Models, Information Technology, Optimization Algorithms, SGLang, Build Process, Software Coding, Software Version Control
- **Published:** October 23, 2026
- **Apply:** https://www.jobmonkeyjobs.com/career/28135126/Machine-Learning-Engineer-Ii-Aws-Inference-Optimization-California-Santa-Clara-7375

## About the Role

3+ years of non-internship professional software development experience

 - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
 - 1+ years of software development engineer or related occupational experience
 - 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
 - Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
 - Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques

Preferred Qualifications

 - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
 - Bachelor's degree in computer science or equivalent

## Description

As a MLE in Inference Optimization team you will be responsible for the major portion of existing and/or new inference software. List of responsibilities includes but is not limited to developing model servers, developing CUDA kernels in vLLM, SGLang, developing services for GenAI optimization and benchmarking, creating and modifying a mid-size application, or service.