> Markdown version of [/jobs/ext/2459374-lead-software-engineer-ml-network-stack-annapurna-labs](https://www.wearedevelopers.com/jobs/ext/2459374-lead-software-engineer-ml-network-stack-annapurna-labs). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Software Engineer, ML Network Stack - Annapurna Labs

- **Company:** Amazon.com, Inc.
- **Location:** Cupertino, CA, United States
- **Experience:** Expert
- **Salary:** $193,300.0 - $261,500.0
- **Contract:** Permanent contract
- **Skills:** Computer-Aided Design, Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, C++ (Programming Language), Code Review, Protocol Stack, Nvidia CUDA, Software Design Patterns, Linux, Machine Learning, Remote Direct Memory Access, Software Engineering, Graphics Processing Unit (GPU), Session Description Protocol Security Descriptions (SDES), Information Technology, Build Process, Machine Learning Operations, Software Coding, Software Version Control, Programming Languages
- **Published:** August 1, 2026
- **Apply:** https://www.jobmonkeyjobs.com/career/27897782/Lead-Software-Engineer-Ml-Network-Stack-Annapurna-Labs-California-Cupertino-7375

## About the Role

5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience

 - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
 - Experience as a mentor, tech lead or leading an engineering team, or experience in development in the last 3 years
 - 5+ years of experience with programming language: C or C++

Preferred Qualifications

 - Bachelor's degree in computer science or equivalent
 - Experience working with ML Communication Libraries or RDMA Networking

## Description

We are seeking an experienced engineer and technical leader to join our team that owns the network stack for EC2 distributed AI/ML systems. The team develops support for a variety of frameworks and communication libraries including NCCL, NVSHMEM, NIXL, NCCL GIN, and CUDA kernels. Solid knowledge of Linux, networking, and performant coding is important. Experience with embedded systems is valued, and experience with high-speed networking or HPC/RDMA interconnects is highly valued.

If you like solving hard problems, want to work with HPC and ML customers, iterate fast and deliver meaningful solutions at scale, then come join us! This truly is a role at the forefront of AI/ML-you'll be working on features for the largest clusters, with the largest customers, for the largest AI models.

The organization you would be joining is Annapurna Labs, an integral part of AWS that develops hardware and software components that are critical building blocks for EC2 infrastructure. Every instance in EC2 is running some type of hardware designed by Annapurna Labs. We specialize in designing software, systems, and chips that optimize the AWS customer experience., Be the Leader which works across the NVIDIA ML communication stack for enabling NVIDIA GPUs to work with the AWS EC2 machines. Knowledge of ML Networking, ML applications, and frameworks will be highly regarded. You'll be leading senior, mid-level, and junior SDEs and directing work to ensure the team delivers functions and features required for the latest and largest ML workloads.


## Related Videos

- [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data)
- [Machine Learning for Software Developers (and Knitters)](https://www.wearedevelopers.com/videos/154-machine-learning-for-software-developers-and-knitters)
- [The weekly developer show: Boosting Python with CUDA, CSS Updates & Navigating New Tech Stacks](https://www.wearedevelopers.com/videos/1293-the-weekly-developer-show-boosting-python-with-cuda-css-updates-navigating-new-tech-stacks)
- [Build a CI/CD pipeline to automate code reviews and ensure code quality](https://www.wearedevelopers.com/videos/349-build-a-ci-cd-pipeline-to-automate-code-reviews-and-ensure-code-quality)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Why Attend a Developer Event in 2026?](https://www.wearedevelopers.com/magazine/688-why-attend-a-developer-event-in-2026)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)