> Markdown version of [/jobs/ext/257459-senior-software-dev-engineer-ec2-nitro](https://www.wearedevelopers.com/jobs/ext/257459-senior-software-dev-engineer-ec2-nitro). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Dev Engineer, EC2 Nitro - **Company:** Amazon.com, Inc. - **Location:** Seattle, WA, United States - **Experience:** Expert - **Salary:** $168,100.0 - $227,400.0 - **Contract:** Internship / Graduate position - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Data Analysis, Code Review, Computer Programming, Computer Engineering, Software Design Patterns, Firmware, Machine Learning, Performance Tuning, Regression Testing, Tensorflow, Software Engineering, Computer Networking Systems, Pytorch, Large Language Models, Information Technology, Optimization Algorithms, Build Process, Machine Learning Operations, TensorRT, Software Coding, Software Version Control, Programming Languages - **Published:** May 15, 2026 - **Apply:** https://seeker-sp.worksourcewa.com/jobview/GetJob.aspx?JobID=293415220 ## About the Role 5+ years of non-internship professional software development experience - 5+ years of programming with at least one software programming language experience - 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience as a mentor, tech lead or leading an engineering team - Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques Preferred Qualifications - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience - Bachelor's degree in computer science or equivalent - Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT - Knowledge of machine learning model architecture and inference ## Description Join the EC2 Nitro Machine Learning Systems team to revolutionize supercomputing in the cloud. We're seeking an experienced Software Development Engineer to build and optimize infrastructure powering the most computationally intensive AI/ML workloads. In this role, you'll establish EC2 as the definitive source for best-known-configurations across diverse ML applications while influencing future accelerated platform designs. You'll bring deep expertise in ML systems performance, working across the full stack from low-level hardware optimization to high-level frameworks. This position offers unique opportunities to translate state of the art ML research into practical platform improvements, build foundational measurement infrastructure, and directly support customers with performance challenges. If you're passionate about solving complex performance optimization problems at massive scale while directly influencing product strategy, this role provides the perfect opportunity to make a significant impact. Key job responsibilities - Design and implement scalable performance measurement infrastructure that serves as the foundation for ML benchmarking across AWS, incorporating critical metrics like tokens/second, latency, and accelerator utilization - Lead technical projects establishing EC2 as the definitive source for ML performance best practices across diverse applications including LLMs, multimodal systems, and emerging model architectures - Develop and maintain comprehensive regression testing systems that validate performance across major component releases including frameworks, firmware, drivers, and networking infrastructure - Collaborate with hardware engineering teams to influence future accelerator platform designs based on performance insights gathered from state-of-the-art research and customer workloads - Build customer relationships by investigating complex performance challenges, developing solutions, and publishing actionable best practices through multiple channels A day in the life Your day revolves around translating technical performance data into actionable business insights while solving complex optimization challenges. You might start by analyzing performance bottlenecks in a customer's large language model training workflow, then collaborate with framework engineers to implement optimizations. Later, you'll present findings at a platform design review, where your data-driven insights directly influence future hardware decisions. Throughout the day, you'll balance immediate customer needs with long-term infrastructure development, all while helping establish processes for this bootstrap team. About the team The EC2 Nitro Machine Learning Systems team is responsible for development, operations, and maintenance of scale-out machine learning platforms used for training and inference workloads. We build and optimize the infrastructure that powers some of the most computationally intensive AI/ML workloads in the cloud. Our team is passionate about creating reliable, high-performance systems that enable customers to push the boundaries of what's possible with machine learning. Working with us means having the opportunity to influence the future of supercomputing in the cloud while solving complex technical challenges at massive scale. We collaborate closely with customers and internal teams to continuously improve our platforms and deliver innovations that accelerate machine learning workflows. ## Related Videos - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Playing Pong on a shoulder press machine](https://www.wearedevelopers.com/videos/100140-playing-pong-on-a-shoulder-press-machine) - [Machine Learning for Software Developers (and Knitters)](https://www.wearedevelopers.com/videos/154-machine-learning-for-software-developers-and-knitters) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) - [20 Years of Solving Unsolvable Problems](https://www.wearedevelopers.com/videos/100214-20-years-of-solving-unsolvable-problems) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)