> Markdown version of [/jobs/ext/1401073-sr-software-engineer-ai-ml-aws-neuron-apps](https://www.wearedevelopers.com/jobs/ext/1401073-sr-software-engineer-ai-ml-aws-neuron-apps). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Software Engineer- AI/ML, AWS Neuron Apps

- **Company:** Amazon.com, Inc.
- **Location:** Seattle, WA, United States
- **Experience:** Expert
- **Salary:** $168,100.0 - $227,400.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, C++ (Programming Language), Code Review, Nvidia CUDA, Computer Programming, Software Debugging, Python (Programming Language), Machine Learning, Tensorflow, Software Engineering, Pytorch, Large Language Models, Parallel Computation, Information Technology, Build Process, Hardware Acceleration, Machine Learning Operations, Software Coding, GPT, Software Version Control
- **Published:** July 23, 2026
- **Apply:** https://dejobs.org/x/x/3493940A4A0E4995BC0B9296332DF1B2/job/

## About the Role

* 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
 * 5+ years of programming experience using Python or C++ and PyTorch.
 * Experience with AI acceleration via quantization, parallelism, model compression, batching, KV caching, vllm serving
 * Experience with accuracy debugging & tooling, performance benchmarking of AI accelerators
 * Fundamentals of Machine learning and deep learning models, their architecture, training and inference lifecycles along with work experience on optimizations for improving the model execution., * Master's degree in computer science or equivalent
 * Master's degree in machine learning or equivalent
 * Experience with accuracy debugging & tooling, performance benchmarking of AI accelerators
 * Experience in developing CUDA kernels, HPC and inference optimization, tensors operations

## Description

Join the elite team behind AWS Neuron-the software stack powering AWS's next-generation AI accelerators Inferentia and Trainium. As a Senior Software Engineer in our Machine Learning Applications team, you'll be at the forefront of deploying and optimizing some of the world's most sophisticated AI models at unprecedented scale.

What You'll Impact:

 * Pioneer distributed inference solutions for industry-leading LLMs such as GPT, Llama, Qwen

 * Optimize breakthrough language and vision generative AI models

 * Collaborate directly with silicon architects and compiler teams to push the boundaries of AI acceleration

 * Drive performance benchmarking and tuning that directly impacts millions of inference calls globally

Key job responsibilities

You will drive the Evolution of Distributed AI at AWS Neuron

As a Technical Leader at the forefront of AWS's AI Accelerator, you'll architect the bridge between ML frameworks including PyTorch, JAX and AI hardware. This isn't just about just optimization-it's about revolutionizing how AI models run at scale.

Technical Impact You'll Drive:

 * Spearhead distributed inference architecture for PyTorch and JAX using XLA

 * Engineer breakthrough performance optimizations for AWS Trainium and Inferentia

 * Develop ML tools to enhance LLM accuracy and efficiency


## Related Videos

- [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia)
- [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Machine learning in the browser with TensorFlowjs](https://www.wearedevelopers.com/videos/155-machine-learning-in-the-browser-with-tensorflowjs)
- [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk)
- [Getting Started with Machine Learning](https://www.wearedevelopers.com/videos/260-getting-started-with-machine-learning)

## Related Articles

- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)