> Markdown version of [/jobs/ext/2872629-sr-software-development-engineer-inference-team-aws-neuron](https://www.wearedevelopers.com/jobs/ext/2872629-sr-software-development-engineer-inference-team-aws-neuron). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Software Development Engineer, Inference Team - AWS Neuron - **Company:** Amazon.com, Inc. - **Location:** Seattle, WA, United States - **Experience:** Expert - **Salary:** $168,100.0 - $227,400.0 - **Contract:** Internship / Graduate position - **Skills:** Artificial Intelligence, Amazon Web Services, Application Frameworks, Systems Engineering, Code Review, Nvidia CUDA, Computer Programming, Software Design Patterns, Linux Kernel, Machine Learning, Open Source Technology, Software Engineering, Graphics Processing Unit (GPU), Pytorch, Large Language Models, Parallel Computation, Information Technology, Build Process, Software Coding, Software Version Control, Programming Languages - **Published:** September 13, 2026 - **Apply:** https://www.careerjet.com/job/us9822db8ab87e0aaea2db68207b39137b/eaa ## About the Role 5+ years of non-internship professional software development experience - 5+ years of programming with at least one software programming language experience - 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience - 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience - Experience as a mentor, tech lead or leading an engineering team - Fundamentals of Machine learning models, their architecture, training and inference lifecycles along with work experience on some optimizations for improving the model performance. Preferred Qualifications - Bachelor's degree in computer science or equivalent - Hands-on experience with PyTorch or JAX, preferably involving developing and deploying LLMs in production on GPUs, AWS Neuron, TPUs, or other AI accelerator hardware - Experience extending or contributing to inference frameworks such as vLLM or SGLang - Kernel development experience (e.g., CUDA, Triton) ## Description The engineer will lead the development of core serving technologies within open-source frameworks (such as vLLM and SGLang) to enable customers to serve large-scale inference efficiently on AWS Neuron. The engineer will also drive excellence in inference framework optimization and engineering best practices. The engineer will work closely with model development engineers, performance engineers, compiler engineers, and runtime engineers to ensure end-to-end model performance and deliver production-ready accuracy, scalability, and efficiency across a broad range of models and customer use cases., The engineer will lead the customization and optimization of open-source inference frameworks (vLLM, SGLang) on AWS Neuron-including core framework logic such as scheduling and model execution-applying state-of-the-art techniques in kernel development, parallel computation, distributed KV cache, speculative decoding, and systems engineering to deliver best-in-class LLM serving performance. The engineer will also influence the team's technical roadmap by evaluating emerging inference research and translating it into production-ready features, and raise the bar through design leadership and mentorship. This role requires close collaboration across model development, compiler, runtime, and performance engineering teams. About the team Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future., Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company's reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records., This position is part of the AWS Specialist and Partner Organization (ASP). Specialists own the go to market strategy for their respective technology domains, providing the busines… + 1 day ago, Are you a software development engineer who wants to build the systems that hundreds of thousands of AWS customers rely on to keep their cloud environments secure and compliant? Th… + 1 day ago, As a Software Development Engineer on the Bottlerocket team, you will design, build, and maintain components of Bottlerocket - AWS's open-source, security-first container OS truste… + 1 day ago + ## Related Videos - [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) - [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)