Software Development Engineer I, ML Infra Services, Annapurna Labs

Design and implement tooling for profiling, optimization, and resource management of ML workloads on custom accelerators.

• Build high-impact solutions that ship to a large and growing customer base.
• Participate in design discussions, code reviews, and cross-functional collaboration with hardware, software, and customer-facing teams.
• Create metrics, implement automation, and resolve root causes of software defects.
• Work in a startup-like environment where you're always focused on the most important problems.

About the team This is a high-impact, high-visibility team where your work directly accelerates every Neuron team's ability to ship, effectively multiplying the output of 100+ engineers. We're a small, senior group actively building greenfield capabilities, which means significant design ownership for SDEs and the opportunity to own major components and drive architectural decisions. You'll work at the cutting edge of AI infrastructure, at the intersection of Kubernetes, custom silicon, and large-scale ML workloads.

Bachelor's degree or above in computer science or equivalent

• Experience in Kubernetes, Docker or containers ecosystem, or experience in deploying identity and access management systems and experience demonstrating software engineering skills in a previous intership, work experience, coding competitions, or publications
• Knowledge of software development lifecycle, including design, development, test, build, deployment processes and timelines
• Proficiency in Java and at least one of Go, Python, or TypeScript.
• Familiarity with Git and CI/CD pipelines.

Preferred Qualifications

• Internship or project experience with AWS services (EKS, EC2, Lambda, S3, DynamoDB, or SQS).
• Familiarity with distributed systems or big data architectures.
• Experience with Linux systems and performance profiling.
• Exposure to compiler toolchains, code generation, or instruction set architectures (CPU, NPU, GPU).

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Seattle - 110,500.00 - 160,000.00 USD annually

Annapurna Labs was a startup acquired by AWS in 2015 and is now fully integrated. If AWS is an infrastructure company, think of Annapurna Labs as the infrastructure provider of AWS. Our org spans silicon engineering, hardware design and verification, software, and operations. We've delivered AWS Nitro, ENA, EFA, Graviton, F1 EC2 Instances, AWS Neuron, Inferentia and Trainium ML Accelerators, and scalable NVMe storage.