> Markdown version of [/jobs/ext/2836128-software-development-engineer-neuron-collectives-annapurna-labs](https://www.wearedevelopers.com/jobs/ext/2836128-software-development-engineer-neuron-collectives-annapurna-labs). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Development Engineer, Neuron Collectives, Annapurna Labs - **Company:** Annapurna Labs - **Location:** Cupertino, CA, United States - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, C++ (Programming Language), Code Review, Data Centers, Software Design Patterns, Distributed Computing Environment, Distributed Systems, Embedded Software, Firmware, Machine Learning, Software Engineering, Systems Integration, Real Time Systems, Large Language Models, Information Technology, Build Process, Software Coding, Software Version Control - **Published:** September 10, 2026 - **Apply:** https://www.careerboard.com/us/en/find-jobs-in-United-States/-824C66000EF3B232D5/ ## About the Role BASIC QUALIFICATIONS - Experience building complex software systems that have been successfully delivered to customers - Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems - Bachelor's degree in computer science or equivalent - Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations - Experience in development in the last 3 years, or experience in Embedded development in C/C++ PREFERRED QUALIFICATIONS - Master's degree in computer science or equivalent - Experience with hardware/software integration and Real Time systems - Familiarity with collective communication algorithms (eg, all-reduce, all-gather) or distributed training frameworks ## Description As a Neuron Collectives Software Developer, you will: Enhance collective algorithms and topologies for optimal training performance Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization Monitor and analyze processor, DMA, firmware, and workload metrics Optimize collective operations to scale AI compute across the data center Work closely with the hardware team to co-optimize software and Trainium silicon Develop and optimize C/C++ implementations of collective communication patterns Investigate and implement improvements for specific training topologies used by modern LLMs Build and maintain analysis frameworks and automation solutions The role offers opportunities to work on cutting-edge AI training hardware while contributing to one of Amazon's most critical initiatives. A day in the life Inclusive Team Culture Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 16 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. Work/Life Balance Our team puts a high value on work-life balance. It isn't about how many hours you spend at home or at work; it's about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge sharing and mentorship. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded professional and enable them to take on more complex tasks in the future. About the team Annapurna Labs, part of AWS, created Trainium as a purpose-built AI training chip to revolutionize machine learning at Amazon scale. The Neuron Collectives team owns the software stack that enables collective operations - the communication primitives that allow AI training to scale across thousands of chips in the data center. Our work is essential to training the frontier models that power AI today. We work closely with hardware teams to extract maximum performance from Trainium, ensuring that compute and interconnect bandwidth are fully utilized. Our team sits at the intersection of hardware, firmware, and distributed systems. ## Related Videos - [The Software Engineer 2030: From Coder To AI Orchestrator? - Patrick Schnell](https://www.wearedevelopers.com/videos/1825-the-software-engineer-2030-from-coder-to-ai-orchestrator-patrick-schnell) - [Playing Pong on a shoulder press machine](https://www.wearedevelopers.com/videos/100140-playing-pong-on-a-shoulder-press-machine) - [The Sustainability Race: AI's Promises, Pitfalls and Potential](https://www.wearedevelopers.com/videos/100155-the-sustainability-race-ai-s-promises-pitfalls-and-potential) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [The AI-Native Engineering Org: What’s Real, What’s Hype, What’s Next](https://www.wearedevelopers.com/videos/100004-the-ai-native-engineering-org-what-s-real-what-s-hype-what-s-next) - [Agent Smith Gets Hardware: Autonomous IoT Hacking From Debug Port to Cloud API](https://www.wearedevelopers.com/videos/100258-agent-smith-gets-hardware-autonomous-iot-hacking-from-debug-port-to-cloud-api) ## Related Articles - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Why Attend a Developer Event in 2026?](https://www.wearedevelopers.com/magazine/688-why-attend-a-developer-event-in-2026) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)