Software Development Engineer I - AI/ML Network Infrastructure, Annapurna Labs
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+34 more
Job description
Weβre looking for a talented early-career engineer to join our team that owns the network stack for EC2 distributed AI/ML systems. Youβll work on software that enables the worldβs largest AI models to train across massive GPU clusters, developing support for communication libraries and frameworks like NCCL, NVSHMEM, and NIXL., Write high-performance C/C++ code for network communication libraries running on custom AWS hardware
- Build and maintain infrastructure that monitors functionality and performance of large-scale AI/ML workloads
- Develop automation using Python and AWS tools (CI/CD, Grafana, Athena) to test, benchmark, and deliver software to customers
- Design mechanisms to detect functional and performance regressions before they reach production
- Work across many instance types, software stacks, and Linux environments
Requirements
Are 18 years of age or older Experience with at least one modern language such as Java, Python, C++, or C# including object-oriented design Experience with at least one general-purpose programming language such as Java, Python, C++, C#, Go, Rust, or TypeScript Experience with data structure implementation, basic algorithm development, and/or object-oriented design principles Experience using AI-assisted development tools in academic or professional settings Bachelorβs degree or above in Computer Science, Computer Engineering, or related fields Strong proficiency in C/C++ Solid coursework or project experience in: 1/ Operating Systems (Linux internals, kernel concepts, memory management) 2/ Parallel Computer Architecture (multi-threading, SIMD, GPU programming, cache coherence) 3/ Distributed Systems (consensus, message passing, fault tolerance, scalability) Familiarity with Linux development environments and toolchains, Experience from a technical internship Experience in optimization mathematics such as linear programming and nonlinear optimization Experience with distributed, multi-tiered systems, algorithms, and relational databases Work 40 hours/week, and overtime as required Experience from previous technical internship(s) or demonstrated project experience Experience with Cloud platforms (preferably AWS), database systems (SQL and NoSQL), AI tools for development productivity, contributing to open-source projects, and/or version control systems Internship experience in ML communications, HPC networking, or RDMA/high-speed interconnects Exposure to network programming (sockets, MPI, collective communication patterns) Experience with performance profiling and optimization Familiarity with GPU programming (CUDA) or hardware-software co-design Contributions to open-source projects in systems, networking, or HPC
Benefits & conditions
The starting pay for this position is listed below. Starting Day 1 of employment, Amazon offers EAP, Mental Health Support, Medical Advice Line, 401(k) matching. Learn more about our benefits at https://hiring.amazon.com/why-amazon/benefits.
Cupertino, CA, USA - 148,400.00 USD Annually
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦