Senior Infrastructure System Software Engineer

• Architect and implement system software within a converged environment that incorporates both HPC/AI workload managers like SLURM with services running on Kubernetes, enhancing resource/process management, scheduling, and resilience of large AI workloads.
• Develop long-running system service solutions to accelerate the training of extensive AI models.
• Work closely with Omniverse infrastructure teams and customers to fully understand and meet their compute and storage needs, ensuring seamless integration with AI/HPC workload managers and cloud APIs.
• Tackle key system software challenges in compute, networking, and storage to enhance the overall performance, efficiency, and resilience of large language model training and other computational tasks.

We are seeking a Senior Infrastructure System Software Engineer with profound expertise in High-Performance Computing (HPC) and AI workload management, as well as Kubernetes-based infrastructure, to join our Omniverse Infrastructure team. The ideal candidate will have a strong understanding of system software design principles and extensive experience in deploying, managing, optimizing, and scaling sophisticated AI and cloud environments using workload management software systems such as SLURM, Flux, PBS Pro, and Kubernetes. Proficiency in integrating HPC/AI workload managers with Cloud resource provisioning APIs (e.g., AWS EC2 with topology-aware configurations) is desirable., * 8+ years of experience in system software engineering with a focus on developing and enhancing AI/HPC workload management software such as SLURM and Flux framework.

• BS Degree or equivalent experience.
• Demonstrated ability in developing fault-tolerant, distributed services at scale.
• Strong familiarity with HPC workload managers such as SLURM, Flux, PBS Pro, and their integration with Cloud APIs to create large AI/HPC cluster instances within major CSPs, for example, by using AWS EC2 provisioning, reservation and topology-aware configurations APIs.
• Proficiency in Python, C/C++, with a solid background in systems programming, including event-based programming, multi-threading, concurrency, and parallelism.
• A deep understanding of cloud technologies including Clouds’ managed services, distributed computing systems, and microservices architecture.
• An advanced degree in Computer Science or a related field, or equivalent professional experience.
• Excellent collaborative skills and the ability to work effectively across multi-functional teams and geographies., * In-depth, practical knowledge of significantly modifying HPC workload managers such as SLURM and Flux.
• Demonstrated experience in maximizing advanced cloud services for AI optimization that use NVIDIA high-end GPUs.
• Experience with low level system provisioning tools such as Forward-thinking Cluster Manager (BCM).

The base salary range is 176,000 USD - 333,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.