Software Co-Design AI HPC Systems

Our team's mission is to architect, co-design, andproductionizenext-generation AI systems atdatacenterscale. Weoperateat the intersection of models, systems software, networking, storage, and AI hardware,optimizingend-to-end performance, efficiency, reliability, and cost. Our work spans today's frontier AI workloads and directly shapes the next generation of accelerators, system architectures, and large-scale AI platforms. We pursue this mission through deep hardware-software co-design, combining rigorous systems thinking with hands-on engineering. The team invests heavily in understanding real production workloads large-scale training, inference, and emerging multimodal models and translating those insights into concrete improvements across the stack: from kernels, runtimes, and distributed systems, all the way down to silicon-level trade-offs and datacenter-scale architectures.

This role sits at the boundary between exploration and production. You will work closely with internal infrastructure, hardware, compiler, and product teams, as well as external partners across the hardware and systems ecosystem. Our operating model emphasizes rapid ideation and prototyping, followed by disciplined execution to drive high-leverage ideas into production systems thatoperateatmassivescale.

In addition to delivering real-world impact on large-scale AI platforms, the team actively contributes to the broader research and engineering community. Our work aligns closely with leading communities in ML systems, distributed systems, computer architecture, and high-performance computing, and we regularly publish, prototype, and open-source impactful technologies whereappropriate. Microsoft Superintelligence Team Microsoft Superintelligence team's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. This role is part of Microsoft AI's Superintelligence Team. The MAIST is a startup-like team inside Microsoft AI, created to push the boundaries of AI toward Humanist Superintelligence-ultra-capable systems that remain controllable, safety-aligned, and anchored to human values. Our mission is to create AI that amplifies human potential while ensuring humanity remains firmly in control. We aim to deliver breakthroughs that benefit society-advancing science, education, and global well-being. We're also fortunate to partner with incredible product teams giving our models the chance to reach billions of users and create immense positive impact. If you're a brilliant, highly-ambitious and low ego individual, you'll fit right in-come and join us as we work on our next generation of models! Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location. This expectation is subject to local law and may vary byjurisdiction.

Responsibilities

• Lead the co-design of AI systems across hardware and software boundaries, spanning accelerators, interconnects, memory systems, storage, runtimes, and distributed training/inference frameworks.

• Drive architectural decisions by analyzing real workloads,identifyingbottlenecks acrosscompute, communication, and data movement, and translating findings into actionablesystemand hardware requirements.

• Co-design and optimize parallelism strategies, execution models, and distributed algorithms to improve scalability,utilization, reliability, and cost efficiency of large-scale AI systems.

• Develop and evaluate what-if performance models to project system behavior under future workloads, model architectures, and hardware generations,providingearly guidance to hardware and platform roadmaps.

• Partner with compiler, kernel, and runtime teams to unlock the full performance of current and next-generation accelerators, including custom kernels, scheduling strategies, and memory optimizations.

• Influence and guide AI hardware design at system and silicon levels, including accelerator microarchitecture, interconnect topology, memory hierarchy, and system integration trade-offs.

• Lead cross-functional efforts to prototype,validate, andproductionizehigh-impact co-design ideas, working across infrastructure, hardware, and product teams.

• Mentor senior engineers and researchers, set technical direction, and raise the overall bar for systems rigor, performance engineering, and co-design thinking across the organization.

Required/Minimum Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

• OR equivalent experience., * Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.

• Strong background in one or more of the following areas:

• AI accelerator or GPU architectures
• Distributed systems and large-scale AI training/inference
• High-performance computing (HPC) and collective communications
• ML systems, runtimes, or compilers
• Performance modeling, benchmarking, and systems analysis
• Hardware-software co-design for AI workloads

• Proficiencyin systems-level programming (e.g., C/C++, CUDA, Python) and performance-critical software development.
• Proven ability to work across organizational boundaries and influence technical decisions involving multiple stakeholders.
• Experience designing oroperatinglarge-scale AI clusters for training or inference.
• Deep familiarity with LLMs, multimodal models, or recommendation systems, and their systems-level implications.
• Experience with accelerator interconnects and communication stacks (e.g., NCCL, MPI, RDMA, high-speed Ethernet or InfiniBand).
• Background in performance modeling and capacity planning for future hardware generations.
• Prior experience contributing to or leading hardware roadmaps, silicon bring-up, or platform architecture reviews.
• Publications, patents, or open-source contributions in systems, architecture, or ML systems are a plus.

Microsoft is a global technology company headquartered in Redmond, Washington. Our mission is to empower every person and every organization on the planet to achieve more. We develop, license, and support a wide range of software products, services, and devices that help individuals and businesses realize their full potential.

Our flagship products include the Microsoft 365 productivity cloud, Windows operating system, Azure cloud platform, and Dynamics 365 business applications. We are also a leader in areas such as artificial intelligence, cybersecurity, developer tools, and gaming through Xbox and Game Pass.

With operations in more than 190 countries and over 220,000 employees worldwide, Microsoft is committed to responsible innovation, inclusive economic growth, and sustainability. We work closely with governments, industries, and communities to ensure that technology serves the public good and helps address some of the world’s most pressing challenges.

As we celebrate our 50th anniversary in 2025, we continue to look forward—investing in AI, cloud, and quantum computing to shape the future of work, education, and society at large scale.