Software Engineer II - AI Infrastructure

Software engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems.

You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You’ll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms.

This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Implement AI Systems: Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions.
• Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.
• Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
• Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
• Full-Stack Engagement: engage with components across the entire stack-from infrastructure to APIs-to deliver end-to-end solutions.

• Bachelor’s Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience., * Master’s Degree in Computer Science or related technical field
• AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR Bachelor’s Degree in Computer Science or related technical field
• AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience.
• Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions.
• Familiarity with relevant tools, frameworks, or programming languages: Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, LangChain.
• Optional experience with OpenAI API / Azure OpenAI.
• Communication and collaboration abilities.
• Problem-solving and decision-making under ambiguity.
• Strategic thinking and adaptability.

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.