Staff Software Engineer, AI Infrastructure, Google Cloud, Applied AI

Google LLC
Sunnyvale, United States of America
27 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 365K

Job location

Sunnyvale, United States of America

Tech stack

A/B testing
Artificial Intelligence
C++
Software Quality
Distributed Systems
Fault Tolerance
Software Engineering
Systems Architecture
AI Infrastructure
Google Cloud Platform
High Performance Computing
Large Language Models
Multi-Agent Systems
Reliability of Systems
Information Technology
Programming Languages

Job description

  • Architect and build high-performance, distributed infrastructure to support agentic AI workflows. Ensure low-latency agentic systems for real-world enterprise loads.
  • Take full ownership of the tech stack, transitioning experimental models into robust production services. Ensure system reliability, observability, and fault tolerance in complex, multi-agent environments.
  • Iterate rapidly on customer needs by identifying product gaps and implementing missing features. Translate vague user requirements into concrete, engineering-driven solutions that directly improve the user experience.
  • Provide technical guidance on system architecture and code quality.
  • Foster a culture of engineering excellence through design reviews, code audits, and the adoption of best practices.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Requirements

Do you have experience in Software engineering?, Do you have a Master's degree?, * Bachelor's degree or equivalent practical experience.

  • 8 years of experience with software development in one or more programming languages (e.g. C++).
  • Experience with Artificial Intelligence, Distributed Systems, LLMs and High Performance Computing., * Master's degree or PhD in Computer Science, or a related field with a focus on Systems or AI.
  • Experience building and maintaining multi-agent systems or complex applications in an enterprise setting.
  • Experience with evaluation frameworks for AI quality in production (e.g., A/B testing, shadow deployment, online learning).
  • Ability to navigate ambiguity and iterate quickly on customer feedback to deliver solutions that precisely meet market needs.

About the company

Google Cloud's mission is to make every business successful through AI by combining cutting-edge technology, infrastructure, and talent. AI/ML software engineers in Cloud bridge the gap between pioneering models and a massive product vehicle reaching billions. Our talent density and AI-powered tools drive rapid development, rooted in a culture of empowerment and a bias to action. In this role, you aren't just building technology; you're shaping the frontier of enterprise and driving the evolution of advanced models. As a Staff Software Engineer, you will be passionate about bridging the gap between innovations and reliable, scalable production systems. We are moving beyond prototypes to deliver robust, agentic AI solutions for impactful enterprise use cases. In this role, you will use your expertise in the end-to-end technology stack-from low-level C++ optimizations to high-level application logic. You will be responsible for landing real-world impact by iterating directly on customer feedback, implementing critical missing features, and architecting the scalable infrastructure required to run sophisticated multi-agent systems at a global enterprise scale. The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $262000 - $365000 (USD) + 25% bonus target + bonus + equity + benefits

Apply for this position