Staff Software Engineer, AI Infrastructure, Google Cloud, Applied AI

Google LLC
Sunnyvale, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$262,000.0 - $365,000.0
Working hours
Regular working hours
Job source

Tech stack

A/B Testing Artificial Intelligence C++ (Programming Language) Software Quality Distributed Systems Fault Tolerance Software Engineering Systems Architecture AI Infrastructure Google Cloud High Performance Computing Large Language Models
+4 more
Multi-Agent Systems Reliability of Systems Information Technology Programming Languages

Job description

  • Architect and build high-performance, distributed infrastructure to support agentic AI workflows. Ensure low-latency agentic systems for real-world enterprise loads.
  • Take full ownership of the tech stack, transitioning experimental models into robust production services. Ensure system reliability, observability, and fault tolerance in complex, multi-agent environments.
  • Iterate rapidly on customer needs by identifying product gaps and implementing missing features. Translate vague user requirements into concrete, engineering-driven solutions that directly improve the user experience.
  • Provide technical guidance on system architecture and code quality.
  • Foster a culture of engineering excellence through design reviews, code audits, and the adoption of best practices.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google’s EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Requirements

Do you have experience in Software engineering?, Do you have a Master’s degree?, * Bachelor’s degree or equivalent practical experience.

  • 8 years of experience with software development in one or more programming languages (e.g. C++).
  • Experience with Artificial Intelligence, Distributed Systems, LLMs and High Performance Computing., * Master’s degree or PhD in Computer Science, or a related field with a focus on Systems or AI.
  • Experience building and maintaining multi-agent systems or complex applications in an enterprise setting.
  • Experience with evaluation frameworks for AI quality in production (e.g., A/B testing, shadow deployment, online learning).
  • Ability to navigate ambiguity and iterate quickly on customer feedback to deliver solutions that precisely meet market needs.

About the company

Google Cloud’s mission is to make every business successful through AI by combining cutting-edge technology, infrastructure, and talent. AI/ML software engineers in Cloud bridge the gap between pioneering models and a massive product vehicle reaching billions. Our talent density and AI-powered tools drive rapid development, rooted in a culture of empowerment and a bias to action. In this role, you aren’t just building technology; you’re shaping the frontier of enterprise and driving the evolution of advanced models.

As a Staff Software Engineer, you will be passionate about bridging the gap between innovations and reliable, scalable production systems. We are moving beyond prototypes to deliver robust, agentic AI solutions for impactful enterprise use cases.

In this role, you will use your expertise in the end-to-end technology stack-from low-level C++ optimizations to high-level application logic. You will be responsible for landing real-world impact by iterating directly on customer feedback, implementing critical missing features, and architecting the scalable infrastructure required to run sophisticated multi-agent systems at a global enterprise scale.

The Cloud Applied AI (AAI) powers business growth with Gemini Enterprise. Our portfolio includes Gemini Enterprise for Customer Experience (Shopping Agent, CX Agent Studio, Agent Assist, Vertex AI Search - Commerce, Customer Experience Insights), along with other vertical and domain packaged solutions. We enable high adoption and speed to value by building solutions that are quickly deployed, delivering new 0-to-1 capabilities with startup agility. Team members operate at the forefront of AI, collaborating directly with model builders with unprecedented speed. Join us to work on cutting-edge projects and shape the future of AI in a fast-paced, collaborative, and impactful environment. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $262000 - $365000 (USD) + 25% bonus target + bonus + equity + benefits

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

54 sec

Generating multiple hook options for outreach A/B testing

Leandro Gomes da Silva Leandro Gomes da Silva · WWC 2025

6:10 min

Unlocking free learning credits via Google Cloud Innovators

Asrar Asrar · WWC 2024

1:05 min

Practical Byzantine Fault Tolerance in distributed computing systems

Jonan Scheffler · WWC 2022

3:51 min

Shifting skill requirements for entry-level software engineers

Taroon Mandhana Taroon Mandhana +1 · WWC Europe 2026

2:24 min

Building scalable icon and button libraries internally

Nathalia Rus · WWC 2022

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

Videos

See all

Related articles

See all