> Markdown version of [/jobs/ext/1321686-senior-staff-engineer-gdc-ai-inference-platform](https://www.wearedevelopers.com/jobs/ext/1321686-senior-staff-engineer-gdc-ai-inference-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Staff Engineer, GDC AI Inference Platform - **Company:** Google LLC - **Location:** Sunnyvale, CA, United States - **Experience:** Expert - **Salary:** $262,000.0 - $365,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, C++ (Programming Language), Cloud Computing, Computer Programming, Data Structures, Distributed Systems, Industry Standard Architecture, Python (Programming Language), Software Architecture, Reliability Engineering, Software Engineering, AI Infrastructure, Large Language Models, Multi-Agent Systems, Kotlin, Containerization, Kubernetes, Information Technology, Machine Learning Operations, Virtual Agents, Decoding, Docker - **Published:** July 17, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=17b9c5d6cd2bedd5 ## About the Role * Bachelor's degree or equivalent practical experience. * 8 years of experience with software development, programming in C++, Java, Python, Kotlin, or Go. * 5 years of experience testing, and launching software products. * 4 years of experience in technical leadership (as a Tech Lead, Staff, or Principal Engineer) leading the architecture, design, and delivery of large-scale distributed systems or cloud infrastructure platforms. * 3 years of experience with software design and architecture., * Master's degree or PhD in Engineering, Computer Science, or a related technical field. * 8 years of experience with data structures and algorithms. * 5 years of experience in a technical leadership role leading project teams and setting technical direction. * Experience designing orchestration platforms or runtime environments for Agentic AI, focusing on multi-agent coordination, state persistence, tool integration, and secure sandboxed execution. * Deep expertise in ML systems engineering, including optimizing LLM serving architectures (e.g., disaggregated serving, speculative decoding, or high-throughput inference engines) and containerization technologies (Kubernetes, Docker). ## Description * Define the GDC AI infrastructure roadmap for LLM serving and Agentic AI platforms, managing key architectural decisions, technology choices, and system health. * Architect scalable, reliable LLM serving infrastructure, pioneering crucial optimizations like disaggregated serving to maximize resource and hardware efficiency. * Build the core platforms and orchestration tools necessary for multi agent systems, seamless tool integration, state persistence, and secure, isolated execution environments. * Collaborate with AI Research, Site Reliability Engineering (SRE), Product, and core platform teams to align and deliver integrated, production-ready AI solutions. * Resolve ambiguous, high impact systems issues, balancing immediate enterprise customer needs with architectural integrity. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Kotlin Multiplatform - True power of native code reuse](https://www.wearedevelopers.com/videos/4-kotlin-multiplatform-true-power-of-native-code-reuse) - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Designing and Deploying Distributed Multimodal Multi-Agent Systems with Google's AI Stac](https://www.wearedevelopers.com/videos/1976-designing-and-deploying-distributed-multimodal-multi-agent-systems-with-google-s-ai-stac) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)