Staff Software Engineer, AI Engines 3P TPU Inference

Google LLC
Mountain View, CA, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Cloud Computing Software Debugging Machine Learning Software Architecture Software Engineering Reinforcement Learning Data Processing Machine Learning Operations

Job description

Experteer Overview In this role you will help advance ML infrastructure at scale within Google, shaping how ML systems perform across Cloud and partner products. You will collaborate with Research and cross-functional teams to drive impactful ML capabilities, including compilers and runtimes, and help migrate runtimes and workflows to ML Runtime. You will lead technical direction and deliver scalable software solutions that influence the broader Google AI stack. This is a high-impact, leadership-oriented engineering role at the intersection of ML research and production. Compensation / Benefits * Guide sustainable engineering choices for ML systems at scale * Define next directions for infrastructure over a 12-month horizon * Deliver capability and optimization improvements to Cloud and partner products * Migrate runtimes and custom workflows onto ML Runtime with minimal user disruption * Partner with GDM to transfer innovations into product teams Tasks * Bachelor’s degree or equivalent practical experience * 8 years of software development experience * 5 years testing and launching software products * 3 years in software design and architecture * 5 years of experience with ML-related domains (speech/audio, reinforcement learning, ML infrastructure, or related field) * 5 years experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning) Key requirements * bonus target (20%) * equity * health benefits * career growth opportunities * work eligibility sponsorship * remote-friendly policies

Requirements

Experteer Overview In this role you will help advance ML infrastructure at scale within Google, shaping how ML systems perform across Cloud and partner products. You will collaborate with Research and cross-functional teams to drive impactful ML capabilities, including compilers and runtimes, and help migrate runtimes and workflows to ML Runtime. You will lead technical direction and deliver scalable software solutions that influence the broader Google AI stack. This is a high-impact, leadership-oriented engineering role at the intersection of ML research and production. Compensation / Benefits * Guide sustainable engineering choices for ML systems at scale * Define next directions for infrastructure over a 12-month horizon * Deliver capability and optimization improvements to Cloud and partner products * Migrate runtimes and custom workflows onto ML Runtime with minimal user disruption * Partner with GDM to transfer innovations into product teams Tasks * Bachelor’s degree or aaaaaa help practical experience * 8 years of software development experience * 5 years testing and launching software products * 3 years in software design and architecture * 5 years of experience with ML-related domains (speech/audio, reinforcement learning, ML infrastructure, or related field) * 5 years experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning) Key requirements * bonus target (20%) * equity * health benefits * career growth opportunities * work eligibility sponsorship * remote-friendly policies

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou Ā· Coffee With Developers

2:27 min

Introduction to WebAssembly in a cloud computing context

Edo Edo Ā· WWC 2024

2:10 min

Defining stream data processing versus standard event processing

Soroosh Khodami Soroosh Khodami Ā· WWC 2024

2:36 min

Applying supervised machine learning for practical rule extraction

Katja TrƤumner

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski Ā· LIVE

2:51 min

Alibaba Cloud developer resources and cloud computing training

Cheng Zhang Ā· LIVE

Videos

See all

Related articles

See all