Technical Program Manager, Compute Infrastructure

OpenAI Inc.
San Francisco, CA, United States
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$257,000.0 - $335,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Computer Clusters Multithreading Computer Network Operations GPT

Job description

The compute infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation models. We operate a large, modern GPU fleet and provide a unified platform for other OpenAI teams to seamlessly run production Applied AI and Research training workloads.

We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth. About the Role

You will be part of an engineer-first TPM team as a Technical Program Manager for Compute Infrastructure who owns the end-to-end delivery of large-scale GPU clusters, partnering with engineers to bring clusters online across external providers and partners. You’ll run a broad, parallel portfolio spanning hardware, networking, power, and cooling-driving execution, risk management, and crisp alignment from working teams through leadership to deliver production-ready capacity at scale.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will:

  • Lead end-to-end delivery of both New Compute SKUs and large-scale GPU clusters across an external partner ecosystem while supporting capacity planning for training and inference.
  • Ability to contextually drive multi-threaded bring-up programs spanning hardware, networking, power, and cooling-owning plans, dependencies, and critical paths.
  • Interface with chip providers to derisk long-term onboarding to new hardware platforms by working across kernels, comms, hardware, and scheduling engineering teams.
  • Build and operationalize program mechanisms (roadmaps, milestones, risk registers, runbooks) that make delivery predictable at massive scale.
  • Partner with engineering to improve cluster turn-up reliability, repeatability, and automation, reducing time-to-serve for new capacity.
  • Support network operations and end-to-end physical and logical bring-up of OpenAI network Points-of-Presence (PoPs), including on-site deployment, rack cabling, and close collaboration with engineering teams.
  • Coordinate cross-functional readiness (security, finance, operations, product/research stakeholders) to ship production-ready compute.
  • Manage integration and handoffs across teams and partners-ensuring consistent execution, clear communication, and fast issue resolution.
  • Identify bottlenecks and systemic gaps, then drive durable fixes across tooling, process, and partner interfaces.
  • Provide crisp executive visibility on progress, tradeoffs, and risks across a large portfolio of concurrent programs.

Requirements

  • Possess a degree in a hard science, or have a demonstrated track record of engineering expertise.
  • Have 5+ years of experience in program management for major projects including capital projects or hyperscaler infrastructure deployment.
  • Demonstrate the ability to serve as the go-to person solely responsible for driving and delivering complex projects.
  • Are comfortable managing cross-functional and cross-company teams; experience driving information and decision hygiene.
  • Have an extensive track record of successfully delivering high-profile, technical projects against tight deadlines.
  • Are technically adept and have effectively partnered with engineering or fundamental research teams of the highest caliber.
  • Have experience interfacing with and leading external vendors including engineering firms, equipment suppliers, and/or construction firms.
  • Have expertise in designing and implementing simple, scalable processes that solve complex problems.
  • Have experience managing complicated dependencies such as logistics and/or supply chains.
  • Are relentlessly resourceful and thrive in ambiguous, fast-paced environments.
  • Are interested in and thoughtful about the impacts of AGI.

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity., At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.localjobnetwork.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:36 min

Managing new AI workloads for non-technical employees

Michael Coté Michael Coté · WWC Europe 2026

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

3:13 min

Multithreading basics and physical versus logical threads

Grzegorz Lang · WWC 2022

6:12 min

Provisioning a free SingleStore workspace and computing cluster

Akmal Chaudhri Akmal Chaudhri · LIVE

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

Videos

See all

Related articles

See all