Data Scientist, Infrastructure Organization

OpenAI Inc.
San Francisco, CA, United States
1 day ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Computer Programming Data Files Python (Programming Language) SQL Databases Scripting Large Language Models Backend

Job description

As a Data Scientist on the Infra team, you will play a key role in shaping how we scale the infrastructure that powers OpenAI’s products and research. This is critical as we operate one of the largest and most advanced compute fleets in the world, supporting millions of users and businesses globally. We focus on aligning infrastructure measurement, planning, scaling, allocation, and efficiency to drive measurable impact across the company.

You should expect to guide the definition of foundational datasets for infrastructure resources, develop metrics that inform key decisions, build forecasting and optimization models, and establish source of truth dashboards and analyses that enable teams to understand and improve infra usage. Most importantly, you should expect to be a core partner to engineering, research, and product teams in shaping the infrastructure that powers everything OpenAI builds.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Build and maintain foundational datasets and metrics that reflect infrastructure usage, efficiency, and scaling.
  • Develop forecasting and optimization models to support infra planning and resource allocation.
  • Partner with engineering, research, and product teams to shape infrastructure strategy through data.
  • Drive clarity with source-of-truth dashboards and analyses that guide infra decisions across OpenAI.

Requirements

  • 5+ years of experience in a quantitative role navigating ambiguous environments, ideally in infrastructure, systems, or platform domains at a high-growth company or research org
  • Experience defining and operationalizing metrics that reflect system performance, resource usage, or efficiency from the ground up
  • A strong foundation in SQL and Python, and a track record of building models and analyses that drive technical and strategic decisions
  • Excellent communication skills and the ability to partner effectively with engineers, researchers, and product stakeholders
  • A strategic mindset that goes beyond statistical testing to surface actionable insights and long-term tradeoffs

You could be an especially great fit if you have:

  • Proven track record of operating as a data partner in large scale backend systems
  • Comfortable navigating fast-paced execution while also anchoring decisions in long-term impact
  • Strong programming background, with ability to run simulations and prototype variants
  • Experience in NLP, large language models, or generative AI, Affirmative Action, Analysis Skills, Artificial Intelligence (AI), Communication Skills, Computer Programming, Data Science, Data Sets, Equal Employment Opportunity (EEO), Forecasting, Genetics, Large-Scale Systems, Metrics, Prototyping, Python Programming/Scripting Language, Reporting Dashboards, Resource Management, SQL (Structured Query Language), Technical Strategy, Vehicle Fleets

About the company

Our infrastructure team helps deliver OpenAI’s most capable models and products to the world by scaling infrastructure and turning demand into useful FLOPS. We collaborate across research, engineering, design, and business to turn cutting-edge AI advancements into impactful, real-world applications. Our team ensures the right compute is available-at the right time and place-to support some of the world’s most demanding workloads. We empower all of OpenAI’s products and research by scaling the infrastructure behind them. Our work makes it possible to launch new models and products reliably and at scale., OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity., At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:04 min

Introduction to Bitcoin script parsing tools

Steve Shadders · LIVE

3:38 min

Reusing email software standards for HTTP file uploads

Imran Nazar · WWC 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · WWC 2024

2:03 min

Solving complex engineering challenges in artificial intelligence deployment

Nico Axtmann · WWC 2022

Videos

See all

Related articles

See all