infrastructure engineers

CAUSAL LABS, INC.
San Francisco, CA, United States
about 1 month ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Computer Clusters Configuration Management Nvidia CUDA Linux Reliability Engineering Software Engineering Supercomputing Data Logging
+6 more
Graphics Processing Unit (GPU) Kubernetes Slurm Machine Learning Operations Software Version Control Docker

Job description

Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.

To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.

Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.

We look for infrastructure engineers who are excited to tackle unsolved problems. Everything we do - training, evaluation, serving - runs on our GPU fleet. Your mission is to design, build, and operate the supercomputing environment underneath it all, delivering performant, reliable, and cost-efficient compute to ensure research is able to iterate rapidly at scale.

Responsibilities

  • Design, deploy, and operate large distributed GPU clusters end to end: provisioning, imaging, upgrades, and capacity planning
  • Extend scheduling and orchestration systems (e.g. Kubernetes, Slurm) for topology-aware placement, preemption, quotas, and multi-tenancy across training and inference workloads
  • Build software that abstracts cluster management and presents a unified, self-serve interface to researchers and engineers
  • Own cluster storage and artifact paths for checkpoints and logs, with clear retention and lineage
  • Monitor and continuously improve reliability and error recovery; build the observability to catch failures before researchers do
  • Partner with researchers to unblock large-scale runs and advise on performance and placement trade-offs

Requirements

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

  • Experience operating large-scale GPU clusters and container orchestration frameworks (e.g. Kubernetes, Slurm, Docker)
  • Strong systems background: Linux, networking, storage, infrastructure-as-code
  • Knowledge of cloud platforms (GCP, AWS, or Azure) and their ML/AI service offerings
  • Understanding of monitoring, logging, observability, and version control best practices for ML systems
  • Familiarity with CUDA/NCCL and performance profiling for distributed workloads
  • Owns deliverables end-to-end, from requirements through autonomous execution

Skills: Amazon Web Services (AWS), Artificial Intelligence (AI), Best Practices, CUDA (Compute Unified Device Architecture), Capacity Management, Cloud Computing, Continuous Improvement, Docker, Drug Discovery, Error Recovery, GCP (Good Clinical Practices), GPU (Graphics Processing Unit), Microsoft Windows Azure, Particle Physics, Physics, Problem Solving Skills, Reliability Engineering, Research Skills, Robotics, Source Code/Configuration Management (SCM), Supercomputing, Vehicle Fleets

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

2:22 min

Infrastructure barriers and compliance risks in research

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · World Congress 2026 Europe

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

Videos

See all

Related articles

See all