Systems Engineer - AI Infrastructure

CLOCKWORK SYSTEMS, INC.
United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$150,000.0 - $230,000.0
Working hours
Regular working hours
Job source

Tech stack

Systems Engineering C++ (Programming Language) Computer Clusters Profiling Nvidia CUDA Databases Software Debugging Device Drivers Distributed Data Store Distributed Systems Fault Tolerance InfiniBand
+4 more
Remote Direct Memory Access Software Engineering Pytorch Gpu Programming

Job description

We’re building infrastructure for fault-tolerant, high-performance distributed GPU training. You’ll work at the intersection of GPU systems, high-speed networking, and distributed coordination-designing and implementing systems that run at scale.

This is a systems building role. You’ll dig into internals, understand why things break under pressure, and design solutions that handle the messy reality of distributed systems. What You’ll Do

  • Design and implement low-level systems software for GPU clusters
  • Work with internals of frameworks like PyTorch, NCCL, CUDA runtime-not as a user, but modifying and extending them
  • Build components that make large-scale GPU training more reliable and efficient
  • Debug complex distributed/concurrent systems where failures are subtle and non-deterministic
  • Own systems end-to-end: from design through production

Requirements

Required: Systems building experience, * Kernel subsystems, device drivers, or OS-level components

  • Distributed storage, databases, or coordination systems
  • Runtimes, profilers, or performance tooling
  • Network stacks, protocols, or high-performance I/O systems
  • Large-scale infrastructure at the systems layer

Core technical skills:

  • Strong C/C++ in systems contexts (not just application code)
  • Deep understanding of concurrency, memory models, and failure modes
  • Experience reasoning about distributed system behavior: consistency, ordering, partial failures
  • Comfortable reading and modifying large, unfamiliar codebases

Nice to have:

  • GPU programming (CUDA) or GPU systems experience
  • High-performance networking (RDMA, InfiniBand)
  • ML framework or runtime internals
  • Cluster scheduling or orchestration systems

We believe strong systems engineers pick up domain-specific tools quickly. We value your ability to reason about complex systems over checkbox familiarity with our specific stack. Senior Expectations

  • Lead design of significant system components
  • Navigate ambiguity and define technical direction
  • Mentor engineers and raise team capabilities
  • 8+ years building systems software

Benefits & conditions

  • Challenging projects.
  • A friendly and inclusive workplace culture.
  • Competitive compensation.
  • A great benefits package.
  • Catered lunch.

Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $230,000. In addition to cash compensation, this role is eligible to participate in the company’s equity program, which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · WWC Europe 2026

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

47 sec

Profiling native execution calls with async-profiler

Gonzalo Ortiz Jaureguizar Gonzalo Ortiz Jaureguizar · WWC Europe 2026

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:41 min

Replacing PyTorch with ONNX runtime for AWS Lambda deployments

Marek Suppa · LIVE

Videos

See all

Related articles

See all