Infrastructure Operations Engineer

Lightning AI
New York, NY, United States
23 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$160,000.0 - $200,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Computing Platforms Build Automation Bash Shell Ubuntu (Operating System) Linux Ethernet Monitoring of Systems InfiniBand Python (Programming Language) Network Attached Storage (Server Appliance) Ansible
+14 more
Prometheus Software Engineering Ceph (Software) Network Switches Network Routers Computer Network Operations System Availability Firewalls (Computer Science) Juniper Kubernetes Bare Metal Terraform Elk Stack Golang

Job description

In this role, you’ll work hands-on with large-scale GPU environments, Linux systems, bare metal infrastructure, provisioning workflows, and platform reliability. You’ll partner closely with Infrastructure Engineering, Network Operations, and Software Platform teams to troubleshoot issues, improve operational efficiency, and build automation that reduces manual toil over time., * At the direction of the Manager of Infrastructure Operations, design, build, and roll out new platforms and patterns to minimize incidents and enable customer facing and internal features.

  • Deploy updates and improvements to support both Voltage Park’s internal and end customer use cases.
  • Collaborate with colleagues in Infrastructure Engineering, Network Operations, Customer Success and Software and Platform Development Teams.
  • Participate in the on-call rotation which is evenly distributed across all team members in a primary / secondary pattern where you are primary then move to a secondary position.

Requirements

  • 8+ years working with Linux as a server / hosting platform, extra points for Ubuntu experience.
  • 5+ years experience with AWS.
  • 2+ years experience with Kubernetes and strong container fundamentals.
  • 2+ years experience with Terraform and Ansible
  • 2+ years with network attached storage management (via NFS, ceph, or other protocols). Extra points for experience with VAST storage systems.
  • Experience with monitoring systems (Prometheus, ELK stack).
  • Familiarity with the gitops workflow.
  • Software development experience using Python, Go, bash, or other languages for the purposes of automation & connecting systems & APIs together.
  • Deep networking fundamentals, extra points for experience with datacenter level networks, 400Gb ethernet, and Infiniband.
  • Experience building and delivering complex systems.
  • Effective at navigating tradeoffs between design, risk, cost, and outcomes.
  • Comfortable with navigating ambiguity.
  • Strong written and oral communication., * Experience with bare metal hardware troubleshooting and provisioning, extra points for working with Dell hardware.
  • Experience with GPU servers, both in bare metal form or under virtualization.
  • Deep experience with network switches, routers, and firewalls, particularly SONiC switches, Palo Alto firewalls and Juniper Networks as vendors.
  • Experience with VAST storage systems

Benefits & conditions

Pulled from the full job description

  • Paid parental leave
  • Parental leave
  • Health insurance
  • Paid time off
  • Vision insurance
  • Dental insurance
  • Paid holidays, We offer a comprehensive and competitive benefits package designed to support our employees’ health, well-being, and long-term success. Benefits may vary by location, team, and role., * Comprehensive medical, dental and vision coverage (U.S.); Private medical and dental insurance (U.K.)
  • Retirement and financial wellness support (U.S.); Pension contribution (U.K.)
  • Generous paid time off, plus holidays
  • Paid parental leave
  • Professional development support
  • Wellness and work-from-home stipends
  • Flexible work environment

About the company

Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems-designed to take ideas from research to production with less friction.

Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in.

We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute., At Lightning AI, we are committed to fostering an inclusive and diverse workplace. We believe that diverse teams drive innovation and create better products. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected characteristic. We are dedicated to building a culture where everyone can thrive and contribute to their fullest potential.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

2:39 min

Experiencing core Linux capabilities for DevOps administration

Michael Cade · LIVE

7:31 min

Essential foundational skills and concepts for infrastructure roles

Megha Kadur · LIVE

1:33 min

Case study on adopting Kubernetes and Golang effectively

Andrew Holway · LIVE

Videos

See all

Related articles

See all