Software Engineer Manager - ML Infra

Facebook Inc.
New York, NY, United States
6 days ago
Apply on www.jobmonkeyjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Adobe InDesign Artificial Intelligence Computer Engineering Distributed Systems Linux Kernel Machine Learning Performance Tuning Tensorflow Software Engineering Graphics Processing Unit (GPU) Pytorch Machine Learning Operations

Job description

Lead a team at the intersection of AI, distributed systems, and hardware architecture. The role drives ML model efficiency and scale, infrastructure costs, and enables next-generation AI capabilities. Directly supporting Meta’s ability to train and serve AI models at scale.

Software Engineer Manager - ML Infra Responsibilities:

  • People Leadership: Build/retain an engineering team
  • provide coaching, mentorship, and performance management
  • Technical Leadership: Engage in design reviews, architecture decisions, and technical trade-offs
  • define technical vision with Tech Leads
  • Execution: Drive complex hardware-software co-design projects to completion
  • manage roadmaps, timelines, and risk mitigation
  • Cross-Functional Partnership: Collaborate with AI Infra, Hardware Engineering, Product, and Research
  • represent the team to leadership

Requirements

  • 3+ years managing software engineering teams with high-performing team track record
  • Technical background in at least two of: AI/ML systems, distributed/HPC systems, or model optimization with GPUs/accelerators
  • Demonstrated ability to engage deep in technical work and guide decisions
  • Experience supporting engineer development through mentorship, technical guidance, and career growth planning
  • Experience communicating technical strategy and influencing cross-functional stakeholders through written proposals and presentations

Preferred Qualifications:

  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • M.S. or Ph.D. in CS, EE, or related field
  • Familiarity with AI compilers, high-performance kernel development, or hardware enablement
  • Experience building teams in ambiguous, exploratory domains
  • Background in performance optimization/profiling
  • Prior Tech Lead, TLM, or IC experience before management
  • Experience with PyTorch, TensorFlow, or equivalent AI frameworks
  • Track record of maintaining team engagement through regular feedback, clear goal-setting, and retention-focused practices, with consistent delivery outcomes

About the company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobmonkeyjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

1:15 min

Overcoming the challenges of modifying Linux kernel code

Ayesha Kaleem · World Congress 2023

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

1:06 min

Compiling PyTorch environments for advanced time forecasting

Christoph Lohrmann Christoph Lohrmann +1 · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all