Fellow Software Engineer - AI Performance & Reliability

Advanced Micro Devices, Inc.
San Jose, CA, United States
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Systems Engineering C++ (Programming Language) Program Optimization Profiling Nvidia CUDA Software Debugging Distributed Systems Monitoring of Systems Python (Programming Language) Machine Learning Performance Tuning
+13 more
Recommender Systems Tensorflow Software Engineering AI Infrastructure Pytorch Large Language Models Parallel Computation Reliability of Systems Information Technology Low Latency Machine Learning Operations Service Stack Programming Languages

Job description

ADVANCE YOUR CAREER. ADVANCE THE WORLD.

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger - technology that moves the world forward.

Fellow Software Engineer - AI Performance & Reliability THE ROLE:

We are looking for a strong, Principal or Fellow level software engineer to join our AI Infrastructure team. You will work on improving the performance, efficiency, and reliability of AI workloads across both model training and inference.

Our team supports a broad range of machine learning systems, including large language models, diffusion models, and recommendation models. You will collaborate closely with customers and internal engineering teams to understand performance bottlenecks, optimize workloads, and ensure that models run reliably at scale.

This role is a strong fit for an engineer who enjoys working across the AI software and hardware stack, solving technically challenging performance problems, and partnering directly with customers to make them successful.

You will help customers achieve meaningful improvements in model performance and system reliability. You will identify difficult bottlenecks, develop reusable solutions, and help shape the infrastructure and product capabilities needed to run demanding AI workloads efficiently at scale. THE PERSON:

  • Profile and optimize AI model training and inference workloads.
  • Improve model throughput, latency, memory efficiency, scalability, and reliability.
  • Identify bottlenecks across models, frameworks, compilers, runtimes, operating systems, and hardware.
  • Optimize workloads involving large language models, diffusion models, recommendation systems, and other modern machine learning architectures.
  • Develop performance tooling, benchmarks, automation, and observability systems.
  • Investigate and resolve complex production issues affecting AI workloads.
  • Collaborate with customers to understand their technical requirements, reproduce issues, and recommend effective solutions.
  • Translate customer feedback into product and infrastructure improvements.
  • Work closely with machine learning engineers, systems engineers, hardware teams, and product teams.
  • Document performance findings, technical recommendations, and best practices.

KEY RESPONSIBILITIES:

  • Strong software engineering skills and experience building production-quality systems.
  • Experience working with AI infrastructure for model training, inference, or both.
  • Demonstrated experience profiling and optimizing machine learning models or AI workloads.
  • Strong foundations in computer architecture, including processors, memory hierarchies, parallelism, and performance tradeoffs.
  • Solid understanding of systems performance concepts such as latency, throughput, memory bandwidth, utilization, and distributed communication.
  • Proficiency in languages such as Python, C++, or similar systems-oriented programming languages.
  • Experience with machine learning frameworks such as PyTorch, TensorFlow, or JAX.
  • Strong debugging and analytical skills, with the ability to investigate problems across multiple layers of the technology stack.
  • Clear written and verbal communication skills.
  • A customer-focused mindset and willingness to work directly with customers through technical evaluations, deployments, troubleshooting, and ongoing support.

PREFERRED EXPERIENCE:

  • Experience optimizing large language models, diffusion models, or recommendation models.
  • Experience with GPU, accelerator, or distributed computing environments.
  • Familiarity with technologies such as ROCm, HIP, CUDA, Triton, XLA, MLIR, NCCL, or similar performance-oriented tools and runtimes.
  • Experience with distributed training, model serving, quantization, compilation, kernel optimization, or memory optimization.
  • Experience operating AI systems in production environments.
  • Prior experience in solutions engineering, field engineering, developer relations, or another customer-facing technical role.
  • Experience designing benchmarks and conducting systematic performance analysis.

ACADEMIC CREDENTIALS:

  • A PhD (or a master’s degree with equivalent experience) in artificial intelligence, machine learning, computer science, or a related field.

LOCATION:

San Jose, CA or Bellevue, WA preferred (Hybrid). Other US locations may be considered.

LI-MV1

HYBRID

Benefits offered are described: AMD benefits at a glance.

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

This posting is for an existing vacancy.

Requirements

  • Strong software engineering skills and experience building production-quality systems.
  • Experience working with AI infrastructure for model training, inference, or both.
  • Demonstrated experience profiling and optimizing machine learning models or AI workloads.
  • Strong foundations in computer architecture, including processors, memory hierarchies, parallelism, and performance tradeoffs.
  • Solid understanding of systems performance concepts such as latency, throughput, memory bandwidth, utilization, and distributed communication.
  • Proficiency in languages such as Python, C++, or similar systems-oriented programming languages.
  • Experience with machine learning frameworks such as PyTorch, TensorFlow, or JAX.
  • Strong debugging and analytical skills, with the ability to investigate problems across multiple layers of the technology stack.
  • Clear written and verbal communication skills.
  • A customer-focused mindset and willingness to work directly with customers through technical evaluations, deployments, troubleshooting, and ongoing support.

PREFERRED EXPERIENCE:

  • Experience optimizing large language models, diffusion models, or recommendation models.
  • Experience with GPU, accelerator, or distributed computing environments.
  • Familiarity with technologies such as ROCm, HIP, CUDA, Triton, XLA, MLIR, NCCL, or similar performance-oriented tools and runtimes.
  • Experience with distributed training, model serving, quantization, compilation, kernel optimization, or memory optimization.
  • Experience operating AI systems in production environments.
  • Prior experience in solutions engineering, field engineering, developer relations, or another customer-facing technical role.
  • Experience designing benchmarks and conducting systematic performance analysis.

ACADEMIC CREDENTIALS:

  • A PhD (or a master’s degree with equivalent experience) in artificial intelligence, machine learning, computer science, or a related field.

About the company

At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.

AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger - technology that moves the world forward.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerarc.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:35 min

Preventing remote code execution in PyTorch models

Balåzs Kiss ¡ WWC 2023

47 sec

Profiling native execution calls with async-profiler

Gonzalo Ortiz Jaureguizar Gonzalo Ortiz Jaureguizar ¡ WWC Europe 2026

1:39 min

Fundamentals of tensors and the TensorFlow library

Hükan Silfvernagel ¡ LIVE

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 ¡ WWC Europe 2026

2:36 min

Exploring high-level Python frameworks for accelerated enterprise artificial intelligence

Paul Graham Paul Graham ¡ LIVE

4:41 min

Replacing PyTorch with ONNX runtime for AWS Lambda deployments

Marek Suppa ¡ LIVE

Videos

See all

Related articles

See all