> Markdown version of [/jobs/ext/4646871-software-engineer-gpu-performance](https://www.wearedevelopers.com/jobs/ext/4646871-software-engineer-gpu-performance). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, GPU Performance

- **Company:** HeyGen Technology Inc.
- **Location:** Los Angeles, CA, United States
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, C++ (Programming Language), Profiling, Nvidia CUDA, Computer Programming, Extract Transform Load (ETL), Memory Management, Python (Programming Language), Machine Learning, Regression Testing, Software Engineering, Graphics Processing Unit (GPU), High Performance Computing, Pytorch, Gpu Programming, Discretization, Transformer Architectures, Machine Learning Operations, Stable Diffusion
- **Published:** November 9, 2026
- **Apply:** https://www.careerbuilder.com/job-details/software-engineer-gpu-performance-los-angeles-ca--e474d48b-51be-4057-84ec-82c1c786fbc6

## About the Role

Software Engineering, GPU (Graphics Processing Unit), Software Engineering, GPU (Graphics Processing Unit), Kernel Programming, CPU (Central Processing Unit), Memory Hardware, Performance Management, Memory Management, Benchmarking, * Experience optimizing GPU-based AI workloads or high-performance computing systems.

 * Proficiency in Python and experience with PyTorch or a similar machine learning framework.
 * Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and data movement between CPU and GPU.
 * Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.
 * Ability to turn performance experiments into reliable production changes and communicate tradeoffs clearly.

Preferred Qualifications

 * Experience with CUDA, Triton, or C++ GPU programming.
 * Experience optimizing video, image, audio, diffusion, or Transformer models.
 * Familiarity with multi-GPU inference, GPU interconnects, quantization, or large-scale model serving.
 * Experience building performance benchmarks or regression testing infrastructure.
 * Prior experience in a fast-paced technology environment.

## Description

HeyGen is building AI applications including Avatar IV, Photo Avatar, Interactive Avatar, and Video Translation. We're looking for a Software Engineer focused on GPU performance to make the systems behind these experiences faster and more efficient.

You will work across model execution and inference infrastructure, using profiling and measurement to improve latency, throughput, and GPU cost. This role is a fit for an engineer who enjoys understanding how software uses the hardware beneath it., * Use NVIDIA Nsight Systems, Nsight Compute, and PyTorch Profiler to investigate GPU utilization, kernel execution, memory bandwidth, and CPU-GPU data movement.

 * Identify bottlenecks across model execution, preprocessing, and inference serving, then measure the impact of each optimization.
 * Improve performance through batching, scheduling, memory management, and better GPU utilization.
 * Develop or integrate high-performance GPU kernels when existing implementations limit performance.
 * Build benchmarks and automated checks that catch performance regressions across representative video workloads.
 * Collaborate with AI researchers and infrastructure engineers to bring optimizations into production.
 * Measure the effect of changes on latency, throughput, cost, and output quality.