> Markdown version of [/jobs/ext/1985392-systems-design-engineer-ai-software](https://www.wearedevelopers.com/jobs/ext/1985392-systems-design-engineer-ai-software). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Systems Design Engineer (AI, Software) - **Company:** Advanced Micro Devices, Inc. - **Location:** San Jose, CA, United States - **Salary:** $140,800.0 - **Contract:** Permanent contract - **Skills:** Board Bringup, Artificial Intelligence, C++ (Programming Language), Profiling, Computer Programming, Computer Engineering, Software Debugging, Data Flow Control, Python (Programming Language), Linux Kernel, Linux System Administration, Machine Learning, Performance Tuning, Software Engineering, Multithreading, Graphics Processing Unit (GPU), High Performance Computing, Pytorch, Model Validation, Hardware Testing, Parallel Computation, Information Technology, ONNX (Open Neural Network Exchange) Format, Machine Learning Operations, Software Version Control - **Published:** August 8, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/17864065?backUrl=%2Fcareer%2F17864065%2FSystems-Design-Engineer-Ai-Software-California-San-Jose ## About the Role * Strong software development experience using C/C++ and Python. * Experience with parallel programming, multithreaded applications, and performance optimization. * Knowledge of machine learning inference workloads and common operators such as GEMM, convolution, attention, and softmax. * Familiarity with AI frameworks and runtimes such as PyTorch, ONNX Runtime, ROCm, or similar technologies. * Understanding of computer architecture, memory hierarchies, cache behavior, and accelerator programming models. * Experience developing software for GPUs, NPUs, AI accelerators, or other high-performance computing platforms. * Experience using development, debugging, profiling, and source control tools in Linux environments. * Familiarity with MLIR, LLVM, compiler technologies, or related software stacks. * Exposure to quantization techniques, including INT8, FP8, FP16, or BF16 optimization. * Knowledge of dataflow architectures, systolic arrays, or custom accelerator designs. * Publications, patents, or demonstrated technical contributions in machine learning systems, computer architecture, or related fields. ACADEMIC CREDENTIALS * Master's or PhD in Computer Engineering, Electrical Engineering, Computer Science, or a related technical field preferred. ## Description AMD is seeking an AI Systems Engineer to help develop and optimize machine learning workloads on next-generation AMD AI accelerators. In this role, you will work at the intersection of hardware and software, designing high-performance ML operator kernels, optimizing dataflow pipelines, and enabling industry-leading AI inference performance across AMD NPU and GPU platforms. You will collaborate closely with compiler, runtime, silicon, and architecture teams while helping bring cutting-edge AI technologies from concept to production. This role offers full-stack visibility from kernel development and model optimization through hardware validation and silicon bring-up. If you are passionate about AI systems, accelerator architectures, and solving complex performance challenges, this is an opportunity to make a significant impact on products deployed in millions of devices worldwide. THE PERSON The ideal candidate is a systems-minded engineer who enjoys tackling complex performance and optimization challenges at the hardware-software boundary. You are naturally curious, thrive in collaborative environments, and are comfortable working across multiple technical domains to debug, analyze, and improve system behavior. You have a strong foundation in computer architecture and machine learning systems, enjoy working with cross-functional teams, and can translate technical insights into scalable solutions that improve performance, functionality, and product quality., * Develop and optimize machine learning operator kernels and dataflow libraries for AMD AI accelerators. * Profile workloads, identify performance bottlenecks, and drive software and system-level optimizations. * Enable and validate ML models within production inference frameworks and runtime environments. * Collaborate with compiler, runtime, architecture, and silicon teams to deliver high-performance AI solutions. * Debug and resolve issues spanning kernel implementation, runtime integration, model accuracy, and hardware bring-up. * Contribute to hardware-software co-design efforts by evaluating architectural tradeoffs and influencing future accelerator technologies. * Drive innovation in performance methodologies, benchmarking, tooling, and AI system optimization., AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD's "Responsible AI Policy" is available here. ## Related Videos - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire) - [An Applied Introduction to eBPF with Go](https://www.wearedevelopers.com/videos/1075-an-applied-introduction-to-ebpf-with-go) - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) - [Into the hive of eBPF!](https://www.wearedevelopers.com/videos/1199-into-the-hive-of-ebpf) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)