> Markdown version of [/jobs/ext/3028388-senior-system-software-engineer-ai-data-platform-inference-factory-optimization](https://www.wearedevelopers.com/jobs/ext/3028388-senior-system-software-engineer-ai-data-platform-inference-factory-optimization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior System Software Engineer - AI Data Platform - Inference Factory Optimization - **Company:** NVIDIA Ltd. - **Location:** Santa Clara, CA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Business Analytics Applications, Data Analysis, Automation of Tests, C++ (Programming Language), Profiling, Computer Programming, Computer Engineering, Continuous Delivery, Continuous Integration, Data Centers, Data Infrastructure, Software Debugging, Device Drivers, Distributed Systems, Memory Management, Python (Programming Language), Machine Learning, Network Protocols, Performance Tuning, Software Engineering, Software Systems, System Software, Reliability of Systems, Information Technology, Docker - **Published:** September 22, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/nptb1pq41d ## About the Role * Bachelor's or equivalent experience in Computer Science, Computer Engineering, or a related technical field, or Master's degree or equivalent experience in a similar field. * 5+ years of industry experience in software development, focusing on infrastructure, distributed systems, automation, and/or performance engineering. * Expertise in System-Level Programming: Proven ability to develop robust tools and automation using programming languages such as C++, Python, or Go. * Deep Understanding of System Software: Experience with operating system internals, device drivers, memory management, and debugging performance issues in complex compute applications. * Distributed Systems: Experience in designing, building, and operating large-scale distributed systems, with knowledge of networking protocols, cluster management, and high-performance interconnects. * Automation and CI/CD Proficiency: Experience building and maintaining automated testing, benchmarking, and continuous integration/continuous deployment pipelines. * Problem-Solving and Analytical Skills: Outstanding analytical, problem-solving, and debugging skills, with a track record of resolving complex technical challenges. * Collaboration and Communication: Excellent interpersonal and communication skills, with the ability to articulate complex technical concepts to diverse audiences and collaborate effectively across teams. Ways to stand out from the crowd * Experience optimizing performance for AI/Machine Learning workloads, especially inference applications, on diverse hardware platforms. * Prior experience building or contributing to large-scale compute infrastructure solutions in cloud environments or on-premises data centers. * Experience with containerization and orchestration technologies, such as Docker and Kubernetes. * Familiarity with performance profiling tools and methodologies for hardware and software systems. * Track record of driving significant efficiency gains or architectural improvements in large-scale systems. ## Description * Develop efficient infrastructure and tools for automating complex software processes. * Drive Performance Optimization: Implement advanced test harnesses, benchmarking frameworks, and analytical tools to rigorously characterize and optimize the performance and efficiency of our software and hardware platforms. * Apply deep knowledge of operating systems, kernel internals, device drivers, memory management, storage, networking, and high-speed interconnects to build and troubleshoot highly performant systems. * Work with engineering teams to understand needs, define requirements, and deliver efficient solutions. * Set performance goals, monitor feedback, analyze data, and make continuous improvements for system reliability. * Influence Technical Strategy: Contribute to defining technical strategies and roadmaps for our platform automation initiatives, ensuring alignment with company-wide goals and standard methodologies. ## Related Videos - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire) - [The Sustainability Race: AI's Promises, Pitfalls and Potential](https://www.wearedevelopers.com/videos/100155-the-sustainability-race-ai-s-promises-pitfalls-and-potential) - [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia) - [Your Next AI Needs 10,000 GPUs. Now What?](https://www.wearedevelopers.com/videos/1590-your-next-ai-needs-10-000-gpus-now-what) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)