> Markdown version of [/jobs/ext/1498983-senior-staff-engineer-ai-software](https://www.wearedevelopers.com/jobs/ext/1498983-senior-staff-engineer-ai-software). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Staff Engineer, AI Software - **Company:** Samsung - **Location:** San Jose, CA, United States - **Experience:** Expert - **Salary:** $189,000.0 - $301,000.0 - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, JIRA, Github, Software Engineering, AI Infrastructure, Graphics Processing Unit (GPU), Pytorch, Large Language Models, Linux Development - **Published:** July 30, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/17214019?backUrl=%2Fcareer%2F17214019%2FSenior-Staff-Ai-Software-Engineer-California-San-Jose ## About the Role * Bachelor's with 15+ years, or Master's with 13+ years, or PhD's with 10+ years of industry experience. * Strong experience writing high-performance AI framework software development for GPUs or other accelerators. * Strong, end-to-end understanding of the AI infrastructure, AI software stack, from model definition through deployment and serving. * Solid understanding of LLM model architectures and workflows, including modern transformer-based designs. * Solid understanding of agentic AI architecture and workflows. * Hands-on expertise with the PyTorch framework. * Practical experience with vLLM for high-throughput model inference and serving. * Solid understanding of the memory wall problem and its impact on AI system performance. * Strong knowledge of memory architecture, including High Bandwidth Memory (HBM), and familiarity with memory-centric acceleration and compute approaches. * Proficiency working in a Linux development environment. * Solid command of development tooling, including agentic coding, GitHub and Jira. ## Description * Lead the co-design of software and hardware solutions that optimize AI model inference performance, with a focus on overcoming memory bottlenecks. * Analyze and optimize LLM and agentic AI workloads across the full software stack, identifying opportunities for hardware-aware acceleration. * Profile and characterize model execution to expose memory wall limitations and guide architectural decisions for HBM and memory-centric compute. * Collaborate with hardware teams to influence memory architecture, acceleration strategies, and compute placement based on real workload behavior. * Develop, optimize, and benchmark inference and serving solutions using frameworks such as PyTorch and vLLM. * Define best practices and provide technical mentorship across software-hardware co-design efforts., At Samsung Semiconductor, we use Artificial Intelligence (AI) tools in the recruitment process to enhance efficiency. However, AI is used as a support tool, not a final decision-maker. All hiring decisions are made by our human recruiting team and hiring managers to ensure every candidate is evaluated fairly and holistically. ## Related Videos - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Engineering Mindset in the Age of AI - Gunnar Grosch, AWS](https://www.wearedevelopers.com/videos/1735-engineering-mindset-in-the-age-of-ai-gunnar-grosch-aws) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)