> Markdown version of [/jobs/ext/2459332-software-test-engineer-on-device-ai-generative-ai](https://www.wearedevelopers.com/jobs/ext/2459332-software-test-engineer-on-device-ai-generative-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # #Software Test Engineer - On-Device AI / Generative AI - **Company:** Qualcomm - **Location:** San Diego, CA, United States (Remote available) - **Experience:** Starter - **Salary:** $94,200.0 - $141,200.0 - **Contract:** Permanent contract - **Skills:** Testing (Software), Java (Programming Language), Artificial Intelligence, Automation of Tests, Bash Shell, Code Coverage, Profiling, Information Systems, Computer Programming, Data Structures, Software Debugging, Python (Programming Language), Linux System Administration, Machine Learning, Regression Testing, Software Engineering, System Testing, Systems Integration, Large Language Models, Model Validation, Generative AI, Information Technology, Machine Learning Operations, Virtual Agents - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=f6fcc4961aa55f60 ## About the Role * Bachelor's degree in Engineering, Information Systems, Computer Science, or related field., Required - BS/MS in Computer Science or related field. - Strong foundation in AI/ML, data structures, and algorithms. - 1-3+ years of experience in software testing or AI validation (fresh graduates with strong AI/ML and programming fundamentals will also be considered) Technical Skills - Strong programming skills in Python, Java, and Shell. - Experience with Linux environments and debugging tools. AI Expertise - Knowledge of LLMs, LVMs, LoRA, and agentic AI concepts. - Understanding of AI inference workflows. Soft Skills - Fast learner and adaptable to fast-paced environments. - Strong team player with excellent communication skills. Preferred - Experience with on-device AI frameworks and automation at scale. - Familiarity with AI evaluation metrics and performance profiling - Familiarity with Qualcomm's ML/AI Frameworks - QNN SDK or ML SW development kit is a plus ## Description This role emphasizes on-device AI stability, system-level validation, and end-to-end AI pipeline verification across SoC (CPU, GPU, DSP, and NPU) execution environments, ensuring robust and scalable AI performance on real-world devices. This role targets engineers with a strong foundation in computer science (especially AI/ML) who are passionate about testing and validating cutting-edge generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The candidate will play a critical role in driving AI test coverage, automation, and system-level quality, ensuring high reliability, performance, and scalability of on-device AI features in a fast-paced environment., On-Device AI Testing & Validation - Validate on-device AI solutions across mobile, PC, and automotive platforms, ensuring functionality, performance, and robustness. - Design, develop, and execute end-to-end validation workflows, including model integration, test framework or test application development, device bring-up, and full system validation on target hardware. - Validate Generative AI use cases across text, multimodal, and speech pipelines, leveraging techniques such as LoRA/adapters, RAG, and agentic AI workflows, ensuring correctness, robustness, and performance on-device Test Coverage & Quality Ownership - Define, expand, and track AI test coverage across features and platforms. - Identify coverage gaps and develop new test scenarios. - Monitor coverage metrics, pass rates, and regression trends. Test Automation Development & Maintenance - Develop new and maintain existing automation frameworks and scripts using Python, Java, and Shell. - Build scalable pipelines for AI validation and regression testing. - Improve efficiency through reusable tools and automation best practices. Generative AI & Model Validation - Validate Generative AI models including LLMs, LVMs (multimodal models), and LoRA-based adaptations - Analyze model outputs for accuracy, consistency, robustness, and edge-case behavior - Validate hybrid AI pipelines and RAG-based systems, including retrieval quality and response correctness - Evaluate agentic AI workflows, including multi-step reasoning, tool invocation, and execution reliability ## Related Videos - [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing) - [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative) - [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks) - [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire) - [The shadows that follow the AI generative models](https://www.wearedevelopers.com/videos/624-the-shadows-that-follow-the-ai-generative-models) - [MCP doesn’t suck — your agent does](https://www.wearedevelopers.com/videos/100202-mcp-doesn-t-suck-your-agent-does) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [The Fastest-Growing Tech Sectors to Look Out for in 2025](https://www.wearedevelopers.com/magazine/373-the-fastest-growing-tech-sectors-to-look-out-for-in-2025) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)