> Markdown version of [/jobs/ext/1350067-gen-ai-tester](https://www.wearedevelopers.com/jobs/ext/1350067-gen-ai-tester). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Gen AI Tester

- **Company:** Info Way Solutions LLC
- **Location:** United States (Remote available)
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Testing (Software), Artificial Intelligence, JIRA, Automation of Tests, Microsoft Azure, Bug Tracking Systems, Python (Programming Language), Scrum Methodology, Software Testing Automation Framework, Strategies of Testing, Scripting, Postman, Large Language Models, Prompt Engineering, Test Scripts, Generative AI
- **Published:** July 19, 2026
- **Apply:** https://www.dice.com/job-detail/6180f4a2-39a5-4f15-9fcc-67306ef040eb

## About the Role

* 3+ years of QA/Software Testing experience.
 * Hands-on experience testing Generative AI/LLM-based applications.
 * Strong understanding of AI testing methodologies, prompt validation, and response evaluation.
 * Experience with manual and/or automation testing.
 * Familiarity with defect tracking tools such as JIRA.
 * Experience with API testing tools like Postman is a plus.
 * Understanding of Agile/Scrum methodologies.
 * Strong analytical, communication, and problem-solving skills.

Preferred Qualifications

 * Experience working with OpenAI, Azure OpenAI, Google Gemini, Anthropic Claude, or similar LLM platforms.
 * Knowledge of prompt engineering and AI evaluation metrics.
 * Experience with test automation frameworks is a plus.
 * Exposure to Python or scripting for testing is preferred.

## Description

We are seeking experienced Gen AI Testers to join our team for a long-term engagement. The ideal candidate will have hands-on experience testing Generative AI applications, validating AI-generated outputs, creating test strategies, and ensuring the quality, reliability, and accuracy of AI-powered solutions., * Develop and execute test plans, test cases, and test scripts for Generative AI applications.

 * Validate AI-generated responses for accuracy, relevance, consistency, and safety.
 * Perform functional, regression, integration, and end-to-end testing.
 * Identify, document, and track defects through resolution.
 * Test AI prompts and evaluate prompt engineering scenarios.
 * Verify LLM behavior, response quality, hallucinations, bias, and edge cases.
 * Collaborate with developers, data scientists, and product teams to resolve issues.
 * Participate in sprint planning, daily stand-ups, and QA reviews.
 * Ensure compliance with quality standards and testing best practices.


## Related Videos

- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java)
- [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks)
- [Back to the Roots: Testing in the Age of AI](https://www.wearedevelopers.com/videos/100021-back-to-the-roots-testing-in-the-age-of-ai)
- [Intermediate Bitcoin Script](https://www.wearedevelopers.com/videos/25-intermediate-bitcoin-script)
- [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software)

## Related Articles

- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [13 AI Tools for Developers](https://www.wearedevelopers.com/magazine/302-13-ai-tools-for-developers)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)