AI Agentic Tester
TALENT Software Services
Denver, CO, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Amazon Web Services
Microsoft Azure
Python (Programming Language)
OpenAI
Swagger
Selenium
Strategies of Testing
Postman
Retrieval-Augmented Generation
Large Language Models
Multi-Agent Systems
+10 more
Prompt Engineering
Generative AI
Agentic-AI
Pytest
AI Platforms
Playwright
Virtual Agents
Google Gemini
Restful APIs
Api Management
Job description
- Validate AI agent workflows against business requirements.
- Test end-to-end AI use cases, including multi-agent interactions.
- Verify task completion accuracy and output quality.
- Test agent orchestration, tool calling, and workflow execution.
AI Model Validation
- Evaluate LLM responses for accuracy, relevance, and consistency.
- Test prompt engineering effectiveness and response quality.
- Validate Retrieval-Augmented Generation (RAG) outputs.
- Measure hallucination rates and response reliability.
Requirements
Skills: QA/Test Engineering experience Must have- Experience testing Generative AI, LLM, or AI-based applications.
Keyword: Skills: Modern Functional Quality Engineering Experience Required: 2-4 Years
PFB the responsibilities and skills needed, * 3-8 years of QA/Test Engineering experience.
- Experience testing Generative AI, LLM, or AI-based applications.
- Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
- Hands-on experience with API testing (Postman, Swagger, REST APIs).
- Experience with automation frameworks (Selenium, Playwright, PyTest).
- Proficiency in Python.
- Understanding of AI evaluation metrics and testing methodologies
- Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦