AI Agentic Tester
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+5 more
Job description
-
Execute API testing using Postman, Swagger, and REST APIs.
-
Develop and maintain automation scripts using Python, Selenium, Playwright, or PyTest.
-
Validate multi-agent interactions, tool calling, and workflow execution.
-
Apply AI testing methodologies and evaluation metrics to ensure response quality.
Requirements
-
AI Agentic Testing
-
Functional Testing
-
Generative AI Testing
-
Large Language Models (LLMs)
-
AI Agents & Agentic AI
-
Retrieval-Augmented Generation (RAG)
-
Prompt Engineering Validation
-
AI Model Validation & Evaluation
-
API Testing (Postman, REST APIs, Swagger)
-
Python
-
Test Automation (Selenium / Playwright / PyTest)
-
AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency)
-
End-to-End Workflow Testing
-
Multi-Agent Testing
-
Azure OpenAI / AWS Bedrock / Gemini
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
The Overflow: AI and Agentic Coding
MLOps And AI Driven Development
Dev Digest 213: Petrol Prices, Agentic Workflows, AI Skills and CODE100!
Top AI Tools for Developers in 2025