AI Agentic Tester

Delan Associates, Inc
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Automation of Tests Microsoft Azure Python (Programming Language) Swagger Selenium Postman Large Language Models Multi-Agent Systems Prompt Engineering Generative AI
+5 more
Pytest Playwright Virtual Agents Restful APIs Api Management

Job description

  • Execute API testing using Postman, Swagger, and REST APIs.

  • Develop and maintain automation scripts using Python, Selenium, Playwright, or PyTest.

  • Validate multi-agent interactions, tool calling, and workflow execution.

  • Apply AI testing methodologies and evaluation metrics to ensure response quality.

Requirements

  • AI Agentic Testing

  • Functional Testing

  • Generative AI Testing

  • Large Language Models (LLMs)

  • AI Agents & Agentic AI

  • Retrieval-Augmented Generation (RAG)

  • Prompt Engineering Validation

  • AI Model Validation & Evaluation

  • API Testing (Postman, REST APIs, Swagger)

  • Python

  • Test Automation (Selenium / Playwright / PyTest)

  • AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency)

  • End-to-End Workflow Testing

  • Multi-Agent Testing

  • Azure OpenAI / AWS Bedrock / Gemini

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

9:05 min

Exploring the AI contract testing assistant inside Backstage

Moataz Nabil Moataz Nabil · World Congress 2026 Europe

1:59 min

Designing governed and AI-native API platforms

Gbadebo Bello Gbadebo Bello · Europe 2026 Virtual

1:25 min

Testing API endpoints visually using Swagger UI

Alex Soto Alex Soto · World Congress 2022

3:05 min

Tagging and organizing execution scenarios with pytest markers

Florian Bruhin · World Congress 2021

1:16 min

Automating documentation and code generation with OpenAPI standards

James Seconde · World Congress 2023

3:07 min

Internal framework architecture and Swagger UI documentation

Matteo Collina Matteo Collina · JS Congress

Videos

See all

Related articles

See all