> Markdown version of [/jobs/ext/4299933-ai-software-test-engineer-5-yrs-new-york-united-states-onsite](https://www.wearedevelopers.com/jobs/ext/4299933-ai-software-test-engineer-5-yrs-new-york-united-states-onsite). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Software Test Engineer- 5+ yrs- New York, United States- Onsite

- **Company:** iMedhas Consulting Services
- **Location:** New York, NY, United States
- **Experience:** Experienced
- **Contract:** Contract
- **Skills:** Testing (Software), Web Accessibility, Application Programming Interfaces (APIs), Artificial Intelligence, Business Logic, JIRA, Automation of Tests, Software Documentation, Regression Analysis, Selenium, Test Case, Performance Testing, Postman, Large Language Models, Api Management
- **Published:** October 12, 2026
- **Apply:** https://www.dice.com/job-detail/dae90731-d535-41d2-a054-a8cc471ef767

## About the Role

Job Requirements Location: Remote USARole Summary: Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.Key Resposibilities:- Design and execute test plans covering AI model outputs, data correctness, and application functionality.- Create automated tests for APIs and UI where appropriate; maintain regression suites.- Validate business logic, edge cases, and non-functional requirements (performance, reliability).- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).- Triage defects, document reproducible steps, and partner with engineers to resolve issues.- Contribute to release readiness, quality gates, and continuous improvement of testing practices.Required Qualifications:- 4+ years in QA/Test Engineering for web/services-based applications.- Experience with test automation tools (Selenium) and API testing (Postman or similar).- Strong understanding of test case design,
defect lifecycle, and agile QA practices.- Familiarity with tracking tools (JIRA) and test documentation.- Ability to reason about data quality and validate outputs against requirements.Preferred Nice to have:- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.- Performance testing experience (load, stress) and observability basics.- Knowledge of accessibility testing for UI.Core Skills:Selenium, Postman, Test Cases, JIRA, Manual Testing Work Experience 5-7Years