AI Software Test Engineer- 5+ yrs- New York, United States- Onsite

Job Requirements Location: Remote USARole Summary: Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.Key Resposibilities:- Design and execute test plans covering AI model outputs, data correctness, and application functionality.- Create automated tests for APIs and UI where appropriate; maintain regression suites.- Validate business logic, edge cases, and non-functional requirements (performance, reliability).- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).- Triage defects, document reproducible steps, and partner with engineers to resolve issues.- Contribute to release readiness, quality gates, and continuous improvement of testing practices.Required Qualifications:- 4+ years in QA/Test Engineering for web/services-based applications.- Experience with test automation tools (Selenium) and API testing (Postman or similar).- Strong understanding of test case design, defect lifecycle, and agile QA practices.- Familiarity with tracking tools (JIRA) and test documentation.- Ability to reason about data quality and validate outputs against requirements.Preferred Nice to have:- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.- Performance testing experience (load, stress) and observability basics.- Knowledge of accessibility testing for UI.Core Skills:Selenium, Postman, Test Cases, JIRA, Manual Testing Work Experience 5-7Years