> Markdown version of [/jobs/ext/1508262-ai-sdet-data](https://www.wearedevelopers.com/jobs/ext/1508262-ai-sdet-data). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI SDET- Data

- **Company:** Therapy Brands
- **Location:** Overland Park, KS, United States (Remote available)
- **Contract:** Franchise
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Software Applications, Automation of Tests, C Sharp (Programming Language), Data Validation, Data Systems, Database Queries, Distributed Systems, Python (Programming Language), Machine Learning, Automation of Marketing, Regression Analysis, SQL Databases, TypeScript, Postman, Large Language Models, Reliability of Systems, Generative AI, Scalability Testing, Backend, Playwright, Machine Learning Operations, Data Pipelines, Automation Anywhere, Api Management, SDET, Programming Languages
- **Published:** July 30, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=05ff965510efb1c0

## About the Role

Strong experience as an SDET or Automation Engineer with a focus on backend and service-level testing
*
Proficiency in test automation using one or more programming languages (TypeScript, Java, C#, or Python)
*
Strong experience with API testing and distributed systems validation
*
Solid understanding of data validation concepts including accuracy, consistency, and completeness
*
Strong SQL skills
*
Hands-on experience using SQL and/or programmatic checks to validate data used by applications or AI systems
*
Experience integrating automated tests into CI/CD pipelines
*
Ability to translate requirements and expected AI behavior into reliable, repeatable automated tests

Nice to Have
*
Experience testing AI/ML systems, RAG pipelines, or LLM-based applications
*
Familiarity with testing non-deterministic systems and defining effective test oracles
*
Experience validating data drift, model regressions, or AI behavior changes over time
*
Familiarity with Playwright, Postman, or similar testing frameworks
*
Experience working with data-intensive platforms or analytics systems
*
Background in healthcare or other regulated environments
*
Interest in leveraging AI-assisted testing techniques to improve coverage and efficiency

## Description

We are seeking a AI Software Development Engineer in Test (SDET) to ensure the quality, reliability, and trustworthiness of AI-powered applications. This role is automation-first and focuses heavily on validating AI behavior, verifying data correctness, and ensuring system reliability across backend services, data pipelines, Retrieval-Augmented Generation (RAG) systems, and AI agents. You will work closely with AI, machine learning, data, and platform engineering teams, with guidance and support from senior quality leadership., Design, build, and maintain robust automated tests for backend services, APIs, and AI-enabled systems
*
Validate end-to-end AI workflows, including data inputs, retrieval logic, and generated outputs
*
Test RAG systems by verifying source data quality, retrieval accuracy, and response correctness
*
Perform data verification to ensure the accuracy of summarized, derived, and feature-level data used by AI systems
*
Validate AI behavior for consistency, edge cases, regressions, and failure scenarios
*
Identify data anomalies, drift, and pipeline issues impacting AI outputs and collaborate on resolution
*
Integrate automated tests into CI/CD pipelines and contribute to quality metrics and reporting
*
Support performance, reliability, and scalability testing for AI-driven services


## Related Videos

- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)
- [Back to the Roots: Testing in the Age of AI](https://www.wearedevelopers.com/videos/100021-back-to-the-roots-testing-in-the-age-of-ai)
- [User 1st! Technology 2nd! Stop building AI nobody uses - start delivering real business outcomes](https://www.wearedevelopers.com/videos/100337-user-1st-technology-2nd-stop-building-ai-nobody-uses-start-delivering-real-business-outcomes)
- [Meet Your New BFF: Backend to Frontend without the Duct Tape](https://www.wearedevelopers.com/videos/682-meet-your-new-bff-backend-to-frontend-without-the-duct-tape)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)
- [Top AI Tools for Developers in 2025](https://www.wearedevelopers.com/magazine/560-top-ai-tools-for-developers-in-2025)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)