> Markdown version of [/jobs/ext/1748492-ai-testing-engineer](https://www.wearedevelopers.com/jobs/ext/1748492-ai-testing-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI testing Engineer

- **Company:** Apptad Inc.
- **Location:** Tampa, FL, United States
- **Experience:** Expert
- **Salary:** $100,100.0 - $150,400.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Automation of Tests, Data Validation, JSON, Python (Programming Language), Machine Learning, Parsing, Data Streaming, Systems Integration, Data Logging, Scripting, Data Storage Technologies, Large Language Models, Machine Learning Operations, Functional Programming
- **Published:** July 16, 2026
- **Apply:** https://www.careerjet.com/jobad/usa9f26cdf3ae5dde5e0b80ea2a08569b3

## About the Role

Strong Python scripting for automation and testing . Experience in AI/ML model validation and QA workflows.
Hands-on with: JSON parsing, schema comparison Data validation pipelines
Experience in testing: Multi-modal AI systems (vision + NLP + audio) LLM outputs and generative AI pipelines. Good understanding of: Structured output validation AI accuracy evaluation techniques Familiarity with AWS cloud environment (S3, Lambda, logging/monitoring) Experience with media/video content analysis workflows preferred Ability to handle mixed manual + automated testing approaches

## Description

We are seeking an AI Testing Engineer to validate and assure quality of AI/ML systems powering real-time contextual advertising on live video streams. The role involves testing multi-modal AI outputs (video + text), ensuring accuracy of detected moments, and automating validation workflows.
This role is critical for native moments validation and system-level QA in a real-time streaming environment., Validate AI-generated outputs against labelled datasets and expected outcomes
Perform content validation for native moments detection across video streams
Design and implement automated testing frameworks (Python-based)
Build validation harness for:
JSON parsing and comparison
Structured output validation using defined schemas
Conduct multi-modal validation (video, audio, transcript outputs)
Execute system integration and end-to-end testing
Track accuracy metrics, defect logging, and root cause analysis
Automate regression and validation pipelines across datasets
Collaborate with Applied Scientists to validate LLM and GenAI outputs
Work within AWS environment using services such as:
S3 (data storage).Lambda (processing).CloudWatch (monitoring), As a Hebrew Transcription Expert, you will play a crucial role in training next-generation AI systems by providing high-quality, real-world input. Your expertise will directly infl…

 + 29 days ago
 + Apply easily
+
*

Senior Development Engineer
Johnson Controls

 + Tampa, FL
 + $100,100-150,400 per year
What you will do Under minimal direction, participates as a leader of the Development Team to achieve department and project objectives on medium to large projects. Leads enginee…

 + 12 days ago


## Related Videos

- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed)
- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [How to Assess and Hire Talent: The Skills-Based Hiring Playbook for the AI Age](https://www.wearedevelopers.com/videos/1488-how-to-assess-and-hire-talent-the-skills-based-hiring-playbook-for-the-ai-age)
- [Hate organising your photos? Try it with 5 Terabytes](https://www.wearedevelopers.com/videos/79-hate-organising-your-photos-try-it-with-5-terabytes)
- [Building a Compiler with C#](https://www.wearedevelopers.com/videos/116-building-a-compiler-with-c)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)