> Markdown version of [/jobs/ext/2750312-test-engineering-analyst-ml-ai-chatbot-w2-dmv-areas](https://www.wearedevelopers.com/jobs/ext/2750312-test-engineering-analyst-ml-ai-chatbot-w2-dmv-areas). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Test Engineering Analyst - ML/AI Chatbot - W2 DMV Areas

- **Company:** Nexiva Inc
- **Location:** Baltimore, MD, United States
- **Experience:** Experienced
- **Salary:** $100,000.0 - $245,000.0
- **Contract:** Permanent contract
- **Skills:** Testing (Software), Java (Programming Language), Artificial Intelligence, Amazon Web Services, Confluence, JIRA, Automation of Tests, Cloud Computing, Python (Programming Language), Machine Learning, Oracle (Applications), Standard Sql, Salesforce.Com, Selenium, Chatbots, Large Language Models, Snowflake, Model Validation, Containerization, Playwright, Data Pipelines, Api Management, Databricks, Microservices
- **Published:** September 6, 2026
- **Apply:** https://www.careerjet.com/jobad/usa421a704febb42aaaf8c59defca2dc3c

## About the Role

Must Have

 * 3+ years software testing / test automation
 * Strong Healthcare experience
 * 3+ years GenAI/ML experience - GenAI is more important
 * Experience testing AI/ML chatbots and LLM outputs
 * Selenium + Java + BDD
 * Python + SQL
 * Selenium / Playwright + API testing
 * Experience with Snowflake or Oracle
 * Cloud experience - AWS preferred
 * Jira and/or Confluence
 * Experience with microservices/containerized applications
 * Understanding of AI hallucinations, model accuracy, and output validation

Strong Plus

 * AWS Bedrock / SageMaker
 * Databricks
 * LangChain
 * Data pipelines between Snowflake and Oracle
 * Salesforce / Einstein
 * AI testing agents, self-healing automation, or AI-based test generation

Ideal Candidate
A QA/Test Engineer or Test Analyst with strong GenAI/Chatbot testing experience who can test chatbot responses, validate accuracy, analyze AI outputs, and communicate issues clearly to the development/AI team.
Important: Don't submit a traditional QA candidate who only has Selenium. Actual GenAI/Chatbot testing experience is a key requirement.

## Description

They need a hands-on Testing Analyst with GenAI/Chatbot testing experience. This is not a lead role. The person will test AI chatbots, analyze whether responses are accurate, identify issues, and provide feedback to developers/AI engineers.


## Related Videos

- [Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems](https://www.wearedevelopers.com/videos/100300-testing-ai-agents-automated-evaluation-for-chatbots-rag-systems)
- [Proactive monitoring and smoke testing in your production environment](https://www.wearedevelopers.com/videos/139-proactive-monitoring-and-smoke-testing-in-your-production-environment)
- [Chatbots are going to destroy infrastructures and your cloud bills](https://www.wearedevelopers.com/videos/1130-chatbots-are-going-to-destroy-infrastructures-and-your-cloud-bills)
- [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray)
- [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software)
- [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)