Test Engineering Analyst - ML/AI Chatbot - W2 DMV Areas

Nexiva Inc
Baltimore, MD, United States
19 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$100,000.0 - $245,000.0
Working hours
Regular working hours

Tech stack

Testing (Software) Java (Programming Language) Artificial Intelligence Amazon Web Services Confluence JIRA Automation of Tests Cloud Computing Python (Programming Language) Machine Learning Oracle (Applications) Standard Sql
+12 more
Salesforce.Com Selenium Chatbots Large Language Models Snowflake Model Validation Containerization Playwright Data Pipelines Api Management Databricks Microservices

Job description

They need a hands-on Testing Analyst with GenAI/Chatbot testing experience. This is not a lead role. The person will test AI chatbots, analyze whether responses are accurate, identify issues, and provide feedback to developers/AI engineers.

Requirements

Must Have

  • 3+ years software testing / test automation
  • Strong Healthcare experience
  • 3+ years GenAI/ML experience - GenAI is more important
  • Experience testing AI/ML chatbots and LLM outputs
  • Selenium + Java + BDD
  • Python + SQL
  • Selenium / Playwright + API testing
  • Experience with Snowflake or Oracle
  • Cloud experience - AWS preferred
  • Jira and/or Confluence
  • Experience with microservices/containerized applications
  • Understanding of AI hallucinations, model accuracy, and output validation

Strong Plus

  • AWS Bedrock / SageMaker
  • Databricks
  • LangChain
  • Data pipelines between Snowflake and Oracle
  • Salesforce / Einstein
  • AI testing agents, self-healing automation, or AI-based test generation

Ideal Candidate A QA/Test Engineer or Test Analyst with strong GenAI/Chatbot testing experience who can test chatbot responses, validate accuracy, analyze AI outputs, and communicate issues clearly to the development/AI team. Important: Don’t submit a traditional QA candidate who only has Selenium. Actual GenAI/Chatbot testing experience is a key requirement.

Benefits & conditions

  • $100,000-245,000 per year Description Are you a critical thinker who loves exploring data to discover issues and find innovative ways to tackle problems? Are you passionate about solving the nation’s mo…

  • 3 days ago + *

Maritime Surveillance LFA/CLFA System Design and Operations Analyst Johns Hopkins Applied Physics Laboratory

  • Laurel, MD
  • $100,000-245,000 per year Description Are you looking to be on the cutting edge of new and innovative ways to deploy active sonar capabilities within the Maritime Surveillance domain? Are you passionate…

  • 3 days ago +

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

1:00 min

Introduction to chatbot infrastructure and cloud challenges

Stan Girard Stan Girard · World Congress 2024

2:35 min

Selecting Selenium for browser automation and testing

Benjamin Bischoff Benjamin Bischoff · Europe 2026 Virtual

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · World Congress 2026 Europe

1:44 min

Workforce navigation and AI executive chatbot demonstration

Sandeep Kusuma Sandeep Kusuma · World Congress 2026 Europe

5:47 min

Integrating user stories and test automation via Jira tools

Christoph Ruggenthaler · LIVE

Videos

See all

Related articles

See all