> Markdown version of [/jobs/ext/2695406-ai-ml-software-test-engineer-genai-chatbot-solutions](https://www.wearedevelopers.com/jobs/ext/2695406-ai-ml-software-test-engineer-genai-chatbot-solutions). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI/ML Software Test Engineer (GenAI & Chatbot Solutions) - **Company:** The Joule - **Location:** Columbia, MD, United States (Remote available) - **Experience:** Experienced - **Salary:** $128,960.0 - **Contract:** Permanent contract - **Skills:** Testing (Software), Agile Methodology, Artificial Intelligence, Amazon Web Services, Software Applications, Confluence, JIRA, Automation of Tests, Microsoft Azure, Cloud Computing, Collaborative Software, Machine Learning, Oracle Databases, Salesforce.Com, Selenium, Software Engineering, System Testing, Systems Integration, Test Data, Google Cloud, Chatbots, Snowflake, Prompt Engineering, Generative AI, AI Platforms, Information Technology, Data Analytics, Non-relational Database, Data Pipelines - **Published:** September 3, 2026 - **Apply:** https://www.dice.com/job-detail/457beee3-63a8-41c1-a886-6c785635d1b5 ## About the Role The ideal candidate has a strong foundation in software engineering and testing, combined with knowledge of ML and GenAI concepts. This individual will help validate AI solution performance, analyze outputs, identify opportunities for improvement, and collaborate with technical and business stakeholders to ensure solutions deliver accurate and meaningful results., * Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience. * 3+ years of software engineering experience. * 3+ years of experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP). * Experience applying Machine Learning (ML) concepts and Generative AI (GenAI) concepts in a professional environment. * Experience evaluating, testing, analyzing, or supporting AI/ML solutions, models, chatbots, or related technologies. * Experience with system testing, software testing, or quality assurance methodologies. * Experience with automation testing using Selenium, BDD, or similar frameworks. * Understanding of data pipelines and data-driven systems. * Experience working with relational and non-relational databases. * Strong analytical, troubleshooting, and problem-solving skills. * Ability to interpret AI-generated outputs and provide actionable feedback. * Strong verbal and written communication skills with the ability to work effectively across technical and business teams. * Experience using collaboration tools such as Jira, Confluence, or similar platforms. Preferred Qualifications * Experience with AWS Bedrock, Amazon SageMaker, or similar AI services. * Experience testing or validating chatbot and conversational AI solutions. * Knowledge of prompt engineering principles and best practices. * Experience working with Snowflake and/or Oracle databases. * Experience with emerging AI testing frameworks and methodologies. * Healthcare industry experience. * Experience working in Agile development environments. * Familiarity with Salesforce platforms and integrations. Preferred Skills * Understanding of machine learning model evaluation and optimization concepts. * Ability to analyze complex datasets and AI-generated outputs. * Strong attention to detail and a quality-focused mindset. * Ability to communicate technical findings to both technical and non-technical audiences. * Interest in emerging AI technologies and industry trends. * Strong collaboration and stakeholder engagement skills. ## Description Seeking a Software Engineer to support innovative Machine Learning (ML) and Generative AI (GenAI) initiatives across the organization. This role will work closely with engineering leadership and cross-functional teams to evaluate, test, and optimize AI-powered solutions, including machine learning models, chatbot technologies, and automation capabilities., * Support existing Machine Learning and Generative AI initiatives while contributing to new projects and enhancements. * Collaborate with engineering teams to evaluate, test, and improve AI-powered applications and services. * Analyze model outputs and provide feedback to improve performance, efficiency, and response quality. * Apply ML and GenAI concepts to assess model behavior, validate outcomes, and identify opportunities for optimization. * Work closely with business stakeholders to gather feedback and ensure AI-generated outputs meet business expectations. * Participate in the evaluation and testing of chatbot solutions and conversational AI platforms. * Validate AI-generated responses for accuracy, consistency, relevance, and effectiveness. * Utilize prompt engineering techniques to improve chatbot interactions and response quality. * Support efforts to fine-tune machine learning models and AI-powered solutions. * Develop and execute system, integration, and automation testing activities. * Test data pipelines and validate intermediate and final outputs throughout the AI lifecycle. * Work with cloud-based environments and AI services to support development and testing activities. * Document findings, recommendations, defects, and testing results using collaboration and project management tools. * Partner with developers, engineers, and business teams to drive continuous improvement and successful project outcomes. ## Related Videos - [The Future of Developer Experience with GenAI: Driving Engineering Excellence](https://www.wearedevelopers.com/videos/1107-the-future-of-developer-experience-with-genai-driving-engineering-excellence) - [Proactive monitoring and smoke testing in your production environment](https://www.wearedevelopers.com/videos/139-proactive-monitoring-and-smoke-testing-in-your-production-environment) - [Chatbots are going to destroy infrastructures and your cloud bills](https://www.wearedevelopers.com/videos/1130-chatbots-are-going-to-destroy-infrastructures-and-your-cloud-bills) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software) - [Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems](https://www.wearedevelopers.com/videos/100300-testing-ai-agents-automated-evaluation-for-chatbots-rag-systems) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [The Prompt Engineer ✍️](https://www.wearedevelopers.com/magazine/216-the-prompt-engineer) - [Prompt Engineering is a Job of the Past](https://www.wearedevelopers.com/magazine/342-prompt-engineering-is-a-job-of-the-past) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)