Test Automation Engineer

• AI & LLM Quality Assurance:

• Execute counterfactual bias testing, similarity-cascade evaluation, theme-tagging precision/recall, and accessibility AI assessments.

• Conduct mandatory LLM testing and evaluation using RAG techniques, Python, scikit-learn, and sentence-transformers.

• Test Design & Execution:

• Write detailed test cases based on business requirements and technical specifications to ensure thorough coverage of all critical functionalities.

• Support release management activities by verifying software builds, conducting system testing prior to deployment, and documenting test results for compliance.

• Defect & Root Cause Analysis:

• Conduct root cause analysis for defects identified during testing phases.

• Collaborate with developers to troubleshoot issues related to APIs, web services (SOAP/REST), databases (MySQL, Oracle, SQL Server), and system configurations.

• Cross-Functional Collaboration:

• Collaborate with product owners and business analysts during requirements gathering to understand project scope and define clear acceptance criteria.

Test Automation Engineer (AI & QA Focus)Job OverviewWe are seeking a dynamic and detail-oriented Test Automation Engineer to join our innovative software development team. In this role, you will drive the quality and efficiency of our testing processes by designing, developing, and maintaining automated test frameworks. Your expertise will ensure our applications meet the highest standards of performance, functionality, and reliability. You will collaborate closely with cross-functional teams to streamline testing workflows, implement continuous integration practices, and support release management. This position offers an exciting opportunity to leverage your technical skills in a fast-paced environment committed to delivering exceptional software solutions., * AI & LLM Testing:

• Mandatory hands-on experience in LLM testing and LLM evaluation.

• Proficiency in Python, scikit-learn, sentence-transformers, and LLM/RAG testing frameworks.

• Automation & Scripting:

• Proven experience in software testing automation within Agile (Scrum) or Waterfall environments.

• Strong proficiency with test automation tools (Selenium WebDriver, Cucumber, TestNG, JUnit) and scripting languages (Python or JavaScript).

• CI/CD & DevOps:

• Hands-on experience with CI/CD tools, including Jenkins, GitHub/GitLab repositories, Azure DevOps, or TFS for seamless test integration into build pipelines.

• Software Engineering & QA Best Practices:

• Solid understanding of the SDLC, QA methodologies, and best practices across web and mobile platforms.

• Ability to work effectively within collaborative environments using tools like Jira, TFS, and version control systems (Git/SVN).

• API & System Testing:

• Knowledge of API testing using REST or SOAP protocols.

• Strong debugging capabilities to efficiently analyze and resolve complex issues.

Preferred / “Good to Have” Qualifications

• Experience working with general AI tools, AI agents, and using VS Code with Claude for development and testing.

• Background in Service-Oriented Architecture (SOA) and cloud platforms such as AWS or Azure.

Why Join Us?Join us if you are passionate about elevating software quality through innovative automation solutions! We value proactive problem solvers who thrive in fast-paced environments dedicated to continuous improvement and delivering top-tier products.