Senior QA Tester - AI Solutions

• Design testing strategies for AI and LLM-powered applications
• Build automated evaluation frameworks and test suites
• Validate complex integrations, APIs and data pipelines
• Work closely with AI Solutions Engineers throughout the delivery lifecycle
• Integrate testing into CI/CD pipelines and development workflows
• Define QA standards and best practices for AI applications
• Help shape the future QA function within a rapidly growing organisation

• 5+ years’ experience in QA Engineering
• Strong automation testing experience
• Experience testing complex software platforms and APIs
• Python or other scripting/programming experience
• Understanding of CI/CD pipelines and modern engineering practices
• Experience with AI, LLMs, prompt testing, evaluation frameworks, or a strong interest in this area
• Excellent communication skills and the ability to work closely with technical teams
• LangSmith, DeepEval, Ragas, Promptfoo or similar tools
• Agentic workflows, RAG applications or AI evaluation pipelines
• Performance testing
• Cloud platforms such as AWS, Azure or GCP
• Docker and containerised environments
• Experience within regulated industries

• Competitive salary and benefits package
• Private healthcare
• Share options
• Flexible hybrid working
• Exposure to cutting-edge AI technologies
• Significant influence over QA strategy and standards
• A genuinely unique working pattern with additional company days off throughout the year

Unfortunately, sponsorship cannot be provided for this position.

MCS Group is delighted to be supporting an innovative Belfast-based technology company as they look to hire a Senior QA Engineer to join their growing AI Solutions team.