> Markdown version of [/jobs/ext/1415671-manager-ai-quality-assurance-quality-engineering-technology-transformation-solutions](https://www.wearedevelopers.com/jobs/ext/1415671-manager-ai-quality-assurance-quality-engineering-technology-transformation-solutions). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Manager, AI Quality Assurance, Quality Engineering, Technology & Transformation, Solutions - **Company:** Deloitte - **Location:** Belfast, UK - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Data Analysis, JIRA, Automation of Tests, Microsoft Azure, Data Cleansing, DevOps, Simple Password Exponential Key Exchange (SPEKE), Test Data, Model Validation, Hp Alm, Machine Learning Operations - **Published:** July 24, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=c0d6b655ea1b3baa ## About the Role You know AI systems are different to conventional systems and require a tailored QA approach to handle characteristics such as non-determinism. You're comfortable moving beyond simple pass/fail thinking, bringing clarity to complex problems through strong communication and helping teams build confidence in AI systems through effective, real-world quality engineering. * In-depth knowledge of Traditional AI and Generative AI model architectures, including training processes and lifecycle considerations. * Knowledge of AI testing methodologies, including specialised techniques for testing AI models and relevant evaluation metrics. * Experience in test automation for AI systems, including strategy, design and implementation. * Ability to perform data analysis to ensure quality and adherence to relevant data compliance standards. * Ability to identify and assess ethical, fairness and responsible AI risks within AI-enabled systems. * Knowledge of AI model monitoring, including drift detection, performance tracking and ongoing model evaluation. * Advanced data preparation and augmentation capabilities to support AI testing scenarios. * Experience analysing AI model behaviour and outputs, and embedding findings into quality, risk and assurance decisions. * ISTQB Certified Tester Foundation Level certificate (or equivalent practical experience). * Strong experience using test management tools (e.g. JIRA) to govern quality activities at engagement level. * Client-facing experience, including stakeholder management at senior levels. * Proficiency in driving adherence to testing governance, including documentation controls and sign-off readiness. * Excellent interpersonal skills, with the ability to lead, influence and mentor teams. * Acute attention to detail, particularly in complex or AI-driven delivery contexts. Desirable Skills * Proven track record delivering within a top-tier consultancy environment. * ISTQB Certified Tester - AI Testing. * Experience administering and governing test management tools (e.g. HP ALM, Zephyr). * Experience working in agile teams, using tools such as Jira, or Azure DevOps. * A collaborative mindset and strong communication skills. ## Description * Designing and delivering AI QA approach for Traditional AI and Generative AI systems, aligned to the AI development lifecycle and client objectives. * Developing structured test cases to evaluate model behavior, performance and risk across a range of use cases, including edge cases and adversarial scenarios. * Validating input and output data across AI pipelines, assessing completeness, consistency, correctness and relevance * Supporting and governing test data preparation, validation and augmentation, including the creation of representative datasets * Implementing AI test automation strategies, selecting appropriate frameworks and approaches to enable scalable, repeatable and efficient testing of AI systems. * Apply appropriate tools and techniques for model observability and evaluation. * Analyse AI model behavior and outputs to identify ethical, fairness and responsible AI risks * Collaborating closely with data scientists, DevOps and delivery teams to embed AI testing practices early and consistently across the development lifecycle. * Mentoring others and contributing to Deloitte's internal tools, accelerators, and communities of practice. ## Related Videos - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Let’s Talk Quality!](https://www.wearedevelopers.com/videos/100012-let-s-talk-quality) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Trustworthy AI Starts at Deployment: 5 Checks Before You Ship](https://www.wearedevelopers.com/magazine/753-trustworthy-ai-starts-at-deployment-5-checks-before-you-ship) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Why Your AI Tool Fails After the Demo](https://www.wearedevelopers.com/magazine/704-why-your-ai-tool-fails-after-the-demo) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)