> Markdown version of [/jobs/ext/3116399-qa-automation-engineer-ai-applications](https://www.wearedevelopers.com/jobs/ext/3116399-qa-automation-engineer-ai-applications). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # QA Automation Engineer AI Applications - **Company:** Air Apps - **Location:** Barcelona, Spain - **Salary:** €47,000.0 - €59,000.0 - **Contract:** Permanent contract - **Skills:** Testing (Software), Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Airflow, Amazon Web Services, Automation of Tests, Microsoft Azure, Software Quality, Code Review, Computer Programming, Continuous Integration, Software Design Patterns, Distributed Systems, Github, Python (Programming Language), Machine Learning, Software Architecture, Tensorflow, Software Engineering, Software Testing Automation Framework, Google Cloud, Application Enhancement Tool, Pytorch, Delivery Pipeline, Model Validation, Backend, AI Platforms, Information Technology, Machine Learning Operations, Data Pipelines, Jenkins - **Published:** September 27, 2026 - **Apply:** https://www.adzuna.es/contact-us.html ## About the Role Bachelor's degree in Computer Science, Engineering, or equivalent practical experience. 5+ years of experience in software QA, test automation, or software engineering roles. Strong programming skills in Python with hands-on experience building test automation frameworks. Experience working with CI/CD systems and modern development workflows. Practical use of AI-powered tools or coding assistants to enhance testing productivity and automation quality. Solid understanding of software architecture, design patterns, and scalable system design. Experience designing QA frameworks or platforms used across multiple teams or services. Strong analytical thinking, problem-solving ability, and attention to detail. Excellent communication and collaboration skills in Agile, distributed environments. Nice to have: experience testing AI/ML systems, validating models, or working with tools such as PyTorch or TensorFlow. Nice to have: familiarity with MLOps practices, data pipelines, or tools such as Apache Airflow, MLflow, or cloud platforms (AWS, Azure, GCP). ## Description You will join a forward-thinking engineering environment focused on ensuring the quality and reliability of next-generation AI-powered products used in real-world, high-impact applications. The role combines advanced test automation engineering with hands-on evaluation of AI/ML systems, requiring both technical depth and product intuition. You will design and scale robust QA frameworks that support complex AI services across APIs, models, and user-facing features. The position sits at the intersection of software quality engineering and artificial intelligence, where testing goes beyond traditional validation into model behavior and output evaluation. You will work closely with engineers, data scientists, and product teams in an Agile, collaborative setup. A strong emphasis is placed on automation, scalability, and continuous improvement of testing systems. This is a high-ownership role where your work directly influences product reliability and user trust in AI systems. Accountabilities: Design, build, and maintain automated test suites, evaluation scenarios, datasets, and metrics for AI-powered features and systems. Develop scalable QA automation frameworks and test harnesses for APIs, backend services, and AI applications using Python. Automate QA workflows within CI/CD pipelines (e.g., GitHub Actions, Jenkins), integrating AI-assisted testing tools to improve coverage and efficiency. Define QA strategy, test plans, and acceptance criteria across functional, integration, API, and AI/ML-specific testing domains. Evaluate AI/ML model outputs for correctness, consistency, bias, and expected product behavior using structured rubrics and measurable quality gates. Build and maintain automated regression and validation pipelines embedded in deployment workflows. Participate in cross-team engineering initiatives, code reviews, and ensure QA best practices are consistently applied. Document testing strategies, findings, and recommendations, while contributing to knowledge sharing across teams. Mentor peers and help elevate QA maturity across engineering teams working on AI-driven systems. ## Related Videos - [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Self-service Quality: QA Without QA](https://www.wearedevelopers.com/videos/100184-self-service-quality-qa-without-qa) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Top AI Tools for Developers in 2025](https://www.wearedevelopers.com/magazine/560-top-ai-tools-for-developers-in-2025) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)