> Markdown version of [/jobs/ext/3058976-python-qa-automation-engineer](https://www.wearedevelopers.com/jobs/ext/3058976-python-qa-automation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Python QA Automation Engineer

- **Company:** Epam
- **Location:** London, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Automation of Tests, Cloud Engineering, Computer Programming, Continuous Integration, Distributed Systems, Python (Programming Language), Data Logging, Large Language Models, Pytest, Containerization, Integration Tests, Cucumber (Software), Network Server, Automation Anywhere, Microservices
- **Published:** September 25, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/python-qa-automation-engineer/48428330

## About the Role

pipelines Understanding of common agentic AI issues, such as hallucination, tool misuse, and performance bottlenecks Familiarity with automated testing of AI workflows, distributed systems, or microservices environments Strong grasp of Agile delivery methodologies and CI/CD integration for quality checks Excellent communication and problem-solving skills with a focus on accuracy and reliability Nice to have Experience with Model Context Protocol (MCP) or other agent orchestration solutions Exposure to observability, monitoring, or logging tools for AI systems API and service integration testing background for multi-layered platforms Knowledge of containerized environments and cloud-native architecture Background in enterprise AI automation projects or intelligent platform engineering We offer EPAM Employee Stock Purchase Plan (ESPP) Protection benefits including life assurance, income protection and critical illness cover Private medical insurance and dental care Employee Assistance
Program Competitive group pension plan Cyclescheme, Techscheme and season ticket loans Various perks such as free Wednesday lunch in-office, on-site massages and regular social events Learning and development opportunities including in-house training and coaching, professional certifications, and courses If otherwise eligible, participation in the discretionary annual bonus program If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program #J-18808-Ljbffr

## Description

automated testing frameworks to validate MCP Servers and related AI systems Design and implement evaluation strategies for LLM accuracy, safety, and reliability Create automated tests using Python, Pytest, and BDD frameworks Build quality gates into CI/CD pipelines to maintain continuous assurance Identify and address agentic AI failure modes such as hallucination, latency, and incorrect tool usage Collaborate with engineering, QA, and product teams to define quality metrics and acceptance criteria Contribute to Agile ceremonies, ensuring testing practices align with sprint goals Prepare detailed reporting on quality outcomes and improvement opportunities Maintain documentation for test cases, evaluation pipelines, and validation strategies Requirements Strong programming experience in Python applied to test automation and evaluation Expertise in Pytest and familiarity with BDD frameworks such as Behave or Cucumber Knowledge of LLM evaluation approaches including RAGAS, DeepEval, or, custom


## Related Videos

- [Microservices: how to get started with Spring Boot and Kubernetes](https://www.wearedevelopers.com/videos/242-microservices-how-to-get-started-with-spring-boot-and-kubernetes)
- [Crypto-secure Data Management with In-Database Blockchain](https://www.wearedevelopers.com/videos/632-crypto-secure-data-management-with-in-database-blockchain)
- [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python)
- [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app)
- [Cloud Chaos and Microservices Mayhem](https://www.wearedevelopers.com/videos/104-cloud-chaos-and-microservices-mayhem)
- [Build Delightful Mobile Experiences with Kotlin, Realm, and Atlas Device Sync](https://www.wearedevelopers.com/videos/694-build-delightful-mobile-experiences-with-kotlin-realm-and-atlas-device-sync)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [The Top ChatGPT Plugins for Developers in 2023](https://www.wearedevelopers.com/magazine/259-the-top-chatgpt-plugins-for-developers-in-2023)
- [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025)