> Markdown version of [/jobs/ext/2667710-agentic-systems-builder-qa-engineer](https://www.wearedevelopers.com/jobs/ext/2667710-agentic-systems-builder-qa-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Agentic Systems Builder & QA Engineer - **Company:** Sitel - **Location:** UK (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Automation of Tests, Programming Tools, Python (Programming Language), Regression Analysis, Strategies of Testing, Large Language Models, Multi-Agent Systems, Model Validation, Information Technology, Api Design, Network Server - **Published:** September 2, 2026 - **Apply:** https://jobs.sitel.com/talentcommunity/apply/1425922800/?locale=en_US ## About the Role * 3+ years in a role combining development, QA, testing, or technical product work * Experience building or configuring AI/ML-powered systems or applications * Experience working directly with end users or internal teams to gather requirements and feedback * Some exposure to product management practices: discovery, spec writing, prioritization, * Comfort working with APIs, configuration interfaces, and developer tooling * Understanding of LLMs and how they are integrated into applications (prompting, tool calling, structured outputs) * Strong analytical and communication skills - able to clearly articulate issues, feedback, and requirements * Detail-oriented with a quality-first mindset * Comfortable in Agile, fast-paced environments with evolving scope, * Experience with agentic systems or agent orchestration frameworks (LangGraph, LangChain, or similar) * Experience with observability or evaluation tooling (LangFuse or similar) * Experience with MCP Servers/Clients * Background in QA engineering or test automation * Experience with testing methodologies - manual and/or automated, ideally for AI or non-deterministic systems * Experience in a product management or technical product owner role * Development skills in Python * Familiarity with vector databases, RAG pipelines, or NLP * Experience writing technical documentation or developer guides Education Bachelor's degree or higher in Computer Science, Engineering, or a related field - or equivalent practical experience. Languages * Excellent written and conversational English (C1 minimum) * French and Spanish are a plus ## Description We are looking for an Agentic Systems Builder & QA Engineer to sit at the intersection of building, testing, and adoption of our agentic systems framework. You will be the first user of the tools we build - stress-testing them, running evaluations, identifying gaps, and feeding insights back to the engineering team. Beyond QA, you will play a key role in enabling other teams to build with our framework: onboarding them, understanding their use cases, translating their needs into actionable specs, and running discovery to inform the platform roadmap. You will combine hands-on building and testing with product-minded thinking - ensuring that what we ship is not only technically sound but genuinely useful for the teams adopting it. This role is ideal for someone who enjoys working across boundaries: part builder, part tester, part enabler - with a strong sense for what makes tools intuitive, reliable, and ready for real-world use., Building & Testing * Be the primary hands-on tester of the agentic systems framework - building agents using our tools, identifying bugs, edge cases, and usability issues before other teams encounter them * Run end-to-end evaluations of agentic systems: execute evaluation pipelines, create and curate datasets, analyze results, and report on agent quality and reliability * Build and configure agentic workflows using the framework's interfaces - system prompts, model selection, tool integrations - validating that the developer experience works as intended * Define and execute QA processes for new framework features, integrations, and releases Adoption & Enablement * Support other technical teams in building agentic systems with our tools - onboarding, troubleshooting, and sharing best practices * Act as the bridge between adopting teams and the engineering team: gather feedback, identify friction points, and advocate for improvements * Create documentation, guides, and examples that help teams get started and build effectively Discovery & Product * Run discovery with internal teams to understand their use cases, pain points, and requirements for agentic systems * Translate user needs into clear specs and requirements that the engineering team can act on * Help prioritize framework improvements based on real adoption feedback and observed usage patterns * Contribute to roadmap discussions with a grounded perspective on what teams actually need Evaluation & Quality * Execute and refine evaluation workflows - running experiments, comparing agent configurations, and reporting on metrics * Help define what "good" looks like for agent behavior in different use cases * Flag quality issues, regressions, and drift in deployed agentic systems ## Related Videos - [API Design - Getting Started](https://www.wearedevelopers.com/videos/33-api-design-getting-started) - [Kubernetes Security - Challenge and Opportunity](https://www.wearedevelopers.com/videos/412-kubernetes-security-challenge-and-opportunity) - [Introduction to Responsible AI: Balancing Value and Risk](https://www.wearedevelopers.com/videos/1972-introduction-to-responsible-ai-balancing-value-and-risk) - [Beyond Chatbots: How to build Agentic AI systems](https://www.wearedevelopers.com/videos/1629-beyond-chatbots-how-to-build-agentic-ai-systems) - [Rest API Antipatterns](https://www.wearedevelopers.com/videos/100208-rest-api-antipatterns) - [AI Agents & Agentic AI](https://www.wearedevelopers.com/videos/2017-ai-agents-agentic-ai) ## Related Articles - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [A 5-Step Open-Source Setup for Agentic Engineering](https://www.wearedevelopers.com/magazine/738-a-5-step-open-source-setup-for-agentic-engineering) - [Never delegate the understanding](https://www.wearedevelopers.com/magazine/749-never-delegate-the-understanding)