Manual QA Engineer (Middle) ID51808

AgileEngine
Municipality of Valencia, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Municipality of Valencia, Spain

Tech stack

API
Agile Methodologies
Artificial Intelligence
JIRA
Azure
Bug Tracking Systems
Continuous Integration
Data Retention
Programming Tools
Firefox
Scrum
Systems Development Life Cycle
Software Engineering
Test Execution Engine
Test Management
User Interface Testing
Web Applications
Postman
Large Language Models
Prompt Engineering
Api Design
Api Management
Testrail
Jenkins

Job description

We are looking for a Manual QA Engineer to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You'll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes., Perform manual testing of web applications to identify bugs, glitches, and inconsistencies;

  • Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;
  • Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.;
  • Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements;
  • Design and execute test scenarios to verify AI behavior, including prompt-response consistency, contextual relevance, and deterministic vs. non-deterministic outputs;
  • Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate);
  • Conduct manual API testing to validate request/response accuracy, error handling, and integration;
  • Use TestRail to create, manage, and track test plans, test cases, and test execution results;
  • Use Jenkins CI/CD pipelines;
  • Report and document defects clearly using the bug tracking system (JIRA);
  • Participate in daily stand-ups, sprint planning, and other Agile team meetings;
  • Review user stories and acceptance criteria to understand the scope of testing;
  • Estimate own tasks, report on risks to the team lead;
  • Collaborate with developers and other QA team members to reproduce issues and verify fixes;
  • Maintain and update test documentation as needed.

Requirements

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!, 2+ years of experience with manual testing;

  • Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models;
  • Knowledge of Testing and Quality Assurance Processes;
  • Strong experience with Test Design activities to cover a set of product requirements;
  • Knowledge of Test Design techniques;
  • Knowledge of testing methodologies;
  • Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes;
  • Experience with Postman (API testing) and Browser developer tools;
  • Experience with UI testing;
  • Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles;
  • Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain);
  • Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization);
  • Experience with TestRail as a Test Management system (as a user, test execution is required);
  • Basic understanding of CI/CD process;
  • Upper-intermediate English level.

NICE TO HAVES

  • Experience with SSO testing;
  • Experience in Performance or Load.

Benefits & conditions

Competitive compensation: USD-based pay with education, fitness, and team activity budgets.

  • Exciting projects: Modern solutions with Fortune 500 and top product companies.
  • Flextime: Flexible schedule with remote and office options.

Meet Our Recruitment Process It includes main stages: Application * Coding Challenge * Video Interview * Technical Interview or Interview with the Hiring Manager(s). Each step helps us understand your skills and overall fit. If it's a match, you'll receive an offer.

About the company

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Apply for this position