AI Project - QA Automation Engineer

TIMEBOX PRO LLC
United States
2 months ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$7,000.0 - $15,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Automation of Tests Continuous Integration Data as a Services Postman Large Language Models Backend Pytest Integration Tests Enterprise Integration Restful APIs
+1 more
Api Management

Job description

  • Execute standard QA testing cycles including Functional, Regression, and Synthetic testing.

  • Validate AI-driven customer interactions across chat, voice, and email channels.

  • Perform integration testing with backend systems (APIs, case management, data services).

  • Test agent handoff and escalation workflows to ensure seamless transitions.

  • Ensure consistency of customer experience across multiple communication channels.

  • Conduct User Experience (UX) testing for clarity, usability, and interaction quality.

  • Perform Data Quality testing to validate accuracy and completeness of data used by AI systems.

  • Develop and maintain QA automation frameworks and test suites.

  • Design and implement AI-driven test suites to validate model accuracy, response quality, consistency, and overall system behavior.

  • Build and maintain API test automation.

  • Develop conversation simulation tests for AI interaction validation.

  • Maintain and enhance regression automation suites.

Requirements

We are seeking highly skilled QA Engineer 3-5 years experience with expertise in AI-driven systems to support the AI initiative. The role involves validating AI-powered customer interactions and ensuring high-quality, scalable, and reliable system behavior across multiple channels., * Strong experience in QA methodologies and automation frameworks.

  • Hands-on experience testing AI/LLM-based applications.

  • Experience with API testing and automation tools (e.g., pytest, Postman, REST frameworks).

  • Understanding of multi-channel communication systems (chat, voice, email).

  • Experience with CI/CD tools and pipeline integration.

  • Strong analytical and problem-solving skills.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:59 min

Designing governed and AI-native API platforms

Gbadebo Bello Gbadebo Bello · Europe 2026 Virtual

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · World Congress 2026 Europe

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:05 min

Tagging and organizing execution scenarios with pytest markers

Florian Bruhin · World Congress 2021

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

1:16 min

Automating documentation and code generation with OpenAPI standards

James Seconde · World Congress 2023

Videos

See all

Related articles

See all