Automation Testing Engineer

We are seeking a Senior Automation Testing Leader / Senior Automation Testing Engineer to own and build the quality engineering and test automation function for an AI-powered healthcare technology platform.

In this role, quality directly impacts patient access to healthcare. A broken call flow can prevent a patient from reaching their physician, making quality assurance an important part of the overall patient experience.

This is not a traditional manual QA position. The role is focused on test automation, framework design, automation strategy, scalable QA processes, AI-assisted testing techniques, and building a future QA organization.

What You''ll Do

Automation Strategy & Leadership

• Own the overall quality engineering vision and automation strategy for an AI-powered voice platform.

• Design, build, and maintain scalable automated testing infrastructure from the ground up.

• Establish testing standards, best practices, and quality metrics across engineering teams.

• Recruit, mentor, and eventually lead future QA and automation testing team members.

• Help drive a culture of quality throughout the organization.

Testing Architecture & Framework Development

• Design and implement automated testing frameworks covering unit testing, integration testing, end-to-end testing, regression testing, and load/performance testing.

• Build reusable test harnesses and tooling that enable engineers to efficiently create and execute tests.

• Develop simulation frameworks for real-time voice and conversational AI workflows.

• Create testing methodologies that can scale with rapid product growth.

AI & Voice Platform Testing

• Build simulation and regression frameworks for conversational AI scenarios.

• Develop testing approaches for real-time voice interactions and telephony workflows.

• Leverage AI-assisted testing techniques to improve coverage and efficiency.

• Validate agent behaviors, routing logic, integrations, and patient call flows before production deployment.

Platform & Integration Quality

• Partner with platform, provisioning, and integrations teams to ensure comprehensive coverage across system boundaries.

• Test APIs, backend services, event-driven systems, and third-party integrations.

• Own test environments and CI/CD integration for automated execution.

• Investigate production issues and lead root cause analysis efforts.

Compliance & Reliability

• Develop testing approaches that support HIPAA and healthcare compliance requirements.

• Help ensure platform reliability, scalability, and quality standards are consistently maintained.

• Drive preventative quality initiatives that reduce production defects and customer-impacting issues.

• 10+ years of experience in software quality engineering with a strong emphasis on automation.

• Proven track record designing and owning automation frameworks from the ground up.

• Expertise in automated testing architecture and test harness design.

• Strong experience building scalable QA processes and automation strategies.

• Experience leveraging AI-assisted testing methodologies.

• Proficiency with Python, TypeScript, or similar programming languages.

• Strong scripting, tooling, and automation development skills.

• Experience integrating automated testing into CI/CD pipelines.

• Hands-on experience with GitHub Actions, Jenkins, or similar tools.

• Deep understanding of unit testing, integration testing, end-to-end testing, regression testing, and performance testing.

• Experience testing APIs, backend services, and distributed/event-driven architectures.

• Strong debugging and analytical skills.

• Demonstrated ability to elevate quality standards across engineering organizations.

• Startup mentality with a willingness to build processes, frameworks, and teams from scratch.

• Ability to operate as both an individual contributor and future people leader.

Preferred Qualifications

• Experience testing real-time systems.

• Experience with telephony platforms, call routing systems, or voice technologies.

• Experience testing conversational AI or AI-powered applications.

• Load and performance testing experience in high-throughput environments.

• HIPAA-regulated healthcare experience.

• Experience in compliance-heavy environments.

• Contract testing experience.

• Service virtualization experience.

• Previous experience building or leading QA organizations.

Ideal Candidate

• Can design testing frameworks from the ground up.

• Can build and execute an automation-first quality strategy.

• Understands how to leverage AI to improve testing effectiveness and efficiency.

• Can create scalable quality processes that grow with the business.

• Can build sophisticated test harnesses and simulation environments.

• Thrives in a fast-paced startup-style environment.

• Operates as a strategic quality leader rather than a traditional manual tester.