Senior QA Tester - Hybrid

The DX US Parks Agentic Experiences team builds AI-powered conversational experiences that help guests discover and plan Disney parks vacations. You will be the primary contributor to our UI automation suite and help us test a product whose answers change from run to run. You will work within the Product team, collaborating daily with product managers, engineers, and content owners. What You Will Do

• Learn the product deeply (features, guest journeys, business rules) and become a go-to voice on how it should behave.
• Turn Gherkin user stories, acceptance criteria, and business rules into Playwright + TypeScript tests.
• Flag gaps or ambiguity in stories before they are built.
• Build and maintain end-to-end tests across full guest journeys.
• Design checks for non-deterministic agent responses (rule-based and semantic assertions, eval datasets) instead of exact-string matching.
• Build reusable fixtures, authentication setup, helpers, and test data.
• Validate what guests see against API responses, using request interception and mocks where appropriate.
• Run automated suites in Jenkins and Harness CI/CD pipelines.
• Triage failures to root cause (application, automation, environment, or test data) and file clear, reproducible defects.
• Use AI coding and agent tools every day to write, refactor, and maintain tests faster, and share what works with the team.

• Strong Playwright and TypeScript skills, with an end-to-end suite you built and maintained in production.
• Experience testing AI or LLM-powered products, including strategies for non-deterministic output.
• Hands-on, demonstrable use of AI tools (e.g., Claude, Copilot, Cursor) to speed up test authoring and maintenance. Be ready to show examples.
• Fluency with Gherkin, acceptance criteria, and business rules, and the ability to pick up a complex business domain quickly.
• API testing experience, including request interception and mocking.
• Experience integrating test suites into Jenkins and/or Harness CI/CD.
• Clear written communication and comfort working directly with product, not only engineering.

Nice to Have

• LLM evaluation or observability tools (e.g., Arize, Phoenix, LangSmith, Promptfoo).
• Travel, hospitality, or e-commerce booking flows.
• Accessibility or visual regression testing.
• Building agent- or MCP-driven test tooling.