Senior QA Tester - Hybrid
- Orlando, FL, United States
Applications open in a new tab.
Job details
- Posting language
- English
- Posted
Original job description
**** Webcam interview; *** Long term project Linkedin Must Hybrid- 3 days onsite **** Due to security reasons only USC/GC ****
Job Description
The DX US Parks Agentic Experiences team builds AI-powered conversational experiences that help guests discover and plan Disney parks vacations. You will be the primary contributor to our UI automation suite and help us test a product whose answers change from run to run. You will work within the Product team, collaborating daily with product managers, engineers, and content owners.
What You Will Do
- Learn the product deeply (features, guest journeys, business rules) and become a go-to voice on how it should behave.
- Turn Gherkin user stories, acceptance criteria, and business rules into Playwright + TypeScript tests.
- Flag gaps or ambiguity in stories before they are built.
- Build and maintain end-to-end tests across full guest journeys.
- Design checks for non-deterministic agent responses (rule-based and semantic assertions, eval datasets) instead of exact-string matching.
- Build reusable fixtures, authentication setup, helpers, and test data.
- Validate what guests see against API responses, using request interception and mocks where appropriate.
- Run automated suites in Jenkins and Harness CI/CD pipelines.
- Triage failures to root cause (application, automation, environment, or test data) and file clear, reproducible defects.
- Use AI coding and agent tools every day to write, refactor, and maintain tests faster, and share what works with the team.
What You Bring
- Strong Playwright and TypeScript skills, with an end-to-end suite you built and maintained in production.
- Experience testing AI or LLM-powered products, including strategies for non-deterministic output.
- Hands-on, demonstrable use of AI tools (e.g., Claude, Copilot, Cursor) to speed up test authoring and maintenance. Be ready to show examples.
- Fluency with Gherkin, acceptance criteria, and business rules, and the ability to pick up a complex business domain quickly.
- API testing experience, including request interception and mocking.
- Experience integrating test suites into Jenkins and/or Harness CI/CD.
- Clear written communication and comfort working directly with product, not only engineering.
Nice to Have
- LLM evaluation or observability tools (e.g., Arize, Phoenix, LangSmith, Promptfoo).
- Travel, hospitality, or e-commerce booking flows.
- Accessibility or visual regression testing.
- Building agent- or MCP-driven test tooling.