Software Engineer in Test, Python
Role details
Job location
Tech stack
Job description
As part of our team, you'll leverage your diverse skills to support both Software Engineers and QA Engineers, tackling the daily challenges of their roles. Your specialist knowledge will be invaluable in suggesting improvements to enhance quality and streamline workflows, ensuring we continue to exceed our customers' expectations.
As a Software Engineer (SDET), you'll be the transformational force that revolutionizes our testing approach. You'll leverage AI and advanced analytics to identify quality gaps, architect intelligent testing solutions, and establish new standards for test effectiveness that go beyond simple coverage metrics.
How will I use AI at Roku?
At Roku, we don't just use AI, we work with it. AI agents and smart tools help power drafts, analysis, and repetitive workflows, while our people bring direction, judgment, and accountability. We're looking for curious, adaptable builders who can show how they've used AI or automation to move faster, raise the bar, and scale their impact. We value your AI skills if have built fluency across the agentic engineering toolchain - coding harnesses like Claude Code or Cursor, MCP servers, custom skills, or agent frameworks. And you can describe projects where you shipped real work with these tools. You know how to drive an agent, verify its output, and ramp on an unfamiliar codebase with an agent helping you.
What are the responsibilities of the role?
- Design and implement intelligent test analysis systems that identify quality gaps, predict failure patterns, and optimize test effectiveness
- Design systems that collect, analyse and act on the testing data to continuously improve on the quality processes
- Experience with systematic regression tracking and implementing process to prevent regression reoccurrence
- Establish new methodologies for measuring and improving test quality beyond simple pass/fail metrics, focusing on regression prevention and production reliability
- Leverage AI-powered tools for automated failure analysis, root cause identification, and test flakiness scoring
- Define and implement architectural patterns that make testing more effective, maintainable, and aligned with business impact, Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned office location require five days' a week attendance.
Requirements
- AI expertise for testing: Ability to design, implement, and optimize solutions leveraging LLMs, agentic AI systems, and predictive analytics for quality assurance
- Experience with autonomous testing agents capable of independently discovering, executing, and adapting test strategies.
- 4+ years of hands-on experience with test architecture and automation systems design
- 3+ years of programming experience across multiple languages with Python
- AI expertise for testing: Ability to design, implement, and optimize solutions leveraging LLMs, and predictive analytics for quality assurance
- Knowledge of continuous integration tools (Jenkins/GitLab, TeamCity, AWS) and their optimization for quality gates
- Advanced test analysis skills: Experience with test flakiness analysis, failure pattern recognition, and automated root cause identification
- Excellent verbal and written communication skills
- Some working knowledge of C++
- Certifications or training in AI/ML or AI testing (e.g., Coursera AI for Everyone, Google AI Engineer, ISTQB AI Testing Foundation)
#LI-AB3What's Roku's approach to hybrid working?