Non-functional testing measures performance, quality, and usability against baselines, moving beyond simple pass/fail criteria to create a five-star user experience.
Establish a framework to catch non-functional regressions by collecting data, identifying hotspots, measuring against baselines, and fixing performance drops.
Collect raw data for analysis by either instrumenting the application with code bookends or by instrumenting the test environment to capture video, network, and system stats.
Transform raw data from instrumented environments into actionable metrics like page load time by defining a region of interest and applying visual analytics.
Integrate non-functional testing into project teams by combining the skills of product engineering, data analysis, and testing to drive improvements.
Use non-functional testing in game development to set and track baselines for CPU usage and frames per second (FPS) across different devices.
Measure and improve the time-to-respond for voice inputs by setting a baseline, such as 500 milliseconds, and testing across various locales and devices.
Monitor streaming media performance by tracking loading animations, buffering events, resolution switches, and perceptual quality factors like blockiness and blurriness.
Discussion covers recommended tools like Appium, integrating tests into CI/CD pipelines, and the benefits of instrumenting the test environment over the application.
25:38Ramona Schwering
43:07Golo Roden
1:29:04Liam Hurrell & Jan Kunzmann
42:34Ryan Latta
47:22Christian Kühn
1:42:16Sascha Depold & Parinaz Roghany
28:29Luise Freese and Elio Struyf
28:12Luise Freese
.gif?w=240&auto=compress,format)
Jobs that call for the skills explored in this talk.
Fedrus Global Llc
Chicago, United States of America
scrumconnect ltd
