WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2021 • Jun 28, 2021

Using non-functional testing to guide user interface, backend services, voice interface, and media development

Brien Colwell

Want to deliver a five-star user experience? Discover how double-purposing functional automated tests for non-functional metrics safeguards performance across UI, voice, and media.

Pause
Mute Enter Fullscreen
#1 about 2 min

Differences between functional and non-functional testing

Non-functional testing focuses on measuring performance, quality, and reliability against target baselines rather than simple pass-fail outcomes.

#2 about 2 min

Creating a safety net to catch non-functional regressions

Establishing a framework centered on data collection creates a continuous safety net for identifying and addressing regressions.

#3 about 2 min

Integrating testing, data, and engineering skills for project teams

Combining the expertise of functional testing, data analysis, and product engineering enables an effective non-functional testing practice.

#4 about 5 min

Implementing a continuous workflow to track non-functional regressions

Identifying hotspots, measuring against established baselines, and tracking changes across builds ensures consistent product improvement.

#5 about 4 min

Collecting raw performance data by instrumenting application logic components

Inserting start and stop markers inside the application logic generates precise telemetry for analyzing performance hotspots.

#6 about 4 min

Instrumenting test environments to gather non-functional metrics synthetically

Capturing external signals like video, network traces, and system statistics avoids modifying application code while generating rich datasets.

#7 about 4 min

Extracting standardized performance metrics from raw test data

Combining application events and visual analytics yields critical insights like first contentful paint and application connection efficiency.

#8 about 5 min

Defining regions of interest to measure page load accuracy

Separating input commands from visual analytics establishes pixel-perfect measurements of user actions within automated testing frameworks.

#9 about 4 min

Structuring project teams to manage non-functional testing goals

Engineering sets the architecture, data teams extract measurements, and testing teams incorporate metric collection into existing functional runs.

#10 about 4 min

Tracking performance baselines and regressions in gaming applications

Monitoring frames per second and processor usage across different devices ensures consistent playability during continuous deployment.

#11 about 3 min

Benchmarking voice application response times across different locales

Synthetically testing voice inputs helps measure application response intervals and identify regressions against industry benchmarks.

#12 about 3 min

Measuring video playback quality and stream resolution transitions

Tracking buffering animations and visual artifacts provides objective visibility into the perceived quality of on-demand media.

#13 about 2 min

Resources for mastering automated non-functional software testing techniques

Teams can access specialized training, developer documentation, and synthetic testing platforms to improve product performance checks.

#14 about 9 min

Tools and strategies for practical non-functional testing workflows

Integrating test frameworks, monitoring production networks, and adopting appropriate instrumentation simplifies comprehensive performance measurements over time.

Matching moments

53 sec

Adopting new testing paradigms for future multimodal applications

Matt Wyman Matt Wyman · World Congress 2026 North America

2:22 min

Adopting modern end-to-end testing for automated deployment pipelines

Luise Freese Luise Freese +1 · Coffee With Developers

3:25 min

Bridging the gap between fantasy testing and real-world conditions

Luise Freese Luise Freese · World Congress 2025

2:00 min

The software testing timeline and regression checking pitfalls

Ingo Philipp · LIVE

1:43 min

Key strategies for continuous frontend performance testing

Ramona Schwering Ramona Schwering · World Congress 2023

3:56 min

Live load testing functional applications using concurrent tooling

Ingo Weichsel · World Congress 2023

More from World Congress 2021

Micro Frontends with Module Federation: Why and How? thumbnail
45:40
about 5 years ago

Micro Frontends with Module Federation: Why and How?

Manfred Steyer

Data Science on Software Data thumbnail
48:10
about 5 years ago

Data Science on Software Data

Markus Harrer

The journey from developer to devops - what i've learnt along the way thumbnail
42:44
about 5 years ago

The journey from developer to devops - what i've learnt along the way

Liam Hurrel, Alireza Chegini

How Data is Shaping our Games thumbnail
43:30
about 5 years ago

How Data is Shaping our Games

Johanna Pirker

Cross platform Augmented Reality development with React Native thumbnail
40:50
over 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

How to Build a Monetization Strategy Based on User's in-app Behavior thumbnail
38:59
over 5 years ago

How to Build a Monetization Strategy Based on User's in-app Behavior

Natalie Sieradzki

Related videos

Proactive monitoring and smoke testing in your production environment thumbnail
1:27:59
LIVE • over 5 years ago

Proactive monitoring and smoke testing in your production environment

Liam Hurrel

Frontend Performance Testing in practice thumbnail
36:50
LIVE • over 6 years ago

Frontend Performance Testing in practice

Jonas Kröger

Implementing smoke testing and proactive monitoring in production thumbnail
1:29:04
World Congress 2021 • over 5 years ago

Implementing smoke testing and proactive monitoring in production

Liam Hurrell, Jan Kunzmann

Continuous testing - run automated tests for every change! thumbnail
47:22
World Congress 2021 • over 5 years ago

Continuous testing - run automated tests for every change!

Christian Kühn

Measure and improve frontend performance by using test automation thumbnail
25:38
World Congress 2023 • about 3 years ago

Measure and improve frontend performance by using test automation

Ramona Schwering

Let's get visual - Visual testing in your project thumbnail
44:59
JS Congress • almost 5 years ago

Let's get visual - Visual testing in your project

Ramona Schwering

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.