WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2021 • Jun 28, 2021

Using non-functional testing to guide user interface, backend services, voice interface, and media development

Brien Colwell

Want to deliver a five-star user experience? Discover how double-purposing functional automated tests for non-functional metrics safeguards performance across UI, voice, and media.

Pause
Mute Enter Fullscreen
#1 about 2 min

Differences between functional and non-functional testing

Non-functional testing focuses on measuring performance, quality, and reliability against target baselines rather than simple pass-fail outcomes.

#2 about 2 min

Creating a safety net to catch non-functional regressions

Establishing a framework centered on data collection creates a continuous safety net for identifying and addressing regressions.

#3 about 2 min

Integrating testing, data, and engineering skills for project teams

Combining the expertise of functional testing, data analysis, and product engineering enables an effective non-functional testing practice.

#4 about 5 min

Implementing a continuous workflow to track non-functional regressions

Identifying hotspots, measuring against established baselines, and tracking changes across builds ensures consistent product improvement.

#5 about 4 min

Collecting raw performance data by instrumenting application logic components

Inserting start and stop markers inside the application logic generates precise telemetry for analyzing performance hotspots.

#6 about 4 min

Instrumenting test environments to gather non-functional metrics synthetically

Capturing external signals like video, network traces, and system statistics avoids modifying application code while generating rich datasets.

#7 about 4 min

Extracting standardized performance metrics from raw test data

Combining application events and visual analytics yields critical insights like first contentful paint and application connection efficiency.

#8 about 5 min

Defining regions of interest to measure page load accuracy

Separating input commands from visual analytics establishes pixel-perfect measurements of user actions within automated testing frameworks.

#9 about 4 min

Structuring project teams to manage non-functional testing goals

Engineering sets the architecture, data teams extract measurements, and testing teams incorporate metric collection into existing functional runs.

#10 about 4 min

Tracking performance baselines and regressions in gaming applications

Monitoring frames per second and processor usage across different devices ensures consistent playability during continuous deployment.

#11 about 3 min

Benchmarking voice application response times across different locales

Synthetically testing voice inputs helps measure application response intervals and identify regressions against industry benchmarks.

#12 about 3 min

Measuring video playback quality and stream resolution transitions

Tracking buffering animations and visual artifacts provides objective visibility into the perceived quality of on-demand media.

#13 about 2 min

Resources for mastering automated non-functional software testing techniques

Teams can access specialized training, developer documentation, and synthetic testing platforms to improve product performance checks.

#14 about 9 min

Tools and strategies for practical non-functional testing workflows

Integrating test frameworks, monitoring production networks, and adopting appropriate instrumentation simplifies comprehensive performance measurements over time.

Matching moments

2:22 min

Adopting modern end-to-end testing for automated deployment pipelines

Luise Freese Luise Freese +1 · Coffee With Developers

3:25 min

Bridging the gap between fantasy testing and real-world conditions

Luise Freese Luise Freese · World Congress 2025

2:00 min

The software testing timeline and regression checking pitfalls

Ingo Philipp · LIVE

1:43 min

Key strategies for continuous frontend performance testing

Ramona Schwering Ramona Schwering · World Congress 2023

3:56 min

Live load testing functional applications using concurrent tooling

Ingo Weichsel · World Congress 2023

16:16 min

Audience questions on visual testing execution and framework differences

Ramona Schwering Ramona Schwering · LIVE

More from World Congress 2021

Micro Frontends with Module Federation: Why and How? thumbnail
45:40
about 5 years ago

Micro Frontends with Module Federation: Why and How?

Manfred Steyer

Data Science on Software Data thumbnail
48:10
about 5 years ago

Data Science on Software Data

Markus Harrer

The journey from developer to devops - what i've learnt along the way thumbnail
42:44
about 5 years ago

The journey from developer to devops - what i've learnt along the way

Liam Hurrel, Alireza Chegini

How Data is Shaping our Games thumbnail
43:30
about 5 years ago

How Data is Shaping our Games

Johanna Pirker

Cross platform Augmented Reality development with React Native thumbnail
40:50
over 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

How to Build a Monetization Strategy Based on User's in-app Behavior thumbnail
38:59
over 5 years ago

How to Build a Monetization Strategy Based on User's in-app Behavior

Natalie Sieradzki

Related videos

Proactive monitoring and smoke testing in your production environment thumbnail
1:27:59
LIVE • over 5 years ago

Proactive monitoring and smoke testing in your production environment

Liam Hurrel

Frontend Performance Testing in practice thumbnail
36:50
LIVE • over 6 years ago

Frontend Performance Testing in practice

Jonas Kröger

Implementing smoke testing and proactive monitoring in production thumbnail
1:29:04
World Congress 2021 • over 5 years ago

Implementing smoke testing and proactive monitoring in production

Liam Hurrell, Jan Kunzmann

Continuous testing - run automated tests for every change! thumbnail
47:22
World Congress 2021 • over 5 years ago

Continuous testing - run automated tests for every change!

Christian Kühn

Measure and improve frontend performance by using test automation thumbnail
25:38
World Congress 2023 • about 3 years ago

Measure and improve frontend performance by using test automation

Ramona Schwering

Let's get visual - Visual testing in your project thumbnail
44:59
JS Congress • almost 5 years ago

Let's get visual - Visual testing in your project

Ramona Schwering

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.