Whereby: Audio & Video Quality Benchmarking in Real-World Conditions

Overview

Whereby, a European browser based video conferencing platform and API, partnered with TestDevLab to gain independent validation of the performance and reliability of its real-time communication technology. As video calls continue to play a central role in hybrid work, and are increasingly becoming vital infrastructure in sectors like healthcare and education, Whereby aims to ensure consistently strong video clarity, smooth motion, and high-quality audio—even under unpredictable network conditions faced by real users.

TestDevLab designed a benchmarking study that simulated realistic network constraints and measured end-to-end user experience quality through both objective metrics and perceptual analysis.

Testing Objectives

The assessment focused on three key dimensions essential to real-time communication:

• Audio ExperienceEvaluating how clearly and consistently audio is delivered, along with end-to-end delay.
• Video Quality & SmoothnessMeasuring perceived video clarity, motion fluidity, and latency using advanced quality algorithms.
• Network ResponsivenessObserving how the system adapts to changes in network conditions, including bitrate stability and recovery behavior.

Together, these areas provided a holistic view of Whereby’s performance across variable connectivity environments.

Test Approach

Structured desktop-based test sessions were conducted to capture a comprehensive set of audio, video, and network indicators. Measurements included:

• Audio quality and delay
• Video quality scores, framerate, visual artifacts, and video delay
• Network metrics such as bitrate adaptation and recovery
• System performance metrics including CPU, GPU, and memory usage

By combining objective data with real-world behavior analysis, the study offered a clear understanding of user experience robustness.

Value Delivered

Through this benchmarking effort, Whereby received:

• Independent confirmation of the resilience and adaptability of its communication technology.
• Actionable insights highlighting strengths and opportunities for further optimization.
• A data-driven framework for ongoing performance monitoring and future improvements.
  

Ultimately, the study supports Whereby’s mission to deliver reliable, high-quality video and audio experiences to users regardless of their network conditions.