VR-PTOLEMAIC: A Virtual Environment for the Perceptual Testing of Spatial Audio Algorithms

2025-08-01

AI Summary

This study addresses the lack of immersive perceptual evaluation methods for spatial audio algorithms by developing the first virtual reality (VR) assessment platform integrated with the standardized MUSHRA psychoacoustic testing framework. The platform employs second-order Ambisonic real-room impulse responses and enables multi-stimulus, hidden-reference, and anchor-based listening tests across 25 spatial positions within a virtual seminar room, leveraging real-time multichannel spatial audio rendering and VR interaction. Its key contribution lies in the first deep integration of the MUSHRA protocol into a VR environment, significantly enhancing spatial awareness, auditory realism, and ecological validity of perceptual testing. Experimental results confirm the platform’s high immersion, robust interactivity, and favorable user experience, enabling cross-position, quantitative perceptual comparison of diverse sound field reconstruction algorithms.

Technology Category

• Intelligent Robots: Multimodal Perception & Sensor Fusion
• Planning, Routing, and Scheduling: Optimization of Spatio-temporal Systems
• Cognitive Modeling & Cognitive Systems: Affective Computing

Application Category

• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web
• Systems and Infrastructure for Web, Mobile and WoT: Experiences and lessons learnt from Web-based algorithms and system deployments

Abstract

The perceptual evaluation of spatial audio algorithms is an important step in the development of immersive audio applications, as it ensures that synthesized sound fields meet quality standards in terms of listening experience, spatial perception and auditory realism. To support these evaluations, virtual reality can offer a powerful platform by providing immersive and interactive testing environments. In this paper, we present VR-PTOLEMAIC, a virtual reality evaluation system designed for assessing spatial audio algorithms. The system implements the MUSHRA (MUlti-Stimulus test with Hidden Reference and Anchor) evaluation methodology into a virtual environment. In particular, users can position themselves in each of the 25 simulated listening positions of a virtually recreated seminar room and evaluate simulated acoustic responses with respect to the actually recorded second-order ambisonic room impulse responses, all convolved with various source signals. We evaluated the usability of the proposed framework through an extensive testing campaign in which assessors were asked to compare the reconstruction capabilities of various sound field reconstruction algorithms. Results show that the VR platform effectively supports the assessment of spatial audio algorithms, with generally positive feedback on user experience and immersivity.

Problem

• Evaluates perceptual quality of spatial audio algorithms
• Provides immersive VR testing for sound field reconstruction
• Compares simulated and recorded acoustic responses

Innovation

• VR platform for spatial audio evaluation
• Implements MUSHRA methodology in VR
• Simulates 25 listening positions interactively