Methodologies for QoE Evaluation in XR Asymmetric Collaborative Applications

The evaluation of the quality perceived by a user when experiencing extended reality is a multifaceted challenge. Studies in the state-of-the-art show that it depends on several factors such as user comfort, level of immersivity, cognitive load, and content quality. In addition, extended reality systems are moving towards the realization of collaborative and multi-user applications. In this scenario, additional aspects should be taken into account such as the social presence and the quality of interaction. Currently, to the best of our knowledge, the literature lacks common practices or standards for designing experimental tests that encompass all these aspects. In this work, we aim at providing practical guidelines for assessing the quality of experience in multi-user applications. Therefore, we focus on a flexible task that can be applied to many extended reality technologies. We provide a thorough set of technological scenarios for the application of the proposed methodology and we compare the perceived quality of experience in different technological settings by analyzing the results of a multi-lab subjective study.