In immersive Audio Augmented Reality, a virtual sound source should be indistinguishable from the existing real ones. This property can be evaluated with the co-immersion criterion, which encompasses scenes constituted by arbitrary configurations of real and virtual objects. Thus, we introduce the term Audio Augmented Virtuality (AAV) to describe a fully virtual environment consisting of auditory content captured from the real world, augmented by synthetic sound generation. We propose an experimental design in AAV investigating how simplified late reverberation (LR) affects the co-immersion of a sound source. Participants listened to simultaneous virtual speakers dynamically rendered through spatial Room Impulse Responses, and were asked to detect the presence of an impostor, i.e., a speaker rendered with one of two simplified LR conditions. Detection rates were found to be close to chance level, especially for one condition, suggesting a limited influence on co-immersion of the simplified LR in the evaluated AAV scenes. This methodology can be straightforwardly extended and applied to different acoustics scenes, complexities, i.e., the number of simultaneous speakers, and rendering parameters in order to further investigate the requirements for immersive audio technologies in AAR and AAV applications.

Co-immersion in Audio Augmented Virtuality: the Case Study of a Static and Approximated Late Reverberation Algorithm / D. Fantini, G. Presti, M. Geronazzo, R. Bona, A.G. Privitera, F. Avanzini. - In: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS. - ISSN 1077-2626. - 29:11(2023 Nov 11), pp. 4472-4482. (Intervento presentato al 22. convegno International Symposium on Mixed and Augmented Reality (ISMAR) tenutosi a Sydney : 16-20 ottobre nel 2023) [10.1109/TVCG.2023.3320213].

Co-immersion in Audio Augmented Virtuality: the Case Study of a Static and Approximated Late Reverberation Algorithm

D. Fantini
Primo
;
G. Presti
Secondo
;
R. Bona;F. Avanzini
Ultimo
2023

Abstract

In immersive Audio Augmented Reality, a virtual sound source should be indistinguishable from the existing real ones. This property can be evaluated with the co-immersion criterion, which encompasses scenes constituted by arbitrary configurations of real and virtual objects. Thus, we introduce the term Audio Augmented Virtuality (AAV) to describe a fully virtual environment consisting of auditory content captured from the real world, augmented by synthetic sound generation. We propose an experimental design in AAV investigating how simplified late reverberation (LR) affects the co-immersion of a sound source. Participants listened to simultaneous virtual speakers dynamically rendered through spatial Room Impulse Responses, and were asked to detect the presence of an impostor, i.e., a speaker rendered with one of two simplified LR conditions. Detection rates were found to be close to chance level, especially for one condition, suggesting a limited influence on co-immersion of the simplified LR in the evaluated AAV scenes. This methodology can be straightforwardly extended and applied to different acoustics scenes, complexities, i.e., the number of simultaneous speakers, and rendering parameters in order to further investigate the requirements for immersive audio technologies in AAR and AAV applications.
No
English
Audio Augmented Virtuality; Co-immersion; Dynamic Binaural Synthesis; Reverberation; Virtual Acoustics
Settore INF/01 - Informatica
Articolo
Esperti anonimi
Pubblicazione scientifica
   Transforming auditory-based social interaction and communication in AR/VR (SONICOM)
   SONICOM
   EUROPEAN COMMISSION
   H2020
   101017743
11-nov-2023
2-ott-2023
Institute of Electrical and Electronics Engineers (IEEE)
29
11
4472
4482
11
Pubblicato
Periodico con rilevanza internazionale
International Symposium on Mixed and Augmented Reality (ISMAR)
Sydney : 16-20 ottobre
2023
22
Institute of Electrical and Electronics Engineers
Convegno internazionale
Intervento inviato
https://ieeexplore.ieee.org/document/10269056
pubmed
crossref
Aderisco
info:eu-repo/semantics/article
Co-immersion in Audio Augmented Virtuality: the Case Study of a Static and Approximated Late Reverberation Algorithm / D. Fantini, G. Presti, M. Geronazzo, R. Bona, A.G. Privitera, F. Avanzini. - In: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS. - ISSN 1077-2626. - 29:11(2023 Nov 11), pp. 4472-4482. (Intervento presentato al 22. convegno International Symposium on Mixed and Augmented Reality (ISMAR) tenutosi a Sydney : 16-20 ottobre nel 2023) [10.1109/TVCG.2023.3320213].
open
Prodotti della ricerca::01 - Articolo su periodico
6
262
Article (author)
Periodico con Impact Factor
D. Fantini, G. Presti, M. Geronazzo, R. Bona, A.G. Privitera, F. Avanzini
File in questo prodotto:
File Dimensione Formato  
IEEE_Co-immersion_in_Audio_Augmented_Virtuality_the_Case_Study_of_a_Static_and_Approximated_Late_Reverberation_A.pdf

accesso aperto

Descrizione: Final version published by IEEE
Tipologia: Publisher's version/PDF
Dimensione 1.03 MB
Formato Adobe PDF
1.03 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/1013428
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact