TY - GEN
T1 - VIRTUAL NAVIGATION VIA HIGHER ORDER DISTRIBUTED SOUND SOURCES
AU - Abhayapala, Thushara D.
AU - Zhang, Jihui
AU - Xu, Shaoheng
AU - Alon, David Lou
AU - Ben-Hur, Zamir
AU - Samarasinghe, Prasanga N.
N1 - Publisher Copyright:
© 2023 European Acoustics Association, EAA. All rights reserved.
PY - 2023/1/1
Y1 - 2023/1/1
N2 - With the rise of virtual reality, there is a demand for recording and recreating real-world experiences that allow users to move throughout audio-visual scenes. Sound field translation achieves this by building an equivalent environment of virtual sources to recreate the recording spatially. However, combining multiple microphone array recordings and dealing with mix fields of exterior and interior together is difficult. In this paper, we explain a novel method of virtual navigation by representing complex sound fields by distributed virtual higher order sound sources. The technique combine recordings from spatially separated microphones and decompose them to a sparse representation of multiple higher order sources. The method can be thought of sound field decomposition into a grid of higher order sources. We show the method can be used in VR applications involving navigation within complex sound scenes.
AB - With the rise of virtual reality, there is a demand for recording and recreating real-world experiences that allow users to move throughout audio-visual scenes. Sound field translation achieves this by building an equivalent environment of virtual sources to recreate the recording spatially. However, combining multiple microphone array recordings and dealing with mix fields of exterior and interior together is difficult. In this paper, we explain a novel method of virtual navigation by representing complex sound fields by distributed virtual higher order sound sources. The technique combine recordings from spatially separated microphones and decompose them to a sparse representation of multiple higher order sources. The method can be thought of sound field decomposition into a grid of higher order sources. We show the method can be used in VR applications involving navigation within complex sound scenes.
KW - higher order sound sources
KW - virtual navigation
KW - virtual sources
UR - http://www.scopus.com/inward/record.url?scp=85191233572&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85191233572
T3 - Proceedings of Forum Acusticum
BT - Forum Acusticum 2023 - 10th Convention of the European Acoustics Association, EAA 2023
PB - European Acoustics Association, EAA
T2 - 10th Convention of the European Acoustics Association, EAA 2023
Y2 - 11 September 2023 through 15 September 2023
ER -