TY - GEN
T1 - Ambisonics Capture using Microphones on Head-worn Device of Arbitrary Geometry
AU - Bastine, Amy
AU - Birnie, Lachlan
AU - Abhayapala, Thushara D.
AU - Samarasinghe, Prasanga
AU - Tourbabin, Vladimir
N1 - Publisher Copyright:
© 2022 European Signal Processing Conference, EUSIPCO. All rights reserved.
PY - 2022/1/1
Y1 - 2022/1/1
N2 - 3D auditory scenes for Extended Reality (XR) environments are usually recorded using spherical microphone arrays and then binaurally rendered through head-wearable devices. Considerable research is ongoing to integrate spatial audio recording capabilities into these devices. Plausible microphone array designs mountable on head-devices will have arbitrary geometry and unknown scattering effects. In this case, we can not apply conventional eigenbeam processing methods of regular arrays. In this paper, we propose an alternative method using Wearable-Device-Related Transfer Functions (WDRTFs) to extract higher-order ambisonics from the recordings of the head-device. WDRTFs are directional responses incorporating the sound wave transformations caused by the device's and wearer's body. The inherent diversity of these functions is exploited to estimate the ambisonics of the recorded soundfield. This paper presents a preliminary evaluation of this method using two irregular microphone array designs worn on a spherical head and the results are promising in comparison to an equivalent SMA. Therefore, we can further adapt this method to achieve perceptually accurate binaural rendering using the microphone recordings of the head-device.
AB - 3D auditory scenes for Extended Reality (XR) environments are usually recorded using spherical microphone arrays and then binaurally rendered through head-wearable devices. Considerable research is ongoing to integrate spatial audio recording capabilities into these devices. Plausible microphone array designs mountable on head-devices will have arbitrary geometry and unknown scattering effects. In this case, we can not apply conventional eigenbeam processing methods of regular arrays. In this paper, we propose an alternative method using Wearable-Device-Related Transfer Functions (WDRTFs) to extract higher-order ambisonics from the recordings of the head-device. WDRTFs are directional responses incorporating the sound wave transformations caused by the device's and wearer's body. The inherent diversity of these functions is exploited to estimate the ambisonics of the recorded soundfield. This paper presents a preliminary evaluation of this method using two irregular microphone array designs worn on a spherical head and the results are promising in comparison to an equivalent SMA. Therefore, we can further adapt this method to achieve perceptually accurate binaural rendering using the microphone recordings of the head-device.
KW - Arbitrary microphone array
KW - device response
KW - extended reality
KW - head devices
KW - spherical harmonics
UR - https://www.scopus.com/pages/publications/85141011842
U2 - 10.23919/eusipco55093.2022.9909803
DO - 10.23919/eusipco55093.2022.9909803
M3 - Conference contribution
AN - SCOPUS:85141011842
T3 - European Signal Processing Conference
SP - 309
EP - 313
BT - 30th European Signal Processing Conference, EUSIPCO 2022 - Proceedings
PB - European Signal Processing Conference, EUSIPCO
T2 - 30th European Signal Processing Conference, EUSIPCO 2022
Y2 - 29 August 2022 through 2 September 2022
ER -