TY - JOUR
T1 - Six-Degrees-of-Freedom Binaural Reproduction of Head-Worn Microphone Array Capture
AU - McCormack, Leo
AU - Meyer-Kahlen, Nils
AU - Alon, David Lou
AU - Ben-Hur, Zamir
AU - Amengual Garí, Sebastià V.
AU - Robinson, Philip
N1 - Publisher Copyright:
© 2023 Audio Engineering Society. All rights reserved.
PY - 2023/10/1
Y1 - 2023/10/1
N2 - This article formulates and evaluates four different methods for six-degrees-of-freedom binaural reproduction of head-worn microphone array recordings, which may find application within future augmented reality contexts. Three of the explored methods are signal-independent, utilizing least-squares, magnitude least-squares, or plane wave decomposition–based solutions. Rotations and translations are realized by applying directional transformations to the employed spherical rendering or optimization grid. The fourth considered approach is a parametric signal-dependent alternative, which decomposes the array signals into directional and ambient components using beamformers. The directional components are then spatialized by applying binaural filters corresponding to the transformed directions, whereas the ambient sounds are reproduced using the magnitude least-squares solution. Formal perceptual studies were conducted, whereby test participants rated the perceived relative quality of the four binaural rendering methods being evaluated. Of the three signal-independent approaches, the magnitude least-squares solution was rated the highest. The parametric approach was then rated higher than the magnitude least-square solution when the listeners were permitted to move away from the recording point.
AB - This article formulates and evaluates four different methods for six-degrees-of-freedom binaural reproduction of head-worn microphone array recordings, which may find application within future augmented reality contexts. Three of the explored methods are signal-independent, utilizing least-squares, magnitude least-squares, or plane wave decomposition–based solutions. Rotations and translations are realized by applying directional transformations to the employed spherical rendering or optimization grid. The fourth considered approach is a parametric signal-dependent alternative, which decomposes the array signals into directional and ambient components using beamformers. The directional components are then spatialized by applying binaural filters corresponding to the transformed directions, whereas the ambient sounds are reproduced using the magnitude least-squares solution. Formal perceptual studies were conducted, whereby test participants rated the perceived relative quality of the four binaural rendering methods being evaluated. Of the three signal-independent approaches, the magnitude least-squares solution was rated the highest. The parametric approach was then rated higher than the magnitude least-square solution when the listeners were permitted to move away from the recording point.
UR - http://www.scopus.com/inward/record.url?scp=85176813823&partnerID=8YFLogxK
U2 - 10.17743/jaes.2022.0104
DO - 10.17743/jaes.2022.0104
M3 - Article
AN - SCOPUS:85176813823
SN - 1549-4950
VL - 71
SP - 638
EP - 649
JO - AES: Journal of the Audio Engineering Society
JF - AES: Journal of the Audio Engineering Society
IS - 10
ER -