Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control

  • Janani Fernandez
  • , David Lou Alon
  • , Zamir Ben-Hur
  • , Vladimir Tourbabin

Research output: Contribution to conferencePaperpeer-review

Abstract

This paper investigates an approach for reproducing head-worn microphone array recordings over headphones, such that the listener is also able to augment the rendering to emphasise sounds arriving within a particular field-of-view (FoV), while also attempting to preserve the spatial properties of the captured scene. This type of processing may find application within future augmented reality contexts. The directional emphasis is realised by applying an additional direction-dependent weighting term, when conducting the magnitude least-squares fitting of the array directivities to the binaural directivities. The proposed approach is presented alongside perceptual metric analysis and evaluated via a perceptual study involving 20 listeners. The results suggest that achieving a gain within a defined FoV is attainable, but there exists a trade-off between increasing gain and negatively impacting the spatial aspects of the reproduced sound scene.

Original languageEnglish
StatePublished - 1 Jan 2024
Externally publishedYes
Event5th AES International Conference on Audio for Virtual and Augmented Reality, AVAR 2024 - Redmond, United States
Duration: 19 Aug 202421 Aug 2024

Conference

Conference5th AES International Conference on Audio for Virtual and Augmented Reality, AVAR 2024
Country/TerritoryUnited States
CityRedmond
Period19/08/2421/08/24

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Acoustics and Ultrasonics

Fingerprint

Dive into the research topics of 'Binaural reproduction of head-worn microphone array recordings with adjustable field-of-view control'. Together they form a unique fingerprint.

Cite this