View-dependent Multi-channel Audio Processing for a Multi-view Camera System
Young Han Lee, Hong Kook Kim, Manbae Kim · ITC-CSCC :International Technical Conference on Circuits Systems, Computers and Communications · 2007
In this paper, we propose a view-dependent multi-channel audio processing (VMAP) method, which reconstructs multi-channel audio corresponding to a viewpoint in a multi-view camera (MVC) system. First of all, we calculate an angle by which the configuration of a multi-channel loudspeaker system must be panned from the viewpoint. Next, we select a pair of speakers which must cover the panned angle. After that, in order to construct the output audio signals by the weighted sum of all the input audio channels, the weighting factors are computed by comparing the actual speaker configuration and the desired panned angle. Finally, it is shown from the experimental results that the proposed VMAP method enables the listeners to vividly perceive audio according to the selected viewpoint in the MVC system.