Wavelet-based multi-view video coding with full scalability and illumination compensation
Jens-Uwe Garbas, Ulrich Fecker, André Kaup · 2007
A wavelet-based approach to scalable multi-view video coding (MVC) is examined in this paper. A 4-D wavelet transform is used to decorrelate the multi-view video data temporally, view-directionally, and spatially for efficient compression. Motion compensated temporal filtering (MCTF) is applied to each video sequence of each camera to exploit temporal correlation and inter-view dependencies are exploited with disparity compensated view filtering (DCVF). Together with a 2-D spatial wavelet transform the 4-D wavelet transform is constituted. The open-loop structure of the decomposition, together with embedded quantization and coding, allows for the construction of a bitstream which is fully scalable in temporal, view-directional, spatial and quality dimension. Results for scalable decoding in all dimensions are given, as well as comparisons to simulcast coding and state-of-the-art non-scalable multi-view video coding. Further, a significant coding gain is shown when the sequences are pre-processed with an algorithm for cross-view illumination compensation based on histogram matching.