Perceptual multimedia compression based on the predictive Kalman filter eye movement modeling
Oleg V. Komogortsev, Javed I. Khan · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2007
In this paper we propose an algorithm for predicting a person's perceptual attention focus (PAtF) through the use of a Kalman Filter design of the human visual system. The concept of the PAtF allows significant reduction of the bandwidth of a video stream and computational burden reduction in the case of 3D media creation and transmission. This is possible due to the fact that the human visual system has limited perception capabilities and only 2 degrees out of the total of 180 provide the highest quality of perception. The peripheral image quality can be decreased without a viewer noticing image quality reduction. Multimedia transmission through a network introduces a delay. This delay reduces the benefits of using a PAtF due to the fact that the person's attention area can change drastically during the delay period, thus increasing the probability of peripheral image quality reduction being detected. We have created a framework which uses a Kalman Filter to predict future PAtFs in order to compensate for the delay/lag and to reduce the bandwidth/creation burden of any visual multimedia.