Gaze Estimation in the Dark with Generative Adversarial Networks

Jung-Hwa Kim, Jin-Woo Jeong · ACM Symposium on Eye Tracking Research and Applications · 2020

In this paper, we propose to utilize generative adversarial networks (GANs) to achieve successful gaze estimation in interactive multimedia environments with low light conditions such as a digital museum or exhibition hall. The proposed approach utilizes a GAN to enhance user images captured under low-light conditions, thereby recovering missing information for gaze estimation. The recovered images are fed into the CNN architecture to estimate the direction of user gaze. The preliminary experimental results on the modified MPIIGaze dataset demonstrated an average performance improvement of 6.6 under various low light conditions, which is a promising step for further research.

Read the paper · More papers on PaperTik