MRGazerII: Camera-free Decoding Eye Movements from Functional Magnetic Resonance Imaging
Rongjie Hu, Jie Liang, Yiwen Ding, Shuang Jian, Xiuwen Wu, Yanming Wang, Yong Zhang, Zhen Liang, Bensheng Qiu, Xiaoxiao Wang · Proceedings on CD-ROM - International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition/Proceedings of the International Society for Magnetic Resonance in Medicine, Scientific Meeting and Exhibition · 2024
Eye movements reflect changes in human behavior and thought to some extent, but many functional magnetic resonance imaging (fMRI) studies are limited by equipment and do not perform eye movement tracking. Recently, a deep learning method has been proposed for the regression problem of a single volume's gaze point. In this paper, we propose an end-to-end pipeline called MRGazerⅡ, which includes eye signal extraction, eye-movement behavior recognition and gaze point regression from fMRI scanning slices. The method was tested on the human connectome project (HCP) fMRI dataset and achieved the desired performance.