Classification of Information Display Types Using Graph Neural Networks
Yuehan Yin, Michael P. McGuire, Yahya Alqahtani, Jinjuan Heidi Feng, Joyram Chakraborty · 2023
Eye-tracking technology has been applied in many studies, such as visual behavior and usability studies. The collected eye-tracking data has been increasingly utilized with deep learning techniques to solve various machine learning tasks. The aim of this study is to classify eye-tracking data collected from two visual information processing studies using graph neural networks (GNNs) to identify three types of information display. Additionally’ data-preprocessing and feature engineering techniques are applied to convert the eye-tracking data into graphs with a certain number of features. This study also explores how feature engineering affects the evaluation metrics of the neural network models used in the study. The best results came from our GNN model trained using feature engineered input, which achieved a test accuracy of 90.14%, a precisiontotal of 90.92%, a recalltotal of 88.97%, and an F1 scoretotal of 89.82%. Furthermore, it demon-strates the promise of GNNs in eye-tracking data analysis by allowing the classification of large numbers of eye-tracking results.