User-Attention Based Product Aesthetics Evaluation with Image and Eye-Tracking Fusion Data Analysis
Baixi Xing, Xinjie Song, Qimeng Chen, Lei Shi, Yanhong Pan, Kaiqi Wang, Mengyue Tang · 2023
Users' viewing behavior could affect their perception and evaluation of design works. Taking into account users' visual attention as a subjective cognition cue, we used eye-tracking evidence to identify users' focus areas for further analysis. We conducted experiments to extract the image features of design images and the reviewers' eye-tracking data, aiming to predict the product design ranking in the competition through fusion data analysis. In particular, we collected 1,504 product design images from a design competition. Four deep convolutional neural networks were selected to explore the best aesthetics computation model. The experimental results show that using design images and eye-tracking data fusion can improve the model prediction performance. Finally, MobileNet-V3 achieves the highest classification accuracy of 74.75%. This suggests the proposed method can provide useful insights into personalized aesthetics evaluation and user-centered design perception.