GP-Net: Global Perceptual Network with Adaptive Gradient Clipping for Emotional Image Classification
Xiaohua Wang, Jie Yang, Min Qiang Hu, Xia Wu · 2023
Traditional image emotion recognition focuses only on the emotion information embedded in the subject or part of the image, while ignoring the global emotion information. In this paper, we propose a new network based on Vision Transformer: a global perception network, containing a main module and a background module. The main module enhances the weighting of objects by showing the interdependencies between modelled channels. The background module further searches for emotional information in the background. In addition, we employ multi-task learning and Adaptive Gradient Clipping to improve the network. Extensive experiments show that our proposed method outperforms the state-of-the-art methods for image sentiment analysis.