Unveiling Social Relations: Leveraging Interpersonal Similarity Learning for Social Relation Recognition

Wang Tang, Linbo Qing, Haosong Gou, Li Guo, Yonghong Peng · IEEE Signal Processing Letters · 2023

Identifying social relationships from images is a challenging yet promising research area with great potential for improving human health and enhancing our understanding of social networks. However, present endeavors in this field tend to concentrate on leveraging visual features for the exploration of social relationships, while disregarding certain concealed information that lies beneath these features, such as interpersonal similarity. These methodologies may result in inadequate visual data encoding, thereby imposing limitations on the accuracy of social relationship recognition. In light of this, we propose a novel framework that utilizes interpersonal similarities within images to provide more information for identifying social relationships, thereby mitigating the issue of insufficient feature exploration. Furthermore, our proposed framework incorporates an innova-tive CF-Loss function that effectively incentivizes the identifica-tion of accurate social relationships while penalizing incorrect identifications, ultimately bolstering the model's capacity to dis-criminate between distinct social relationships. Our experimental findings demonstrate the superiority of our proposed framework over state-of-the-art methods on public datasets, confirming its effectiveness and accuracy in identifying social relationships.

Read the paper · More papers on PaperTik