EXTRA: Integrating External Knowledge into Multimodal Hashtag Recommendation System
Hyun-Sik Won, Su-Min Roh, Dohyun Kim, M Kim, Huiju Kim, Kang-Min Kim · 2023
As microblogs have become commonplace, recommending relevant hashtags for microblog posts has become increasingly important. However, recommending appropriate hashtags for a post is challenging because it requires a high-level understanding of the context and relationships of the information in the post. In this paper, we propose a novel hashtag recommendation framework that incorporates external knowledge to enrich the context of posts. Using an image of the post, we obtain the hierarchical external knowledge extracted by the Open Directory Project (ODP)-based classifier. Experimental results show that our framework performs better than the baselines on a multimodal hashtag recommendation benchmark dataset. It outperformed the existing state-of-the-art model by providing a 39.86% increase in the average F1-score.