A Multi-Modal Knowledge Graph for Classical Chinese Poetry
Yuqing Li, Yuxin Zhang, Bin Wu, Ji-Rong Wen, Ruihua Song, Ting Bai · 2022
Classical Chinese poetry has a long history and is a precious cultural heritage of humankind.Displaying the classical Chinese poetry in a visual way, helps to cross cultural barriers in different countries, making it enjoyable for all the people.In this paper, we construct a multimodal knowledge graph for classical Chinese poetry (PKG), in which the visual information of words in the poetry are incorporated.Then a multi-modal pre-training language model, i.e., PKG-Bert, is proposed to obtain the poetry representation with visual information, which bridges the semantic gap between different modalities.PKG-Bert achieves the state-of-theart performance on the poetry-image retrieval task, showing the effectiveness of incorporating the multi-modal knowledge.The large-scale multi-modal knowledge graph of classical Chinese poetry will be released to promote the researches in classical Chinese culture area 1 .