Calculating Wikipedia Article Similarity Using Machine Translation Evaluation Metrics

Maike Erdmann, Andrew Finch, Kotaro Nakayama, Eiichiro Sumita, Takahiro Hara, Shojiro Nishio · 2011

Calculating the similarity of Wikipedia articles in different languages is helpful for bilingual dictionary construction and various other research areas. However, standard methods for document similarity calculation are usually very simple. Therefore, we describe an approach of translating one Wikipedia article into the language of the other article, and then calculating article similarity with standard machine translation evaluation metrics. An experiment revealed that our approach is effective for identifying Wikipedia articles in different languages that are covering the same concept.

Read the paper · More papers on PaperTik