Multilingual sentence alignment from Wikipedia as multilingual comparable corpora
Min-Hsiang Li, Vitaly V. Klyuev, Shih-Hung Wu · 2010
Bilingual dictionaries and the multilingual dictionaries are necessary resources for machine translation and cross language information retrieval. With the help of these dictionaries, an information retrieval system can find documents of similar content in different languages. Maintaining such dictionaries is an interesting research topic. Researchers can collect multilingual parallel corpora from the Internet and find the translation of new words. Therefore, the parallel corpora can help machine translation and cross language information retrieval. Sentence alignment of parallel corpora is a way to mine the necessary knowledge. But in the real world, a lot of the documents can be presented in comparable corpora. Therefore, we introduce the technique for the extraction of parallel sentences from Wikipedia as multilingual comparable corpora.