Bilingual Dictionary Construction with Transliteration Filtering
John T. E. Richardson, Toshiaki Nakazawa, Sadao Kurohashi · 2014
In this paper we present a bilingual transliteration lexicon of 170K Japanese-English technical terms in the scientific domain.Translation pairs are extracted by filtering a large list of transliteration candidates generated automatically from a phrase table trained on parallel corpora.Filtering uses a novel transliteration similarity measure based on a discriminative phrase-based machine translation approach.We demonstrate that the extracted dictionary is accurate and of high recall (F1-score 0.8).Our lexicon contains not only single words but also multi-word expressions, and is freely available.Our experiments focus on Katakana-English lexicon construction, however it would be possible to apply the proposed methods to transliteration extraction for a variety of language pairs.