Measuring MT Adequacy Using Latent Semantic Analysis
Florence M. Reeder · 2006
Translation adequacy is defined as the amount of semantic content from the source language document that is con-veyed in the target language document. As such, it is more difficult to measure than intelligibility since semantic content must be measured in two documents and then compared. Latent Semantic Analysis is a content measurement technique used in language learner evaluation that exhib-its characteristics attractive for re-use in machine translation evaluation (MTE). This experiment, which is a series of ap-plications of the LSA algorithm in various configurations, demonstrates its useful-ness as an MTE metric for adequacy. In addition, this experiment lays the groundwork for using LSA as a method to measure the accuracy of a translation without reliance on reference translations. 1