Evaluation of Linguistics-Based Translation
Janne Bondi Johannessen, Torbjørn Nordgård, Lars Nygaard · 2008
We report on the evaluation of the Norwegian-English MT prototype system LOGON.The system is rule-based and makes use of well-established frameworks for analysis and generation (LFG and HPSG).Minimal Recursion Semantics is the "glue" which performs transfer from source to target language and serves as the information vehicle between LFG and HPSG.The project-internal testing uses material from the training data sources.We report on two test methods in addition: 1) on test data from the same (narrow) domain as the project was designed for, and 2) on a syntactic test suite.The former turns out to give much worse results than the project-internal tests, while the latter obtains somewhat better results.These results are important for future evaluations of similar systems.