End-to-End Evaluation of Machine Interpretation Systems: A Graphical Evaluation Tool
Susanne Johanna Jekat, Lorenzo Tessiore · 2000
VERBMOBIL as a long-term project of the Federal Ministry of Education, Science, Research and Technology aims at developing a mobile translation system for spontaneous speech.The source-language input consists of human speech (English, German or Japanese), the translation (bidirectional English-German and Japanese-German) and target-language output is effected by the VERBMOBIL system.As to the innovative character of the project new methods for end-to-end evaluation had to be developed by a subproject which has been established especially for this purpose.In this paper we present criteria for the evaluation of speech-tospeech translation systems and a tool for judging the translation quality which is called Graphical Evaluation Tool (GET) 2 .