Towards Innovative Evaluation Methodologies for Speech Translation
Michael D. Paul, Hiromi Nakaiwa, Marcello Federico · NTCIR · 2004
This paper reports on activities within the C-STAR 1 consortium which aim at novel speech translation technologies and their evaluation. In C-STAR, current state-of-the-art speech translation systems developed by the partners are evaluated and discussed on a regular basis by means of evaluation workshops. The objectives of these workshops are to provide a framework for the validation of existing evaluation methodologies concerning their applicability to the evaluation of speech translation technologies, and to open new directions on how to improve current methods.