Spoken dialogue translation systems evaluation: results, new trends, problems and proposals.
Hervé Blanchon, Christian Boitet, Laurent Besacier · 2004
It is important to evaluate Spoken Dialogue Translation Systems, but as we show by analyzing evaluation methods in the Verbmobil, C-STAR II, and the Nespole! projects, the current state of the art is not fully satisfactory. Subjective methods are too costly, and objective methods, although cheaper, don’t give good indications about usability. We propose some ideas to improve that situation. 1.