Evaluation of the Scusi? Spoken Language Interpretation System -- A Case Study
Thomas Kleinbauer, Ingrid Zukerman, Su Nam Kim · International Joint Conference on Natural Language Processing · 2013
We present a performance evaluation framework for Spoken Language Understanding (SLU) modules, focusing on three elements: (1) characterization of spoken utterances, (2) experimental design, and (3) quantitative evaluation metrics. We then describe the application of our framework to Scusi?— our SLU system that focuses on referring expressions.