Measuring relative target user group success in spoken conversation for edutainment
Niels Ole Bernsen · University of Southern Denmark Research Portal (University of Southern Denmark) · 2004
The paper presents corpus data obtained from a relatively large field test of a Wizard of Oz (WoZ)-simulated specification of a multimodal domain-oriented spoken conversation system for edutainment. As the system design targets 10-18 years old users, a metrics is proposed for measuring the extent to which the simulated system specifically manages to appeal to its target user group. The metrics are applied to the WoZ corpus data, focusing on how to handle the observed differences between native and non-native English speaking users. This leads to a derived metrics which seems useful for system development progress evaluation.