We are not amused - but how do you know? user states in a multi-modal dialogue system
Anton M. Batliner, Viktor Zeißler, Carmen Frank, Johann Adelhardt, Rui Ping Shi, Elmar Nöth · 2003
For the multi-modal dialogue system SmartKom, emotional user states in a Wizard-of-Oz experiment as, e.g., joyful, angry, helpless, are annotated holistically and based purely on facial expressions; other phenomena (prosodic peculiarities, offtalk, i.e., speaking aside, etc.) are labelled as well.We present the correlations between these different annotations and report classification results using a large prosodic feature vector.The performance of the user state classification is not yet satisfactory; possible reasons and remedies are discussed.