Dialogue Scenario Collection of Persuasive Dialogue with Emotional Expressions via Crowdsourcing
Koichiro Yoshino, Yoko Ishikawa, Masahiro Mizukami, Yu Suzuki, Sakriani Sakti, Satoshi Nakamura · 2018
Existing dialogue data collection methods such as the Wizard of Oz method (WoZ) or real dialogue recording are costly, and they prevent launching a new dialogue system.In this study, we requested crowd workers in crowdsourcing to create dialogue scenarios according to the instruction of the situation for persuasive dialogue systems that use emotional expressions.We collected 200 dialogues in 5 scenarios for a total of 1,000 via crowdsourcing.We also annotated emotional states and users' acceptance for system persuasion by using crowdsourcing.We constructed a persuasive dialogue system with the collected data and evaluated the system by interacting with crowd works.From the experiment, it was investigated that the collected labels have sufficient agreement even if we did not impose any training of annotation to workers.