Presentation Styles on User Perceived Usefulness in Opinion Summarization
Xiaojun Yuan, Ning Sa, Grace M. Begany, Huahai Yang · 2016
This study systematically compared perceived usefulness of different types of opinion summarization techniques in two phases of experiments. In the first crowd-sourced experiment, we recruited 46 Amazon turkers to first read 50 reviews from Amazon.com, and then completed a survey in order to generate high quality summary information. This first phase generated four presentation styles of summaries, namely, Tag Clouds, Aspect-Oriented Sentiments, Paragraph Summary and Group Sample. In the second, follow-up lab experiment, 34 participants evaluated the four styles in a card sorting experiment. Each participant was given 32 cards (8 cards each presentation style) and grouped the cards into five categories based on the usefulness of the cards. Results indicate that presentation styles have a significant impact on user perceived usefulness in making decisions in a product review task. Participants perceived Aspect-Oriented Sentiments as the most useful presentation style. System implications and recommendations were discussed.