Detection of Product Comparisons - How Far Does an Out-of-the-Box Semantic Role Labeling System Take You?
Wiltrud Kessler, Jonas Kuhn · 2013
This short paper presents a pilot study investigating the training of a standard Semantic Role Labeling (SRL) system on product reviews for the new task of detecting comparisons.An (opinionated) comparison consists of a comparative "predicate" and up to three "arguments": the entity evaluated positively, the entity evaluated negatively, and the aspect under which the comparison is made.In user-generated product reviews, the "predicate" and "arguments" are expressed in highly heterogeneous ways; but since the elements are textually annotated in existing datasets, SRL is technically applicable.We address the interesting question how well training an outof-the-box SRL model works for English data.We observe that even without any feature engineering or other major adaptions to our task, the system outperforms a reasonable heuristic baseline in all steps (predicate identification, argument identification and argument classification) and in three different datasets.