Constructing a Textual Semantic Relation Corpus Using a Discourse Treebank
Rui Wang, Caroline Sporleder · 2010
corpus by making use of an existing treebank annotated with discourse relations; • Our annotation scheme includes six TSRs, backward entailment, forward entailment, equality, contradiction, overlapping, and independent; • We show some ambiguous examples to show the difficulty of such an annotation task, which cannot be easily done by an automatic mapping between discourse relations and semantic relations; • We achieve 81.17 % of agreement on the six semantic relation annotation with a.718 kappa score, and it increases to 91.21 % if we collapse the last two labels with a.775 kappa score. More Examples • elaboration (I vs. BE) • The contract signing represented a major step in the long-planned petrochemical project. • At an estimated $360 million, the project would represent the single largest foreign investment in the Philippines since President Corazon Aquino took office in February 1986. • explanation (FE?)