Annotating Agreement and Disagreement in Threaded Discussion
Jacob Andreas, Sara Rosenthal, Kathleen R. McKeown · 2012
We introduce a new corpus of sentence-level agreement and disagreement annotations over LiveJournal and Wikipedia threads.This is the first agreement corpus to offer full-document annotations for threaded discussions.We provide a methodology for coding responses as well as an implemented tool with an interface that facilitates annotation of a specific response while viewing the full context of the thread.Both the results of an annotator questionnaire and high inter-annotator agreement statistics indicate that the annotations collected are of high quality.