Crowd-Sourced Iterative Annotation for Narrative Summarization Corpora
Jessica Ouyang, Serina Y. Chang, Kathy McKeown · 2017
We present an iterative annotation process for producing aligned, parallel corpora of abstractive and extractive summaries for narrative.Our approach uses a combination of trained annotators and crowd-sourcing, allowing us to elicit human-generated summaries and alignments quickly and at low cost.We use crowd-sourcing to annotate aligned phrases with the text-to-text generation techniques needed to transform each phrase into the other.We apply this process to a corpus of 476 personal narratives, which we make available on the Web.