Football Coreference Corpus
Michael Bugert, Nils Reimers, Shany Barhom, Ido Dagan, Iryna Gurevych · 2020
This script generates the Football Coreference Corpus (FCC), as introduced in the paper Breaking the Subtopic Barrier in Cross-Document Event Coreference Resolution by Bugert et al. 2020. Cross-document event coreference resolution (CDCR) is the task of detecting and clustering mentions of events across a set of documents. A major bottleneck in CDCR is a lack of appropriate datasets, which stems from the difficulty of annotating data for this task. We present the first scalable approach for annotating cross-subtopic event coreference links, a highly valuable but rarely occurring type of cross-document link. The annotation of these links requires combing through hundreds of documents - an endeavor for which conventional token-level annotation schemes with trained expert annotators are too expensive. We instead propose crowdsourcing annotation on sentence level to achieve scalability. We apply our approach to create the Football Coreference Corpus (FCC), a corpus of 451 sports news reports, while reaching high agreement between NLP experts and crowd annotators in the process.