MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization
Xinnuo Xu, Ondřej Dušek, Shashi Narayan, Verena Rieser, Ioannis Konstas · 2021
One of the most challenging aspects of current single-document news summarization is that the summary often contains 'extrinsic hallucinations', i.e., facts that are not present in the source document, which are often derived via world knowledge.This causes summarization systems to act more like open-ended language models tending to hallucinate facts that are erroneous.In this paper, we mitigate this problem with the help of multiple supplementary resource documents assisting the task.We present a new dataset MIRANEWS and benchmark existing summarization models. 1 In contrast to multi-document summarization, which addresses multiple events from several source documents, we still aim at generating a summary for a single document.We show via data analysis that it's not only the models which are to blame: more than 27% of facts mentioned in the gold summaries of MIRANEWS are better grounded on assisting documents than in the main source articles.An error analysis of generated summaries from pretrained models fine-tuned on MIRANEWS reveals that this has an even bigger effects on models: assisted summarization reduces 55% of hallucinations when compared to single-document summarization models trained on the main article only.Summary: Kathy Griffin and Howard Stern gather to say goodbye at Joan Rivers funeral in manhattan New York AP.Even in death, Joan Rivers got what she wanted: a star-studded funeral, with the worlds of Hollywood, fashion, media and money all among the mourners on Sunday morning.Document: on sunday morning, a legion of notables turned out at new york's temple emanu-el to remember rivers, who died thursday at 81: kathy griffin, whose edgy, biting comedy career was largely made possible by rivers; colleague and friend kelly osbourne; sarah jessica parker and whoopi goldberg; howard stern... lined up outside the fifth avenue synagogue and waited for their names to be checked against a list before entering.barricades lined several blocks of manhattan's fifth avenue, and a crowd of fans and media stood watch across the street.the comedian detailed in her 2012 book `` i hate everyone starting with me'' that she hoped for ``a huge showbiz affair with lights, cameras, action ''and ``hollywood all the way.''... Assisting Document: new york city's temple emanu-el; joan rivers all access photo/splash news online updated 09