The TIPSTER SUMMAC Text Summarization Evaluation
Inderjeet Mani, David House, Gary L. Klein, Lynette Hirschman, Thérèse Firmin, Beth M. Sundheim · 1999
The TIPSTER Text Summarization Evaluation (SUMMAC) has established definitively that automatic text summarization is very effective in relevance assessment tasks. Summaries as short as 17% of full text length sped up decision-making by almost a factor of 2 with no statistically significant degradation in F-score accuracy. SUMMAC has also introduced a new intrinsic method for automated evaluation of informative summaries.