Temporal Evaluation
Naushad UzZaman, James F. Allen · 2011
In this paper we propose a new method for evaluating systems that extract temporal information from text. It uses temporal closure 1 to reward relations that are equivalent but distinct. Our metric measures the overall performance of systems with a single score, making comparison between different systems straightforward. Our approach is easy to implement, intuitive, accurate, scalable and computationally inexpensive. 1