Multimedia retrieval benchmarks
J.R. Smith, Paul Over, Clement H. C. Leung, Horace H. S. Ip, M. Grubinger · IEEE Multimedia · 2004
Multimedia retrieval systems' development has long been challenged by the lack of standard benchmarks for evaluating and comparing the performance of emerging techniques. However, two recent benchmarking efforts, TREC Video Retrieval Evaluation (TRECVID) and the IAPR TC-12 Benchmark for Visual Information Search, show great promise for letting the multimedia retrieval community collaborate on advancing the state of the art.