Improving accuracy and run-time performance for TREC-4
David A. Grossman, David O. Holmes, Ophir Frieder, Matthew D. Nguyen, Christopher E. Kingsbury · 1995
For TREC-4, we enhanced our existing prototype that implements relevance ranking using the AT&T DBC-1012 Model 4 parallel database machine to support the entire document collection. Additionally,we developed a special purpose IR prototype to test a new index compression algorithm and to provide performance comparisons to the relational approach. We submitted o#cial results for both automatic and manual adhoc queries for the entire 2GB English collection and the provided Spanish collection. Additionally,we submitted results using n-grams to process the corrupted data. In addition to implementing the vector-space model, we experimented with query reduction based on term frequency. Query reduction was shown to result in dramatically improved run-time performance and, in many cases, resulted in little or no degradation of precision#recall. 1 Introduction For TREC-4, we implemented relevance ranking queries using SQL on an AT&T DBC-1012 #formerly Teradata# parallel database machi...