Phrase discovery for English and Cross-Language Retrieval at TREC-6
Fredric C. Gey, Aitao Chen · 1997
Berkeley's experiments in TREC-6 center around phrase discovery in topics and documents. The technique of ranking bigram term pairs by their expected mutual information value was utilized for English phrase discovery as well as Chinese segmentation. This differentiates our phrase-finding method from the mechanistic one of using all bigrams which appear at least 25 times in the collection. Phrase finding presents an interesting interaction with stop words and stop word processing. English phrase discovery proved very important in a dictionary-based English to German cross language run. Our participation in the filtering track was marked with an interesting strictly Boolean retrieval as well as some experimentation with maximum utility thresholds on probabilistically ranked retrieval. 1 Introduction Berkeley's participation in the TREC conferences has provided a venue for experimental verification of the utility of algorithms for probabilistic document retrieval. Probabilistic document ...