Topic based language models for ad hoc information retrieval

Leif A. Azzopardi, Mark Girolami, C. J. van Rijsbergen · 2005

We propose a topic based approach to language modelling for ad-hoc information retrieval (IR). Many smoothed estimators used for the multinomial query model in IR rely upon the estimated background collection probabilities. In this paper, we propose a topic based language modelling approach, that uses a more informative prior based on the topical content of a document. In our experiments, the proposed model provides comparable IR performance to the standard models, but when combined in a two stage language model, it outperforms all other estimated models.

Read the paper · More papers on PaperTik