Theme Topic Mixture Model: A Graphical Model for Document Representation
Mikaela Keller, Samy Bengio · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2004
Documents are usually represented in the bag-of-word space. However, this representation does not take into account the possible relations between words. We propose here a graphical model for representing documents: the Theme Topic Mixture Model (TTMM). This model assumes two types of relations among textual data. Topics link words to each other and Themes gather documents with particular distribution over the topics. This paper defines the TTMM, compares it to the related Latent Dirichlet Allocation (LDA) model [2] and reports some interesting empirical results.