Dimensionality Reduction for Text using Domain Knowledge

Yi Mao, Krishnakumar Balasubramanian, Guy Lebanon · 2010

Text documents are complex high dimensional objects. To effectively visualize such data it is important to reduce its dimensionality and visualize the low dimensional embedding as a 2-D or 3-D scatter plot. In this paper we explore dimensionality reduction methods that draw upon domain knowledge in order to achieve a better low dimensional embedding and visualization of documents. We consider the use of geometries specified manually by an expert, geometries derived automatically from corpus statistics, and geometries computed from linguistic resources. 1

Read the paper · More papers on PaperTik