Text Document Clustering Using K-means Algorithm with Dimension Reduction Techniques

Rutuja Kumbhar, Saniya Mhamane, Harshada Patil, Sukruta Patil, Shubhangi Kale · 2020

With growing technologies commercial sites, social media, organizations generate lots of data. However, this huge amount of information needs to be organized properly. For this, the text mining process used as extracting relevant features and knowledge of the given unstructured text documents. The document clustering method in text mining is used for retrieving interesting features. In which similar documents organize into different groups called clusters. The large dimensions of data become a barrier in the extraction of useful information, so using dimensionality reduction (DR) technique for reducing the dimensions of the data matrices. Further data divide into groups using the k-means clustering algorithm. This study implements TF-IDF, singular value decomposition (SVD), non-negative matrix factorization (NMF), and k-means clustering. Finally, the results of the comparison of scores of kmeans, SVD with kmeans, and NMF with k-means are shown by graphical representation. The system uses 20 newsgroup datasets for simulating results.

Read the paper · More papers on PaperTik