A New Agglomerative Hierarchical Clustering Algorithm Implementation based on the Map Reduce Framework
Hui Gao, Jun Jiang, Li She, Yan Fu · International Journal of Digital Content Technology and its Applications · 2010
Text clustering is one of the difficult and hot research fields in the text mining research. Combing Map Reduce framework and the neuron initialization method of VPSOM (vector pressing SelfOrganizing Model) algorithm, a new text clustering algorithm is presented. It divides the large text vector dataset into data blocks, each of which then processed in different distributed data node of Map Reduce framework with agglomerative hierarchical clustering algorithm. The experiment results indicate that the improved algorithm has a higher efficiency and a better accuracy.