Term Importance Degree Impact on Search Result Clustering
Soheila Karbasi, Mehdi Yaghoubi · International Journal of Computer Applications · 2014
As wellactual clustering algorithms have to deal with explosive growth of documents of various sizes and terms of various frequencies, an appropriate term-weighting scheme has a crucial impact on the overall performance of such systems.Term-weighting is one of the critical process for document retrieval and ranking in most search result clustering systems.In this paper we introduce a new technique forclustering algorithms that solve the problem of indexing the terms of big datasets and their characteristicswhich exist in most of current clustering approaches.The paper focus on term frequency normalization step ofclustering algorithms.Anew factor has been applied tobasic term-weighting schemes for using in clustering process.The evaluated results confirm the impact of this factor to increase the performance of clusteringtechniques.The experiments were carried out on the standard algorithms and ODP-239 datasets which validated by statistical tests.