Research on Parallel k-means Algorithm Design Based on Hadoop Platform
Zhongzhi Shi · 2011
In the past decades,data clustering has been studied extensively and a mass of methods and theories have been achieved.However,with the development of database and popularity of Internet,a lot of new challenges such as massive data and new computing environment lie in the research on data clustering.We conducted a deep research on parallel k-means algorithm based on Hadoop,which is a new cloud computing platform.We showed how to design parallel k-means algorithms on Hadoop.Experiments on different size of datasets demonstrate that our proposed algorithm shows good performance on speedup,scaleup and sizeup.Thus it fits to data clustering on huge datasets.