Study on Massive Web Log Mining Based on Cloud
Wei Shuan · Computer Knowledge and Technology · 2014
Data on Internet are massive, heterogeneous, dynamic and increasingly complex. It is possible to get potentially valuable information by mining and analyzing the data. However, there are many bottlenecks in traditional data mining system. This paper proposes a web log mining and analyzing system based on Hadoop, using cloud computing technology. At the same time, to improve the efficiency, the Apriori algorithm is parallelized for massive web log mining and it is verified with the proposed system.