Weblog mining based on MapReduce
Liu Li-li · Computer Engineering and Applications Journal · 2012
The current data mining system based on single CPU has developed to a bottleneck to deal with mass data from Web.Using the advantage of cloud computing distributed processing,virtualization and parallelism of ant colony algorithm,this paper presents a weblog mining algorithm based on Map/Reduce's framework.To further verify the high efficiency of the algorithm,it uses the algorithm to mine users'preferred access path based on Hadoop platform.Experimental results show that,using distributed algorithm to process large number of Weblog files in the cluster,can significantly improve the efficiency of Web data mining.