Research and Improvement of Apriori Algorithm Based on Hadoop
Gao Pengfei, Wang Jianguo, Liu Pengcheng · International Journal of Advanced Network Monitoring and Controls · 2018
Abstract Association rules can forcefully get a horizontal relation in the big data, the Apriori algorithm is one of the most significant association rules. Traditional mining based on parallel Apriori algorithms needs much more time in data IO with the increasing size of large transaction database. This paper improves the Apriori algorithm from compressing transactions, reducing the number of scans and simplifying candidate set generation. And then the improved algorithm is parallelized on the Hadoop framework. The experiments show that this improved algorithm is suitable for large-scale data mining and has good scalability and effectiveness.