Applying Prefixed-Itemset and Compression Matrix to Optimize the MapReduce-based Apriori Algorithm on Hadoop
Rui Sun, Yuqiang Li · 2020
Apriori algorithm is the classical algorithm for mining association rules. However, it also has some problems, such as comparing the identical itemset repeatedly and scanning the external storage database frequently. Based on the previous research, this paper proposed a method of applying the prefixed-itemset and the compression matrix to optimize the connection step, pruning step, support counting step and transaction storage mode of the Apriori algorithm. The experimental results show that compared with the conventional Apriori algorithm, the optimized Apriori algorithm has more powerful mining efficiency and more excellent performance.