A new parallel association rule mining algorithm on distributed shared memory system
M. H. Marghny, Hosam E. Refaat · International Journal of Business Intelligence and Data Mining · 2012
Frequent itemset finding is the most time consuming step in analysing large transactional databases. The use of sequential algorithms cannot give analytical ability for such very large databases especially in terms of run-time performance. Therefore, we must rely on high performance parallel computing. In this paper, we present a new parallel algorithm for frequent itemset mining, called ‘HorVertical’ algorithm. This algorithm introduces a new database partitioning called ‘HorVertical’ partitioning. This technique in partitioning the database reduces the dependency in the parallel computation and gives new properties to reduce the computations. The algorithm passes the database only one time and starts a new stage with the finished itemsets while some other itemsets in the same stage have not been finished yet. We present the result on the performance of our algorithm on various databases, and compare it against well known algorithms.