Testing Rules for Mapreduce Fameworks
Sara Hsaini, Salma Azzouzi, My El Hassan Charaf · 2018 IEEE 5th International Congress on Information Science and Technology (CiSt) · 2018
Nowadays, MapReduce frameworks has emerged as the most popular framework to process efficiently large-scale datasets using several workers with various functionalities. However, the execution of such models on large clusters produces several failures due to bugs or hardware problems. In this context, we present a novel architecture-Based Conformance Testing in order to check if the behavior of a Mapreduce Implementation Under Test (MR-IUT) is conform to its specification. The proposed approach shows how to cope with problems encountered in Mapreduce distributed testing using distributed testing rules. Afterwards, we illustrate our contribution using a case study based on the famous `Inverted Index' application distributed by Hadoop.