Enhanced Dynamic Data Placement and Virtual Machine Creation for MapReduce
2017
In this paper, we proposed a novel mechanism, namely Enhanced Dynamic Data Placement (EDDP).There are two components in EDDP: data partitioning and virtual machines (VMs) optimization.The first component is adapted from [Lee et al, 2014] whereby data placement and their size at the computing nodes must be proportional with their computation capability.In the second component, the configurations of the virtual machines created to handle the incoming jobs are optimized based on benchmarking.Experimental results show that EDDP managed to shorten job completion time.