A Quasi-Real-Time MapReduce Schedule Algorithm
Chun Yan Fu, Zhou Hong, Mao Song Ge, Xiao Qu, Yong Li Wang · Advanced materials research · 2013
In this paper, we extend and rewrite MapReduce dispatcher and its quasi-real-time schedule algorithm to support operation scheduling in time-limited. MapReduce dispatcher has an evaluation of completion time of tasks in dependence of rate of progress of tasks at hand, and allocated resource dynamically to every task when they are running. Experimental investigation shows that, the algorithm increase the resource utilization of the MapReduce system, and the goals of quasi-real-time MapReduce schedule has been achieved.