The Improvement and Implementation of Job Scheduling Algorithm of Hadoop in MapReduce
Xie Hui-jua · Computer Knowledge and Technology · 2014
Based on the MapReduce framework achieved by Hadoop,this article has a detailed analysis of the existing three job scheduling algorithm, For these three algorithms does not consider the load conditions of server cluster and poor data locality, this paper presents the FSVQ algorithm which analyze the number of the arrival of idle nodes in certain time,it is also meet the data locality by waiting approach.The results prove that the algorithm can increase the efficiency of server clusters and reduce network latency, with practical application significance by test.