A Review of Hadoop Resource Scheduling Research
Tengfei Han, Wanjun Yu · 2023
Scheduling of Hadoop resources and tasks is the core technology of Hadoop platform and has an important impact on the overall operational performance of the cluster, so it is crucial to study Hadoop resource scheduling. This paper describes the objectives and characteristics of Hadoop resource scheduling, discusses the current research status of Hadoop resource scheduling, and summarizes the four aspects of improving data locality, improving heterogeneous environment adaptability, optimizing task prediction mechanism and optimizing other aspects. Some problems in the existing research on Hadoop scheduling are analyzed, and the future directions of Hadoop scheduling research are prospected.