Results of a Model for Hadoop YARN MapReduce Tasks
Thomas C. Bressoud, Qiuyi Tang · 2016
The performance of Hadoop YARN MapReduceapplications can be distilled down to a relatively small handfulof performance factors affecting the completion of the individualtask component times of map task time, shuffle time, mergetime, and reduce task time. These four components, coupledwith the operational policies of an application master and theresource management and scheduling ultimately determine theperformance of an application executing on a given cluster. Wepresent models for each of these task components and assess themodels against MapReduce applications to demonstrate their promise.