SSDP: A Slot-Sensitive Data Placement Strategy in Cloud Computing
Tian Tian, Peng Liu, Huaxing Kuang · 2015
Since preserving data locality is very important in MapReduce frameworks, the placement of jobs' input data becomes critical for MapReduce job performance. However, existing data placement strategies applied in MapReduce based file systems lack the efficient control of data storage. Some input data of jobs may concentrate in a few nodes, making slots contention on those nodes more aggressive and thereby hurting job performance significantly. To address this problem, we propose a Slot-Sensitive Data Placement strategy that aims to alleviate the contention for slots due to inappropriate data placement. By separately placing the input data of jobs on as many nodes as possible according to the availability of slots, SSDP contributes to the improvement of job performance. Extensive simulations by replaying public workloads demonstrate that SSDP can significantly improve the job performance up to 13%.