Earlier stage for straggler detection and handling using combined CPU test and LATE methodology
Anwar H. Katrawi, Rosni Abdullah, Mohammed Anbar, Ammar Kamal Abasi · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · 2020
Using MapReduce in Hadoop helps in lowering the execution time and power consumption for large scale data. However, there can be a delay in job processing in circumstances where tasks are assigned to bad or congested machines called "straggler tasks"; which increases the time, power consumptions and therefore increasing the costs and leading to a poor performance of computing systems. This research proposes a hybrid MapReduce framework referred to as the combinatory late-machine (CLM) framework. Implementation of this framework will facilitate early and timely detection and identification of stragglers thereby facilitating prompt appropriate and effective actions.