Performance Analysis of MapReduce Program in Heterogeneous Cloud Computing
Wen‐Hui Lin, Jun Liu · Journal of Networks · 2013
The research of Hadoop is an important part of cloud computing industry, and Hadoop performance research is a key research direction. The Hadoop performance analysis as a basic work can provide important reference for other performance optimization researches. In this paper, based on previous researches of server performance analysis, we propose a node performance measurement method on Hadoop. We describe in detail how to measure the performance value of each node in heterogeneous Hadoop cluster and evaluate measurement results by running MapReduce programs. Meanwhile, the method has also been implemented and evaluated in real-world Hadoop cluster. Experiment results show that the method can accurately measure the performance value of each node. Based on this research, users can have a comprehensive and objective understanding of their own Hadoop cluster and then make optimization and improvement on Hadoop