MapReduce System Productivity Modeling and Measurement
Dongyu Feng, Ligu Zhu, Lei Zhang · International Journal of Grid and Distributed Computing · 2017
How to effectively utilize the computing resource remains a longstanding challenge in MapReduce application, and MapReduce system productivity has become a major issue in research field.In the paper, we explored the productivity mathematical models for MapReduce system, defining the productivity as the ratio of the workload and energy consumption per unit time, and proposed the measurement approach for MapReduce system productivity.Based on the measurement model and approach, this paper selected CPU intensive and I/O intensive computing in MapReduce to measure and evaluate MapReduce system productivity.Finally, the measurement and evaluation result showed that productivity model and approach in the paper is reasonable and valid for architecture design of MapReduce system in production environment.