Improvement of the MapReduce Model Based on Message Middleware Oriented Data Intensive Computing
Junwei Ge, Xian Jiang, Yiqiu Fang · 2011
MapReduce is an abstract model of processing big data with the parallel computing framework. However it is heavy that the model for the data intensive computing, DIC, depends on the data transmission between the cluster's nodes which causes the overload on the master node handling the messages used to communicate with the nodes in the cluster. Therefore, this paper proposes an improved model of MapReduce based on message middleware, to improve the performance of DIC. This paper describes the principles and mechanism of the improved model in detail.