Research and Implementation of MapReduce Programming Oriented Graphical Modeling System
Wulun Du, Depei Qian, Ming Xie, Wei Chen · 2013
Along with the beginning of the big data era, it becomes difficult to capture, store, search, share, transfer, analyze, and visualize bigger data using the traditional data processing applications. Therefore, the problem is very rigid for many larger companies and research institutes that how to correctly and efficiently extract useful information from the massive data. MapReduce is a programming model developed by Google for processing and generating large data sets in distributed environments. Hadoop, an open-source project, is used to implement Google MapReduce architecture which is wildly used by many large companies. However, it is difficult to program map-reduce functions for common users to solve real world problems because of the rigid pattern of the framework. In this paper, we develop a graphic platform to help ordinary users in creating MapReduce application by dragging encapsulated components. We are particularly concerned with simplifying development and increasing efficiency.