Enhancing time performance by job commonality feature: Hadoop

Chattopadhyay Soumya, Muzameel Ahmed · 2017

Cloud computing and Big Data both leverages Hadoop framework to process the Bid Data parallel. Hadoop framework is used to build both high performance and large scale clusters. The limitation posed by the framework for efficient execution due to data locality provides the scope to improve the performance. An enhanced architecture is proposed in this paper which addresses the issue of reducing the time taken to read the data and to increase the number task executed. The architecture provides an additional layer to the NameNode using which it directs the task to the DataNode having the required data rather than searching the data every execution.

Read the paper · More papers on PaperTik