Design And Implementation of Novel Job Scheduler for Map reduce System in Hadoop Platform
Mohammed Muzammil Mehdi, S Prakasha, M. Tech Student · IJSRD : international journal for scientific research and development · 2015
Apache Hadoop is an open source group of tools which is widely adopted in industries and as well as in academia due to its processing of large data in parallel. MapReduce is the most important component of Hadoop which is a programmable framework for pulling a data in parallel across the number of clusters. When lots of users submit their job at the same time they compete for the same resources as a result the job response time an important factor system performance seriously disgraced. So there is a need of efficient scheduler for such MapReduce clusters. To overcome this problem an efficient scheduler is designed and implemented which make use of the knowledge of workload patterns to improve the response time.