Intra-Tenant resource sharing in yarn based on weighted arithmetic mean
Kiran Kumar Pulamolu, T. Bhavani, D. Venkata Subramanian · 2017
Hadoop is a popular open source framework that supports the processing and storage of large data sets using the MapReduce programming model. To run intensive-data that changes over time, Hadoop decoupling resource management and processing framework is used. Hadoop workloads can run on both Homogeneous and Heterogeneous infrastructures, but running workload in Heterogeneous cluster leads to several challenges like resource fairness, energy, partition skew etc. This paper proposes a priority based Weighted Arithmetic Mean resource sharing using YARN (Yet Another Resource Negotiator). This approach helps in improving the resource sharing by 20%.