Optimization of the search graph using Hadoop and Linux Operating System
Preeti Narooka, Sunita Choudhary · 2017
The evolution of Social networking sites has posed lot of challenges for technology firms and researchers [1]. The Social networking sites are gaining popularity amongst users across the globe and networking of individuals is increasing very rapidly. People search on the Social networking sites to find old friends and other interesting people, this search operation runs in the background of the Social network. The search operation needs to be optimized to enhance the user's experience. In this research paper a MapReduce based search algorithm was designed and processed on a selected Hadoop cluster. The search operation on Hadoop framework could be affected by system parameters like memory, I/O and CPU performance etc. In this research paper one of the functionality of memory i.e. swappiness (which handles a Swap space) is changed & all the other parameters are kept constant to achieve the optimization of the search operation. The search operation is optimized by processing the BigData of different sizes and varying the swappiness which behave as a virtual memory of the system.