Loading, searching and retrieving data from local data nodes on HDFS
M. Sreerama Murty, N. Naga MalleswaraRao · International Journal of Data Science · 2020
The loading and searching the data from data with in local data nodes by using the Hadoop environment. In general the loading and searching data by using a query is more complex, because the capacity of the dataset may large. We propose a technique to handle the data in local nodes without overlapping and data retrieved by script. The main task of the query is to store the information on distributed environment and searching the without any delay. Here we define the script to avoid the redundancy of the duplicate while searching and loading the data in dynamic mechanism. And also provide the Hadoop file system in distributed environment. The apache script is used to loading and searching the information instead of the SQL mechanism. We improve the performance of query execution and graph theory. The query can split into three parts to search the data individually and combined the results in execution. Here we used the replica concept to store the data at time of executing query in Hadoop file system. The script is executed on the locating environment of Hadoop file system.