Big Data Analytics Using Hadoop Map Reduce Framework and Data Migration Process
Payal M. Bante, K. Raja Rajeswari · 2017
Database are increasing in tremendous speed, volume (terabyte to petabyte), and types (variety of Data) becoming more complex. Managing such big data has turn out to be the comprehensive challenge. To conquer this problem, Migration of Data from MySQL to NoSQL and bigdata processing performs through a programming concept identified as Hadoop MapReduce. This paper provides methodology for Migration of data from relation to NoSQL (MongoDB) database and bigdata analytics using Hadoop Map reduce framework above Hadoop Distributed File System (HDFS). Also Sqoop is used for migrating data from Relational Database to Hadoop for analytics process. Hive is introduced for migrate analyzed data from Hadoop to MongoDB. All Experiments are performed on Four different datasets- Loan Database, Connect 4 dataset, Lenses dataset and player tennis dataset form UCI Repository and KAGGLE repository.