Data Cleaning Mechanism for Big Data and Cloud Computing
Kumar Rahul, Rohitash Kumar Banyal · International Conference on Computing for Sustainable Global Development · 2019
Data cleaning and data filtering mechanism are an important tool for IoT(Internet of Things) based Big Data and Cloud Computing technologies. In today's world, majority of the industries and sectors needs data's for processing and they find out potential customer for their businesses. With the exceptional growth in scale up of data's, increasing amount of training data set available for processing at Big Data and Cloud Computing side. In most of the data set, at least 10 % of data set are missing values, erroneous, in-complete, not suitable, noisy data or outliers. Data cleaning approach is used to remove outliers, missing values from the huge data set and correct information gathered. No data set provides right information with noisy or missing values. This paper deals with mechanism through programming concept to remove noisy or missing values in a heterogeneous data set under Big Data system and Cloud Computing. This paper deals with outlier analysis concept with respect of Big Data technologies.