Toward Optimal Streaming Feature Selection
Noura Al Nuaimi, Mohammad Mehedy Masud · 2017
Recently, real-time data brings explosion of big data that is challenged traditional data mining techniques. Analyzing data in real-time would allow making better decisions on realtime. Usually, big data contains many irrelevant and redundant data. Therefore, removing and discarding these data is essential. Streaming feature selection involving big data has generally been viewed as a solution for selecting informative features that lead to accurate learning models. In this paper we introduce an efficient algorithm for selection of features from a feature stream by online feature grouping. This technique will be useful in big data analytics due to its efficiency and scalability. The main contribution of this work is to solve the challenge of extremely high dimensional of big data by delivering the streaming feature grouping and selection algorithm. In our approach the algorithm is designed with the idea of grouping similar features to reduce the redundancy and to handle the stream of features in an online fashion. Experimental results have demonstrated that our proposed algorithm shown superior performance in terms of prediction accuracy and running time.