A Particle Swarm Optimization with Filter-based Population Initialization for Feature Selection
Yu Xue, Weiwei Jia, Alex X. Liu · 2019
Feature selection is an important research issue in classification. As an effective global optimization technique, Particle Swarm Optimization (PSO) algorithm has been widely employed to solve feature selection problems. Population initialization is an important stage in Evolutionary Computation (EC) techniques. Therefore, in EC research field, many works focus on population initialization and it has been verified that suitable population initialization methods can significantly improve the performance of EC techniques. The efficient of PSO significantly deteriorates when being used to solve the large-scale feature selection problems. At present, only a few works have been done to enhance the performance of PSO for feature selection problems through population initialization. Meanwhile, there are many excellent traditional filter feature selection methods. Their characteristic is quick in speed but low in effect. However, they can provide a lot of useful heuristic information. Therefore, this paper focuses on improving the performance of PSO for feature selection problems by designing filter-based population initialization methods. In the proposed method, the filters are firstly used to evaluate features. Based on the obtained heuristic information, the initialization method combining the mixed initialization and the threshold selection is designed. The experiments are carried out on several datasets and the proposed initialization method is compared to some related initialization methods. Besides, the K-Nearest Neighbour (KNN) and other compatible fitness learners are used for performance assessment for feature selection. The results show that the proposed method using KNN classifier is promising to improve the performance of PSO for feature selection problems.