Archive-based multiple feature construction methods using adaptive Genetic Programming
Kaixuan Jia, Jianbin Ma, Xiaoying Gao, Jiaxin Niu · Proceedings of the Genetic and Evolutionary Computation Conference Companion · 2024
The quality of features is an important factor that affects the classification performance of machine learning algorithms. Feature construction based on Genetic Programming (GP) can automatically create more discriminative features, sometimes greatly improving classification performance. However, insufficient information caused by constructing a single feature or constructing only a few features can affect the classification performance of feature construction. In addition, GP may fall into premature convergence, which also affects classification performance. This paper proposes an archive-based multiple feature construction method which uses elite archive strategy to preserve and select effective constructed features, and employs an adaptive strategy for GP to adjust the crossover and mutation probabilities based on fitness values. Experiments on ten datasets show that our proposed archive-based multiple feature construction method without using adaptive GP can significantly improve the classification performance compared with traditional single feature construction method, and the classification performance can be maintained or further improved by adding the adaptive strategy. The comparisons with three state-of-the-art techniques show that our proposed methods can significantly achieve better classification performance.