A Phenotypic Learning Classifier System for Problems with Continuous Features
Yi Liu, Yu Juan Cui, Wen Cheng, Will Neil Browne, Bing Xue, Chengyuan Zhu, Yiding Zhang, Mingkai Sheng, Lingfang Zeng · Proceedings of the Genetic and Evolutionary Computation Conference · 2024
Over the past four decades, Learning Classifier Systems (LCSs) have faced challenges in producing accurate and interpretable models for domains with continuous features, mainly due to the irrelevance issue caused by genotypic methods. These methods directly modify genotypes (conditions), leading to the creation of irrelevant rules. Phenotypic LCSs, which first modify a rule's phenotype (covered instance set) before altering its genotype, can avoid this issue. However, previous phenotypic LCSs struggle with overfitting, resulting in lower testing performance. In response, we propose a novel phenotypic LCS featuring innovations: 1) a heterogeneous phenotype approach in the rule discovery mechanism to alleviate overfitting, and 2) Informed Mutation leverages the inherent neighbouring of similar instances to enhance rule generalization, thereby improving model interpretability. The proposed LCS demonstrates its success with superior testing performance and more interpretable models in all experiments compared to other LCSs. Notably, in a problem with 2048 features, the proposed LCS model outperformed the genotypic UCS by achieving a 97.4% testing accuracy with just 13 rules, compared to the UCS's 9961 rules but only 49.9% accuracy.