Enhancing ReliefF for multi-label text classification via high-order label correlation
Farica Perdana Putri, Ismail Ahmed Al-Qasem Al-Hadi, Abdulalem Ali, Kuru Ratnavelu · Results in Engineering · 2026
• An improved ReliefF feature selection is proposed for multi-label text classification. • Integration of high-order label correlations by label clustering and weighting. • Achieves consistently superior classification performance compared with ReliefF-based and state-of-the-art multi-label feature selection methods. • Ablation studies confirm the contributions of label clustering and weighting to overall performances. ReliefF is a widely used feature selection algorithm due to its effectiveness in high-dimensional feature spaces and its non-parametric nature. However, existing ReliefF-based approaches often rely on the similarity between the label sets of two instances. They ignore global and high-order label correlations, which lower the accuracy performance of these approaches. In multi-label data, labels can correlate with more than one label and tend to form a group based on their similarities. Therefore, this study introduces HLC-ReliefF, a novel feature selection method based on ReliefF by integrating high-order label correlations for multi-label text classification. This allows scalable and innovative knowledge discovery in technological innovation systems. First, mutual information is used to extract the non-linear relationship between labels and features. It is employed to cluster the label space for capturing global and high-order label correlations. Second, imbalanced labels are mitigated by assigning a proportion of labels to determine the weight of each cluster. Finally, the hybrid metric for ReliefF’s instance-distance computation is adapted by implementing feature distance and cluster-aware label distance. Cluster similarity is integrated into the feature update weights to increase the influence of neighbors with more similar cluster structures to the target instance. The effectiveness of HLC-ReliefF is validated on nine open-access benchmark multi-label datasets using five standard evaluation metrics. The results demonstrate that HLC-ReliefF outperforms other methods across most metrics and datasets. Ablation studies also confirm the major contribution of label clustering and cluster weighting. This highlights their impact on improving ReliefF for capturing label correlations.