Relevant Features Independence of Heuristic Selection and Important Features of Decision Tree in the Medical Data Classification
Yusi Tyroni Mursityo, Irfany Rupiwardani, Widhy Hayuhardhika Nugraha Putra, Dewi Sri Susanti, Titis Handayani, Samingun Handoyo · Journal of Advances in Information Technology · 2024
The input of predictive models has an important role in directing the classification model to have a satisfactory performance in predicting an unknown label of the instance class.The predictor features should be not only relevant to the target feature but also should be independent of each other.The research objective is to obtain the predictor features that are relevant and independent through feature selection using the Chi-square test, one-way Analysis of Variance (ANOVA), and Pearson's correlation test, and to show important features of the decision tree are different from the features of relevant and independent.The evaluation of irrelevant features yields 44 of 67 relevant features which as many as 18 discrete types with two labels are dropped.The dataset with 44 relevant features is used to train the first decision tree.The relevant features mean that the target feature depends on them.The best predictor features should not only be relevant but also independent of each other.The evaluation of independent among features yields 11 of 44 independent features where the features of numeric and discrete with 2 labels are represented by 1 and three features respectively.The dataset with 11 relevant and independent features is used to train the second decision tree.The important features of both models are very different and the second model has better performance than the first one for the metrics of accuracy, recall, and F1-Score.