Performance Comparison of Support Vector Machines, Random Forest and Artificial Neural Networks in Binary Classification: Descriptive Comparison Study
Emre Dirican, Zeki Akkuş · Turkiye Klinikleri Journal of Biostatistics · 2021
Objective: In this study, it was aimed to find the method with high classification success among the methods used in the study by comparing the supervised machine learning methods according to the classification performance. Material and Methods: In our study, both the real data set obtained from 302 patients with invasive ductal carcinoma and 24 different data sets obtained by simulation were used to compare the classification performance of support vector machines, random forest and artificial neural networks. The success of classifications of the methods used was compared according to the general accuracy, F-measure, Matthews correlation coefficient, area under the curve (AUC) and discriminant power in breast cancer data. In addition, the difference in training-test accuracy in the simulation data and the significance of this difference were also evaluated. Results: The highest survival classification accuracy (80%) for the test set of stage III patients with invasive ductal carcinoma was obtained from support vector machines (SVM) with the radial-based kernel. The highest values in other performance metrics (F-measure=0.87, Matthews correlation coefficient=0.22, AUC=0.89 and discriminant power=0.52), and the most successful results in simulation data were generally obtained from SVM. Conclusion: SVM had higher accuracy in both the real data set and simulation data than random forest and artificial neural networks.