The Investigation into Deep Learning Classifiers Towards Imbalanced Text Data
Luthfia Nur Azizah, Purnomo Husnul Khotimah, Andria Arisal, Andri Fachrur Rozie, Devi Munandar, Dianadewi Riswantini, Ekasari Nugraheni, Wiwin Suwarningsih, Dian Kurniasari · 2022
Class imbalance is an important classification problem where failure to identify events can be hazardous due to failure of solution preparation or opportune handling. Minorities are mostly more consequential in such cases. It is necessary to know a reliable classifier for imbalanced classes. This study examines several conventional machine learning and deep learning methods to compare the performance of each method on dataset with imbalanced classes. We use COVID-19 online news titles to simulate different class imbalance ratios. The results of our study demonstrate the superiority of the CNN with embedding layer method on a news titles dataset of 16,844 data points towards imbalance ratios of 37%, 30%, 20%, 10%, and 1%. However, CNN with embedding layer showed a noticeable performance degradation at an imbalance ratio of 1%.