KAFK at SemEval-2020 Task 12: Checkpoint Ensemble of Transformers for Hate Speech Classification
Kaushik Das, Arup Baruah, Ferdous Ahmed Barbhuiya, Kuntal Dey · 2020
This paper presents the approach of Team KAFK for the English edition of SemEval-2020 Task 12.We use checkpoint ensembling to create ensembles of BERT-based transformers and show that it can improve the performance of classification systems.We explore attention mask dropout to mitigate for the poor constructs of social media texts.Our classifiers scored macro-f1 of 0.909, 0.551 and 0.616 for subtasks A, B and C respectively.