VL-BERT+: Detecting Protected Groups in Hateful Multimodal Memes
Piush Aggarwal, Michelle Espranita Liman, Darina Gold, Torsten Zesch · 2021
This paper describes our submission (winning solution for Task A) to the Shared Task on Hateful Meme Detection at WOAH 2021.We build our system on top of a state-of-the-art system for binary hateful meme classification that already uses image tags such as race, gender, and web entities.We add further metadata such as emotions and experiment with data augmentation techniques, as hateful instances are underrepresented in the data set.* Equal contribution of the first two authors 1 https://www.workshopononlineabuse.com/cfp/ shared-task-on-hateful-memes 2 In the data set, memes are labeled as PC EMPTY if they are not hateful and none of the protected categories can be applied.In this paper, we use NONE instead of PC EMPTY for better intuition.