Learning Representations for Detecting Abusive Language

Magnus Sahlgren, Tim Isbister, Fredrik K. Olsson · 2018

This paper discusses the question whether it is possible to learn a generic representation that is useful for detecting various types of abusive language.The approach is inspired by recent advances in transfer learning and word embeddings, and we learn representations from two different datasets containing various degrees of abusive language.We compare the learned representation with two standard approaches; one based on lexica, and one based on dataspecific n-grams.Our experiments show that learned representations do contain useful information that can be used to improve detection performance when training data is limited.

Read the paper · More papers on PaperTik