Automating News Comment Moderation with Limited Resources: Benchmarking in Croatian and Estonian
Ravi Shekhar, Marko Pranjić, Senja Pollak, Andraž Pelicon, Matthew Purver · LDV-Forum/Journal for language technology and computational linguistics · 2020
This article describes initial work into the automatic classification of user-generated content in news media to support human moderators.We work with real-world data -comments posted by readers under online news articles -in two less-resourced European languages, Croatian and Estonian.We describe our dataset, and experiments into automatic classification using a range of models.Performance obtained is reasonable but not as good as might be expected given similar work in offensive language classification in other languages; we then investigate possible reasons in terms of the variability and reliability of the data and its annotation.