Predicting Moderation of Deliberative Arguments: Is Argument Quality the Key?
Neele Falk, Iman Jundi, Eva Maria Vecchi, Gabriella Lapesa · 2021
Human moderation is commonly employed in deliberative contexts (argumentation and discussion targeting a shared decision on an issue relevant to a group, e.g., citizens arguing on how to employ a shared budget).As the scale of discussion enlarges in online settings, the overall discussion quality risks to drop and moderation becomes more important to assist participants in having a cooperative and productive interaction.The scale also makes it more important to employ NLP methods for (semi-)automatic moderation, e.g. to prioritize when moderation is most needed.In this work, we make the first steps towards (semi-)automatic moderation by using state-ofthe-art classification models to predict which posts require moderation, showing that while the task is undoubtedly difficult, performance is significantly above baseline.We further investigate whether argument quality is a key indicator of the need for moderation, showing that surprisingly, high quality arguments also trigger moderation.We make our code and data publicly available.1 ⇤ denotes equal contribution 1 Code and annotated sample available here: https://github.com/imanjundi/arguments-moderation