A Strategy Labelled Dataset of Counterspeech

Aashima Poudhar, Ioannis Konstas, Gavin Abercrombie · 2024

Increasing hateful conduct online demands effective counterspeech strategies to mitigate its impact.We introduce a novel dataset annotated with such strategies, aimed at facilitating the generation of targeted responses to hateful language.We labelled 1000 hate speech/counterspeech pairs from an existing dataset with strategies established in the social sciences.We find that a one-shot prompted classification model achieves promising accuracy in classifying the strategies according to the manual labels, demonstrating the potential of generative Large Language Models (LLMs) to distinguish between counterspeech strategies.

Read the paper · More papers on PaperTik