Integrating Transformers and Knowledge Graphs for Twitter Stance Detection
Thomas Clark, Costanza Conforti, Fangyu Liu, Zaiqiao Meng, Ehsan Shareghi, Nigel Collier · 2021
Stance detection (SD) entails classifying the sentiment of a text towards a given target, and is a relevant sub-task for opinion mining and social media analysis.Recent works have explored knowledge infusion -supplementing the linguistic competence and latent knowledge of large pre-trained language models with structured knowledge graphs (KGs), yet few works have applied such methods to the SD task.In this work, we first perform stance-relevant knowledge probing on Transformers-based pre-trained models in a zero-shot setting, showing these models' latent real-world knowledge about SD targets and their sensitivity to context.We then propose novel knowledge-enriched stance detection models.We evaluate them on two Twitter stance datasets, achieving state-of-the-art performance on both.