Attention-based Semantic Priming for Slot-filling
Jiewen Wu, Rafael E. Banchs, Luis Fernando D’Haro, Pavitra Krishnaswamy, Nancy F. Chen · 2018
The problem of sequence labelling in language understanding would benefit from approaches inspired by semantic priming phenomena.We propose that an attentionbased RNN architecture can be used to simulate semantic priming for sequence labelling.Specifically, we employ pretrained word embeddings to characterize the semantic relationship between utterances and labels.We validate the approach using varying sizes of the ATIS and ME-DIA datasets, and show up to 1.4-1.9%improvement in F1 score.The developed framework can enable more explainable and generalizable spoken language understanding systems.