Bi-GRU Sentiment Classification for Chinese Based on Grammar Rules and BERT
Qiang Lu, Zhenfang Zhu, Fuyong Xu, Dianyuan Zhang, Wenqing Wu, Qiangqiang Guo · International Journal of Computational Intelligence Systems · 2020
Sentiment classification is a fundamental task in NLP, and its aim to predict the sentiment polarities of the given texts.Recent researches show great interest in modeling Chinese sentiment classification.However, the complexity of Chinese grammar makes the performance of the existing Chinese sentiment classification model not perform well.In order to address the above problem, we propose a sentiment classification method based on grammar rules and bidirectional encoder representation from transformers (BERT).We first preprocess data through BERT model.Then we combine the Chinese grammar rules with Bi-gated recurrent neural network (GRU) in the form of constraints, and simulate the linguistic functions at the sentence by standardizing the output of adjacent positions.Extensive experiments on two public datasets demonstrate the effectiveness of our proposed method, and our findings in the experiment provide new insights for the future development of Chinese sentiment classification.