YNU-HPCC at SemEval-2018 Task 2: Multi-ensemble Bi-GRU Model with Attention Mechanism for Multilingual Emoji Prediction
Nan Wang, Jin Wang, Xuejie Zhang · 2018
This paper describes our approach to SemEval-2018 Task 2, which aims to predict the most likely associated emoji, given a tweet in English or Spanish.We normalized textbased tweets during preprocessing, following which we utilized a bi-directional gated recurrent unit with an attention mechanism to build our base model.Multi-models with or without class weights were trained for the ensemble methods.We boosted models without class weights, and only strong boost classifiers were identified.In our system, not only was a boosting method used, but we also took advantage of the voting ensemble method to enhance our final system result.Our method demonstrated an obvious improvement of approximately 3% of the macro F1 score in English and 2% in Spanish.