SyntNN at SemEval-2018 Task 2: is Syntax Useful for Emoji Prediction? Embedding Syntactic Trees in Multi Layer Perceptrons
Fabio Massimo Zanzotto, Andrea Santilli · 2018
In this paper, we present SyntNN as a way to include traditional syntactic models in multilayer neural networks used in the task of Semeval Task 2 of emoji prediction (Barbieri et al., 2018).The model builds on the distributed tree embedder also known as distributed tree kernel (Zanzotto and Dell'Arciprete, 2012).Initial results are extremely encouraging but additional analysis is needed to overcome the problem of overfitting.