Exploring Contextual word representation for Arabic question classification
Hamza Alami, Noureddine En-Nahnahi, Saïd Ouatik El Alaoui · 2020 1st International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · 2020
Identifying the category of a question is an essential task in Question Answering Systems. Contextual continuous word representation proved to be effective in various natural language processing tasks. However, these models have not been considered in the field of Arabic question classification. In this paper, we investigate the use of a contextual word representation named Embeddings from Language Models (ELMo) on Arabic question classification. We study the behaviour of this representation by building numerous neural network architectures trained to classify questions. The dataset contains 3173 questions annotated with two taxonomies including Arabic taxonomy and an updated Li & Roth taxonomy. By comparing to enriched word2vec with subword information technique, which is a context-free representation, we show that ELMo representation achieves better performance at the cost of reduced sized word vector. The best classifier achieves up to 94% in terms of accuracy, macro F 1 score, and weighted F 1 score.