A Study on Efficient Training Method for Named Entity Recognition Model with Word Embedding Applied to PCA
Eunyoung Song, Hoe-Ryeon Choi, Hong-Chul Lee · Journal of Korean Institute of Industrial Engineers · 2019
The Bidirectional LSTM CRF model used for Named Entity Recognition takes much time to train Named Entity. The hyper-parameters of Word Embedding used as input data in this model affect performance and training time. However, there is very little research on the number of dimensions, which is one of the parameters of Word Embedding. In this paper, we obtain proper number of 4-Word Embeddings (fastText, GloVe, skipgram, CBOW) considering performance and training time in Bidirectional LSTM CRF which can input large amount of data. Next, apply the PCA to the word vector in Word Embedding to reduce the dimension to small dimensional (10 dimensions) intervals. Therefore, applying PCA to conventional Word Embedding and training Word Embedding with small dimensional intervals shows that the model can be trained by maintaining or improving performance based on stable training time in fewer dimensions than conventional Word Embedding.