Neural Approach for Named Entity Recognition
Kateryna Yalova, Kseniia Yashyna, Iryna Ivanochko · 2021
The work presents the results of bidirectional long short term memory (BiLSTM) neural network with conditional random fields (CRF) architecture for named entity recognition (NER) problem solving. NER is one of the natural language processing (NLP) tasks. The NER solution allows to recognize and identify specific entities that are relevant for searching in particular data domain. The generalized NER algorithm and neural approach for NER with BiLSTM-CRF model are presented. The use of CRF is responsible for prediction the appearance of searched named entities and improves the recognition quality indicators. The result of the neural network processing is input text information with recognized and designated named entities. It is proposed to use weakly structured resume text information to conduct experiments with BiLSTM-CRF model for named entities recognition. Ten types of named entities are chosen for neural network processing, such as: person, date, location, organization, etc. Own created corpus of resume documents marked manually was used as a data set for BiLSTM-CRF neural model training, validation and testing. Analysis of the adequacy of the proposed approach was carried out using precision, recall and balanced measure F1 metrics. The average recognition values on the testing set were: precision 79,06%, recall 71,51% and F1 75,09%. The best recognition scores were obtained for named entity “date”: precision 92,12%, recall 81,60%, F1 86,54%. The developed neural model and software have practical value for solving problem of resume summarizing and ranking candidates for work as they can be used to form an array of incoming data.