Named Entity Recognition in Chinese Judicial Domain Based on Self-attention mechanism and IDCNN
Wenming Huang, Juan Zhang, Yannan Xiao, Zheng Han, Zhenrong Deng · 2020
Chinese named entity recognition (CNER) in the judicial domain is an important basic task for intelligent analysis and processing of massive documents. This domain entity has more complicated structure than the common named entity, and its entity category is more abundant. However, the general method can not solve the problem of domain specific identification. In this paper, we combine self-attention mechanism and iteration dilated convolution neural network (IDCNN) for CNER in judicial domain. The bidirectional gate recurrent unit (BiGRU) model is used to automatically learn the context semantic information of the text and solve the long-distance dependence of the sequence. The model introduce the IDCNN to extract the key features of context semantic information, and capture finer-grained semantic information in underlying texts. The self-attention mechanism is used to analyze the relationship between characters, and the problem of long sequence semantic dilution is effectively solved by means of dynamic weight, and the optimal tag sequence is calculated by integrating conditional random fields (CRF), which further improves the recognition ability of the model. Finally, by analyzing the characteristics of legal documents, the new data set is annotated and the fine-grained named entity recognition is realized. The experimental results on our corpus show that the proposed method can effectively identify the entities in legal documents, and improve performance in the judicial field.