Research on Modern Chinese Multi-category Words Part of Speech Tagging Based on Hidden Markov Model
Zhendong Song · Advances in engineering research/Advances in Engineering Research · 2014
In recent years, computer systems are widely used in the modern Chinese part of speech tagging.Modern Chinese part of speech tagging is a basic subject in the natural language processing.It is widely used in machine translation, natural language understanding, establishing of the Chinese corpus, information retrieval, text classification, text proofreading and speech recognition, among others.In the part of speech tagging, multi-category words part of speech (POS) tagging is always a difficulty.Although the total number of multi-category words in the modern Chinese is not high, the usage is fairly widespread.This paper, proposes an algorithm of multi-category words part of speech tagging.First, it is word segmentation according to the traditional method.And then, on this basis, we introduce a method based on the rules of multi-category words part of speech tagging.Finally, a detailed description of the Hidden Markov Model (HMM) used in the words part of speech tagging, and a statistical algorithm based on Hidden Markov Model.