An Approach of Processing New Words Based on HMM in Tagging of Speech of Part
Xiao Zhang · Zhongwen xinxi xuebao · 2003
Ambiguity of part of speech (POS) which urgent needs to be resolved is a very important ambiguous phenomenon in natural language processing. Furthermore, it is very difficult to disambiguate the ambiguity of part of speech of the new words. In this paper, through converting the problem of tagging of POS to the problem of calculation of word's emission probability; a new approach based on HMM is proposed to solve this problem. This approach uses nothing more than a tagged corpus (e.g. no grammar dictionaries, no grammar rules), and the result shows that the correct rata arrive at 97% in close test and 92% in open test.