Model of Chinese Words Segmentation and Part-of-Word Tagging
Wang Chuan-jing · Jisuanji gongcheng · 2010
This paper proposes a model of Chinese words segmentation and part-of-word tagging.In the words segmentation stage,the top N segmentation results are confirmed as the candidate.The final result among these candidates is gotten after unknown words recognition and part-of-word tagging.A Chinese lexical analyzer is developed.This model with different size of training set is tested.The lexical analyzer's accuracy of words segmentation and part-of-word is 98.34%and 96.07%.This proves the effectiveness of the method.