Research on the Model of Integrating Chinese Word Segmentation with Part-of-speech Tagging
Tong Yang Xiao · 2007
In this paper,we present a model integrating Chinese word segment with part-of-speech tagging.In the early stage,reserves the top N segmentation results as candidates.After Unknown words recognized and POS tagging fin- ished,we get the final result by select form the top N segmentation candidates.We also develop a Chinese lexical ana- lyzer based on this model.The primary experiment proved that the overall accuracy of the proposed analyzer is 98.1% for segmentation and 95.7% for POS tagging respectively.