Consistency Check on POS Tagging of Chinese Corpus Based on Classification
Zheng Jia-heng · Jisuanji gongcheng · 2008
It is a key problem to guarantee the consistency of POS(Part of Speech)tagging of Chinese corpus.After analyzing the POS tagging in the large-scale corpus,the new consistency check method of POS tagging are put forward.This paper builds the vector model of the context of trans-classed word,then uses k-NN to classify the POS tagging sequence vectors,judges their consistency,and obtains circumstances of the consistency of POS tagging of every text.The methods are evaluated on our 1 5000-word corpus.