The Inspecting Method Study on Consistence of Part of Speech Tagging of Corpus
Jiang Liu · Zhongwen xinxi xuebao · 2004
In the deep processing of large-scale corpus, it has been a chief problem to assure the consistence of part of speech tagging to build the high-quantity corpus. A new inspecting method on consistence of part of speech tagging based on clustering and classifying is put forward, firstly we cluster the sequences of part of speech of the example and get the threshold value, then classify the test sequences to judge its correctness, furthermore, we can know the condition of the consistence of part of speech on every text, and assure the correctness of the part of speech tagging on large-scale corpus further.