Application of error-driven learning approach for unknown word in POS tagging
Zhu Yao-ting · Jisuanji gongcheng yu sheji · 2008
Ambiguity of POS is the key of automatic part-of-speech tagging procedure.Especially,the correction of tagging unknown word greatly affects automatic POS results.Firstly the ambiguity of POS is studied.After comparing the advantage and weakness of the statistical methods and the rule-governed methods,an automatic POS tagging method based on both HMM and TBL is presented.Finally,how to complete part-of-speech tagging and guess the part-of-speech of the unknown words with a limited lexicon is shown.And the tests prove that the method can raise the accuracy of unknown words tagging.