Word Sense Disambiguation method based on probability model improved by information gain
Dongmei Fan, Zhimao Lu, Rubo Zhang, Xueyao Li · 2008
Word Sense Disambiguation (WSD) has always being a key problem and one of difficult points in natural language processing. WSD is usually considered to be a pattern classification to be research. Feature selection is an important sector of WSD process. We review Naïve Bayes Model (NBM) seriously, and the feature selection method adopted in this paper is directed at Bayesian Assumption to improve NBM. Positional information concealed in the context of ambiguous word is mined via information gain calculation, to increase the knowledge acquisition efficiency of Bayesian model and to improve the effect of word-sense classification. Eight ambiguous words are tested in our experiment; the experimental results of improved Bayesian model are higher 3.5 per cent than the ones of NBM. The accuracy rise is bigger and the improvement effect is outstanding; and these results prove also the method put forward in this paper is efficacious.