Automatic Acquisition of Chinese Collocation
Suge Wang, Yang Jun-ling · Zhongwen xinxi xuebao · 2006
As a kind of word phenomenon,collocation plays a very important role in nature language processing.In this paper,4 kinds of word association measurements and 3 kinds of word structure distribution measurements are compared and analyzed respectively,and a hybrid method based on mutual information and entropy for collocation is proposed.The experiment results indicate that 4 kinds of word association measurements,mutual information,Cosine coefficient,x~2test and likelihood ratio have the same impact under high co-occurrence frequency for collocation acquiring and entropy is superior to variance and spread for measuring the word structure distribution.The proposed method relies on fewer measurements and can easily selects coefficient thresholds and achieves the same impact of the existing methods.