Evaluation and Combining Association Measures for Collocation Extraction
Victor Zakharov · 2017
The paper deals with collocation extraction from corpus data. The experiments are described with the objective to study collocation extraction based on statistical association measures. A whole number of formulas have been created to integrate different factors that determine the association between the collocation components. The experiments are described whose objective was to study the method of collocation extraction based on the statistical association measures. The paper is focused on bigram collocations. The obtained data on the measure precision allows to establish to some degree that in cases when collocation extraction is not used for some special purposes such measures as MI.l-og_f, log-Dice, minimum sensitivity should be used. At the same time, various options of their integration are desirable and useful. To use advantages of separate measures, we offer to create a combined list of collocations extracted by different measures and propose a number of parameters that allow to rank collocates in a combined list in some reasonable way.