Variable scaling in cluster analysis of linguistic data
Hermann L. Moisl · Corpus Linguistics and Linguistic Theory · 2010
Where the variables selected for cluster analysis of linguistic data are measured on different numerical scales, those whose scales permit relatively larger values can have a greater influence on clustering than those whose scales restrict them to relatively smaller ones, and this can compromise the reliability of the analysis. The first part of this discussion describes the nature of that compromise. The second part argues that a widely used method for removing disparity of variable scale, Z-standardization, is unsatisfactory for cluster analysis because it eliminates differences in variability among variables, thereby distorting the intrinsic cluster structure of the unstandardized data, and instead proposes a standardization method based on variable means which preserves these differences. The proposed mean-based method is compared to several other alternatives to Z-standardization, and is found to be superior to them in cluster analysis applications.